Those illusions are very real and powerful. It happens regularly in non-VMC conditions, although experienced pros know it for what it is and don't get excited.
Inexperienced pilots can feel disoriented or scared when it happens. Non-instrument rated pilots often die, even though they all had it explained to them in training. It's very hard to overide your instinctive feelings.