Sensory consonance and dissonance
by
alewbail
08/24/2007, 10:38 AM #
Don't know whether the phrase has been coined yet, but I'd call this phenomenon "sensory consonance", meaning that multiple senses are stimulated in a consistent way to generate a realistic feeling. Sensory consonance is what we experience all the time every day. The experimenters took advantage of sensory consonance to induce a real feeling of an unreal situation.
"Sensory dissonance" happens if different senses give you conflicting information. This happened when the hammer was swung in the experiment. Your eyes say you've been hit, but your nose says otherwise.
This conflict can induce an uneasy, even sickening feeling. If you've ever been to an IMAX movie, you've probably experienced it. The movie screen fills your whole field of vision, and it tells you that you're swooping through the Grand Canyon, or something equally engaging. But the seat of your pants tells you you're sitting still. Depending on your constitution, you can get serious motion sickness during those swooping scenes.
I work in Iowa City, home of the National Advanced Driving Simulator. The "advanced" simulator has a 360-degree screen and a sophisticated motion base. The video and motion respond very realistically to your driving inputs, accelerating and turning through a virtual landscape. An earlier, "pre-advanced" simulator had the video, but not the motion base. The video responded realistically to your inputs, but the "car" did not move. I drove this old simulator once. During gentle maneuvers, it felt OK. But during the more evasive maneuvers I felt some serious motion sickness.
And heaven help you if the software isn't working right on the advanced simulator, because the steering wheel/gas pedal, the video, and the seat of your pants can be telling you three different things.