Vision based hearing

nyhifihead

Well-Known Member
Stumbled upon a fascinating study having to do with the interactions between sight & hearing

http://www.pnas.org/content/early/2018/01/22/1717948115.full

These observations suggest that a vision-related process modulates the first stage of hearing. In particular, these eye movement-related eardrum oscillations may help the brain connect sights and sounds despite changes in the spatial relationship between the eyes and the ears.

The article is very technical, but here's the basics

Our eardrums are constantly moving and adjusting based on our vision sensory input, even with NO sound present, so technically our sight is the first step in "hearing" as far as our brain processes go

These eardrum movements, which we dub eye movement-related eardrum oscillations (EMREOs), occurred in the absence of a sound stimulus.

So if visual stimulation has such an impact on how and what we hear, Could exposure to certain visual stimuli artificially increase our enjoyment of music?

what about visual stimuli that sets us up to not enjoy music as much? I have always wondered about the fight or flight response because loud and sudden noises can actually trigger the brain to "protect" This can possibly change hearing ability

This study demonstrates for the first time that the cochlea – a small, snail-shaped organ that's part of the hearing system, alerts the brain to produce CRF to protect itself when exposed to loud noise. You don't have to think about it – it just happens, just as the fight or flight reaction kicks in whenever we're faced with perceived danger or stress.

https://www.healthyhearing.com/report/47463-Hearing-loss-protection-fight

What are your experiences with this phenomena? I will try to keep a record of times I feel like I'm hearing "differently" based on what i saw or did previous to listening.

Between our own actual hearing ability, placebos & bias, and now the fact NON audio stimulation can change the way we hear, are we even hearing the music?
 
Register to hide this ad
Well, for myself I've noticed that an asymmetrically placed source of light appears to skew my perceived stereo balance a bit in that direction.

And another effect I've noticed: Sometimes, when I begin to listen via stereo headphones, the soundstage doesn't quite seem to fit together, as if the left and the right half wouldn't quite want to properly link up. When that happens, I found that I just need to deliberately squint a bit upwards, best with closed eyes, and kinda concentrate my view on the mid of my forehead for a short while, which appears to make the two halves link up and also let the soundstage appear more loudspeaker-like.

Greetings from Munich!

Manfred / lini
 
Very interesting.

Something else more or less related:

Sometimes on TV, one can see music performances where timing of what you see is a little bit off versus the audio. (if big: you see a singers lips moving but the audio comes before or after)
It would be interesting to know, if there are people having tested this for audio quality.

Does the music sound less good when there is a latency between what they see and what they hear?

Can latency between hearing lead to a "sickness" like vision-motion "sickness"more or less? If I see such music performance on TV I get "irritated" and do not want to see it.....

One interesting article from the internet on vision/audio timing:

http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0172028
 
Last edited:
Back
Top Bottom