Language Experience Changes Audiovisual Perception
AbstractCan experience change perception? Here, we examine whether language experience shapes the way individuals process auditory and visual information. We used the McGurk effect—the discovery that when people hear a speech sound (e.g., “ba”) and see a conflicting lip movement (e.g., “ga”), they recognize it as a completely new sound (e.g., “da”). This finding that the brain fuses input across auditory and visual modalities demonstrates that what we hear is profoundly influenced by what we see. We find that cross-modal integration is affected by language background, with bilinguals experiencing the McGurk effect more than monolinguals. This increased reliance on the visual channel is not due to decreased language proficiency, as the effect was observed even among highly proficient bilinguals. Instead, we propose that the challenges of learning and monitoring multiple languages have lasting consequences for how individuals process auditory and visual information. View Full-Text
Share & Cite This Article
Marian, V.; Hayakawa, S.; Lam, T.Q.; Schroeder, S.R. Language Experience Changes Audiovisual Perception. Brain Sci. 2018, 8, 85.
Marian V, Hayakawa S, Lam TQ, Schroeder SR. Language Experience Changes Audiovisual Perception. Brain Sciences. 2018; 8(5):85.Chicago/Turabian Style
Marian, Viorica; Hayakawa, Sayuri; Lam, Tuan Q.; Schroeder, Scott R. 2018. "Language Experience Changes Audiovisual Perception." Brain Sci. 8, no. 5: 85.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.