Next Article in Journal
Effects of 2-Year Cognitive–Motor Dual-Task Training on Cognitive Function and Motor Ability in Healthy Elderly People: A Pilot Study
Previous Article in Journal
Informed Consent Decision-Making in Deep Brain Stimulation
Open AccessArticle

Language Experience Changes Audiovisual Perception

Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL 60201, USA
Department of Psychological Sciences, Loyola University, New Orleans, LA 70118, USA
Department of Speech-Language-Hearing Sciences, Hofstra University, Hempstead, NY 11549, USA
Author to whom correspondence should be addressed.
Brain Sci. 2018, 8(5), 85;
Received: 21 March 2018 / Revised: 5 May 2018 / Accepted: 8 May 2018 / Published: 11 May 2018
Can experience change perception? Here, we examine whether language experience shapes the way individuals process auditory and visual information. We used the McGurk effect—the discovery that when people hear a speech sound (e.g., “ba”) and see a conflicting lip movement (e.g., “ga”), they recognize it as a completely new sound (e.g., “da”). This finding that the brain fuses input across auditory and visual modalities demonstrates that what we hear is profoundly influenced by what we see. We find that cross-modal integration is affected by language background, with bilinguals experiencing the McGurk effect more than monolinguals. This increased reliance on the visual channel is not due to decreased language proficiency, as the effect was observed even among highly proficient bilinguals. Instead, we propose that the challenges of learning and monitoring multiple languages have lasting consequences for how individuals process auditory and visual information. View Full-Text
Keywords: speech perception; bilingualism; multisensory integration; McGurk effect; language speech perception; bilingualism; multisensory integration; McGurk effect; language
Show Figures

Figure 1

MDPI and ACS Style

Marian, V.; Hayakawa, S.; Lam, T.Q.; Schroeder, S.R. Language Experience Changes Audiovisual Perception. Brain Sci. 2018, 8, 85.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop