Next Article in Journal
Effects of 2-Year Cognitive–Motor Dual-Task Training on Cognitive Function and Motor Ability in Healthy Elderly People: A Pilot Study
Previous Article in Journal
Informed Consent Decision-Making in Deep Brain Stimulation
Article Menu

Export Article

Open AccessArticle
Brain Sci. 2018, 8(5), 85; https://doi.org/10.3390/brainsci8050085

Language Experience Changes Audiovisual Perception

1
Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL 60201, USA
2
Department of Psychological Sciences, Loyola University, New Orleans, LA 70118, USA
3
Department of Speech-Language-Hearing Sciences, Hofstra University, Hempstead, NY 11549, USA
*
Author to whom correspondence should be addressed.
Received: 21 March 2018 / Revised: 5 May 2018 / Accepted: 8 May 2018 / Published: 11 May 2018
View Full-Text   |   Download PDF [1886 KB, uploaded 22 May 2018]   |  

Abstract

Can experience change perception? Here, we examine whether language experience shapes the way individuals process auditory and visual information. We used the McGurk effect—the discovery that when people hear a speech sound (e.g., “ba”) and see a conflicting lip movement (e.g., “ga”), they recognize it as a completely new sound (e.g., “da”). This finding that the brain fuses input across auditory and visual modalities demonstrates that what we hear is profoundly influenced by what we see. We find that cross-modal integration is affected by language background, with bilinguals experiencing the McGurk effect more than monolinguals. This increased reliance on the visual channel is not due to decreased language proficiency, as the effect was observed even among highly proficient bilinguals. Instead, we propose that the challenges of learning and monitoring multiple languages have lasting consequences for how individuals process auditory and visual information. View Full-Text
Keywords: speech perception; bilingualism; multisensory integration; McGurk effect; language speech perception; bilingualism; multisensory integration; McGurk effect; language
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Marian, V.; Hayakawa, S.; Lam, T.Q.; Schroeder, S.R. Language Experience Changes Audiovisual Perception. Brain Sci. 2018, 8, 85.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Brain Sci. EISSN 2076-3425 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top