Skip to Content
Brain SciencesBrain Sciences
  • Article
  • Open Access

13 August 2023

13 Pages

Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners

,
,
and
1
Department of Psychology and Logopedics, University of Helsinki, 00014 Helsinki, Finland
2
Department of Psychology, College of Contemporary Psychology, Rikkyo University, Saitama 352-8558, Japan
3
Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka 567-8570, Japan
4
College of Comprehensive Psychology, Ritsumeikan University, Osaka 567-8570, Japan

Abstract

In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.