Electrophysiological Differentiation of the Effects of Stress and Accent on Lexical Integration in Highly Fluent Bilinguals
Abstract
:1. Introduction
2. Materials and Methods
2.1. Participants
2.2. Materials
2.3. Procedure
2.4. Data Analysis
2.4.1. ERP Recording and Pre-Processing
2.4.2. Modelling of Behavioural Data
2.4.3. ERP Analysis
3. Results
3.1. Experiment 1: Semantic Priming
3.1.1. Behavioural Results
3.1.2. Electrophysiological Results
3.2. Experiment 2: Cross-Language Phonological Priming
3.2.1. Behavioural Results
3.2.2. Electrophysiological Results
4. Discussion
4.1. Experiment 1
4.1.1. Behavioural Data
4.1.2. Electrophysiological Data
4.2. Experiment 2
4.2.1. Behavoural Data
4.2.2. Electrophysiological Data
5. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Major, R.C. Foreign accent: recent research and theory. IRAL—Int. Rev. Appl. Linguist. Lang. Teach. 2009, 25, 185–202. [Google Scholar] [CrossRef]
- Long, M.H. Maturational Constraints on Language Development. Stud. Second Lang. Acquis. 1990, 12, 251–285. [Google Scholar] [CrossRef] [Green Version]
- Thompson, I. Foreign Accents Revisited: The English Pronunciation of Russian Immigrants. Lang. Learn. 1991, 41, 177–204. [Google Scholar] [CrossRef]
- Best, C.T.; McRoberts, G.W.; Goodell, E. Discrimination of non-native consonant contrasts varying in perceptual assimilation to the listener’s native phonological system. J. Acoust. Soc. Am. 2001, 109, 775–794. [Google Scholar] [CrossRef]
- Brown, K. Intelligibility. In Language Testing Symposium; Davies, A., Ed.; Oxford University Press: Oxford, UK, 1968; pp. 180–191. [Google Scholar]
- Wilcox, G.K. The Effect of Accent on Listening Comprehension—A Singapore Study. ELT J. 1978, 32, 118–127. [Google Scholar] [CrossRef]
- Bent, T.; Bradlow, A.R. The interlanguage speech intelligibility benefit. J. Acoust. Soc. Am. 2003, 114, 1600–1610. [Google Scholar] [CrossRef]
- Lagrou, E.; Hartsuiker, R.J.; Duyck, W. Knowledge of a second language influences auditory word recognition in the native language. J. Exp. Psychol. Learn. Mem. Cogn. 2011, 37, 952–965. [Google Scholar] [CrossRef] [Green Version]
- Lagrou, E.; Hartsuiker, R.J.; Duyck, W. The influence of sentence context and accented speech on lexical access in second-language auditory word recognition. Biling. Lang. Cognit. 2013, 16, 508–517. [Google Scholar] [CrossRef] [Green Version]
- Hayes-Harb, R.; Smith, B.L.; Bent, T.; Bradlow, A.R. The interlanguage speech intelligibility benefit for native speakers of Mandarin: Production and perception of English word-final voicing contrasts. J. Phon. 2008, 36, 664–679. [Google Scholar] [CrossRef] [Green Version]
- Stibbard, R.M.; Lee, J.-I. Evidence against the mismatched interlanguage speech intelligibility benefit hypothesis. J. Acoust. Soc. Am. 2006, 120, 433–442. [Google Scholar] [CrossRef]
- Thierry, G.; Wu, Y.J. Brain potentials reveal unconscious translation during foreign-language comprehension. Proc. Natl. Acad. Sci. USA 2007, 104, 12530–12535. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Wu, Y.J.; Thierry, G. Chinese-English bilinguals reading English hear Chinese. J. Neurosci. 2010, 30, 7646–7651. [Google Scholar] [CrossRef] [PubMed]
- Vaughan-Evans, A.; Kuipers, J.R.; Thierry, G.; Jones, M.W. Anomalous Transfer of Syntax between Languages. J. Neurosci. 2014, 34, 8333–8335. [Google Scholar] [CrossRef] [PubMed]
- Ju, M.; Luce, P.A. Falling on sensitive ears: Constraints on bilingual lexical activation. Psychol. Sci. 2004, 15, 314–318. [Google Scholar] [CrossRef]
- Jenner, B.R.A. Interlanguage and Foreign Accent. Int. Stud. Bull. 1976, 1, 166–195. [Google Scholar]
- Jilka, M. The Contribution of Intonation to the Perception of Foreign Accent. Ph.D. Thesis, Universtität Stuttgart, Stuttgart, Germany, 2000. [Google Scholar]
- Munro, M.J. Nonsegmental Factors in Foreign Accent: Ratings of Filtered Speech. Stud. Second Lang. Acquis. 1995, 17, 17–34. [Google Scholar] [CrossRef]
- Boula de Mareüil, P.; Vieru-Dimulescu, B. The contribution of prosody to the perception of foreign accent. Phonetica 2006, 63, 247–267. [Google Scholar] [CrossRef]
- Cutler, A. Lexical Stress. In The Handbook of Speech Perception; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2005; pp. 264–289. [Google Scholar]
- Archibald, J. The acquisition of English stress by speakers of nonaccentual languages: Lexical storage versus computation of stress. Linguistics 1997, 35, 167–182. [Google Scholar] [CrossRef]
- Erdmann, P.H. Patterns of stress-transfer in English and German. IRAL 1973, 31, 229–241. [Google Scholar] [CrossRef]
- Schwab, S.; Llisterri, J. The perception of Spanish lexical stress by French speakers: Stress identification and time cost. In Achievements and Perspectives in SLA of Speech: NewSounds 2010; Wrembel, M., Kul, M., Dziubalska-Kołaczyk, K., Eds.; Peter Lang: Frankfurt am Main, Germany, 2011; Volume 1, pp. 229–242. [Google Scholar]
- Chakraborty, R.; Goffman, L. Production of lexical stress in non-native speakers of American English: Kinematic correlates of stress and transfer. J. Speech Lang. Hear. Res. 2010, 54, 821–835. [Google Scholar] [CrossRef] [Green Version]
- Dupoux, E.; Pallier, C.; Sebastian, N.; Mehler, J. A Destressing “Deafness” in French? J. Mem. Lang. 1997, 36, 406–421. [Google Scholar] [CrossRef] [Green Version]
- Dupoux, E.; Peperkamp, S. A robust method to study stress ‘“deafness”’. J. Acoust. Soc. Am. 2001, 110, 13. [Google Scholar] [CrossRef]
- Domahs, U.; Knaus, J.; Orzechowska, P.; Wiese, R. Stress “deafness” in a Language with Fixed Word Stress: An ERP Study on Polish. Front. Psychol. 2012, 3, 439. [Google Scholar] [CrossRef] [Green Version]
- Honbolygó, F.; Csépe, V.; Ragó, A. Suprasegmental speech cues are automatically processed by the human brain: A mismatch negativity study. Neurosci. Lett. 2004, 363, 84–88. [Google Scholar] [CrossRef] [PubMed]
- Honbolygó, F.; Csépe, V. Saliency or template? ERP evidence for long-term representation of word stress. Int. J. Psychophysiol. 2013, 87, 165–172. [Google Scholar] [CrossRef] [PubMed]
- Domahs, U.; Genc, S.; Knaus, J.; Wiese, R.; Kabak, B. Processing (un-)predictable word stress: ERP evidence from Turkish. Lang. Cogn. Proc. 2013, 28, 335–354. [Google Scholar] [CrossRef]
- Kóbor, A.; Honbolygó, F.; Becker, A.B.C.; Schild, U.; Csépe, V.; Friedrich, C.K. ERP evidence for implicit L2 word stress knowledge in listeners of a fixed-stress language. Int. J. Psychophysiol. 2018, 128, 100–110. [Google Scholar] [CrossRef] [PubMed]
- Fry, D.B. Experiments in the Perception of Stress. Lang. Speech 1958, 1, 126–152. [Google Scholar] [CrossRef]
- Fry, D.B. Duration and Intensity as Physical Correlates of Linguistic Stress. J. Acoust. Soc. Am. 1955, 27, 765–768. [Google Scholar] [CrossRef]
- Lieberman, P. Some Acoustic Correlates of Word Stress in American English. J. Acoust. Soc. Am. 1960, 32, 451–454. [Google Scholar] [CrossRef]
- Mennen, I.; Mayr, R.; Morris, J. Influences of Language Contact and Linguistic Experience on the Production of Lexical Stress in Welsh and Welsh English. In Proceedings of the Proceedings of the ICPhS 2015, The International Phonetic Association, Glasgow, UK, 10–14 August 2015. [Google Scholar]
- Cooper, S. Intonation in Anglesey Welsh. Ph.D. Thesis, Bangor University, Bangor, UK, 2015. [Google Scholar]
- Williams, B.J. Stress in modern Welsh. Ph.D. Thesis, University of Cambridge, Cambridge, UK, 1983. [Google Scholar]
- Cooper, N.; Cutler, A.; Wales, R. Constraints of Lexical Stress on Lexical Access in English: Evidence from Native and Non-native Listeners. Lang. Speech 2002, 45, 207–228. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Sumner, M.; Samuel, A.G. The effect of experience on the perception and representation of dialect variants. J. Mem. Lang. 2009, 60, 487–501. [Google Scholar] [CrossRef]
- Aydelott, J.; Bates, E. Effects of acoustic distortion and semantic context on lexical access. Lang. Cogn. Proc. 2004, 19, 29–56. [Google Scholar] [CrossRef]
- Connolly, J.F.; Phillips, N.A. Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences. J. Cogn. Neurosci. 1994, 6, 256–266. [Google Scholar] [CrossRef]
- Newman, R.L.; Connolly, J.F. Electrophysiological markers of pre-lexical speech processing: Evidence for bottom–up and top–down effects on spoken word processing. Biol. Psychol. 2009, 80, 114–121. [Google Scholar] [CrossRef]
- Desroches, A.S.; Newman, R.L.; Joanisse, M.F. Investigating the Time Course of Spoken Word Recognition: Electrophysiological Evidence for the Influences of Phonological Similarity. J. Cogn. Neurosci. 2008, 21, 1893–1906. [Google Scholar] [CrossRef] [Green Version]
- Sučević, J.; Savić, A.M.; Popović, M.B.; Styles, S.J.; Ković, V. Balloons and bavoons versus spikes and shikes: ERPs reveal shared neural processes for shape–sound-meaning congruence in words, and shape–sound congruence in pseudowords. Brain Lang. 2015, 145–146, 11–22. [Google Scholar] [CrossRef]
- Holcomb, P.J.; Grainger, J. On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming. J. Cogn. Neurosc. 2006, 18, 1631–1643. [Google Scholar] [CrossRef] [Green Version]
- Grainger, J.; Kiyonaga, K.; Holcomb, P.J. The Time Course of Orthographic and Phonological Code Activation. Psychol. Sci. 2006, 17, 1021–1026. [Google Scholar] [CrossRef] [Green Version]
- Grainger, J.; Holcomb, P.J. Watching the Word Go by: On the Time-course of Component Processes in Visual Word Recognition. Lang. Linguist. Compass 2009, 3, 128–156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hagoort, P.; Brown, C.M. ERP effects of listening to speech: Semantic ERP effects. Neuropsychologia 2000, 38, 1518–1530. [Google Scholar] [CrossRef] [Green Version]
- Dumay, N.; Benraïss, A.; Barriol, B.; Colin, C.; Radeau, M.; Besson, M. Behavioral and Electrophysiological Study of Phonological Priming between Bisyllabic Spoken Words. J. Cogn. Neurosc. 2001, 13, 121–143. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Praamstra, P.; Meyer, A.S.; Levelt, W.J.M. Neurophysiological Manifestations of Phonological Processing: Latency Variation of a Negative ERP Component Timelocked to Phonological Mismatch. J. Cogn. Neurosc. 1994, 6, 204–219. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Lapalme, G. Edinburgh Associative Thesaurus (EAT). Available online: http://rali.iro.umontreal.ca/rali/?q=en/Textual%20Resources/EAT (accessed on 21 March 2018).
- Nelson, D.L.; McEvoy, C.L.; Schreiber, T.A. The University of South Florida word association, rhyme, and word fragment norms. Behav. Res. Meth. Instrum. Comput. 2004, 36, 402–407. [Google Scholar] [CrossRef] [Green Version]
- Marslen-Wilson, W.; Tyler, L.K. The temporal structure of spoken language understanding. Cognition 1980, 8, 1–71. [Google Scholar] [CrossRef] [Green Version]
- Marslen-Wilson, W. Function and process in spoken word recognition: A tutorial review. In Attention and Performance: Control of Language Processes; Bouma, H., Bouwhuis, G., Eds.; Lawrence Erlbaum Associates: Erlbaum, UK, 1984; pp. 125–150. [Google Scholar]
- van Heuven, W.J.B.; Mandera, P.; Keuleers, E.; Brysbaert, M. SUBTLEX-UK: A new and improved word frequency database for British English. Quart. J. Exp. Psychol. 2014, 67, 1176–1190. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Ellis, N.C.; O’Dochartaigh, C.; Hicks, W.; Morgan, M.; Laporte, N. Cronfa Electroneg O Gymraeg (CEG): A 1 Million Word Lexical Database and Frequency Count for Welsh. Available online: https://www.bangor.ac.uk/canolfanbedwyr/ceg.php.en (accessed on 22 November 2019).
- Brysbaert, M.; Warriner, A.B.; Kuperman, V. Concreteness ratings for 40 thousand generally known English word lemmas. Behav. Res. Meth. 2014, 46, 904–911. [Google Scholar] [CrossRef] [Green Version]
- Palmer, J.A.; Makeig, S.; Kreutz-Delgado, K.; Rao, B.D. Newton Method for the ICA mixture model. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA, 30 March – 4 April 2008; pp. 1805–1808. [Google Scholar]
- Barr, D.J.; Levy, R.; Scheepers, C.; Tily, H.J. Random effects structure for confirmatory hypothesis testing: Keep it maximal. J. Mem. Lang. 2013, 68, 255–278. [Google Scholar] [CrossRef] [Green Version]
- Bates, D.; Mächler, M.; Bolker, B.; Walker, S. Fitting linear mixed-effects models using lme4. arXiv 2014, arXiv:preprint/1406–5823. [Google Scholar]
- Kutas, M.; Federmeier, K.D. Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Annu. Rev. Psychol. 2011, 62, 621–647. [Google Scholar] [CrossRef] [Green Version]
- Neely, J.H. Semantic priming and retrieval from lexical memory: Evidence for facilitatory and inhibitory processes. Mem. Cogn. 1976, 4, 648–654. [Google Scholar] [CrossRef] [PubMed]
- Martin, C.D.; Thierry, G. Interplay of orthography and semantics in reading: An event-related potential study. Neuroreport 2008, 19, 1501–1505. [Google Scholar] [CrossRef] [PubMed]
- Wu, Y.J.; Athanassiou, S.; Dorjee, D.; Roberts, M.; Thierry, G. Brain Potentials Dissociate Emotional and Conceptual Cross-Modal Priming of Environmental Sounds. Cereb. Cortex. 2012, 22, 577–583. [Google Scholar] [CrossRef] [Green Version]
- Bak, T. Cooking Pasta in La Paz: Bilingualism, Bias and the Replication Crisis. Linguist. Approaches Biling. 2016, 6, 699–717. [Google Scholar] [CrossRef] [Green Version]
- Shook, A.; Marian, V. The Bilingual Language Interaction Network for Comprehension of Speech*. Biling. Lang. Cogn. 2013, 16, 304–324. [Google Scholar] [CrossRef] [Green Version]
- Lewy, N.; Grosjean, F. BIMOLA: A Computational Model of Bilingual Word Recognition. In Proceedings of the 2nd International Symposium on Bilingualism: University of Newcastle-upon-Tyne; University of Newcastle-upon-Tyne: Newcastle-upon-Tyne, UK, 14–17 April 1999. [Google Scholar]
- Grosjean, F.; : Oxford, UK. Studying Bilinguals; Oxford University Press: Oxford, UK; New York, NY, USA, 2008. [Google Scholar]
- van den Noort, M.; Struys, E.; Bosch, P.; Jaswetz, L.; Perriard, B.; Yeo, S.; Barisch, P.; Vermeire, K.; Lee, S.-H.; Lim, S. Does the Bilingual Advantage in Cognitive Control Exist and If So, What Are Its Modulating Factors? A Systematic Review. Behav. Sci. 2019, 9, 27. [Google Scholar] [CrossRef] [Green Version]
- Clopper, C.G. Frequency of Stress Patterns in English: A Computational Analysis. IULC Working Pap. Online 2002, 2, 1–9. [Google Scholar]
- Peperkamp, S.; Dupoux, E. A typological study of stress “deafness”. In Laboratory Phonology; Gussenhoven, C., Warner, N., Eds.; Mouton de Gruyter: Berlin, Germany, 2002; pp. 203–240. [Google Scholar]
Measure | Mean | SD |
---|---|---|
Age of Welsh acquisition | 0.2 | 0.9 |
Age of English acquisition | 3.8 | 2.29 |
Daily Welsh usage (%) | 64.5 | 20.2 |
Daily English usage (%) | 35.2 | 19.5 |
1st Syllable | 2nd Syllable | 3rd Syllable | |||||||
---|---|---|---|---|---|---|---|---|---|
Stress Cond. | 1 | 2 | 3 | 1 | 2 | 3 | 1 | 2 | 3 |
Duration (s) | 0.195 | 0.173 | 0.156 | 0.158 | 0.232 | 0.164 | 0.340 | 0.354 | 0.425 |
SD | 0.056 | 0.058 | 0.060 | 0.050 | 0.056 | 0.054 | 0.117 | 0.115 | 0.107 |
Intensity (dB) | 76.8 | 73.3 | 70.7 | 73.5 | 75.5 | 72.5 | 73.6 | 73.4 | 74.6 |
SD | 1.69 | 2.46 | 2.39 | 2.33 | 1.87 | 2.34 | 2.10 | 2.61 | 1.85 |
Pitch (Hz) | 226.8 | 189.8 | 187.2 | 184.0 | 202.3 | 187.2 | 158.3 | 157.4 | 171.5 |
SD | 17.9 | 25.7 | 16.7 | 12.2 | 16.5 | 16.5 | 5.4 | 10.5 | 8.3 |
1st Syllable | 2nd Syllable | 3rd Syllable | |||||||
---|---|---|---|---|---|---|---|---|---|
Stress Cond. | 1 | 2 | 3 | 1 | 2 | 3 | 1 | 2 | 3 |
Duration | 0.190 | 0.173 | 0.144 | 0.132 | 0.219 | 0.132 | 0.314 | 0.333 | 0.369 |
SD | 0.053 | 0.055 | 0.044 | 0.044 | 0.054 | 0.041 | 0.093 | 0.096 | 0.098 |
Intensity | 72.3 | 69.6 | 73.3 | 71.9 | 72.6 | 71.6 | 71.5 | 70.6 | 73.4 |
SD | 2.13 | 2.40 | 2.75 | 1.88 | 1.73 | 2.05 | 1.67 | 1.82 | 2.19 |
Pitch | 211.9 | 195.4 | 187.0 | 205.9 | 205.3 | 182.9 | 224.2 | 180.1 | 172.5 |
SD | 11.7 | 12.7 | 11.0 | 16.3 | 11.0 | 11.6 | 24.5 | 12.9 | 8.7 |
English Speaker | Welsh Speaker | |||||
---|---|---|---|---|---|---|
1st Syllable | 2nd Syllable | 3rd Syllable | 1st Syllable | 2nd Syllable | 3rd Syllable | |
Duration | (ANOVA: F = 84.18, p < 0.001) | (ANOVA: F = 67.08, p < 0.001) | ||||
Stress 1–stress 2 | 0.002 | <0.001 | 0.532 | 0.452 | <0.001 | 0.136 |
Stress 1–stress 3 | <0.001 | 1.000 | <0.001 | <0.001 | 1.000 | <0.001 |
Stress 2–stress 3 | <0.366 | <0.001 | <0.001 | <0.001 | <0.001 | <0.001 |
Intensity | (ANOVA: F = 84.404, p < 0.001) | (ANOVA: F = 26.614, p < 0.001 | ||||
Stress 1–stress 2 | <0.001 | <0.001 | 1.000 | <0.001 | 0.714 | 0.405 |
Stress 1–stress 3 | <0.001 | 0.329 | 0.308 | 0.405 | 1.000 | <0.001 |
Stress 2–stress 3 | <0.001 | <0.001 | 0.087 | <0.001 | 0.254 | <0.001 |
Pitch | (ANOVA: F = 80.90, p < 0.001) | (ANOVA: F = 41.80, p < 0.001) | ||||
Stress 1–stress 2 | <0.001 | <0.001 | 1.000 | <0.001 | 1.000 | <0.001 |
Stress 1–stress 3 | <0.001 | 1.000 | 0.002 | <0.001 | <0.001 | <0.001 |
Stress 2–stress 3 | 1.000 | <0.001 | <0.001 | 0.150 | <0.001 | 0.312 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Lewendon, J.; Foltz, A.; Thierry, G. Electrophysiological Differentiation of the Effects of Stress and Accent on Lexical Integration in Highly Fluent Bilinguals. Brain Sci. 2020, 10, 113. https://doi.org/10.3390/brainsci10020113
Lewendon J, Foltz A, Thierry G. Electrophysiological Differentiation of the Effects of Stress and Accent on Lexical Integration in Highly Fluent Bilinguals. Brain Sciences. 2020; 10(2):113. https://doi.org/10.3390/brainsci10020113
Chicago/Turabian StyleLewendon, Jennifer, Anouschka Foltz, and Guillaume Thierry. 2020. "Electrophysiological Differentiation of the Effects of Stress and Accent on Lexical Integration in Highly Fluent Bilinguals" Brain Sciences 10, no. 2: 113. https://doi.org/10.3390/brainsci10020113
APA StyleLewendon, J., Foltz, A., & Thierry, G. (2020). Electrophysiological Differentiation of the Effects of Stress and Accent on Lexical Integration in Highly Fluent Bilinguals. Brain Sciences, 10(2), 113. https://doi.org/10.3390/brainsci10020113