Search Results (16)

Teachers often raise their vocal volume to improve intelligibility or capture students’ attention. While this practice is common in second language (L2) teaching, its effects on tone perception remain understudied. To fill this gap, this study explores the effects of loud speech on Mandarin tone perception for L2 learners. Twenty-two native Mandarin speakers and twenty-two Thai L2 learners were tested on their perceptual accuracy and reaction time in identifying Mandarin tones in loud and normal modes. Results revealed a significant between-group difference: native speakers consistently demonstrated a ceiling effect across all tones, while L2 learners exhibited lower accuracy, particularly for Tone 3, the falling-rising tone. The loud speech had different impacts on the two groups. For native speakers, tone perception accuracy remained stable across different speech modes. In contrast, for L2 learners, loud speech significantly reduced the accuracy of Tone 3 identification and increased confusion between Tones 2 and 3. Reaction times in milliseconds were prolonged for all tones in loud speech for both groups. When subtracting the length of the tones, the delay of RT was evident only for Tones 3 and 4. Therefore, raising the speaking volume negatively affects the Mandarin tone perception of L2 learners, especially in distinguishing Tone 2 and Tone 3. Our findings have implications for both theories of L2 tone perception and pedagogical practices. Full article

Background: A transfer of learning effects across speech perception and production is evident in second-language (L2)-learning research, suggesting that perception and production are closely linked in L2 speech learning. However, underlying factors, such as the phonetic cue weightings given to acoustic features, of the relationship between perception and production improvements are less explored. To address this research gap, the current study explored the effects of Mandarin tone learning on the production and perception of critical (pitch direction) and non-critical (pitch height) perceptual cues. Methods: This study tracked the Mandarin learning effects of Indonesian adult learners over a four-to-six-week learning period. Results: We found that perception and production gains in Mandarin L2 learning concurrently occurred with the critical pitch direction cue, F0 slope. The non-critical pitch height cue, F0 mean, only displayed a production gain. Conclusions: The results indicate the role of critical perceptual cues in relating tone perception and production in general, and in the transfer of learning effects across the two domains for L2 learning. These results demonstrate the transfer of the ability to perceive phonological contrasts using critical phonetic information to the production domain based on the same cue weighting, suggesting interconnected encoding and decoding processes in L2 speech learning. Full article

The tonal system of Cantonese is very different from that of Mandarin, which creates potential challenges for Mandarin speakers when learning Cantonese. The aim of this study was to explore second language (L2) production of Cantonese tones by advanced learners whose first language (L1) is Mandarin. Forty-one informants participated in a recording experiment to provide production data of Cantonese tones. The speech data were measured acoustically using the computer software Praat (Version 6.3.10) and were evaluated perceptually by native Cantonese speakers. The relationship between the acoustic analysis and perceptual evaluation was also explored. The acoustic and perceptual evaluations confirmed that, while the tones that the Mandarin learners of Cantonese produced were non-native-like, their production of the Cantonese T1 and T2 was good in general. Furthermore, the accuracy of the perceptual evaluations could be predicted based on the acoustic features of the L2 tones. Our findings are in line with hypotheses in current speech learning models, and demonstrate that familiar phonetic categories are easier to acquire than are unfamiliar ones. To provide a more complete picture of L2 speech acquisition, future research should investigate L2 tone acquisition using both production and perception data obtained from participants with a greater variety of L1s. Full article

This study used an electrophysiological technique to investigate the perception mechanism of Mandarin native speakers and learners from non-tonal language backgrounds when processing the third tone (T3) and its variants in Mandarin. The experiments used a 2 × 2 two-factor mixed design to examine the perception of T3 and its variants and the processing mechanisms of learners and native speakers under different levels of attention. Differences in attention and language backgrounds in the perception of Mandarin tones were further investigated. These results provide evidence that there are no significant differences in the perception of the two T3 variants by native Mandarin speakers under different attentional conditions. In contrast, learners from non-tonal language backgrounds were more likely to perceive a low flat tone as T3 than a low concave tone in the attentive condition. This means that learners are more likely to rely on low-pitch cues rather than the concave contour of the tone when perceiving T3. Full article

Pitch is a fundamental element in music. While most previous studies on musical pitch have focused on musicians, our understanding of musical pitch perception in non-musicians is still limited. This study aimed to explore how Mandarin-speaking listeners who did not receive musical training perceive and categorize musical pitch. Two experiments were conducted in the study. In Experiment 1, participants were asked to discriminate musical tone pairs with different intervals. The results showed that the nearer apart the tones were, the more difficult it was to distinguish. Among adjacent note pairs at major 2nd pitch distance, the A4–B4 pair was perceived as the easiest to differentiate, while the C4–D4 pair was found to be the most difficult. In Experiment 2, participants completed a tone discrimination and identification task with the C4–D4 and A4–B4 musical tone continua as stimuli. The results revealed that the C4–D4 tone continuum elicited stronger categorical perception than the A4–B4 continuum, although the C4–D4 pair was previously found to be more difficult to distinguish in Experiment 1, suggesting a complex interaction between pitch perception and categorization processing. Together, these two experiments revealed the cognitive mechanism underlying musical pitch perception in ordinary populations and provided insights into future musical pitch training strategies. Full article

While existing cross-language studies on the perception of non-native tones primarily focus on naïve listeners, this study addresses an obvious gap by investigating learners from diverse language backgrounds. Specifically, it investigates Mandarin tone perception in two groups of learners from Nordic languages, Swedish (a pitch-accent language), and Danish (a non-tonal language), as well as in a group of native Chinese speakers. Analysis of their performance in tone identification task revealed a slight advantage for Swedish learners, implying the influence of their pitch accent background in learning Mandarin tones. However, both Swedish and Danish learners who excelled in the tone identification task exhibited similar perception of within-category tonal variations but differed from native Chinese speakers. Additionally, the study found that the presence of length contrast, a prosodic feature in the learners’ native languages, significantly influences their perception of Mandarin tones. Full article

The visual cues of lexical tones are more implicit and much less investigated than consonants and vowels, and it is still unclear what facial areas contribute to facial tones identification. This study investigated Chinese and English speakers’ eye movements when they were asked to identify audiovisual Mandarin lexical tones. The Chinese and English speakers were presented with an audiovisual clip of Mandarin monosyllables (for instance, /ă/, /à/, /ĭ/, /ì/) and were asked to identify whether the syllables were a dipping tone (/ă/, / ĭ/) or a falling tone (/ à/, /ì/). These audiovisual syllables were presented in clear, noisy and silent (absence of audio signal) conditions. An eye-tracker recorded the participants’ eye movements. Results showed that the participants gazed more at the mouth than the eyes. In addition, when acoustic conditions became adverse, both the Chinese and English speakers increased their gaze duration at the mouth rather than at the eyes. The findings suggested that the mouth is the primary area that listeners utilise in their perception of audiovisual lexical tones. The similar eye movements between the Chinese and English speakers imply that the mouth acts as a perceptual cue that provides articulatory information, as opposed to social and pragmatic information. Full article

How people recognize linguistic and emotional prosody in different listening conditions is essential for understanding the complex interplay between social context, cognition, and communication. The perception of both lexical tones and emotional prosody depends on prosodic features including pitch, intensity, duration, and voice quality. However, it is unclear which aspect of prosody is perceptually more salient and resistant to noise. This study aimed to investigate the relative perceptual salience of emotional prosody and lexical tone recognition in quiet and in the presence of multi-talker babble noise. Forty young adults randomly sampled from a pool of native Mandarin Chinese with normal hearing listened to monosyllables either with or without background babble noise and completed two identification tasks, one for emotion recognition and the other for lexical tone recognition. Accuracy and speed were recorded and analyzed using generalized linear mixed-effects models. Compared with emotional prosody, lexical tones were more perceptually salient in multi-talker babble noise. Native Mandarin Chinese participants identified lexical tones more accurately and quickly than vocal emotions at the same signal-to-noise ratio. Acoustic and cognitive dissimilarities between linguistic prosody and emotional prosody may have led to the phenomenon, which calls for further explorations into the underlying psychobiological and neurophysiological mechanisms. Full article

Extensive research has explored the perception of English lexical stress by Chinese EFL learners and tried to unveil the underlying mechanism of the prosodic transfer from a native tonal language to a non-native stress language. However, the role of the pitch as the shared cue by lexical stress and lexical tone during the transfer remains controversial when the segmental cue (i.e., reduced vowel) is absent. By employing event-related potential (ERP) measurements, the current study aimed to further investigate the role of the pitch during the prosodic transfer from L1 lexical tone to L2 lexical stress and the underlying neural responses. Two groups of adult Chinese EFL learners were compared, as both Mandarin and Cantonese are tonal languages with different levels of complexity. The results showed that Cantonese speakers relied more than Mandarin speakers on pitch cues, not only in their processing of English lexical stress but also in word recognition. Our findings are consistent with the arguments of Cue Weighting and attest to the influence of native tonal language experience on second language acquisition. The results may have implications on pedagogical methods that pitch could be an important clue in second language teaching. Full article

Electro-laryngeal (EL) speech has poor intelligibility and naturalness, which hampers the popular use of the electro-larynx. Voice conversion (VC) can enhance EL speech. However, if the EL speech to be enhanced is with complicated tone variation rules in Mandarin, the enhancement will be less effective. This is because the source speech (Mandarin EL speech) and the target speech (normal speech) are not strictly parallel. We propose using cycle-consistent generative adversarial networks (CycleGAN, a parallel-free VC framework) to enhance continuous Mandarin EL speech, which can solve the above problem. In the proposed framework, the generator is designed based on the neural networks of a 2D-Conformer-1D-Transformer-2D-Conformer. Then, we used Mel-Spectrogram instead of traditional acoustic features (fundamental frequency, Mel-Cepstrum parameters and aperiodicity parameters). At last, we converted the enhanced Mel-Spectrogram into waveform signals using WaveNet. We undertook both subjective and objective tests to evaluate the proposed approach. Compared with traditional approaches to enhance continuous Mandarin EL speech with variable tone (the average tone accuracy being 71.59% and average word error rate being 10.85%), our framework increases the average tone accuracy by 12.12% and reduces the average errors of word perception by 9.15%. Compared with the approaches towards continuous Mandarin EL speech with fixed tone (the average tone accuracy being 29.89% and the average word error rate being 10.74%), our framework increases the average tone accuracy by 42.38% and reduces the average errors of word perception by 8.59%. Our proposed framework can effectively address the problem that the source and target speech are not strictly parallel. The intelligibility and naturalness of Mandarin EL speech have been further improved. Full article

Adults commonly struggle with perceiving and recognizing the sounds and words of a second language (L2), especially when the L2 sounds do not have a counterpart in the learner’s first language (L1). We examined how L1 Mandarin L2 English speakers learned pseudo English words within a cross-situational word learning (CSWL) task previously presented to monolingual English and bilingual Mandarin-English speakers. CSWL is ambiguous because participants are not provided with direct mappings of words and object referents. Rather, learners discern word-object correspondences through tracking multiple co-occurrences across learning trials. The monolinguals and bilinguals tested in previous studies showed lower performance for pseudo words that formed vowel minimal pairs (e.g., /dit/-/dɪt/) than pseudo word which formed consonant minimal pairs (e.g., /bɔn/-/pɔn/) or non-minimal pairs which differed in all segments (e.g., /bɔn/-/dit/). In contrast, L1 Mandarin L2 English listeners struggled to learn all word pairs. We explain this seemingly contradicting finding by considering the multiplicity of acoustic cues in the stimuli presented to all participant groups. Stimuli were produced in infant-directed-speech (IDS) in order to compare performance by children and adults and because previous research had shown that IDS enhances L1 and L2 acquisition. We propose that the suprasegmental pitch variation in the vowels typical of IDS stimuli might be perceived as lexical tone distinctions for tonal language speakers who cannot fully inhibit their L1 activation, resulting in high lexical competition and diminished learning during an ambiguous word learning task. Our results are in line with the Second Language Linguistic Perception (L2LP) model which proposes that fine-grained acoustic information from multiple sources and the ability to switch between language modes affects non-native phonetic and lexical development. Full article

Word identification models assume that words are identified by at least two sources of information and analysis; one is phonological, and the other is visual. The present study investigated the influence of phonological awareness, Pinyin letter knowledge, and visual perception skills on Chinese character recognition after controlling for vocabulary, rapid naming, and verbal short-term memory in 80 Mandarin-speaking kindergarten children. Children were tested on phonological awareness (syllable awareness, onset-end rhyme awareness, and tone awareness), Pinyin letter naming, and visual perception (visual discrimination and visual-spatial relationships). The results showed that variance in Chinese character recognition could be explained by syllable awareness and tone awareness, but not by visual perception skills or Pinyin letter knowledge. Analyses further indicated that Pinyin letter knowledge moderated the relationship between tone awareness and Chinese character recognition. A focus on tone awareness and syllable awareness in the kindergarten may help Chinese children to accomplish the transition from phonological awareness to early literacy, while Pinyin letter knowledge can help children to make the connection between Chinese speech and writing. Full article

Fundamental frequency (F0) provides the primary acoustic cue for lexical tone perception in tonal languages but remains poorly represented in cochlear implant (CI) systems. Currently, there is still a lack of understanding of sensitivity to F0 change in CI users who speak tonal languages. In the present study, just-noticeable differences (JNDs) of F0 contour and F0 level changes in Mandarin-speaking children with CIs were measured and compared with those in their age-matched normal-hearing (NH) peers. Results showed that children with CIs demonstrated significantly larger JND of F0 contour (JND-C) change and F0 level (JND-L) change compared to NH children. Further within-group comparison revealed that the JND-C change was significantly smaller than the JND-L change among children with CIs, whereas the opposite pattern was observed among NH children. No significant correlations were seen between JND-C change/JND-L change and age at implantation /duration of CI use. The contrast between children with CIs and NH children in sensitivity to F0 contour and F0 level change suggests different mechanisms of F0 processing in these two groups as a result of different hearing experiences. Full article

It has been widely assumed that in speech perception it is imperative to first detect a set of distinctive properties or features and then use them to recognize phonetic units like consonants, vowels, and tones. Those features can be auditory cues or articulatory gestures, or a combination of both. There have been no clear demonstrations of how exactly such a two-phase process would work in the perception of continuous speech, however. Here we used computational modelling to explore whether it is possible to recognize phonetic categories from syllable-sized continuous acoustic signals of connected speech without intermediate featural representations. We used Support Vector Machine (SVM) and Self-organizing Map (SOM) to simulate tone perception in Mandarin, by either directly processing f₀ trajectories, or extracting various tonal features. The results show that direct tone recognition not only yields better performance than any of the feature extraction schemes, but also requires less computational power. These results suggest that prior extraction of features is unlikely the operational mechanism of speech perception. Full article

Pitch perception is known to be difficult for individuals with cochlear implant (CI), and adding a hearing aid (HA) in the non-implanted ear is potentially beneficial. The current study aimed to investigate the bimodal benefit for lexical tone recognition in Mandarin-speaking preschoolers using a CI and an HA in opposite ears. The child participants were required to complete tone identification in quiet and in noise with CI + HA in comparison with CI alone. While the bimodal listeners showed confusion between Tone 2 and Tone 3 in recognition, the additional acoustic information from the contralateral HA alleviated confusion between these two tones in quiet. Moreover, significant improvement was demonstrated in the CI + HA condition over the CI alone condition in noise. The bimodal benefit for individual subjects could be predicted by the low-frequency hearing threshold of the non-implanted ear and the duration of bimodal use. The findings support the clinical practice to fit a contralateral HA in the non-implanted ear for the potential benefit in Mandarin tone recognition in CI children. The limitations call for further studies on auditory plasticity on an individual basis to gain insights on the contributing factors to the bimodal benefit or its absence. Full article