Next Article in Journal
The Prevalence and Association of Cognitive Impairment with Sleep Disturbances in Patients with Chronic Liver Disease
Next Article in Special Issue
Neural–Behavioral Relation in Phonetic Discrimination Modulated by Language Background
Previous Article in Journal
Supporting Relatives Prior to Caregiver Burden—Preventive E-Mental Health Short Intervention for Family Members of Individuals with Parkinsonism in an Early Phase of the Disease: Protocol for a Feasibility Study
Previous Article in Special Issue
Phonetic Effects in the Perception of VOT in a Prevoicing Language
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Just-Noticeable Differences of Fundamental Frequency Change in Mandarin-Speaking Children with Cochlear Implants

1
Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen 518055, China
2
Unit of Human Communication, Development, and Information Sciences, Faculty of Education, The University of Hong Kong, Hong Kong 999077, China
*
Author to whom correspondence should be addressed.
Brain Sci. 2022, 12(4), 443; https://doi.org/10.3390/brainsci12040443
Submission received: 16 February 2022 / Revised: 16 March 2022 / Accepted: 23 March 2022 / Published: 26 March 2022
(This article belongs to the Special Issue Auditory and Phonetic Processes in Speech Perception)

Abstract

:
Fundamental frequency (F0) provides the primary acoustic cue for lexical tone perception in tonal languages but remains poorly represented in cochlear implant (CI) systems. Currently, there is still a lack of understanding of sensitivity to F0 change in CI users who speak tonal languages. In the present study, just-noticeable differences (JNDs) of F0 contour and F0 level changes in Mandarin-speaking children with CIs were measured and compared with those in their age-matched normal-hearing (NH) peers. Results showed that children with CIs demonstrated significantly larger JND of F0 contour (JND-C) change and F0 level (JND-L) change compared to NH children. Further within-group comparison revealed that the JND-C change was significantly smaller than the JND-L change among children with CIs, whereas the opposite pattern was observed among NH children. No significant correlations were seen between JND-C change/JND-L change and age at implantation /duration of CI use. The contrast between children with CIs and NH children in sensitivity to F0 contour and F0 level change suggests different mechanisms of F0 processing in these two groups as a result of different hearing experiences.

1. Introduction

Fine pitch processing is relatively scarce in non-tonal languages, whereas in tonal languages, which account for 70% of the world’s languages [1], rapid pitch variations (i.e., lexical tones) are used to alter the meaning of a syllable. For example, in Mandarin Chinese, each of the four lexical tones has a distinct pattern of pitch inflection: level, mid-rising, dipping, and high-falling, changing the meaning of a syllable such as /ma/ into “mother”, “hemp”, “horse”, or “scold”. Prior research findings have consistently suggested that fundamental frequency (F0) provides the primary acoustic information for Mandarin tone recognition [2], while the temporal [3,4] and spectral envelope [5] serve as the secondary acoustic cues.
Cochlear implantation is widely accepted as a life-changing invention for individuals with severe to profound hearing impairment. According to the Sixth National Population Census of the People’s Republic of China, the total number of hearing-impaired children aged 0 to 14 was estimated to be more than 4.6 million [6]. It is reported that about 2000 preschool children with congenital severe to profound hearing loss in mainland China (hereafter referred to as Mandarin-speaking children with CIs) underwent cochlear implantation in 2004, increasing at a rate of 30% to 50% per year thereafter [7].
The speech processing strategies currently used in CIs are mainly designed to encode the temporal envelope of sound stimuli. Given the vulnerability of the temporal envelope in noise, it is not surprising that speech perception in noise conditions among Mandarin-speaking children with CIs remains unsatisfactory [8,9] and is even worse than that in English-speaking children with CIs [10,11]. In recent decades, to improve speech perception in CI users speaking tonal languages, speech processing strategies have been developed to provide more F0 information by delivering more spectral information (e.g., HiRes 120) or by enhancing temporal fine structure cues (e.g., Temporal Fine Structure) in CI systems. Unfortunately, these new speech processing strategies have not improved tone perception in CI users who speak tonal languages [12,13]. For instance, using a two-alternative forced-choice paradigm, researchers found that two speech processing strategies (i.e., HiRes or HiRes 120) failed to produce statistically significant differences in Mandarin tone recognition performance among a group of 20 Mandarin-speaking children with CIs, although most of them reported a preference for HiRes 120 [12]. Such negative results have also been found among Cantonese-speaking adult CI users when comparing Cantonese tone recognition using a typical speech processing strategy (i.e., continuous interleaved sampling) to that using a relatively new one [13].
The insignificant improvement in lexical tone recognition using newer speech processing strategies, as reported in previous studies, might have been the result of a lack of understanding of F0 processing in Mandarin-speaking CI users, which has received little attention until recent years. F0s of Mandarin tones comprise two dimensions: F0 level and F0 contour. F0 level, which refers to the height of onset F0 in Mandarin tones, is usually used to identify different talkers (e.g., male vs. female), while F0 contour reflects the trajectory of F0 change over the duration of a single tone and plays a more decisive role in the discrimination of word meaning compared to F0 level. Existing studies on F0 contour processing in Mandarin-speaking children with CIs suggest that these children may use F0 contours differently from their age-matched NH peers as a result of different hearing experiences [14,15]. For example, researchers found that, although Mandarin-speaking children with CIs were able to use F0 contours for tone recognition, they tended to rely more on the temporal envelope than on F0 contours when performing word-level tone recognition tasks [15]. However, the situation was quite different at the sentence level. A recent study investigated the effects of F0 contours on sentence recognition in Mandarin-speaking preschool children with CIs in both quiet and noise conditions. The results showed that when other acoustic cues (e.g., temporal envelope) were neutralized, sentence recognition with flattened F0 contours was significantly worse than that with normal F0 contours in both children with CIs and NH children. While the F0 contour-caused decrease in sentence recognition was only seen in quiet conditions among the NH children, it was seen in both quiet and noise conditions among the children with CIs. Furthermore, the impact of F0 contours on sentence recognition accuracy in children with CIs was significantly more salient than that in NH children [14].
Processing of the F0 level in Mandarin-speaking children with CIs has received much less attention compared to that of the F0 contour. Similar to previous studies on music perception in CI users [16,17], the few studies on F0 level processing in Mandarin-speaking children with CIs have demonstrated deficits when compared to NH controls. For example, researchers measured and compared F0 level discrimination in 24 Mandarin-speaking school-aged children (aged 4.6 to 21.3 years) and found that percent correct performance for F0 level discrimination in the CI group was significantly poorer than that in the NH group, suggesting a compromise in F0 level processing in Mandarin-speaking school-aged children with CIs [18].
The extent to which sensitivity to F0 contour and F0 level change is affected by CI-related demographic factors (e.g., age at implantation, duration of CI use) indicates whether and how F0 processing in Mandarin-speaking children with CIs is shaped by the children’s experiences on using CIs. Currently, the relationship between sensitivity to F0 change and CI-related demographic factors is rarely reported in the existing literature. According to the existing literature, while reliance on temporal envelope was significantly correlated with age at implantation, there was no significant relationship between reliance on F0 contours and the duration of CI use [15]. In English-speaking preschool children, researchers found no significant correlations between CI-related demographic factors and sensitivity to F0 contour change [19]. Similarly, no significant correlations between CI-related demographic factors (i.e., age at implantation and duration of CI use) and sensitivity to F0 level change were reported in either English-speaking or Mandarin-speaking preschool children [18].
To date, there is still a lack of understanding of F0 contour and F0 level processing in Mandarin-speaking children with CIs and of the extent to which F0 processing in these children is similar to or different from that in age-matched NH children. In the present study, just-noticeable differences (JNDs) of F0 contour and F0 level change, which were used as indicators of F0 processing, were measured and compared between Mandarin-speaking kindergarten-aged children with normal hearing and children with CIs. Given the well-known deficits in F0 processing of speech sounds in CI systems, it was predicted that children with CIs would be significantly less sensitive to both F0 level and F0 contour change compared to NH children. Based on the previously reported larger JND of pitch contour change in NH adults compared to the JND of pitch level change [20], it was predicted that in NH children, the JND of F0 contour change would also be larger than that of F0 level change. As F0 contour and F0 level perception have only been examined separately in previous studies, the relative sensitivity to F0 contour change and F0 level change has yet to be explored.
To gain a better understanding of the relationship between CI-related demographic factors (e.g., age at implantation, duration of CI use) and F0 change detection in Mandarin-speaking children with CIs, correlation analyses were conducted between CI-related demographic factors and JNDs of F0 contour and F0 level change in the Mandarin-speaking children with CIs. Based on the previously reported results on this issue, it was expected that CI-related demographic factors would not be significantly correlated with the JNDs of F0 contour and F0 level change in the Mandarin-speaking kindergarten-aged children with CIs.

2. Materials and Methods

2.1. Participants

Thirty Mandarin-speaking preschool children with CIs (18 males and 12 females; mean age 4.36 ± 0.70 years old) participated in the current study. The preschool children were chosen for the following reasons: (a) children with normal hearing exhibit protracted development of tonal processing before school age [21,22,23,24]; (b) there is a critical period for central auditory system in pediatric CI users before the age of 7 [25,26]; (c) most prelingually deafened children in mainland China receive implantation before the age of six. Therefore, investigations in children before school age provide evidence of tonal development at an early stage, which offers valuable references for the development and improvement of the tonal language-oriented speech processing strategies in CI systems. All participants were recruited from the Beijing Children’s Hospital and the China Rehabilitation Research Center for Hearing and Speech Impairment. Children in the CI group met the following inclusion criteria: (a) aged 3–6 years, (b) diagnosed with congenital bilateral severe to profound sensorineural hearing impairment, (c) had received unilateral implantation, and (d) had been using CIs for not less than six months. Children in this group were using CIs from four manufacturers: Advanced Bionics (n = 5), Cochlear (n = 12), MED-EL (n = 12), and Nurotron (n = 1). The speech processing strategies used by these CI manufacturers are HiResolution (HiRes) 120, Advanced Combination Encoder (ACE), Fine Structure (FS) 4, and C-tone, respectively. Among these children, 12 had undergone a unilateral (n = 5) or bilateral (n = 7) hearing aid trial before implantation, and 25 wore a hearing aid on the non-implanted ear after implantation. Details of demographic information and device use are shown in Table 1. Thirty age-matched Mandarin-speaking children (17 male and 13 female, mean age: 4.37 ± 0.48 years old) with audiometric thresholds not worse than 20 dB HL at octave frequencies between 250 and 4000 Hz were included as normal controls in this study. Children in both groups scored within the normal range on the Hiskey-Nebraska Test of Learning Aptitude for children above 3 years of age [27]. The research study was approved by the Human Research Ethics Committee of the University of Hong Kong and Beijing Children’s Hospital. All children participated voluntarily in the study, with informed consent obtained from their parents.

2.2. Stimuli

The original stimulus, an isolated Mandarin vowel /a/ with tone 1, was first spoken by an adult female native Mandarin speaker. Using Praat [28], the F0 contour of /a1/ was then replaced with a series of linear F0 contours, with other acoustic features remaining the same. JNDs of F0 contour and F0 level change were measured in two separate blocks. In the block measuring the JND of F0 contour change, the offset F0s were manipulated to vary from 100 to 300 Hz, with the onset of the linear F0 contours being fixed at 100 Hz, resulting in an offset continuum with F0 contours ranging from a level tone to a rising tone. The step size between adjacent offset F0s was set at 1 Hz, and thus, the newly resynthesized stimuli were made up of 201 /a/ carrying different F0 contours (see Figure 1A). The stimuli in the block measuring the JND of F0 level change were the same as those in the F0 contour condition, except that the onset F0 was equal to the offset F0 throughout the resynthesized F0 contours (see Figure 1B). According to the Syllabus of the Chinese Proficiency Test, the duration of a naturally uttered lexical tone is around 200 to 300 ms [29]. To make the stimuli more natural and to guarantee the audibility of stimuli, the duration of each stimulus in both conditions was set at 300 ms.

2.3. Procedure

A three-alternative forced-choice paradigm with a two-down, one-up tracking algorithm was used to measure the JNDs of F0 contour and F0 level change among the children in both groups. Within each trial, two standard stimuli and one deviant stimulus were randomly presented, with the inter-stimulus interval being 400 ms. The probability of the deviant stimulus appearing at each interval was equal to 1/3. In the F0 level condition, 100–100 Hz was selected as the standard stimulus. In contrast, to ensure that pitch contour was the main cue for the detection of F0 change and not pitch height, three flat contours (i.e., 100–100, 200–200, and 300–300 Hz) were used as standard stimuli in the F0 contour condition, two of which were randomly chosen in each trial.
During the test, children in the CI group wore their CIs only. Children in both groups were seated at a rectangular table in a quiet room while performing the task. The sound stimuli were presented at a listening level of 65 dB SPL via a loudspeaker located in front of the children at a 0° azimuth and a distance of one meter from the center of the head of participants. Three identical cartoon dogs were printed on three separate pieces of paper. During the presentation of the three sound stimuli in each trial, the examiner was seated next to the children and pointed at the cartoon dogs one by one with the sound stimuli. Children were asked to indicate which dog’s voice sounded different from the other two (see Figure 2). In the F0-contour block, children were first taught with the targeted rising tone (i.e., 100–300 Hz). In each trial of this block, children were presented with the rising tone three times before the onset of sound stimuli.
Each of the two blocks contained 60 trials. In both blocks, the offset F0s of the deviant stimuli were first started at 300 Hz and went downward and approached the standard stimulus (100 Hz) upon correct responses. Following the successful discrimination of the deviant stimulus in the first trial, the offset F0 change was set at 100 Hz for the second trial. Based on previous studies [20,30], the step size in each trial was adjusted to 5 Hz for the first three reversals and to 1 Hz thereafter. With the exclusion of the first three reversals, the average offset F0 change from the original one (300 Hz) was calculated from the last even number of reversals in the adaptive track. The JND for each condition was defined as the offset F0 difference between the average offset F0 change and the offset F0 of the standard stimulus (i.e., 100 Hz). The children were given practice trials before the test until they were familiarized with the task requirements. The order of the blocks of F0 contour and F0 level measurement was counterbalanced among the children. A break was given every four to six trials.

2.4. Statistical Analysis

To investigate the effects of hearing experience (normal hearing vs. CIs) and F0 dimensions on the sensitivity to F0 change, JNDs of F0 contour change and F0 level change were entered as the dependent variables in a two-way analysis of variance, with group (NH group/CI group) and F0 dimension (F0 level/F0 contour) as the independent variables. A test of simple effects was conducted upon the significant interaction between group and F0 dimension. The Mann–Whitney U test was performed for the comparison between groups.
To investigate the relationship between demographic factors (e.g., age at implantation) and sensitivity to F0 change, Pearson correlation analyses were performed between JNDs of F0 contour/ F0 level change and demographic factors.
The p-value of 0.05 was set as a threshold of statistical significance throughout all tests.

3. Results

The JNDs of F0 contour and F0 level change in children with CIs and NH children are shown in Figure 3. On the whole, the JNDs of F0 change were larger in children with CIs than in their age-matched peers. Within-group comparison between the JND of F0 level change and the JND of F0 contour change revealed that, in the control group, the JNDs of F0 contour change were consistently larger than those of F0 level change, while in children with CIs, contrasting patterns were observed: 22 of the 30 children with CIs exhibited larger JNDs of F0 level change, 6 showed opposite patterns, and 2 demonstrated equal JNDs of F0 contour and F0 level change. The percentage of children exhibiting different patterns of JNDs of F0 level change and F0 contour change for each type of speech processing strategy is shown in Table 2.
Significant positive correlations between the JND of F0 contour change and the JND of F0 level change were found in the NH group (r = 0.622, p < 0.001), the CI group (r = 0.636, p < 0.001), and the combination of the two groups (r = 0.793, p < 0.001). A two-way analysis of variance (ANOVA), with group (children with CIs/normal hearing) as the between-subject factor and F0 dimension (F0 level/contour) as the within-subject factor (see Figure 4), demonstrated the significant main effects of group (F (1, 58) = 102.12, p < 0.001, partial η2 = 0.64) and F0 dimension (F (1, 58) = 21.17, p < 0.001, partial η2 = 0.27) and interaction between group and F0 dimension (F (1, 58) = 4.54, p < 0.001, partial η2 = 0.57). The ANOVA results are summarized in Table 3. Post hoc analysis revealed significantly larger JNDs of F0 contour change (F (1, 58) = 38.07, p < 0.001, partial η2 = 0.40) and F0 level change (F (1, 58) = 141.43, p < 0.001, partial η2 = 0.0.71) in children with CIs than those in NH children. Among NH children, the JND of F0 contour change was significantly larger than that of F0 level change (F (1, 58) = 92.50, p < 0.001, partial η2 = 0.61). In contrast, among children with CIs, the JND of F0 contour change was found to be significantly smaller than the JND of F0 level change (F (1, 58) = 8.67, p < 0.01, partial η2 = 0.13). Furthermore, an independent-samples t-test, comparing the difference between the JND of F0 contour change and the JND of F0 level change in both groups, suggested that the JND difference between F0 contours and F0 levels was significantly larger in NH children than in children with CIs (t (58) = 4.72, p < 0.001).
No significant correlation was observed between age at implantation and either the JND of F0 contour change (r = −0.09, p = 0.65) or the JND of F0 level change (r = −0.15, p = 0.42) or between duration of CI use and either the JND of F0 contour change (r = −0.09, p = 0.64) or the JND of F0 level change (r = 0.03, p = 0.86).

4. Discussion

The main purpose of this study is to investigate the processing of F0, including F0 level and F0 contour, in Mandarin-speaking children with CIs as compared to NH peers, which may partially account for the unsatisfactory outcome of Mandarin tone recognition in CI users. To achieve this goal, we investigated the JNDs of F0 contour change and F0 level change in Mandarin-speaking kindergarten-aged children with CIs compared to those of their age-matched NH peers. The results showed that NH children were more sensitive to F0 level changes, as evidenced by the significantly smaller JND in the F0 level condition than that in the F0 contour condition. The higher sensitivity to F0 level change compared to sensitivity to F0 contour change in NH children is consistent with previous findings among NH adults at both behavioral [20] and electrophysiological levels [31]. It should be noted that, although the F0 onset and offset and measurement methods in the F0 level condition in the present study (100 Hz to 300 Hz) were similar to those in NH adults (180 to 250 Hz) [20], the JNDs of F0 level change obtained among NH children in this study was much larger than those that have been found among NH adults [19,20]. The relatively larger JNDs in NH children compared to NH adults are probably the result of the children’s less-developed central auditory system, which does not fully mature until about 12 years of age [32,33]. However, since the measurement of JND of F0 level change and JND of F0 contour change was not fully equivalent, it may not be suitable to conclude the relationship between the sensitivity to F0 level change and that to F0 contour change in this group alone.
Although positive correlations between the JNDs of F0 contour and F0 level change were found in both groups of children in the present study, the sensitivity to F0 change in children with CIs was quite different from that in NH children. While NH children consistently showed higher sensitivity to F0 level changes compared to F0 contour changes, large individual variabilities were observed in the CI group. Although the majority of children in the CI group (n = 22) exhibited larger JNDs for F0 level change, four children exhibited the opposite pattern, while two children showed equal sensitivity to F0 contour and F0 level change. Substantial individual variability in speech perception in Mandarin-speaking CI users has been reported in many studies [12,34], which probably results from variations in demographic factors, such as age at implantation [12] and duration of CI use [35], although the results of the present study did not show significant correlations between the JNDs of F0 contour and F0 level change and these demographic factors. This issue is discussed later.
It is known that in CIs, F0 information up to approximately 300 Hz is processed by way of temporal information, which conveys far less fine structure information than can be processed by the normal auditory system [36,37]. Therefore, it is not surprising that children with CIs show a deficit in F0 processing, as reflected by the significantly larger JNDs of both F0 contour and F0 level change compared to NH children. These findings are consistent with those reported in previous studies [15,18,19]. More importantly, as shown in Figure 4, the relationship between sensitivity to F0 contour change and to F0 level change in children with CIs was in contrast to that in the NH children at the group level. While the NH controls demonstrated higher sensitivity to F0 level change, the pediatric CI users were more sensitive to F0 contour change. It is worth noting that the higher sensitivity to F0 contour change compared to F0 level change was widely seen in the CI group, regardless of the type of speech processing strategies used by these children (see Table 2). Therefore, the significant sensitivity to F0 contour change observed in the CI group cannot simply be attributed to speech processing strategies; rather, it is probably a common phenomenon in CI users, resulting from their hearing experience with CIs. Such higher sensitivity to F0 contour change compared to F0 level change could be caused by two factors. First, as reported by the previous study, amplitude modulation depth is usually inconsistently coded by clinical speech processing strategies (even for those produced by the same talker), which results in the inconsistent perception of the F0 level; however, the perception of the F0 contour is not likely to be affected [38]. Under such circumstances, it is not surprising that the inconsistent perception of the F0 level leads to a significantly larger JND of F0 level change than that of F0 contour change. Second, as introduced above, CIs are designed to extract temporal envelope information so that the contour of the frequency fluctuations of speech is maintained. To master a tonal language, in which contour information plays a dominant role in discriminating word meanings, CI users must maximally utilize the contour information conveyed by CIs. Thus, children with CI users in the present study might have developed a unique mechanism of F0 processing that differs from that of their NH peers. In other words, the contour information of speech sounds might have been prioritized compared to F0 level information in speech perception among children with CIs. The difference in sensitivity to F0 level and F0 contour change between children with CIs and NH children suggests that the enhancement of F0 information in the newly developed speech processing strategies (e.g., HiRes 120, Temporal Fine Structure) in Mandarin-speaking children with CIs may not fully satisfy the requirements for F0 processing in speech perception, which partially explains the unsatisfactory improvement in speech perception among this population when switching to new speech processing strategies [12].
No significant correlation was found between JNDs of F0 contour/F0 level and age at implantation/duration of CI use in this study. This finding was consistent with the previous study, in which 23 English-speaking school-aged children with CIs were evaluated [19]. Children in both studies were prelingually deaf, and their hearing during tests depended on the implanted CI on either side of the ear, with the hearing aid on the contralateral side being turned off and removed from the ear. The insignificant relationship between JNDs of F0 contour/F0 level and age at implantation/duration of CI use in this study suggests that age at implantation and duration of CI use may have little impact on the F0 processing in these children. However, it is also possible that given the relatively small sample size, the effect of age at implantation and duration of CI use was overwhelmed by the well-recognized individual variability [39].
There are several limitations in the current study. According to a recent study, different types (i.e., the posterior tympanotomy technique vs. the endomeatal approach) of CI surgery result in different levels of postoperative discomfort [40]. Unfortunately, the type of surgery in the CI group was not well documented in the present study, and it was unclear whether the type of surgery would play a role in the F0 change detection in children with CIs. Technically speaking, the round window approach manages to preserve hearing residues [40] so that F0 change detection in CI recipients will be better. Such an inference is expected to be verified by further studies. In addition, the relatively small sample size (n = 30) in this study made it unlikely to demonstrate the relationship between demographic factors and F0 processing in children with CIs. A larger sample size is required to address this question in the future. Additionally, given that the F0 level and F0 contour were processed holistically when perceiving tones [41], an improved paradigm is needed to further confirm the findings in this study.

5. Conclusions

The current study explored F0 processing in Mandarin-speaking children with CIs from a psychophysical perspective. The results revealed significantly compromised sensitivity to F0 change in children with CIs. Specifically, children with CIs demonstrated higher sensitivity to F0 contour change than to F0 level change; this pattern contrasted with the relatively well-developed sensitivity to F0 level change in NH children. However, CI-related demographic factors (i.e., age at implantation and duration of CI use) seemed to have little impact on sensitivity to F0 change in children with CIs. This is the first study to investigate F0 processing in Mandarin-speaking preschool children with CIs by comparing the two dimensions of F0 (i.e., F0 contour and F0 level). The contrast in sensitivity to F0 contour and F0 level change between children with CIs and NH children may suggest different mechanisms of F0 processing in these two groups as a result of their hearing experiences. To the best of our knowledge, this is the first study exploring both dimensions of F0 information in Mandarin-speaking children with CIs. The difference in F0 processing between children with CIs and NH children, revealed in this study, provides new perspectives on the development and improvement of speech processing strategies in CI systems, especially those targeted at tonal language speakers. It is believed that it will significantly improve the life quality of CI users by providing more accurate F0 information in the CI systems.

Author Contributions

Conceptualization, all authors.; methodology, W.H. and F.C.; software, W.H.; validation, F.C.; formal analysis, W.H.; investigation, W.H.; resources, L.L.N.W.; data curation, W.H.; writing—original draft preparation, W.H.; writing—review and editing, all authors; visualization, W.H.; supervision, L.L.N.W. and F.C.; project administration, L.L.N.W. and F.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work of Fei Chen was supported by the National Natural Science Foundation of China (Grant No. 61971212).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Human Research Ethics Committee of The University of Hong Kong (EA1610013; November 2016) and Beijing Children’s Hospital (IEC-C-028-A10; March 2017).

Informed Consent Statement

Informed consent was obtained from parents of all subjects involved in the study.

Data Availability Statement

Data are available upon request from the corresponding authors.

Acknowledgments

This work was presented as an abstract in the 177th Meeting of the Acoustical Society of America in Louisville in 2019. This work was submitted as a part of PhD thesis at the University of Hong Kong and was permitted to republish the data. We thank the doctors at the Beijing Children’s Hospital and the teachers at the China Rehabilitation Research Center for Hearing and Speech Impairment for helping with participant recruitment. We are also grateful to all participants and their parents.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yip, M. Tone; Cambridge University Press: Cambridge, UK, 2002; p. 1. [Google Scholar]
  2. Lin, M. The acoustic characteristics and perceptual cues of tones in Standard Chinese. Chin. Yuwen. 1988, 204, 182–193. [Google Scholar]
  3. Fu, Q.J.; Zeng, F.G. Identification of temporal envelope cues in Chinese tone recognition. Asia Pac. J. Speech Lang. Hear. 2000, 5, 45–57. [Google Scholar] [CrossRef]
  4. Liu, S.; Samuel, A.G. Perception of Mandarin lexical tones when F0 information is neutralized. Lang. Speech. 2004, 47, 109–138. [Google Scholar] [CrossRef] [PubMed]
  5. Kong, Y.Y.; Zeng, F.G. Temporal and spectral cues in Mandarin tone recognition. J. Acoust. Soc. Am. 2006, 120, 2830–2840. [Google Scholar] [CrossRef] [PubMed]
  6. Communiqué on the Main Data of the Sixth National Census in 2010. Available online: http://www.gov.cn/test/2012-04/20/content_2118413.htm (accessed on 20 April 2012).
  7. Du, X.; Sun, X.; Huang, Z. Introduction of ”Study of Chinese language education in CI postoperative rehabilitation”. China Sci J. Hear. Speech Rehab. 2005, 6, 12. [Google Scholar]
  8. Chen, Y.; Wong, L.L.; Chen, F.; Xi, X. Tone and sentence perception in young Mandarin-speaking children with cochlear implants. Int. J. Pediatr. Otorhinolaryng. 2014, 78, 1923–1930. [Google Scholar] [CrossRef]
  9. Wei, C.G.; Cao, K.; Jin, X.; Chen, X.; Zeng, F.G. Psychophysical performance and Mandarin tone recognition in noise by cochlear implant users. Ear Hear. 2007, 28 (Suppl. S2), 62S. [Google Scholar] [CrossRef] [Green Version]
  10. Peng, S.C.; Tomblin, J.B.; Turner, C.W. Production and perception of speech intonation in pediatric cochlear implant recipients and individuals with normal hearing. Ear Hear. 2008, 29, 336–351. [Google Scholar] [CrossRef]
  11. See, R.L.; Driscoll, V.D.; Gfeller, K.; Kliethermes, S.; Oleson, J. Speech intonation and melodic contour recognition in children with cochlear implants and with normal hearing. Otol. Neurotol. 2013, 34, 490. [Google Scholar] [CrossRef] [Green Version]
  12. Han, D.; Liu, B.; Zhou, N.; Chen, X.; Kong, Y.; Liu, H.; Xu, L. Lexical tone perception with HiResolution and HiResolution 120 sound-processing strategies in pediatric Mandarin-speaking cochlear implant users. Ear Hear. 2009, 30, 169. [Google Scholar] [CrossRef] [Green Version]
  13. Schatzer, R.; Krenmayr, A.; Au, D.K.; Kals, M.; Zierhofer, C. Temporal fine structure in cochlear implants: Preliminary speech perception results in Cantonese-speaking implant users. Acta Oto-Laryngol. 2010, 130, 1031–1039. [Google Scholar] [CrossRef] [PubMed]
  14. Huang, W.; Wong, L.L.; Chen, F.; Liu, H.; Liang, W. Effects of Fundamental Frequency Contours on Sentence Recognition in Mandarin-Speaking Children With Cochlear Implants. J. Speech Lang. Hear. Res. 2020, 63, 3855–3864. [Google Scholar] [CrossRef] [PubMed]
  15. Peng, S.C.; Lu, H.-P.; Lu, N.; Lin, Y.S.; Deroche, M.L.; Chatterjee, M. Processing of acoustic cues in lexical-tone identification by pediatric cochlear-implant recipients. J. Speech Lang. Hear. Res. 2017, 60, 1223–1235. [Google Scholar] [CrossRef] [PubMed]
  16. Galvin, J.J., III; Fu, Q.J.; Shannon, R.V. Melodic contour identification and music perception by cochlear implant users. Ann. N. Y. Acad. Sci. 2009, 1169, 518. [Google Scholar] [CrossRef] [Green Version]
  17. Hopyan, T.; Peretz, I.; Chan, L.P.; Papsin, B.C.; Gordon, K.A. Children using cochlear implants capitalize on acoustical hearing for music perception. Front. Psychol. 2012, 3, 425. [Google Scholar] [CrossRef] [Green Version]
  18. Deroche, M.L.; Lu, H.P.; Limb, C.J.; Lin, Y.S.; Chatterjee, M. Deficits in the pitch sensitivity of cochlear-implanted children speaking English or Mandarin. Front. Neurosci. 2014, 8, 282. [Google Scholar] [CrossRef] [Green Version]
  19. Deroche, M.L.; Kulkarni, A.M.; Christensen, J.A.; Limb, C.J.; Chatterjee, M. Deficits in the sensitivity to pitch sweeps by school-aged children wearing cochlear implants. Front. Neurosci. 2016, 10, 73. [Google Scholar] [CrossRef] [Green Version]
  20. Huang, W.T.; Nan, Y.; Dong, Q.; Liu, C. Just-noticeable difference of tone pitch contour change for Mandarin congenital amusics. J. Acoust. Soc. Am. 2015, 138, EL99–EL104. [Google Scholar] [CrossRef]
  21. Mok PP, K.; Fung HS, H.; Li, V.G. Assessing the link between perception and production in Cantonese tone acquisition. J. Speech Lang. Hear. Res. 2019, 62, 1243–1257. [Google Scholar] [CrossRef]
  22. Mok, P.P.K.; Li, V.G.; Fung, H.S.H. Development of phonetic contrasts in Cantonese tone acquisition. J. Speech Lang. Hear. Res. 2020, 63, 95–108. [Google Scholar] [CrossRef]
  23. Xu Rattanasone, N.; Tang, P.; Yuen, I.; Gao, L.; Demuth, K. Five-year-olds’ acoustic realization of Mandarin tone sandhi and lexical tones in context are not yet fully adult-like. Front. Psychol. 2018, 9, 817. [Google Scholar] [CrossRef] [PubMed]
  24. Wong, P. Perceptual evidence for protracted development in monosyllabic Mandarin lexical tone production in preschool children in Taiwan. J. Acoust. Soc. Am. 2013, 133, 434–443. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Sharma, A.; Dorman, M.F.; Kral, A. The influence of a sensitive period on central auditory development in children with unilateral and bilateral cochlear implants. Hear. Res. 2005, 203, 134–143. [Google Scholar] [CrossRef] [PubMed]
  26. Sharma, A.; Dorman, M.F.; Spahr, A.J. A sensitive period for the development of the central auditory system in children with cochlear implants: Implications for age of implantation. Ear Hear. 2002, 23, 532–539. [Google Scholar] [CrossRef]
  27. Hiskey, M.S. A study of the intelligence of deaf and hearing children. Am. Ann. Deaf. 1956, 329–339. [Google Scholar]
  28. Boersma, P. Praat, a system for doing phonetics by computer. Glot. Int. 2001, 5, 341–345. [Google Scholar]
  29. Liu, Y.L. Research on the Chinese Proficiency Test; No. 504; Modern Press Co., Ltd.: Beijing, China, 1989. [Google Scholar]
  30. Liu, C. Just noticeable difference of tone pitch contour change for English-and Chinese-native listeners. J. Acoust. Soc. Am. 2013, 134, 3011–3020. [Google Scholar] [CrossRef]
  31. Wang, X.D.; Wang, M.; Chen, L. Hemispheric lateralization for early auditory processing of lexical tones: Dependence on pitch level and pitch contour. Neuropsychologia 2013, 51, 2238–2244. [Google Scholar] [CrossRef]
  32. Moore, J.K.; Linthicum, F.H., Jr. The human auditory system: A timeline of development. Int. J. Audiol. 2007, 46, 460–478. [Google Scholar] [CrossRef]
  33. Ponton, C.; Eggermont, J.J.; Khosla, D.; Kwong, B.; Don, M. Maturation of human central auditory system activity: Separating auditory evoked potentials by dipole source modeling. Clin. Neurophysiol. 2002, 113, 407–420. [Google Scholar] [CrossRef]
  34. Wei, C.G.; Cao, K.; Zeng, F.G. Mandarin tone recognition in cochlear-implant subjects. Hear. Res. 2004, 197, 87–95. [Google Scholar] [CrossRef] [PubMed]
  35. Chen, Y.; Wong, L.L.; Zhu, S.; Xi, X. A structural equation modeling approach to examining factors influencing outcomes with cochlear implant in mandarin-speaking children. PLoS ONE 2015, 10, e0136576. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Carlyon, R.P.; Van Wieringen, A.; Long, C.J.; Deeks, J.M.; Wouters, J. Temporal pitch mechanisms in acoustic and electric hearing. J. Acoust. Soc. Am. 2002, 112, 621–633. [Google Scholar] [CrossRef] [PubMed]
  37. Zeng, F.G. Temporal pitch in electric hearing. Hear. Res. 2002, 174, 101–106. [Google Scholar] [CrossRef]
  38. Vandali, A.; Sly, D.; Cowan, R.; Van Hoesel, R. Pitch and loudness matching of unmodulated and modulated stimuli in cochlear implantees. Hear. Res. 2013, 302, 32–49. [Google Scholar] [CrossRef]
  39. Xu, L.; Chen, X.; Lu, H.; Zhou, N.; Wang, S.; Liu, Q.; Han, D. Tone perception and production in pediatric cochlear implants users. Acta Otolaryngol. 2011, 131, 395–398. [Google Scholar] [CrossRef]
  40. Freni, F.; Gazia, F.; Slavutsky, V.; Perello Scherdel, E.; Nicenboim, L.; Posada, R.; Galletti, F. Cochlear implant surgery: Endomeatal approach versus posterior tympanotomy. Int. J. Environ. Res. Public Health 2020, 17, 4187. [Google Scholar] [CrossRef]
  41. Xu, Y.; Wang, Q.E. Pitch targets and their realization: Evidence from Mandarin Chinese. Speech Commun. 2001, 33, 319–337. [Google Scholar] [CrossRef]
Figure 1. Schematic representation of linear F0 contours in F0 contour (A) and F0 level (B) conditions.
Figure 1. Schematic representation of linear F0 contours in F0 contour (A) and F0 level (B) conditions.
Brainsci 12 00443 g001
Figure 2. Diagram of the experimental scene. The loudspeaker is one meter away from the child.
Figure 2. Diagram of the experimental scene. The loudspeaker is one meter away from the child.
Brainsci 12 00443 g002
Figure 3. JNDs of F0 contour change and F0 level change in the 30 children with normal hearing (upper panel) and in the 30 children with CIs (lower panel).
Figure 3. JNDs of F0 contour change and F0 level change in the 30 children with normal hearing (upper panel) and in the 30 children with CIs (lower panel).
Brainsci 12 00443 g003
Figure 4. JNDs as a function of F0 dimensions in the CI and NH groups. Error bars indicate standard errors. The level of significance is indicated with asterisks (**: p < 0.01; ***: p < 0.001).
Figure 4. JNDs as a function of F0 dimensions in the CI and NH groups. Error bars indicate standard errors. The level of significance is indicated with asterisks (**: p < 0.01; ***: p < 0.001).
Brainsci 12 00443 g004
Table 1. Demographics of children with CIs.
Table 1. Demographics of children with CIs.
No.SexAAT (Years)HAT (Years)AAI (Years)Hearing DeviceDCI
(Years)
DAVT (Years)
Left DeviceRight DeviceCI Speech Processing Strategies
1F5.751.753.58PhonakMED-ELFS42.172.17
2F5.080.423.33PhonakCochlearACE1.751.75
3M4.330.331.42PhonakABHiRes1202.912.91
4F4.830.832.92CochlearPhonakACE1.911.75
5M4.923.673.67CochlearWidexACE1.251.25
6M5.3303.17PhonakMED-ELFS42.162.16
7M3.9201.33PhonakMED-ELFS42.592.5
8F4.8302.58PhonakNurotronC-tone2.251.91
9F4.0813.33MED-ELPhonakFS40.750.75
10F4.0802.58MED-ELPhonakFS41.51.33
11F40.332.75PhonakCochlearACE1.251.25
12M4.1703MED-ELPhonakFS41.171.17
13M4.330.753.25PhonakCochlearACE1.081.08
14M3.7502ABPhonakHiRes1201.751.5
15M4.2502.25PhonakCochlearFS422
16M3.501.67PhonakMED-ELFS41.831.25
17F4.170.671.58CochlearWidexACE2.591.59
18M3.830.671.92CochlearPhonakACE1.911.91
19M402.08PhonakCochlearACE1.921.67
20M3.5800.67PhonakABHiRes1202.912.08
21M3.501.58PhonakCochlearACE1.921.92
22F3.420.672.08MED-ELPhonakFS41.341.34
23M3.501.83CochlearPhonakACE1.671.5
24M4.0802.08CochlearPhonakACE21.5
25F5.750.922.5ABNullHiRes1203.251.75
26M4.9201.67MED-ELNullFS43.251.33
27F4.3301.17NullMED-ELFS43.171.5
28F5.502.17ABNullHiRes1203.330.92
29M5.3304.17PhonakMED-ELFS41.170.83
30M3.8302.08CochlearNullACE1.531.67
AAT: age at test; HAT: hearing aid trial before implantation; AAI: age at implantation; DCI: duration. of CI use; DAVT: duration of auditory-verbal training; AB: Advanced Bionics; FS4: Fine Structure 4; ACE: Advanced Combination Encoder; HiRes 120: HiResolution 120.
Table 2. Percentage of the children with CIs exhibiting different patterns of JNDs of F0 level (JND-L) and F0 contour (JND-C) change regarding each type of speech processing strategy.
Table 2. Percentage of the children with CIs exhibiting different patterns of JNDs of F0 level (JND-L) and F0 contour (JND-C) change regarding each type of speech processing strategy.
CI Speech Processing StrategiesJND-L > JND-CJND-L = JND-CJND-L < JND-C
FS4 (n = 12)66.7%0%33.3%
ACE (n = 12)83.3%8.3%8.3%
HiRes 120 (n = 5)60%20%20%
C-tone (n = 1)100%0%0%
CI: cochlear implant; FS4: Fine Structure 4; ACE: Advanced Combination Encoder; HiRes 120: HiResolution 120.
Table 3. Summary of the ANOVA results.
Table 3. Summary of the ANOVA results.
Source of VariationdfF ValuePartial Eta2
group1102.12 ***0.64
F0 dimension121.17 ***0.27
group × F0 dimention14.54 ***0.57
Eta2: Eta squared; ***: p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Huang, W.; Wong, L.L.N.; Chen, F. Just-Noticeable Differences of Fundamental Frequency Change in Mandarin-Speaking Children with Cochlear Implants. Brain Sci. 2022, 12, 443. https://doi.org/10.3390/brainsci12040443

AMA Style

Huang W, Wong LLN, Chen F. Just-Noticeable Differences of Fundamental Frequency Change in Mandarin-Speaking Children with Cochlear Implants. Brain Sciences. 2022; 12(4):443. https://doi.org/10.3390/brainsci12040443

Chicago/Turabian Style

Huang, Wanting, Lena L. N. Wong, and Fei Chen. 2022. "Just-Noticeable Differences of Fundamental Frequency Change in Mandarin-Speaking Children with Cochlear Implants" Brain Sciences 12, no. 4: 443. https://doi.org/10.3390/brainsci12040443

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop