1.1. Introduction
Relative to adult-directed speech (ADS), infant-directed speech (IDS) has been described as exhibiting intonational and rhythmic exaggeration: higher mean fundamental frequency (F0), higher maximum F0, an expanded F0 range, greater F0 variability, shorter utterances, slower speech rate, and longer pauses across a variety of languages (
Bortfeld & Morgan, 2010;
Broesch & Bryant, 2015;
Fernald et al., 1989;
Fernald & Simon, 1984;
Kitamura et al., 2002;
Stern et al., 1983;
Uther et al., 2007, i.a.). These prosodic modifications and other characteristic phonetic properties of IDS (e.g., vowel space expansion; see
Cristia (
2013) for a review) have been hypothesized to occur because IDS is an instance of hyperspeech (
Fernald, 2000;
Lindblom, 1990) that simplifies and facilitates the infant’s task of learning language: adults use “a hyperspeech mode, in order to reduce phonetic variability and provide clearer exemplars for the inexperienced listener” (
Fernald, 2000, p. 243).
Studies testing IDS for hyperspeech characteristics relative to ADS in different phonetic domains over the last decade have found mixed results (
Cristia, 2013). They have also drawn attention to the care needed in operationalizing what “clearer”/“enhanced”/“exaggerated” speech in IDS might mean. One particular issue that has been raised—and is the focus of this paper—is the importance of considering language-specific intonational phonology and prosodic structure above the word-level. Language-specific variation in how prosody is structured above the word-level has long been a focus of research in intonational phonology, especially from the perspective of autosegmental–metrical (AM) theory taken here (
Frota & Prieto, 2015;
Jun, 2005,
2014;
Ladd, 1996;
J. B. Pierrehumbert, 1980, i.a.). AM theory, as well as other theories in prosodic phonology, assumes that speech is organized into a hierarchical structure defined over prosodic constituents (also called “phrases”, for constituents above the word-level). Constituents that are “larger” or “higher” in the hierarchy are built up from smaller ones. In the intonational analyses described in this paper, the following hierarchy of intonational constituents is assumed: intonational phrase (IP) > intermediate phrase (ip) > accentual phrase (AP). The IP is the largest constituent, while the AP is the smallest. A constituent of one category is built up of units from the immediately lower category in the hierarchy; e.g., an IP is built out of ips, which is in turn built out of APs.
AM theory conceptualizes the F0 contour as a phonetic reflex of the intonational melody: a sequence of discrete tonal elements (i.e., intonational phonological categories), drawn from a finite inventory and subject to positional (“tonotactic”) restrictions. These restrictions also depend on the phonological source of the tonal elements. Some tonal elements are prosodic boundary tones associated with different types of prosodic constituents, graphically represented with special diacritics, e.g., “%”, “-”, and “a”. These are temporally sequenced at the edges of the constituents. Other tonal elements are so-called pitch accents (marked with a “*” diacritic): these are associated with syllables or moras in a word that are specially marked in the lexicon and/or that are assigned as stressed by the phonological grammar.
The importance of considering language-specific intonational phonology and prosodic structure to understand IDS has been raised most forcefully in work on Japanese IDS vs. ADS based on the RIKEN corpus (
Igarashi et al., 2013;
Martin et al., 2016;
Mazuka et al., 2015).
Igarashi et al. (
2013) showed that while F0 range did not differ significantly between Japanese ADS and IDS when measured over entire utterances (defined as spans of speech delineated by pauses of at least 200 ms), localized F0 range expansion did occur in a particular region of Japanese intonational melodies determined by discrete, phrase-final tonal elements called Boundary Pitch Movements (BPMs), largely equivalent to the IP boundary tone in descriptions of other languages. Specifically, the F0 range was greater for each type of BPM in IDS compared to ADS.
Based on these results,
Igarashi et al. (
2013, p. 1292) suggested that “pitch-range expansions in IDS are not realized in the same way in every language, but are instead implemented within a language-specific system of intonation. When there is a desire or pressure to exaggerate the intonation, speakers seem to do so by expanding the pitch range at the location where flexibility in varying contours is most tolerated. In phonological terms, this is the location where pragmatically chosen tones are realized. In the case of Japanese, these are BPMs at the boundaries of prosodic phrases, while in the case of English, they are not only phrase accents and boundary tones at the phrasal boundaries, but pitch accents at the locations of stressed syllables.”
This paper extends and tests the idea that intonational exaggeration in IDS is restricted to the most “flexible” parts of intonational melodies in a language, where flexibility is determined by language-specific intonational phonology. We disentangle three related but distinct hypotheses about “flexibility” which are indistinguishable in Japanese, but that make different predictions in the two languages of study here: English and Bengali.
Pragmatic Restriction Hypothesis. Intonational exaggeration is restricted to tones that are pragmatically chosen. Prediction: Intonational exaggeration occurs in all parts of intonational melodies in both English and Bengali.
Phrase-finality Hypothesis. Intonational exaggeration is restricted to the IP-final region of the intonational melody, as defined in the (language-specific) intonational grammar. Prediction: Intonational exaggeration is restricted to the IP-final region of the intonational melody in both English and Bengali.
Predictability Hypothesis. Intonational exaggeration is restricted to where tonal choice is most unpredictable in the intonational melody.
Prediction: This cannot be determined before predictability in English and Bengali intonational melodies is assessed (
Section 3, using probabilistic finite automata theoretic methods).
The notion of intonational exaggeration, too, requires operationalization. We return to this after first introducing the three hypotheses in more detail.
The Pragmatic Restriction Hypothesis arises from
Igarashi et al. (
2013)’s point that tonal choice at BPMs in Tokyo Japanese is determined by pragmatics and thus a locus of flexibility. For example, BPM tonal choice can indicate questioning, emphasis, or continuation. In contrast, tonal choice in other parts of the intonational melody is largely fixed by the lexicon since words in Tokyo Japanese are lexically specified as being accented or unaccented, and accents in this language are marked by just one kind of tonal melody. In both Bengali and English, pragmatic factors influence tonal choice for all parts of an intonational melody. This includes not only IP-final boundary tones, but also pitch accents and boundary tones in non-final positions (
Section 1.2).
The Phrase-finality Hypothesis arises from the observation that BPMs in Tokyo Japanese are not only pragmatically determined but also positionally special in being phrase-final. In fact, BPMs typically mark the end of the largest kind of prosodic constituent defined in the intonational analysis of Tokyo Japanese followed in
Igarashi et al. (
2013): the intonational phrase (IP) (
Maekawa et al., 2002;
Venditti et al., 2008).
1 IP-final position has been identified as being a locus of perceptual salience for speech melodies; e.g., fundamental frequency peaks in IP-final position are perceived as higher in pitch than earlier peaks with the same f0 (
Gussenhoven & Rietveld, 1988). Across many languages, IP-final position has also been identified as the site of rich inventories of tonally signaled pragmatic distinctions, i.e., in so-called nuclear contours, where “nuclear” refers to IP-final position (
Frota et al., 2007;
Frota & Prieto, 2015;
Gussenhoven, 2004;
Jun, 2005,
2014;
J. Pierrehumbert & Hirschberg, 1990).
BPMs are not only pragmatically chosen, as well as phrase-final, but also the point in an intonational melody in Tokyo Japanese where speakers have the greatest number of tonal choices available. The Predictability Hypothesis isolates this aspect of “flexibility” noted by
Igarashi et al. (
2013)—the number of tonal choices available at a given point in the melody—but generalizes to a more elaborate definition of predictability (
Section 3). Separating out tonal choice (Predictability Hypothesis) from the grammatical source of a tone (Pragmatic Restriction Hypothesis) is important because languages can have a large inventory of tonal choices available, not just due to pragmatics, e.g., due to a rich inventory of lexical and/or grammatical tones, or associated with other communicative functions that some researchers might not classify as pragmatics.
To build intuition for the Predictability Hypothesis, let us first consider
Igarashi et al. (
2013)’s simpler “flexibility” definition. Taking “flexibility” as our measure of predictability, the Predictability Hypothesis says that intonational exaggeration is restricted to the most “flexible” region of an intonational melody, i.e., the part where the speaker has the most tonal choices. What do we mean by a region or part of the melody? This can be formalized with a finite state automaton (FSA) diagram as a representation of the intonational grammar for a language. By the language-specific “intonational grammar”, we mean a finite device that generates exactly and only the licit intonational melodies in the language (
J. B. Pierrehumbert, 1980). Choice points in the intonational melody are represented as “states”. Finite state automata and related formalisms have been used to characterize well-formed tonal sequences in intonational grammars, from the early days (
J. B. Pierrehumbert, 1980, p. 29) to more recent work (
Dainora, 2001,
2002,
2006;
Gussenhoven, 2004, pp. 273, 313,
2016, p. 29;
Igarashi et al., 2013).
Figure 1 represents a very simplified fragment of the intonational grammar of Bangladeshi Standard Bengali (
Khan, 2008,
2014)—henceforth simply “Bengali”, also known as “Bangla”—as an FSA for expository purposes. The full intonational grammar of Bengali, including its inventory of tones like “L*”, “HLH%”, etc., is explained in detail in
Section 1.2.2. For now, what is important is simply the topology of the FSA in
Figure 1: its states (drawn as circles) and the directed arcs representing possible transitions between them. The set of licit intonational melodies over an IP based on the intonational grammar represented in
Figure 1 is the set of tonal sequences that can be generated on a path from the start state “0” (thickly outlined) to the final “IP” state (doubly outlined). For example, “L* L%” is generated on the path from State “0” to State “ip” to State “IP”. Each transition arc from one state to another represents a tonal choice the speaker can make in generating a melody. For example, at State “ip”, the speaker has seven choices. They can choose to end the intonational melody by choosing one of five different IP boundary tones (L%, H%, LH%, HL%, or HLH%) or to continue the intonational melody by choosing one of two ip boundary tones (L-, H-). But at State “AP”, there is only one choice: “Ha”. The greatest flexibility in the intonational grammar is at State “ip”.
2 Thus, under the “flexibility” definition of predictability, the Predictability Hypothesis says State “ip”—the choice point for ip/IP boundary tones—is where intonational exaggeration in IDS is expected to occur according to the intonational grammar defined in
Figure 1.
Having introduced the three hypotheses about the scope of intonational exaggeration in a melody, we turn to the operationalization of intonational exaggeration itself.
Igarashi et al. (
2013, p. 1292)’s quote about “flexibility” from above refers to intonational exaggeration specifically as pitch range (or F0) expansion. How to operationalize F0 range expansion via phonetic measures is itself an issue (
Section 6), but from the perspective of intonational phonology, intonation has other acoustic reflexes besides variation in F0. The tonal choices in an intonational melody that cause F0 variation are also simultaneously choices about prosodic structure: how to phrase speech into intonational constituents. These phrasing choices are also reflected in durational patterns—most importantly, for this paper, pre-boundary lengthening concentrated at the right edge of intonational constituents. The degree of pre-boundary lengthening increases for constituents higher and higher in the hierarchy: pre-boundary lengthening is greatest at the right edge of IPs (
Byrd, 2000;
Byrd & Saltzman, 1998;
Cambier-Langeveld, 2000;
Gussenhoven & Rietveld, 1992;
Khan, 2008;
Klatt, 1975;
Krivokapić, 2014;
Wightman et al., 1992).
An example from our recorded speech corpus of how tonal and phrasing choices go hand-in-hand and can shift together as a function of speech style is given in
Figure 2 and
Figure 3.
Figure 2 shows F0 contours, waveforms, spectrograms, and intonational transcriptions for the first several words in two renditions of the fable
The North Wind and the Sun (
Khan, 2010) produced by the same speaker first in (a) read speech and then in (b) simulated infant-directed speech. The intonational melody/melodies chosen by the speaker for each rendition can be read off as the sequence of leaves of the trees in
Figure 3.
Figure 3 also shows how the choice of tones implies the choice of phrasing. The choice of an AP boundary tone at the right edge of [ɛk d ̪ in] in
Figure 2a and
Figure 3a is also the choice to phrase [ɛk d ̪ in] as the smallest intonational constituent, an AP. The choice of an IP boundary tone at the right edge of [ɛk d ̪ in] in
Figure 2b and
Figure 3b is also the choice to phrase [ɛk d ̪ in] as the largest intonational constituent, an IP. F0 range expansion, as well as pre-boundary lengthening in the IP [ɛk d ̪ in], is also visible in
Figure 2b, relative to the AP [ɛk d ̪ in] in
Figure 2a.
In this paper, we examine intonational exaggeration in IDS via lengthening as well as F0 range expansion. We probe the claim that, cross-linguistically, speech rate is slower in IDS (
Fernald et al., 1989, i.a.). It is not only the case that F0 range expansion in IDS is restricted to IP-final BPMs in the Japanese RIKEN corpus (
Igarashi et al., 2013): lengthening is also restricted to IP-final and other phrase-final positions.
Martin et al. (
2016) showed that an ostensibly globally lower average speech rate in IDS in the same corpus was in fact purely a consequence of the pre-boundary lengthening of phrase-final words. That is, the duration increase was solely attributable to the categorical, phonological differences in speakers’ choices in chunking speech into prosodic constituents. This is an instance of
intonational exaggeration that is the consequence of phonological choices. First, moras that were AP-, IP-, or utterance-final were all significantly longer than AP-medial moras. Second, the likelihood of a word to be phrase-final was higher in IDS; i.e., speakers chose to phrase words in IDS into shorter and larger intonational constituents. There were thus more words subject to the largest degrees of pre-boundary lengthening. Put another way, from a statistical point of view, slowing down in IDS was a consequence of two main effects: (i) a main effect of speech style on the number of utterances, IPs, and APs (an increased number of these chunks, and thus phrase-final positions in these chunks, in IDS) and (ii) a main effect of phrase-finality on mora duration (increased duration in phrase-final positions).
However, the increase in average mora duration in phrase-final words was not larger in IDS relative to ADS. More specifically, the degree of pre-boundary lengthening within a particular prosodic category, i.e., an AP, IP, or utterance, was not significantly different between IDS and ADS. That is, the interaction between speech style and prosodic category was not significant in modeling mora duration. Another way to characterize this negative result in more general terms is the following:
Martin et al. (
2016) found no evidence of
intonational exaggeration that is the consequence of a within-category change in the phonetic implementation of a particular phonological choice.
But an example of precisely this kind of within-category intonational exaggeration is
Igarashi et al. (
2013)’s finding of F0 range expansion in IDS within a particular BPM type; see Table I in
Igarashi et al. (
2013).
Igarashi et al. (
2013) also present evidence consistent with F0 range expansion that is the consequence of phonological choices. First, F0 range is significantly increased in IDS vs. ADS in BPMs (but seemingly
3 not in non-BPM regions). Second,
Martin et al. (
2016)’s results on the same corpus imply that speakers chose to increase the number of BPMs in IDS (since they increased the number of IPs, and a BPM occurs at the end of each IP). Therefore, choosing to increase the number of BPM sites in IDS increased the number of F0 range expansion sites.
Conceptualizing intonational exaggeration as arising from potentially distinct sources—(i) phonological choices vs. (ii) within-category changes in phonetic implementation—is only possible when data is phonologically transcribed. Both kinds of intonational exaggeration are conditioned on intonational phonological categories. There has been a growing body of work on how the prosodic profile of a language (i.e., if the language has lexical tonal contrasts, lexical accents, or stress) might affect phonetic manipulations in IDS (
Wang et al., 2016). But to our knowledge,
Igarashi et al. (
2013) and
Martin et al. (
2016)’s studies of the Japanese RIKEN corpus are the only analyses of F0 variation and duration in IDS that are informed in detail by intonational phonology in the literature. Even for English,
4 to our knowledge, any work on IDS referring to intonational phonology is scant.
Thorson and Morgan (
2014b) and
Thorson et al. (
2023) considered pitch accent categories, H* and L+H* (see
Section 1.2.1), that have been proposed in American English. They showed that 18-month-olds had longer looking times for referents when words were uttered with F0 contours that were H*-like (F0 peak) and L+H*-like (F0 peak with a clear preceding valley), relative to those uttered with flat, low F0. Besides this work, work on English IDS that has considered intonational categories has defined those categories in terms of F0 contour shapes (e.g., bell shapes, sinusoidal shapes, hills, valleys, and waves). This work has also focused on highlighting words for word learning and the expression of socioaffective intent and emotional categories like surprise, anger, comfort, prohibition, and bids for attention (
Fernald, 1989;
Fernald & Kuhl, 1987;
Fernald & Mazzie, 1991;
Katz et al., 1996;
Nencheva et al., 2021;
Papoušek et al., 1990;
Stern et al., 1982,
1983;
Trainor et al., 2000;
Werker & McLeod, 1989).
Systematic properties of F0 contours can certainly correlate with socioaffective intent and emotions, even perhaps universally across languages, e.g.,
Gussenhoven (
2002). However, reducing the role of intonation in IDS to the utility of particular F0 movement shapes for word learning and communicating socioaffective intent misses two important issues. First, phonological structure above the word-level—including language-specific intonational grammar—is itself a target of language acquisition. Second, the phonological prosodic choices available to a speaker constrain possible F0 movements. Those choices depend on a language’s intonational grammar, so cross-linguistic work that samples different kinds of intonational grammars is necessary to understand F0 and other prosodic manipulations in IDS.
In this paper, we highlight intonational exaggeration that is the consequence of phonological choices, which yielded the clearest results in our study. For this type of intonational exaggeration,
Table 1 summarizes expected predictions for each of the three hypotheses. (We also discuss intonational exaggeration that is the consequence of within-category changes in phonetic implementation in
Section 7). Each prediction is divided into two types of effects: (i) the effect of speech style on phonological category choice and (ii) the effect of phonological category choice on phonetic implementation that is independent of speech style. The Phrase-finality and Predictability Hypotheses demand that both types of effects are present. In
Table 1, we also further operationalize “region” in “IP-final region” for the Phrase-finality Hypothesis in terms of the smallest intonational constituent in the grammar: the atomic intonational chunk. For Bengali, this is the AP; for English, it is of a larger size: the intermediate phrase (ip, see
Section 1.2.1). Choosing the atomic chunk to be IP-final in either language implies choosing an IP-boundary tone as opposed to a pitch accent or boundary tone associated with a non-final, smaller constituent.
The Pragmatic Restriction Hypothesis, at least for Bengali and English, predicts the lack of specificity in the locus of intonational exaggeration across the IP, rather than singling out a particular part of the intonational melody. It thus does not have the same kind of two-part prediction as the other hypotheses. Rather, a preference of the speaker between IP-final and non-final regions in IDS, i.e., an interaction between Style (the factor indexing speech style in our experimental design) and IP-finality in phonological category choice, is one way to be inconsistent with the hypothesis. Another way would be to have an interaction between Style and IP-finality in the phonetic implementation of intonational exaggeration.
Since the Phrase-finality Hypothesis predicts an increased likelihood of atomic chunks to be IP-final in IDS relative to non-IDS, while the Pragmatic Restriction Hypothesis predicts no such increase, their phonological category choice predictions are mutually exclusive. Whether the main effects predicted by the Phrase-finality Hypothesis and those by the Predictability Hypothesis are mutually exclusive depends on what the most unpredictable region of the intonational melody is. For example, to preview
Section 3, it turns out that the most unpredictable region of the melody in Bengali is in IP-final APs. Thus, the Predictability Hypothesis for Bengali is in fact identical to the Phrase-finality Hypothesis. On the other hand, suppose that the most unpredictable region of the melody in Bengali had been instead non-final APs. In that case, the Phrase-finality and Predictability Hypotheses would have been mutually exclusive for Bengali. To preview our results, the only hypothesis supported across both languages is the Phrase-finality Hypothesis.
Besides the general empirical goal of expanding cross-linguistic coverage of work approaching IDS using perspectives from intonational phonology, the methodological goals of this paper are to provide proof-of-concept demonstrations of (i) how to approach phonological characterizations of intonational melodies in IDS using computational tools and (ii) how to extend characterizations of IDS in terms of acoustic measures of F0 to large corpora of naturalistic, long-form recordings. Overall, we seek to encourage infant speech researchers who are less familiar with intonational phonology to incorporate the concepts and structure of this approach in future work on IDS. Taking IDS as a case study of a context where intonational exaggeration occurs, the concepts and methods we introduce in this paper are also more generally applicable beyond IDS.
The rest of this introductory section concludes with a background sketch of the most relevant aspects of the intonational phonology of English and Bengali for the paper (
Section 1.2). We follow with a general methods section in
Section 2 that describes the construction and data processing of our corpus, as well as common choices across statistical analyses. Methodological details specific to a particular analysis are provided within the relevant section.
Section 3 explicates our definition of predictability in an intonational melody and determines where the most unpredictable choice points in the melodies are in English and Bengali, based on data from our corpus.
Section 4 analyzes the effect of speech style on phrasing choices. The next two sections evaluate the three hypotheses about the scope of intonational exaggeration, with intonational exaggeration operationalized in terms of lengthening (
Section 5) and F0 range expansion (
Section 6).
Section 7 provides a general discussion and conclusion.