Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French
Abstract
1. Introduction
1.1. The Multichanneled, Semiotic Nature of Our Face-to-Face Conversations
1.2. Comparative Work on SpL and SL Research
1.3. The Case of PU
Mary: | …NOT UNDERSTAND WELL? | <— |
[…You don’t understand?] | ||
Lisa: | [no response] | |
Mary: | (lowers hands, palmsa) [PU] | <— |
Lisa: | (begins response) |
1.4. Current Study: Aims and Research Questions
2. Materials and Methods
2.1. Dataset Description
2.1.1. The LSFB—Belgian French Datasets
2.1.2. The ASL—American English Datasets
2.2. Data Annotation and Coding
2.2.1. Identification of PU Forms
2.2.2. Identification of PU Functions
3. Results
3.1. General Overview of PU in the Four Languages
3.2. The Interactive World of PU Across Language Ecologies
4. Discussion
solves a particular problem for speakers, which is to include their addressee in the dialogue and let him or her know where things stand—without having to stop and do this verbally. If a speaker kept checking in verbally (e.g., “Here’s something new to you,” “As you just said,” “This is important,” “You fill in the rest,” “Are you following me?”), it would constantly interrupt the flow of topical information.(p. 117)
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
SpL | Spoken Language |
SL | Signed Language |
ASL | American Sign Language |
LSFB | Belgian French Sign Language |
AmEng | American English |
BF | Belgian French |
PU | Palm-up |
VGT | Flemish Sign Language |
Appendix A
Interactive Function | Definition | Paraphrases | References | |
Interactive Functions | Backchannelling [AGR] | It expresses understanding or indicates approval of what has previously been said. It is used to show agreement/following (the role of feedback in interaction). | ‘I agree’, ‘indeed’, ‘okay’, ‘I understand’; “yeah” | Ferrara (2020) |
Common Ground [COGR] | It expresses the participant’s understanding that the information being conveyed is shared by the addressee. It includes Bavelas’ “shared information” gestures, which mark information that the addressee probably already knows. It also includes “general citing” gestures revealing that the point the speaker is now making had been contributed earlier by the addressee. Pointing actions serving this function can also be used “by an addressee “to respond to another signer ‘right, as was just mentioned (earlier)’” (Ferrara, 2020, p. 8). | “as you know” or “as you/I said earlier” | Holler and Bavelas (2017) | |
Delivery [DELIV] | It consists of the presentation of a topic as new or salient to the addressee. For instance, the palm presentation PU with the giving/offering function of an idea, a concept, … | “Here’s my point” | Bavelas et al. (1992, 1995), Kendon (2004), Müller (2004) | |
Digression [DIG] | It marks information that should be treated by the addressee as an aside from the main point, as part of a parenthesis. | “by the way”, “back to the main point” | Bavelas et al. (1992, 1995) | |
Elliptical [ELL] | It marks information that the addressee should imagine for himself/herself; the speaker will not provide further details. | “And things like that”, “or whatever” | Bavelas et al. (1992, 1995) | |
Monitoring [MONI] | It expresses cooperation or checks the addressee’s reaction for understanding and attention by an explicit address. It includes Bavelas’: (1) “acknowledgement” of the addressee’s response (viz., the speaker saw or heard that the addressee understood what had been said; (2) “seeking agreement” asks whether the addressee agrees/disagrees with the point made; and (3) “seeking following” asks whether the addressee understands what is said. | “I see that you understood me”, “do you agree?”, “you know?”, “eh?” | Bavelas et al. (1992, 1995) | |
Planning [PLAN] | It indicates that the participant is making a cognitive effort in editing a term or in the processing of speech (e.g., hesitation, word searching, and pause fillers). Planning can be interactively designed as the participant can request help from the addressee during word search activities (corresponding to seeking help gestures, Bavelas et al., 1992, 1995) | “euh” | Goodwin (1986) | |
Turn Opening [TURN-OPEN] | The item opens a new turn, in which case it indicates floor-taking, or a new sequence within the same topic, namely an introduction to an enumeration or a narrative sequence. | “Well, …”, “So, …”, “First, … | Bavelas et al. (1992, 1995) | |
Turn Giving [TURN-GIVE] | Turn yielding includes Bavelas’ “giving turn” and “leaving turn open”. It is used to hand over the turn. | “your turn” | Bavelas et al. (1992, 1995) | |
Turn Closing [TURN-CLOSE] | It indicates the intention to close a list, a thematic unit, or a turn. It must be in final or autonomous position. | “This topic is now closed” | Bavelas et al. (1992, 1995) |
References
- Baker, C. (1977). Regulators and turn-taking in American Sign Language discourse. In L. A. Friedman (Ed.), On the other hand (pp. 215–236). Academic Press. [Google Scholar]
- Bavelas, J. B. (2022). Face-to-face dialogue: Theory, research, and applications. Oxford University Press. [Google Scholar]
- Bavelas, J. B., Chovil, N., Coates, L., & Roe, L. (1995). Gestures specialized for dialogue. Personality and Social Psychology Bulletin, 21, 394–405. [Google Scholar] [CrossRef]
- Bavelas, J. B., Chovil, N., Lawrie, D., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15, 469–489. [Google Scholar] [CrossRef]
- Bavelas, J. B., Gerwing, J., Sutton, C., & Prevost, D. (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58, 495–520. [Google Scholar] [CrossRef]
- Beukeleers, I., & Lepeut, A. (2022). Who’s got the upper hand? A cross-linguistic study on overlap in VGT and LSFB. In A. Lepeut, & I. Beukeleers (Eds.), On the semiotic diversity of language: The case of signed languages (pp. 212–246). John Benjamins. [Google Scholar]
- Bolly, C. T., & Crible, L. (2015, July 26–31). From context to functions and back again: Disambiguating pragmatic uses of discourse markers [Conference paper]. 14th International Pragmatics Conference (IPra): Anchoring Utterances in Co(n)text, Argumentation, Common Ground, Antwerp, Belgium. [Google Scholar]
- Borkovec, M., & Madin, N. (2025). ggparty: ‘ggplot’ visualizations for the ‘partykit’ package_. R package version 1.0.0.1. Available online: https://CRAN.R-project.org/package=ggparty (accessed on 3 September 2024).
- Chu, M., Meyer, A., Foulkes, L., & Kita, S. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General, 143(2), 694–709. [Google Scholar] [CrossRef] [PubMed]
- Cienki, A. (2021). From the finger lift to the palm-up open hand when presenting a point: A methodological exploration of forms and functions. Languages and Modalities, 1, 17–30. [Google Scholar] [CrossRef]
- Cienki, A. (2023). Channels, modalities, and semiotic modes and systems: Multi- and poly. In T. I. Davidjuk, I. I. Isaev, J. V. Mazurova, S. G. Tatevosov, & O. V. Fedorova (Eds.), Язык кaк oн ecть: Cбopник cтaтeй к 60-лeтию Aндpeя Aлeкcaндpoвичa Kибpикa (pp. 288–292). Buki Vedi. [Google Scholar] [CrossRef]
- Clark, H. H. (1996). Using language. Cambridge University Press. [Google Scholar]
- Coates, J., & Sutton-Spence, R. (2001). Turn-taking patterns in deaf conversation. Journal of Sociolinguistics, 5, 507–529. [Google Scholar] [CrossRef]
- Cooperrider, K., Abner, N., & Goldin-Meadow, S. (2018). The palm-up puzzle: Meanings and origins of a widespread form in gesture and sign. Frontiers in Communication, 3, 23. [Google Scholar] [CrossRef]
- Deaf Stories Collection. (2017). Home [Kaltura channel]. Available online: https://media.gallaudet.edu/channel/DSC+-+Deaf+Stories+Corpus/121808791 (accessed on 3 September 2024).
- Debras, C., & Cienki, A. (2012, September 3–5). Some uses of head tilts and shoulder shrugs during human interaction, and their relation to stancetaking [Conference paper]. 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Conference on Social Computing, Amsterdam, The Netherlands. [Google Scholar] [CrossRef]
- de Vos, C., Torreira, F., & Levinson, S. C. (2015). Turn-timing in signed conversations: Coordinating stroke-to-stroke boundaries. Frontiers in Psychology, 6, 268. [Google Scholar] [CrossRef] [PubMed]
- Dingemanse, M., Roberts, S. G., Baranova, J., Blythe, J., Drew, P., Floyd, S., Gisladottir, R. S., Kendrick, K. H., Levinson, S. C., Manrique, E., Rossi, G., & Enfield, N. J. (2015). Universal principles in the repair of communication problems. PLoS ONE, 10(9), e0136100. [Google Scholar] [CrossRef] [PubMed]
- Dively, V. L. (1998). Conversational repairs in ASL. In C. Lucas (Ed.), Pinky extension and eye gaze: Language use in deaf communities (pp. 137–169). Gallaudet University Press. [Google Scholar]
- Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 49–98. [Google Scholar] [CrossRef]
- Emmorey, K. (1999). Do signers gesture? In L. Messing, & R. Campbell (Eds.), Gesture, speech, and sign (pp. 133–159). Oxford University Press. [Google Scholar]
- Fenlon, J., & Hochgesang, J. A. (2022). Signed language corpora. Gallaudet University Press. [Google Scholar]
- Ferrara, L. (2020). Some interactional functions of finger pointing in signed language conversations. Glossa: Journal of General Linguistics, 5(1), 1–26. [Google Scholar] [CrossRef]
- Gabarró-López, S. (2020). Are discourse markers related to age and educational background? A comparative account between two sign languages. Journal of Pragmatics, 156, 68–82. [Google Scholar] [CrossRef]
- Gabarró-López, S., & Meurant, L. (2022). Contrasting signed and spoken languages: Towards a renewed perspective on language. Languages in Contrast, 22(2), 169–194. [Google Scholar] [CrossRef]
- Girard-Groeber, S. (2015). The management of turn transition in signed interaction through the lens of overlaps. Frontiers in Psychology, 6, 741. [Google Scholar] [CrossRef]
- Goodwin, C. (1986). Gestures as a resource for the organization of mutual orientation. Semiotica, 62(1–2), 29–49. [Google Scholar] [CrossRef]
- Groeber, S., & Pochon-Berger, E. (2014). Turns and turn-taking in sign language interaction: A study of turn-final holds. Journal of Pragmatics, 65, 121–36. [Google Scholar] [CrossRef]
- Haviland, J. B. (2015). Hey! Topics in Cognitive Science, 7(1), 124–149. [Google Scholar] [CrossRef] [PubMed]
- Hochgesang, J. A. (2020). Collections of ASL for research and documentation (CARD). Figshare. [Google Scholar] [CrossRef]
- Hochgesang, J. A., Crasborn, O., & Lillo-Martin, D. (2025). ASL signbank. Available online: https://aslsignbank.com (accessed on 3 September 2024).
- Hodge, G., Sekine, K., Schembri, A., & Johnston, T. (2019). Comparing signers and speakers: Building a directly comparable corpus of Auslan and Australian English. Corpora, 14, 63–76. [Google Scholar] [CrossRef]
- Holler, J., & Bavelas, J. (2017). Multi-modal communication of common ground: A review of social functions. In R. B. Church, M. W. Alibali, & S. D. Kelly (Eds.), Why gesture? How the hands function in speaking, thinking and communicating (pp. 213–240). Benjamins. [Google Scholar]
- Hothorn, T., & Zeileis, A. (2015). partykit: A modular toolkit for recursive partytioning in R. Journal of Machine Learning Research, 16, 3905–3909. Available online: https://jmlr.org/papers/v16/hothorn15a.html (accessed on 3 September 2024).
- Hoza, J. (2011). The discourse and politeness functions of HEY and WELL in American Sign Language. In C. B. Roy (Ed.), Discourse in signed languages (pp. 69–95). Gallaudet University Press. [Google Scholar] [CrossRef]
- Jokinen, K. (2010, May 19–21). Non-verbal signals for turn-taking and feedback. Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta. [Google Scholar]
- Kendon, A. (2004). Gesture: Visible actions as utterances. Cambridge University Press. [Google Scholar]
- Kendon, A. (2008). Some Reflections on the relationship between ‘gesture’ and ‘sign’. Gesture, 8, 348–366. [Google Scholar] [CrossRef]
- Kita, S., van Gijn, I., & van der Hulst, H. (1998). Movement phases in signs and co-speech gestures, and their transcription by human coders. In I. Wachsmuth, & M. Fröhlich (Eds.), Gesture and sign language in human-computer interaction (Vol. 1371). GW 1997. Lecture Notes in Computer Science. Springer. [Google Scholar] [CrossRef]
- Klima, E. S., & Bellugi, U. (1979). The signs of language. Harvard University Press. [Google Scholar]
- Kusters, A. (2017). Gesture-based customer interactions: Deaf and hearing Mumbaikars’ multimodal and metrolingual practices. International Journal of Multilingualism, 14(3), 283–302. [Google Scholar] [CrossRef]
- Ladewig, S. H. (2011). Putting the cyclic gesture on a cognitive basis. CogniTextes, 6. [Google Scholar] [CrossRef]
- Lepeut, A. (2020). Framing language through gesture: Palm-up, index finger-extended gestures, and holds in spoken and signed interactions in French-speaking and signing Belgium [Ph.D. dissertation, University of Namur]. [Google Scholar]
- Lepeut, A., Lombart, C., Vandenitte, S., & Meurant, L. (2024). Spoken and signed languages hand in hand: Parallel and directly comparable corpora of French Belgian Sign Language (LSFB) and French. Corpora, 19(2), 241–253. [Google Scholar] [CrossRef]
- Lepeut, A., Lombart, C., Vandenitte, S., & Meurant, L. (2025). Make it a double: The building and use of the LSFB and FRAPé corpora to study and compare French Belgian Sign Language and Belgian French. In T. Leuschner, A. Vajnovszki, G. Delaby, & J. Barðdal (Eds.), How to do things with corpora. Linguistik in Empirie und Theorie/Empirical and Theoretical Linguistics. J.B. Metzler. [Google Scholar] [CrossRef]
- Lepeut, A., & Shaw, E. (2022). Time is ripe to make interactional moves: Bringing evidence from four languages across modalities. Frontiers in Communication, 7, 780124. [Google Scholar] [CrossRef]
- Lepeut, A., & Shaw, E. (2024a). When the mess is the message: Simultaneous signing in an ASL multiparty interaction. Sign Language Studies, 24(3), 722–763. [Google Scholar] [CrossRef]
- Lepeut, A., & Shaw, E. (2024b). Where language lives and breathes: A special issue featuring signed language interaction. Sign Language Studies, 24(3), 493–512. [Google Scholar] [CrossRef]
- Levshina, N. (2021). Conditional inference trees and random forests. In M. Paquot, & T. Gries (Eds.), Practical handbook of corpus linguistics (pp. 611–643). Springer. [Google Scholar]
- Liddell, S. (2003). Grammar, gesture, and meaning in American Sign Language. Cambridge University Press. [Google Scholar]
- Lopez-Ozieblo, R. (2020). Proposing a revised functional classification of pragmatic gestures. Lingua, 247, 102870. [Google Scholar] [CrossRef]
- Lutzenberger, H., Wael, L., Omardeen, R., & Dingemanse, M. (2024). Interactional infrastructure across modalities: A comparison of repair initiators and continuers in British Sign Language and British English. Sign Language Studies, 24(3), 548–581. [Google Scholar] [CrossRef]
- Manrique, E. (2016). Other-initiated repair in Argentine Sign Language. Open Linguistics, 2(1), 1–34. [Google Scholar] [CrossRef]
- Maricchiolo, F., De Dominicis, S., Cancellieri, G. U., Di Conza, A., Gnisci, A., & Bonaiuto, M. (2014). Co-speech gestures: Structures and functions. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body–language–communication (Vol. II, pp. 1461–1473). Mouton De Gruyter. [Google Scholar]
- McClave, E. M. (1994). Gestural beats: The rhythm hypothesis. Journal of Psycholinguistic Research, 23(1), 45–66. [Google Scholar] [CrossRef]
- McCleary, L. E., & Leite, T. d. A. (2013). Turn-taking in Brazilian Sign Language: Evidence from overlap. Journal of Interactional Research in Communication Disorders, 4(1), 123–154. [Google Scholar] [CrossRef]
- McIlvenny, P. (1995). Seeing conversations: Analysing sign language talk. In P. ten Have, & G. Psathas (Eds.), Situated order: Studies in the social organisation of talk and embodied activities (pp. 129–150). University Press of America. [Google Scholar]
- McKee, R. L., & Wallingford, S. (2011). ‘So, well, whatever’: Discourse functions of palm-up in New Zealand Sign Language. Sign Language & Linguistics, 14(2), 213–247. [Google Scholar] [CrossRef]
- McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press. [Google Scholar]
- Meurant, L. (2015). Corpus LSFB. First digital open access corpus of movies and annotations of French Belgian Sign Language (LSFB). LSFB-Lab, University of Namur. Available online: http://www.corpus-lsfb.be (accessed on 3 September 2024).
- Mondada, L. (2007). Multimodal resources for turn-taking: Pointing and the emergence of possible next speakers. Discourse Studies, 9(2), 194–225. [Google Scholar] [CrossRef]
- Müller, C. (2004). Forms of the uses of the palm up open hand: A case of a gesture family? In C. Müller, & R. Posner (Eds.), The semantics and pragmatics of everyday gestures (pp. 233–256). Weidler. [Google Scholar]
- Müller, C. (2018). Gesture and sign: Cataclysmic break or dynamic relations? Frontiers in Psychology, 9, 1651. [Google Scholar] [CrossRef]
- Parisot, A. M., Pilarski, A., Richer-Lemay, L., Rinfret, J., & Voghel, A. (2008, May 5–9). Description de la variation du marquage spatial en langue des signes québécoise (LSQ) [Description of the variation of spatial marking in Quebec Sign Language] [Paper presentation]. 76ème Congrès de l’Association francophone pour le savoir, Quèbec, QC, Canada. [Google Scholar]
- R Core Team. (2024). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Available online: https://www.R-project.org/ (accessed on 3 September 2024).
- Schegloff, E. A. (1996). Turn organization: One intersection of grammar and interaction. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and grammar (pp. 52–133). Cambridge University Press. [Google Scholar]
- Shaw, E. (2019). Gesture in multiparty interaction. Gallaudet University Press. [Google Scholar]
- Shaw, E., & Delaporte, Y. (2015). A historical and etymological dictionary of American Sign Language. Gallaudet University Press. [Google Scholar]
- Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., Hoymann, G., Rossano, F., De Ruiter, J. P., Yoon, K. E., & Levinson, S. C. (2009). Universals and cultural variation in turn-taking in conversation. Proceedings of the National Academy of Sciences of the United States of America, 106(26), 10587–10592. [Google Scholar] [CrossRef]
- Stokoe, W., Casterline, D., & Croneberg, C. (1965). The dictionary of American Sign Language on linguistic principles. Gallaudet College Press. Revised 1978. Linstok Press. [Google Scholar]
- Teßendorf, S. (2014). Pragmatic and metaphoric—Combining functional with cognitive approaches in the analysis of the “brushing aside gesture”. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body–language–communication (Vol. II, pp. 1540–1558). De Gruyter Mouton. [Google Scholar] [CrossRef]
- van Loon, E. (2012). What’s in the palm of your hand? Discourse functions of palm-up in Sign Language of the Netherlands [Master’s thesis, University of Amsterdam]. [Google Scholar]
- Wilbur, R. B., & Petitto, L. A. (1983). Discourse structure in American Sign Language conversations (or, how to know a conversation when you see one). Discourse Processes, 6(3), 225–228. [Google Scholar] [CrossRef]
- Wilcox, S. (2009). Symbol and symptom: Routes from gesture to signed language. Annual Review of Cognitive Linguistics, 7, 89–110. [Google Scholar] [CrossRef]
- Wilkin, K., & Holler, J. (2011). Speakers’ use of ‘action’ and ‘entity’ gestures with definite and indefinite references. In G. Stam, & M. Ishino (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 293–308). Benjamins. [Google Scholar]
Interactive Function | Description |
---|---|
Turn-regulating | Opening, giving, closing one’s turn, including backchannelling (i.e., giving feedback) |
Monitoring | Seeking attention, understanding from addressees |
Delivery | Delivery of new and/or relevant information to the addressee |
Common Ground | Delivery of shared information known to the addressee |
Planning | Planning upcoming discourse (e.g., as a pause filling marker) while also keeping the floor |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Lepeut, A.; Shaw, E. Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French. Languages 2025, 10, 239. https://doi.org/10.3390/languages10090239
Lepeut A, Shaw E. Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French. Languages. 2025; 10(9):239. https://doi.org/10.3390/languages10090239
Chicago/Turabian StyleLepeut, Alysson, and Emily Shaw. 2025. "Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French" Languages 10, no. 9: 239. https://doi.org/10.3390/languages10090239
APA StyleLepeut, A., & Shaw, E. (2025). Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French. Languages, 10(9), 239. https://doi.org/10.3390/languages10090239