Perception and Monitoring of Sign Language Acquisition for Avatar Technologies: A Rapid Focused Review (2020–2025)
Abstract
1. Introduction
- Acquisition and AoA Sensitivity: Research consistently shows that individuals exposed to sign language later in life face lasting challenges in syntactic processing, classifier use, and real-time sign comprehension. These effects are especially pronounced when avatars lack contextual cues or display abrupt motion patterns [6].
- Perceptual Design and Realism: Recent work shows that intrinsic avatar properties, such as movement fluidity, facial expressions, and naturalness, all directly affect user comprehension and trust. Particularly, high-fidelity motion capture avatars are rated more favorably by early-exposed users [6,7,8].
- Monitoring and Feedback Integration: New research emphasizes user-in-the-loop design using eye-tracking, rating scales, and iterative feedback loops to improve signing avatars. These approaches help identify comprehension bottlenecks and perceptual gaps, especially across a diverse signing population [9].
2. Related Works
3. Materials and Methods
3.1. Rapid Review Methodology
3.2. Search Strategy
- “Sign Language Acquisition”;
- “Sign Language Perception”;
- “Sign Language Acquisition Monitoring”.
3.3. Inclusion and Exclusion Criteria
- Publication Date: Published between January 2020 and March 2025.
- Language: English.
- Content Focus: Addressed sign language acquisition and/or perception in various contexts.
- Publication Type: Peer-reviewed academic sources, including journal articles and conference proceedings.
- Avatar Relevance: Study must report at least one empirical metric that can feed avatar design.
- Non-Scholarly Articles: Such as those from social media and popular press.
- Not Peer Reviewed: Theses and books.
- Age: Studies on infants and newborns were excluded because avatar work targets literate children and adults.
- Language: Publications in languages other than English.
- Literature Reviews: Used for contextual background, but excluded from final data synthesis to avoid redundancy.
3.4. Study Selection, Data Extraction, and Verification
3.5. Quality Appraisal
3.6. Data Synthesis
4. Results
4.1. Participant Groups and Age Ranges in Sign Language Acquisition Studies
4.1.1. Native Signers
4.1.2. Late Signers
4.1.3. Hearing M2L2 Learners of Sign Language
4.1.4. Mixed and Control Groups
4.2. Summary of Methodological Approaches and Aspects Examined Across Studies
- The Godspeed Questionnaire adapted with thermometer-style visual analog scales and culturally relevant clip-art for accessibility.
- The Funometer scale to measure emotional state shifts before and after exposure to each agent.
- A sorting task using animated GIFs of agents for categorizing perceived animacy, anthropomorphism, intelligence, and likeability.
4.3. Measurement Constructs Across Studies
4.4. Comprehensive Synthesis of Findings
4.4.1. Age of Acquisition and Its Impact on Sign Language Perception
4.4.2. Spatial Grammar and Classifier Constructions
4.4.3. Methods for Monitoring and Perceiving Sign Acquisition
5. Discussion
5.1. Age of Acquisition and Linguistic Development
5.2. Cognitive and Neurocognitive Correlates
5.3. Importance of Perceptual Fidelity and Spatial Grammar
5.4. Implications for Educational Practice and Accessibility
5.5. Limitations and Methodological Considerations
5.6. Future Research Directions
- Standardize participant reporting: Studies should consistently report age of acquisition (AoA), signing fluency, language dominance, and exposure context. These variables are essential for interpreting results and comparing across studies.
- Stratify sampling across user groups: Future work should include balanced cohorts of native signers, late signers, and hearing L2 learners. Including multilingual and dialectal signers can enhance ecological validity and inform avatar adaptability across signing communities.
- Expand linguistic coverage: Current research is heavily skewed toward a few well-documented sign languages (e.g., ASL, BSL). Including underrepresented languages, such as Kazakh–Russian SL, Qatari SL, or regional Arab variants, will support more inclusive design and prevent overgeneralization.
- Develop unified evaluation protocols: Establishing common frameworks for avatar assessment, combining subjective ratings (e.g., trust and clarity) and objective measures (e.g., eye-tracking, EEG, and reaction time), will improve cross-study comparability and metric validity.
- Adopt participatory research methods: Engaging Deaf users in co-design, usability testing, and feedback collection is critical. Tools like translated consent forms, visual Likert scales, and multimodal feedback tasks can improve accessibility and inclusivity in experimental design.
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
DGS | Deutsche Gebärdensprache (German Sign Language) |
ÖGS | Österreichische Gebärdensprache (Austrian Sign Language) |
BhSL | Bhutanese Sign Language |
NGT | Nederlandse Gebarentaal (Sign Language of the Netherlands) |
BSL | British Sign Language |
TİD | Türk İşaret Dili (Turkish Sign Language) |
ASL | American Sign Language |
PJM | Polski Język Migowy (Polish Sign Language) |
EEG | Electroencephalography |
fMRI | Functional Magnetic Resonance Imaging |
TMS | Transcranial Magnetic Stimulation |
M2L2 | Modality 2 Language 2 (hearing learners learning a second language in a second modality) |
L2 | Second Language |
L1 | First Language |
L2M1 | Learners learning a second sign language (already know one sign language) |
L2M2 | Learners learning sign language as a second language and in a new modality |
DS | Depicting Signs |
AoA | Age of Acquisition |
DoD | Deaf-of-Deaf (deaf individuals with deaf parents) |
DoH | Deaf-of-Hearing (deaf individuals with hearing parents) |
RT | Reaction Time |
SPL | Superior Parietal Lobule |
NaKom DGS-Test | A specific standardized assessment tool for German Sign Language narrative skills |
PRISMA | Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
GDPR | General Data Protection Regulation |
References
- Home Page. Available online: https://wfdeaf.org (accessed on 19 January 2025).
- Lillo-Martin, D.; Henner, J. Acquisition of Sign Languages. Annu. Rev. Linguist. 2021, 7, 395–419. [Google Scholar] [CrossRef]
- Jemni, M.; Jaballah, K. A Review on 3D Signing Avatars: Benefits, Uses and Challenges. Int. J. Multimed. Data Eng. Manag. (IJMDEM) 2013, 4, 21–45. [Google Scholar] [CrossRef]
- Naert, L.; Larboulette, C.; Gibet, S. A Survey on the Animation of Signing Avatars: From Sign Representation to Utterance Synthesis. Comput. Graph. 2020, 92, 76–98. [Google Scholar] [CrossRef]
- Choudhury, S. Analysis of Torso Movement for Signing Avatar Using Deep Learning. In Proceedings of the 7th International Workshop on Sign Language Translation and Avatar Technology: The Junction of the Visual and the Textual: Challenges and Perspectives, Marseille, France, 24 June 2022. [Google Scholar]
- Quandt, L.C.; Willis, A.; Schwenk, M.; Weeks, K.; Ferster, R. Attitudes Toward Signing Avatars Vary Depending on Hearing Status, Age of Signed Language Acquisition, and Avatar Type. Front. Psychol. 2022, 13, 730917. [Google Scholar] [CrossRef] [PubMed]
- Lacerda, I.; Nicolau, H.; Coheur, L. Towards Realistic Sign Language Animations. In Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents, Würzburg, Germany, 19–22 September 2023. [Google Scholar] [CrossRef]
- McDonald, J. Considerations on Generating Facial Nonmanual Signals on Signing Avatars. Univers. Access Inf. Soc. 2024, 24, 19–36. [Google Scholar] [CrossRef]
- Othman, A.; Dhouib, A.; Chalghoumi, H.; Ghoul, O.E.; Al-Mutawaa, A. The Acceptance of Culturally Adapted Signing Avatars Among Deaf and Hard-of-Hearing Individuals. IEEE Access 2024, 12, 78624–78640. [Google Scholar] [CrossRef]
- Emmorey, K.; Bosworth, R.; Kraljic, T. Visual Feedback and Self-Monitoring of Sign Language. J. Mem. Lang. 2009, 61, 398–411. [Google Scholar] [CrossRef]
- Gimeno-Martínez, M.; Costa, A.; Baus, C. Influence of Gesture and Linguistic Experience on Sign Perception. J. Deaf. Stud. Deaf. Educ. 2020, 25, 80–90. [Google Scholar] [CrossRef]
- Krebs, J.; Malaia, E.; Wilbur, R.; Roehm, D. Neural Mechanisms of Event Visibility in Sign Languages. Lang. Cogn. Neurosci. 2023, 38, 1282–1301. [Google Scholar] [CrossRef]
- Krebs, J.; Roehm, D.; Wilbur, R.B.; Malaia, E.A. Age of Sign Language Acquisition Has Lifelong Effect on Syntactic Preferences in Sign Language Users. Int. J. Behav. Dev. 2021, 45, 397–408. [Google Scholar] [CrossRef]
- Malaia, E.A.; Krebs, J.; Roehm, D.; Wilbur, R.B. Age of Acquisition Effects Differ across Linguistic Domains in Sign Language: EEG Evidence. Brain Lang. 2020, 200, 104708. [Google Scholar] [CrossRef]
- Tomaszewski, P.; Krzysztofiak, P.; Morford, J.P.; Eźlakowski, W. Effects of Age-of-Acquisition on Proficiency in Polish Sign Language: Insights to the Critical Period Hypothesis. Front. Psychol. 2022, 13, 896339. [Google Scholar] [CrossRef]
- Morford, J.P.; Grieve-Smith, A.B.; Macfarlane, J.; Staley, J.; Waters, G.S. Effects of Language Experience on the Perception of American Sign Language. Cognition 2008, 109, 41–53. [Google Scholar] [CrossRef] [PubMed]
- Caselli, N.K.; Occhino, C.; Artacho, B.; Savakis, A.; Dye, M. Perceptual Optimization of Language: Evidence from American Sign Language. Cognition 2022, 224, 105040. [Google Scholar] [CrossRef] [PubMed]
- Alyami, S.; Luqman, H.; Hammoudeh, M. Reviewing 25 Years of Continuous Sign Language Recognition Research: Advances, Challenges, and Prospects. Inf. Process. Manag. 2024, 61, 103774. [Google Scholar] [CrossRef]
- Yu, M.; Jia, J.; Xue, C.; Yan, G.; Guo, Y.; Liu, Y. A Review of Sign Language Recognition Research. J. Intell. Fuzzy Syst. 2022, 43, 3879–3898. [Google Scholar] [CrossRef]
- Emmorey, K. Ten Things You Should Know About Sign Languages. Curr. Dir. Psychol. Sci. 2023, 32, 387–394. [Google Scholar] [CrossRef]
- Murray, J.J.; Hall, W.C.; Snoddon, K. Education and Health of Children with Hearing Loss: The Necessity of Signed Languages. Bull. World Health Organ. 2019, 97, 711–716. [Google Scholar] [CrossRef]
- Humphries, T.; Kushalnagar, P.; Mathur, G.; Napoli, D.; Padden, C.; Rathmann, C. Ensuring Language Acquisition for Deaf Children: What Linguists Can Do. Language 2014, 90, e31–e52. [Google Scholar] [CrossRef]
- Bowman-Smart, H.; Gyngell, C.; Morgan, A.R.; Savulescu, J. The Moral Case for Sign Language Education. Monash Bioeth. Rev. 2019, 37, 94–110. [Google Scholar] [CrossRef]
- Nedjar, I.; M’hamedi, M. Interactive System Based on Artificial Intelligence and Robotic Arm to Enhance Arabic Sign Language Learning in Deaf Children. Educ. Inf. Technol. 2024, 29, 24563–24580. [Google Scholar] [CrossRef]
- Deoghare, R.; Gaikwad, M.; Desale, V.; Mahajan, P. Interactive Sign Language Learning Platform Fostering Sign Language Literacy. In Proceedings of the 2024 8th International Conference on Computing, Communication, Control and Automation (ICCUBEA), Pune, India, 23–24 August 2024; pp. 1–5. [Google Scholar] [CrossRef]
- Berrett, B. Using Computer-Assisted Language Learning in an American Sign Language Course. Innov. Lang. Learn. Teach. 2012, 6, 29–43. [Google Scholar] [CrossRef]
- Brock, H.; Nishina, S. Quantifying Sign Avatar Perception: How Imperfect Is Insufficient? In Proceedings of the CHI EA ‘20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020. [Google Scholar] [CrossRef]
- Dimou, A.-L.; Papavassiliou, V.; McDonald, J.C.; Goulas, T.; Vasilaki, K.; Vacalopoulou, A.; Fotinea, S.-E.; Efthimiou, E.; Wolfe, R.J. Signing Avatar Performance Evaluation within EASIER Project. In Proceedings of the 7th International Workshop on Sign Language Translation and Avatar Technology: The Junction of the Visual and the Textual: Challenges and Perspectives, Marseille, France, 24 June 2022. [Google Scholar]
- Aziz, M.; Othman, A. Evolution and Trends in Sign Language Avatar Systems: Unveiling a 40-Year Journey via Systematic Review. Multimodal Technol. Interact. 2023, 7, 97. [Google Scholar] [CrossRef]
- Imashev, A.; Oralbayeva, N.; Baizhanova, G.; Sandygulova, A. Assessment of Comparative Evaluation Techniques for Signing Agents: A Study with Deaf Adults. J. Multimodal User Interfaces 2025, 19, 1–19. [Google Scholar] [CrossRef]
- Naert, L.; Larboulette, C.; Gibet, S. Motion Synthesis and Editing for the Generation of New Sign Language Content. Mach. Transl. 2021, 35, 405–430. [Google Scholar] [CrossRef]
- Tricco, A.C.; Antony, J.; Zarin, W.; Strifler, L.; Ghassemi, M.; Ivory, J.; Perrier, L.; Hutton, B.; Moher, D.; Straus, S.E. A Scoping Review of Rapid Review Methods. BMC Med. 2015, 13, 224. [Google Scholar] [CrossRef]
- Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D. Reprint-Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Phys. Ther. 2009, 89, 873–880. [Google Scholar] [CrossRef]
- Stevens, A.; Garritty, C.; Hersi, M.; Moher, D. Developing PRISMA-RR, a Reporting Guideline for Rapid Reviews of Primary Studies (Protocol). Equat. Netw. 2018, 1–12. [Google Scholar] [CrossRef]
- Klerings, I.; Robalino, S.; Booth, A.; Escobar-Liquitay, C.M.; Sommer, I.; Gartlehner, G.; Devane, D.; Waffenschmidt, S. Rapid Reviews Methods Series: Guidance on Literature Search. BMJ Evid.-Based Med. 2023, 28, 412–417. [Google Scholar] [CrossRef]
- Kolbe, V. Open Science versus Data Protection–Challenges and Solutions in Sign Language Acquisition Studies. Hrvat. Rev. Za Rehabil. Istraz. 2022, 58, 109–120. [Google Scholar] [CrossRef]
- Choden, S.; Jigyel, K. Impact of Delay in Sign Language Acquisition on Writing Development: The Case of a Deaf Child. Int. J. Sci. Innov. Res. 2022, 3, 01000130IJESIR. [Google Scholar]
- Watkins, F.; Webb, S.; Stone, C.; Thompson, R.L. Language Aptitude in the Visuospatial Modality: L2 British Sign Language Acquisition and Cognitive Skills in British Sign Language-English Interpreting Students. Front. Psychol. 2022, 13, 932370. [Google Scholar] [CrossRef] [PubMed]
- Boers-Visker, E. On the Acquisition of Complex Classifier Constructions by L2 Learners of a Sign Language. Lang. Teach. Res. 2024, 28, 749–785. [Google Scholar] [CrossRef]
- Gür, C. Investigating the Effects of Late Sign Language Acquisition on Referent Introduction: A Follow-up Study. Poznan Stud. Contemp. Linguist. 2024, 60, 1–25. [Google Scholar] [CrossRef]
- Keleş, O.; Atmaca, F.; Gökgöz, K. Reference Tracking Strategies of Deaf Adult Signers in Turkish Sign Language. J. Pragmat. 2023, 213, 12–35. [Google Scholar] [CrossRef]
- Weisberg, J.; Casey, S.; Sehyr, Z.S.; Emmorey, K. Second Language Acquisition of American Sign Language Influences Co-Speech Gesture Production. Biling. Lang. Cogn. 2020, 23, 473–482. [Google Scholar] [CrossRef]
- Kurz, K.B.; Kartheiser, G.; Hauser, P.C. Second Language Learning of Depiction in a Different Modality: The Case of Sign Language Acquisition. Front. Commun. 2023, 7, 896355. [Google Scholar] [CrossRef]
- Boers–Visker, E.; Pfau, R. Space Oddities: The Acquisition of Agreement Verbs by L2 Learners of Sign Language of The Netherlands. Mod. Lang. J. 2020, 104, 757–780. [Google Scholar] [CrossRef]
- Banaszkiewicz, A.; Bola, Ł.; Matuszewski, J.; Szczepanik, M.; Kossowski, B.; Mostowski, P.; Rutkowski, P.; Śliwińska, M.; Jednoróg, K.; Emmorey, K.; et al. The Role of the Superior Parietal Lobule in Lexical Processing of Sign Language: Insights from FMRI and TMS. Cortex 2021, 135, 240–254. [Google Scholar] [CrossRef]
- Caselli, N.K.; Emmorey, K.; Cohen-Goldberg, A.M. The Signed Mental Lexicon: Effects of Phonological Neighborhood Density, Iconicity, and Childhood Language Experience. J. Mem. Lang. 2021, 121, 104282. [Google Scholar] [CrossRef]
- Boers-Visker, E. The Acquisition of Strategies to Express Plurality in Hearing Second Language Learners of Sign Language of The Netherlands. Lang. Learn. 2023, 73, 101–135. [Google Scholar] [CrossRef]
- Wienholz, A.; Lieberman, A.M. Tracking Effects of Age of Sign Language Acquisition and Phonology in American Sign Language Sentence Processing. Mem. Cogn. 2025, 1–19. [Google Scholar] [CrossRef]
- Imashev, A.; Oralbayeva, N.; Sandygulova, A. An Exploratory User Study towards Developing a Unified, Comprehensive Assessment Apparatus for Deaf Signers, Specifically Tailored for Signing Avatars Evaluation: Challenges, Findings, and Recommendations. Multimed. Tools Appl. 2024, 84, 30865–30902. [Google Scholar] [CrossRef]
- Boers-Visker, E.; Bogaerde, B. van den Learning to Use Space in the L2 Acquisition of a Signed Language: Two Case Studies. Sign Lang. Stud. 2019, 19, 410–452. [Google Scholar] [CrossRef]
- Karadöller, D.Z.; Peeters, D.; Manhardt, F.; Özyürek, A.; Ortega, G. Iconicity and Gesture Jointly Facilitate Learning of Second Language Signs at First Exposure in Hearing Nonsigners. Lang. Learn. 2024, 74, 781–813. [Google Scholar] [CrossRef]
- Ortega, G.; Özyürek, A.; Peeters, D. Iconic Gestures Serve as Manual Cognates in Hearing Second Language Learners of a Sign Language: An ERP Study. J. Exp. Psychol. Learn. Mem. Cogn. 2020, 46, 403–415. [Google Scholar] [CrossRef]
- Schönström, K.; Holmström, I. L2M1 and L2M2 Acquisition of Sign Lexicon: The Impact of Multimodality on the Sign Second Language Acquisition. Front. Psychol. 2022, 13, 896254. [Google Scholar] [CrossRef]
- Marshall, C.; Morgan, G. From Gesture to Sign Language: Conventionalisation of Classifier Constructions by Adult Hearing Learners of BSL. Top. Cogn. Sci. 2015, 7, 61–80. [Google Scholar] [CrossRef]
- Donner, A.; Marshall, M.; Mozrall, J.R. Effects of Early Exposure to Sign Language on the Biomechanics of Interpreting. J. Interpret. 2016, 25, 4. [Google Scholar]
- Almubayei, D.S. Sign Language Choice and Policy among the Signing Community in Kuwait. Dig. Middle East Stud. 2024, 33, 166–183. [Google Scholar] [CrossRef]
Database | Method | Search Terms |
---|---|---|
ScienceDirect | Utilized the advanced search feature with the query | (“Sign Language Acquisition” OR “Sign Language Perception” OR “Sign Language Acquisition Monitoring”) AND publication_year: [2020 TO 2025] |
IEEE Xplore | Employed the search string: | ((“All Metadata”: ”Sign Language Acquisition”) OR (“All Metadata”: ”Sign Language Perception”) OR (“All Metadata”: ”Sign Language Acquisition Monitoring”)) AND (Publication Year: 2020–2025) |
Google Scholar | Applied the search with a custom date range from 2020 to 2025. | allintitle: “Sign Language Acquisition” OR “Sign Language Perception” OR “Sign Language Acquisition Monitoring” |
ACM Digital Library | Used the query with filters set for publication dates between 1 January 2020 and 31 March 2025. | All: “Sign Language Acquisition” OR “Sign Language Perception” |
SpringerLink | Conducted separate searches for each term with publication years limited to 2020 through 2025 | “Sign Language Acquisition” “Sign Language Perception” |
Ref. | Publication Title | Publication Year | Type of Venue | Country/Language |
---|---|---|---|---|
[36] | Open science versus data protection--Challenges and solutions in sign language acquisition studies | 2022 | Journal | Germany/German Sign Language (Deutsche Gebärdensprache) (DGS) |
[14] | Age of acquisition effects differ across linguistic domains in sign language: EEG evidence | 2020 | Journal | Austria/Austrian Sign Language (Österreichische Gebärdensprache) (ÖGS) |
[37] | Impact of delay in sign language acquisition on writing development: The Case of a Deaf Child | 2022 | Journal | Bhutan/Bhutanese Sign Language (BhSL) |
[13] | Age of sign language acquisition has a lifelong effect on syntactic preferences in sign language users | 2021 | Journal | Austria/ÖGS |
[38] | Language aptitude in the visuospatial modality: L2 British Sign Language acquisition and cognitive skills in British Sign Language-English interpreting students | 2022 | Journal | United Kingdom/British Sign Language (BSL) |
[39] | On the acquisition of complex classifier constructions by L2 learners of a sign language | 2024 | Journal | Netherlands/Sign Language of the Netherlands (Nederlandse Gebarentaal) (NGT) |
[40] | Investigating the effects of late sign language acquisition on referent introduction: a follow-up study | 2024 | Journal | Turkey/Turkish Sign Language (Türk İşaret Dili) (TİD) |
[41] | Reference tracking strategies of Deaf adult signers in Turkish Sign Language | 2023 | Journal | Turkey/TİD |
[42] | Second language acquisition of American Sign Language influences co-speech gesture production | 2020 | Journal | USA/American Sign Language (ASL) |
[43] | Second language learning of depiction in a different modality: the case of sign language acquisition | 2023 | Journal | USA/ASL |
[44] | Space oddities: The acquisition of agreement verbs by L2 learners of Sign Language of the Netherlands | 2020 | Journal | Netherlands/NGT |
[45] | The role of the superior parietal lobule in lexical processing of sign language: Insights from fMRI and TMS | 2021 | Journal | Poland/Polish Sign Language (Polski Język Migowy) (PJM) |
[46] | The signed mental lexicon: Effects of phonological neighborhood density, iconicity, and childhood language experience | 2021 | Journal | USA/ASL |
[47] | The Acquisition of Strategies to Express Plurality in Hearing Second Language Learners of Sign Language of the Netherlands | 2023 | Journal | Netherlands/NGT |
[48] | Tracking effects of age of sign language acquisition and phonology in American Sign Language sentence processing | 2025 | Journal | USA/ASL |
[49] | An exploratory user study towards developing a unified, comprehensive assessment apparatus for Deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendations | 2024 | Journal | Kazakhstan-Russia/Kazakh-Russian sign language (K-RSL) |
[30] | Assessment of comparative evaluation techniques for signing agents: a study with Deaf adults | 2024 | Journal | Kazakhstan-Russia/K-RSL |
Methodological Group | Paper | Key Methodologies | Aspects Examined | Key Outcome Indicators |
---|---|---|---|---|
Community-Based Participatory and Standardized Assessment Adaptation | [36] | Adaptation and administration of the NaKom DGS-Test; narrative elicitation; qualitative and quantitative video analysis; community-based participatory research; GDPR-compliant data protection (secure storage, pseudonymization, layered consent) | Narrative structure, fluency, and linguistic features in children’s DGS narratives; reference measures for DGS development | Narrative fluency index; grammatical accuracy; Deaf-community validation loops |
Narrative Elicitation and Discourse-Coding | [40] | Narrative elicitation (“Spider Story”); ELAN qualitative coding of lexical signs (LS) vs. classifier predicates (CL) | Strategies (lexical/classifier) used for first introductions of inanimate objects; late vs. native | Proportion of lexical signs vs. classifiers in referent introduction |
[41] | Narrative elicitation (Tom and Jerry clips); ELAN annotation of discourse status and referring expressions; Bayesian regression analysis | Use of explicit vs. implicit referring expressions (nominal, zero anaphora) by DoD vs. DoH signers | Distribution of nouns, classifiers, zero-anaphora across discourse roles | |
[42] | Narrative elicitation (Canary Row); video recording; gesture coding (iconic, deictic, beat; handshape markedness and variety); coding of embedded ASL signs | Gesture rate/type, handshape variety, and ASL sign intrusions in English narrative retellings | Gesture rate; gesture type; handshape variety; ASL sign intrusions | |
[43] | Cross-sectional narrative elicitation; ELAN annotation; coding of depicting signs (Entity, Body-Part, Handling, Size-and-Shape Specifiers); ASL Comprehension Test | Acquisition/use of depicting signs (types, frequency, comprehension relation, gestural transfer) and ASL comprehension | Counts of four depicting-sign types; correlation with ASL-CT scores | |
Psycholinguistic and Neurocognitive Measures | [14] | EEG (N400 response); grammaticality ratings; reaction times; acceptability ratings | N400 responses, acceptability ratings, and RTs to classifier signs, word order (SOV vs. OSV), and topic-marking signals | N400 amplitude; sentence-acceptability ratings; RTs |
[13] | Seven-point Likert acceptability ratings; reaction-time measurement; mixed-effects statistical modeling | Age of Acquisition (AoA) impacts on processing of syntax (word order), pragmatics (topic marking), and semantics (classifier constructions). | Acceptability ratings and RTs for syntax/pragmatics | |
[45] | Longitudinal fMRI (5 sessions) + Deaf comparison (1 session); TMS to left/right SPL; explicit vs. implicit lexical decision tasks; accuracy measures | SPL role in lexical processing; hemispheric specialization; brain activation in PJM learners. | Lexical-decision accuracy; SPL activation (fMRI); TMS interference effects | |
[46] | Unprimed lexical decision task with ASL-LEX 1.0 stimuli; reaction times; accuracy; demographic and exposure metrics (age of first ASL exposure, hearing status of parents, etc.) | Effects of phonological density, iconicity, and early language experience on lexical recognition. | RT and accuracy in lexical-decision; effects of frequency, neighborhood density, iconicity | |
Longitudinal Designs in L2 Acquisition | [38] | Three-year longitudinal design (4 sessions); cognitive assessments (dual n-back, Corsi blocks, digit span; 2D/3D mental rotation; MLAT phonological encoding; KBIT-2 non-verbal reasoning); TED-talk summarization; BSL sign/sentence repetition; interpreting tasks (BSL↔English) | Working memory (multimodal, visuospatial, auditory), mental rotation, phonological encoding, reading, non-verbal reasoning, summarization in relation to BSL proficiency and interpreting outcomes. | Visuospatial memory and mental-rotation accuracy; BSL repetition; interpreting scores |
[39] | Two-year longitudinal (15 sessions); 180 visual prompts; video recording; ELAN transcription and coding of formational features and error types (handshape substitution, misorientation, etc.) | Acquisition of two-handed classifier predicates (handshape, orientation, movement, spatial coordination); developmental progression from gestures to conventional use | Frequency and accuracy of classifier predicates; orientation errors | |
[44] | Two-year longitudinal (6 sessions); picture and sentence prompts; video recording; ELAN transcription; coding of agreement verb strategies (fully/partly agreeing, constructed action, lexical strategies) | Acquisition of spatial verb agreement (inflection, localization), constructed action, and alternative strategies; error patterns (overgeneralization, omission) | % verbs with correct spatial agreement; error typology | |
[47] | Spontaneous conversations (3 learners, every 10 weeks for 18 months) + elicited sessions (11 learners, 6 sessions in Year 1); ELAN transcription; coding of plurality strategies (reduplication, numeral incorporation, classifier predicates); interrater reliability 86–93% | Learners’ strategies to express plural referents, early use of plural markers and errors in expressing plurality | Frequency and appropriateness of plural strategies; teacher ratings | |
In-Depth Qualitative Case Study | [37] | Qualitative case study; purposive sampling; semi-structured interviews; participant observation; photovoice; videotaping; data triangulation; thematic analysis | Effects of delayed SL acquisition on vocabulary, writing competency, and cross-linguistic transfer (BhSL ↔ English/Dzongkha); role of early intervention in literacy development | Vocabulary size; syntactic variety in writing; teacher rubric scores |
Eye-Tracking with Phonological Priming | [48] | Eye-tracking, ASL sentence processing, divergence point analysis, windowed fixation | Sentence-level sign recognition under varying degrees and types of phonological similarity; group comparisons by AoA | Divergence points and gaze ratios by parameter; age-of-acquisition sensitivity to phonological overlap |
Evaluation of Avatar-based Sign Language Presentation | [49] | Mixed-methods design, including online and in-person user studies; subjective assessment via Likert scales; adapted Godspeed and RoSAS questionnaires; video translation of consent and instructions into K-RSL; use of data-driven and manually animated avatars; eye-tracking and Funometer mood scale (in-person study) | Perceived naturalness, intelligibility, human-likeness, and usability of avatar-based SL output; translation accuracy; mood impact; attention distribution (manual vs. non-manual features) | Translation rate per sign; mood change metrics; Godspeed dimensions (anthropomorphism, animacy, intelligence, likeability); gaze fixation ratios (manual vs. facial regions) |
[30] | In-person user study with Deaf signers; eye-tracking with Tobii Pro Glasses 2; Funometer emotional scale; adapted Godspeed thermometer visuals; sorting tasks using GIFs; evaluation of 3 avatar agents (rule-based, data-driven, symbolic) vs. human signer | Visual attention patterns (face vs. hands); emotional response pre/post interaction; comprehension and perception of synthetic agents based on age/exposure | Gaze fixation ratios; mood change metrics; Godspeed thermometer scores; participant sorting; qualitative feedback on signing accuracy and realism |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chemnad, K.; Othman, A. Perception and Monitoring of Sign Language Acquisition for Avatar Technologies: A Rapid Focused Review (2020–2025). Multimodal Technol. Interact. 2025, 9, 82. https://doi.org/10.3390/mti9080082
Chemnad K, Othman A. Perception and Monitoring of Sign Language Acquisition for Avatar Technologies: A Rapid Focused Review (2020–2025). Multimodal Technologies and Interaction. 2025; 9(8):82. https://doi.org/10.3390/mti9080082
Chicago/Turabian StyleChemnad, Khansa, and Achraf Othman. 2025. "Perception and Monitoring of Sign Language Acquisition for Avatar Technologies: A Rapid Focused Review (2020–2025)" Multimodal Technologies and Interaction 9, no. 8: 82. https://doi.org/10.3390/mti9080082
APA StyleChemnad, K., & Othman, A. (2025). Perception and Monitoring of Sign Language Acquisition for Avatar Technologies: A Rapid Focused Review (2020–2025). Multimodal Technologies and Interaction, 9(8), 82. https://doi.org/10.3390/mti9080082