Search Results (2)

Background/Objectives: Narrative differences in autism spectrum disorder (ASD) and subtle and parallel differences among their first-degree relatives suggest potential genetic liability to this critical social-communication skill. Effective social-communication relies on coordinating signals across modalities, which is often disrupted in ASD. Therefore, the current study examined the coordination of fundamental skills—gaze and speech—as a potential mechanism underlying narrative and broader pragmatic differences in ASD and their first-degree relatives. Methods: Participants included 35 autistic individuals, 41 non-autistic individuals, 90 parents of autistic individuals, and 34 parents of non-autistic individuals. Participants narrated a wordless picture book presented on an eye-tracker, with gaze and speech simultaneously recorded and subsequently coded. Time series analyses quantified their temporal coordination (i.e., the temporal lead of gaze to speech) and content coordination (i.e., the amount of gaze-speech content correspondence). These metrics were then compared between autistic and non-autistic groups and between parent groups and examined in relation to narrative quality and conversational pragmatic language skills. Results: Autistic individuals showed reduced temporal coordination but increased content coordination relative to non-autistic individuals with no significant differences found between parent groups. In both autistic individuals, and parent groups combined, increased content coordination and reduced temporal coordination were linked to reduced narrative quality and pragmatic language skills, respectively. Conclusions: Reduced temporal and increased content coordination may reflect a localized strategy of labeling items upon visualization. This pattern may indicate more limited visual, linguistic, and cognitive processing and underlie differences in higher-level social-communicative abilities in ASD. To our knowledge, this study is the first to identify multimodal skill coordination as a potential mechanism contributing to higher-level social-communicative differences in ASD and first-degree relatives, implicating mechanism-based interventions to support pragmatic language skills in ASD. Full article

Soft skills such as communication and collaboration are vital in both professional and educational settings, yet difficult to train and assess objectively. Traditional role-playing scenarios rely heavily on subjective trainer evaluations—either in real time, where subtle behaviors are missed, or through time-intensive post hoc analysis. Virtual reality (VR) offers a scalable alternative by immersing trainees in controlled, interactive scenarios while simultaneously capturing fine-grained behavioral signals. This study investigates how task design in VR shapes non-verbal and paraverbal behaviors during dyadic collaboration. We compared two puzzle tasks: Task 1, which provided shared visual access and dynamic gesturing, and Task 2, which required verbal coordination through separation and turn-taking. From multimodal tracking data, we extracted features including gaze behaviors (eye contact, joint attention), hand gestures, facial expressions, and speech activity, and compared them across tasks. A clustering analysis explored whether o not tasks could be differentiated by their behavioral profiles. Results showed that Task 2, the more constrained condition, led participants to focus more visually on their own workspaces, suggesting that interaction difficulty can reduce partner-directed attention. Gestures were more frequent in shared-visual tasks, while speech became longer and more structured when turn-taking was enforced. Joint attention increased when participants relied on verbal descriptions rather than on a visible shared reference. These findings highlight how VR can elicit distinct soft skill behaviors through scenario design, enabling data-driven analysis of collaboration. This work contributes to scalable assessment frameworks with applications in training, adaptive agents, and human-AI collaboration. Full article