Next Article in Journal
Training-Based Methods for Comparison of Object Detection Methods for Visual Object Tracking
Next Article in Special Issue
Assistive Grasping Based on Laser-point Detection with Application to Wheelchair-mounted Robotic Arms
Previous Article in Journal
M2M Communication Assessment in Energy-Harvesting and Wake-Up Radio Assisted Scenarios Using Practical Components
Previous Article in Special Issue
HoPE: Horizontal Plane Extractor for Cluttered 3D Scenes
Open AccessArticle

Computational Assessment of Facial Expression Production in ASD Children

Institute of Applied Sciences and Intelligent Systems, National Research Council of Italy, via Monteroni, 73100 Lecce, Italy
Amici di Nico Onlus, Via Campania, 6, 73046 Lecce, Italy
USI, Institute of Communication and Health, Via Buffi 6, 6900 Lugano, Switzerland
L’ Adelfia Onlus, via S. Sangiovanni, 115-73031 Lecce, Italy
Dipartimento di Storia, University of Salento, Società e Studi Sull’ Uomo, Studium 2000-Edificio 5-Via di Valesio, 73100 Lecce, Italy
Author to whom correspondence should be addressed.
Sensors 2018, 18(11), 3993;
Received: 4 October 2018 / Revised: 9 November 2018 / Accepted: 14 November 2018 / Published: 16 November 2018
(This article belongs to the Special Issue Semantic Representations for Behavior Analysis in Robotic System)
In this paper, a computational approach is proposed and put into practice to assess the capability of children having had diagnosed Autism Spectrum Disorders (ASD) to produce facial expressions. The proposed approach is based on computer vision components working on sequence of images acquired by an off-the-shelf camera in unconstrained conditions. Action unit intensities are estimated by analyzing local appearance and then both temporal and geometrical relationships, learned by Convolutional Neural Networks, are exploited to regularize gathered estimates. To cope with stereotyped movements and to highlight even subtle voluntary movements of facial muscles, a personalized and contextual statistical modeling of non-emotional face is formulated and used as a reference. Experimental results demonstrate how the proposed pipeline can improve the analysis of facial expressions produced by ASD children. A comparison of system’s outputs with the evaluations performed by psychologists, on the same group of ASD children, makes evident how the performed quantitative analysis of children’s abilities helps to go beyond the traditional qualitative ASD assessment/diagnosis protocols, whose outcomes are affected by human limitations in observing and understanding multi-cues behaviors such as facial expressions. View Full-Text
Keywords: quantitative facial expression analysis; geometrical and temporal regularization of facial action units; ASD diagnosis and assessment quantitative facial expression analysis; geometrical and temporal regularization of facial action units; ASD diagnosis and assessment
Show Figures

Figure 1

MDPI and ACS Style

Leo, M.; Carcagnì, P.; Distante, C.; Spagnolo, P.; Mazzeo, P.L.; Rosato, A.C.; Petrocchi, S.; Pellegrino, C.; Levante, A.; De Lumè, F.; Lecciso, F. Computational Assessment of Facial Expression Production in ASD Children. Sensors 2018, 18, 3993.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Search more from Scilit
Back to TopTop