Next Article in Journal
PRISER: Managing Notification in Multiples Devices with Data Privacy Support
Next Article in Special Issue
Use of Computing Devices as Sensors to Measure Their Impact on Primary and Secondary Students’ Performance
Previous Article in Journal
Electrochemical Nanocomposite Single-Use Sensor for Dopamine Detection
Previous Article in Special Issue
A Visual Dashboard to Track Learning Analytics for Educational Cloud Computing
Open AccessArticle

Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks

1
Welten Institute, Research Centre for Learning, Teaching and Technology Open University of the Netherlands, Valkenburgerweg, 177 6401 AT Heerlen, The Netherlands
2
DIPF - Leibniz Institute for Research and Information in Education, Rostocker Straße 6, 60323 Frankfurt, Germany
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(14), 3099; https://doi.org/10.3390/s19143099
Received: 20 May 2019 / Revised: 24 June 2019 / Accepted: 5 July 2019 / Published: 13 July 2019
(This article belongs to the Special Issue Advanced Sensors Technology in Education)
This study investigated to what extent multimodal data can be used to detect mistakes during Cardiopulmonary Resuscitation (CPR) training. We complemented the Laerdal QCPR ResusciAnne manikin with the Multimodal Tutor for CPR, a multi-sensor system consisting of a Microsoft Kinect for tracking body position and a Myo armband for collecting electromyogram information. We collected multimodal data from 11 medical students, each of them performing two sessions of two-minute chest compressions (CCs). We gathered in total 5254 CCs that were all labelled according to five performance indicators, corresponding to common CPR training mistakes. Three out of five indicators, CC rate, CC depth and CC release, were assessed automatically by the ReusciAnne manikin. The remaining two, related to arms and body position, were annotated manually by the research team. We trained five neural networks for classifying each of the five indicators. The results of the experiment show that multimodal data can provide accurate mistake detection as compared to the ResusciAnne manikin baseline. We also show that the Multimodal Tutor for CPR can detect additional CPR training mistakes such as the correct use of arms and body weight. Thus far, these mistakes were identified only by human instructors. Finally, to investigate user feedback in the future implementations of the Multimodal Tutor for CPR, we conducted a questionnaire to collect valuable feedback aspects of CPR training. View Full-Text
Keywords: multimodal data; neural networks; psychomotor learning; training mistakes; medical simulation; learning analytics; signal processing; activity recognition; sensors multimodal data; neural networks; psychomotor learning; training mistakes; medical simulation; learning analytics; signal processing; activity recognition; sensors
Show Figures

Figure 1

MDPI and ACS Style

Di Mitri, D.; Schneider, J.; Specht, M.; Drachsler, H. Detecting Mistakes in CPR Training with Multimodal Data and Neural Networks. Sensors 2019, 19, 3099.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop