Next Article in Journal
Maize and Sorghum as Raw Materials for Brewing, a Review
Next Article in Special Issue
Segmentation of Brain Tumors from MRI Images Using Convolutional Autoencoder
Previous Article in Journal
A Hybrid Hidden Markov Model for Pipeline Leakage Detection
Previous Article in Special Issue
Spider U-Net: Incorporating Inter-Slice Connectivity Using LSTM for 3D Blood Vessel Segmentation
Article

Deep Learning Techniques Applied to Predict and Measure Finger Movement in Patients with Multiple Sclerosis

1
High School of Information Technologies and Automatic Systems, Northern Artic Federal University, 163002 Arkhangelsk, Russia
2
The Deustotech-LIFE (eVIDA) Research Group, Faculty of Engineering, University of Deusto, 48007 Bilbao, Spain
*
Author to whom correspondence should be addressed.
Academic Editors: Il Dong Yun and Soochahn Lee
Appl. Sci. 2021, 11(7), 3137; https://doi.org/10.3390/app11073137
Received: 28 February 2021 / Revised: 29 March 2021 / Accepted: 30 March 2021 / Published: 1 April 2021
This research focuses on the development of a system for measuring finger joint angles based on camera image and is intended for work within the field of medicine to track the movement and limits of hand mobility in multiple sclerosis. Measuring changes in hand mobility allows the progress of the disease and its treatment process to be monitored. A static RGB camera without depth vision was used in the system developed, with the system receiving only the image from the camera and no other input data. The research focuses on the analysis of each image in the video stream independently of other images from that stream, and 12 measured hand parameters were chosen as follows: 3 joint angles for the index finger, 3 joint angles for the middle finger, 3 joint angles for the ring finger, and 3 joint angles for the pinky finger. Convolutional neural networks were used to analyze the information received from the camera, and the research considers neural networks based on different architectures and their combinations as follows: VGG16, MobileNet, MobileNetV2, InceptionV3, DenseNet, ResNet, and convolutional pose machine. The final neural network used for image analysis was a modernized neural network based on MobileNetV2, which obtained the best mean absolute error value of 4.757 degrees. Additionally, the mean square error was 67.279 and the root mean square error was 8.202 degrees. This neural network analyzed a single image from the camera without using other sensors. For its part, the input image had a resolution of 512 by 512 pixels, and was processed by the neural network in 7–15 ms by GPU Nvidia 2080ti. The resulting neural network developed can measure finger joint angle values for a hand with non-standard parameters and positions. View Full-Text
Keywords: convolutional neural network; layer; finger; joint angle; hands convolutional neural network; layer; finger; joint angle; hands
Show Figures

Figure 1

MDPI and ACS Style

Viatkin, D.; Garcia-Zapirain, B.; Méndez Zorrilla, A. Deep Learning Techniques Applied to Predict and Measure Finger Movement in Patients with Multiple Sclerosis. Appl. Sci. 2021, 11, 3137. https://doi.org/10.3390/app11073137

AMA Style

Viatkin D, Garcia-Zapirain B, Méndez Zorrilla A. Deep Learning Techniques Applied to Predict and Measure Finger Movement in Patients with Multiple Sclerosis. Applied Sciences. 2021; 11(7):3137. https://doi.org/10.3390/app11073137

Chicago/Turabian Style

Viatkin, Dmitry, Begonya Garcia-Zapirain, and Amaia Méndez Zorrilla. 2021. "Deep Learning Techniques Applied to Predict and Measure Finger Movement in Patients with Multiple Sclerosis" Applied Sciences 11, no. 7: 3137. https://doi.org/10.3390/app11073137

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop