MSCB-DualAttn Network for sEMG-Based Gesture Recognition in Transradial Amputees with Varying Residual Limb Lengths
Abstract
1. Introduction
2. Materials and Methods
2.1. Dataset Acquisition and Preprocessing
2.1.1. Different Residual Limb Length Amputee Dataset
2.1.2. Open-Access Dataset
2.1.3. Data Preprocessing
2.1.4. Sliding Window Setting
2.1.5. Dataset Split
2.2. Multi-Scale Convolutional Block Dual Attention Network (MSCB-DualAttn)
2.2.1. Complete Model Framework
2.2.2. Stem Layer
2.2.3. MSCB
2.2.4. Dual Attention Block
2.2.5. Classifier and Loss Function Design
2.3. Model Evaluation Metrics and Interpretability Analysis
2.3.1. Model Evaluation Metrics
2.3.2. Ablation Study
2.3.3. t-SNE Visualization
2.4. Experimental Training Settings and Hyperparameters
3. Results
3.1. Overall Performance Evaluation Across Different Groups
3.2. Ablation Study Results
3.3. t-SNE Analysis Results
3.4. Comparison of Saliency Across MSCB Branches
3.5. Gradient Importance Saliency
3.6. Channel Attention Weight Distribution
3.7. Comparison with Other Studies
3.8. Analysis of Model Parameters
4. Discussion
Limitations of the Study and Future Work
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| MSCB-DualAttn | Multi-Scale Convolutional Block with Dual Attention Network |
| sEMG | Surface electromyography |
| HS | Healthy subjects |
| LS | Long stump subjects |
| MS | Middle stump subjects |
| SS | Short-stump subjects |
| CNN | Convolutional neural network |
References
- Simon, A.M.; Turner, K.L.; Miller, L.A.; Potter, B.K.; Beachler, M.D.; Dumanian, G.A.; Hargrove, L.J.; Kuiken, T.A. User Performance With a Transradial Multi-Articulating Hand Prosthesis During Pattern Recognition and Direct Control Home Use. IEEE Trans. Neural Syst. Rehabil. Eng. 2023, 31, 271–281. [Google Scholar] [CrossRef] [Scilit]
- Hong, C.; Park, S.; Kim, K. sEMG-Based Gesture Recognition Using Temporal History. IEEE Trans. Biomed. Eng. 2023, 70, 2655–2666. [Google Scholar] [CrossRef] [Scilit]
- Tamilvanan, P.; Elumalai, V.K.; Elumalai, B. A Comprehensive Survey of Machine Learning Algorithms in Hand Gesture Recognition for Myoelectric Prosthetic Control: Current Trends, Challenges and Future Directions. Arch. Comput. Methods Eng. 2025, 33, 5839–5868. [Google Scholar] [CrossRef] [Scilit]
- Liao, S.; Li, G.; Li, J.; Jiang, D.; Jiang, G.; Sun, Y.; Tao, B.; Zhao, H.; Chen, D.; Farouk, A. Multi-object intergroup gesture recognition combined with fusion feature and KNN algorithm. J. Intell. Fuzzy Syst. 2020, 38, 2725–2735. [Google Scholar] [CrossRef] [Scilit]
- Zhan, Z.; Kim, S.-K. Versatile time-window sliding machine learning techniques for stock market forecasting. Artif. Intell. Rev. 2024, 57, 209. [Google Scholar] [CrossRef] [Scilit]
- Chen, Z.; Zhang, X.; Luo, Y.; Wang, H.; Zhang, L.; Kang, X. A Multiscale Attention Network for sEMG Gesture Recognition Using a Portable Armband. IEEE Sens. J. 2025, 25, 45041–45049. [Google Scholar] [CrossRef] [Scilit]
- Atzori, M.; Cognolato, M.; Müller, H. Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands. Front. Neurorobot. 2016, 10, 9. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Khan, D.; Alonazi, M.; Abdelhaq, M.; Al Mudawi, N.; Algarni, A.; Jalal, A.; Liu, H. Robust human locomotion and localization activity recognition over multisensory. Front. Physiol. 2024, 15, 1344887. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ullah, A.; Song, Z.; Riaz, W.; Qi, X.; Hossain, M.M. Hand Gesture-Based Biometric Verification and Identification Using Embedded-STQNet Deep Neural Architecture in Security-Oriented Systems. IEEE Internet Things J. 2026, 1. [Google Scholar] [CrossRef] [Scilit]
- Gopal, P.; Gesta, A.; Mohebbi, A. A Systematic Study on Electromyography-Based Hand Gesture Recognition for Assistive Robots Using Deep Learning and Machine Learning Models. Sensors 2022, 22, 3650. [Google Scholar] [CrossRef] [Scilit]
- Wei, W.; Hu, X.; Liu, H.; Zhou, M.; Song, Y. Towards Integration of Domain Knowledge-Guided Feature Engineering and Deep Feature Learning in Surface Electromyography-Based Hand Movement Recognition. Comput. Intell. Neurosci. 2021, 2021, 4454648. [Google Scholar] [CrossRef] [Scilit]
- Le, H.; Panhuis, M.i.h.; Alici, G. Reducing user training burden for myoelectric prosthetic hand control with CNN–LDA temporal-spectral transfer learning. Biomim. Intell. Robot. 2026, 6, 100291. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Chen, S.; Cao, W.; Guo, P.; Gao, D.; Wang, M.; Zhou, J.; Wang, T. MFFNet: Multi-dimensional Feature Fusion Network based on attention mechanism for sEMG analysis to detect muscle fatigue. Expert Syst. Appl. 2021, 185, 115639. [Google Scholar] [CrossRef] [Scilit]
- Zhang, J.; Matsuda, Y.; Fujimoto, M.; Suwa, H.; Yasumoto, K. Feasibility Analysis of sEMG Recognition via Channel-Wise Transformer. In Proceedings of the 2022 IEEE 11th Global Conference on Consumer Electronics (GCCE), Osaka, Japan, 18–21 October 2022; pp. 105–106. [Google Scholar]
- Shi, P.; Dong, X.; Ge, R.; Liu, Z.; Yang, A. Dp-M3D: Monocular 3D object detection algorithm with depth perception capability. Knowl.-Based Syst. 2025, 318, 113539. [Google Scholar] [CrossRef] [Scilit]
- Dong, X.; Shi, P.; Qi, H.; Yang, A.; Liang, T. TS-BEV: BEV object detection algorithm based on temporal-spatial feature fusion. Displays 2024, 84, 102814. [Google Scholar] [CrossRef] [Scilit]
- Wang, Y.; Zhao, P.; Zhang, Z. A deep learning approach using attention mechanism and transfer learning for electromyographic hand gesture estimation. Expert Syst. Appl. 2023, 234, 121055. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Z.; Shen, Q.; Wang, Y. Electromyographic hand gesture recognition using convolutional neural network with multi-attention. Biomed. Signal Process. Control 2024, 91, 105935. [Google Scholar] [CrossRef] [Scilit]
- Shen, S.; Wang, X.; Mao, F.; Sun, L.; Gu, M. Movements Classification Through sEMG With Convolutional Vision Transformer and Stacking Ensemble Learning. IEEE Sens. J. 2022, 22, 13318–13325. [Google Scholar] [CrossRef] [Scilit]
- He, D.; Liu, W.; Yan, H.; Zhao, Y.; Jiang, B. A multi-scale dual-stream fusion network for high-accuracy sEMG-based gesture classification. Sci. Rep. 2026, 16, 4819. [Google Scholar] [CrossRef] [Scilit]
- Ji, P.; Cao, C.; Zhang, H.; Li, Q. Multi-Scale Convolution Attention Neural Network for Gesture Recognition. In Proceedings of the 2024 3rd International Conference on Cryptography, Network Security and Communication Technology, Harbin, China, 19–21 January 2024; pp. 421–425. [Google Scholar]
- Niu, B.; Li, J.; Wang, Y. A Simplified Convolutional Block Attention Module for Robust Hand Gesture Recognition with High Density Surface Electromyography. In Proceedings of the 2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Hangzhou, China, 14–18 July 2025; pp. 1–7. [Google Scholar]
- Luo, X.; Huang, W.; Wang, Z.; Li, Y.; Duan, X. InRes-ACNet: Gesture Recognition Model of Multi-Scale Attention Mechanisms Based on Surface Electromyography Signals. Appl. Sci. 2024, 14, 3237. [Google Scholar] [CrossRef] [Scilit]
- Wang, Z.; Huang, W.; Qi, Z.; Yin, S. MS-CLSTM: Myoelectric Manipulator Gesture Recognition Based on Multi-Scale Feature Fusion CNN-LSTM Network. Biomimetics 2024, 9, 784. [Google Scholar] [CrossRef] [Scilit]
- Shah, G.; Sharma, A.; Joshi, D.; Rathor, A.S.; Semwal, S. TFF-Net: A hybrid MSC-TCN-Attention network for enhanced long–short term features extraction in gesture classification. Signal Image Video Process. 2025, 19, 1356. [Google Scholar] [CrossRef] [Scilit]
- Atzori, M.; Gijsberts, A.; Kuzborskij, I.; Elsig, S.; Hager, A.G.M.; Deriaz, O.; Castellini, C.; Müller, H.; Caputo, B. Characterization of a Benchmark Database for Myoelectric Movement Classification. IEEE Trans. Neural Syst. Rehabil. Eng. 2015, 23, 73–83. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Çelik, Y.; Can, U. Surface EMG-Based Hand Gesture Recognition Using a Hybrid Multistream Deep Learning Architecture. Sensors 2026, 26, 2281. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cognolato, M.; Gijsberts, A.; Gregori, V.; Saetta, G.; Giacomino, K.; Hager, A.-G.M.; Gigli, A.; Faccio, D.; Tiengo, C.; Bassetto, F.; et al. Gaze, visual, myoelectric, and inertial data of grasps for intelligent prosthetics. Sci. Data 2020, 7, 43. [Google Scholar] [CrossRef] [Scilit]
- Sun, Y.; Li, K.x.; Li, C.; Zhang, J.H.; Wang, L.; Li, Y.b. RCTNet: A Wavelet-Enhanced CNN-Transformer for sEMG Gesture Recognition. In Proceedings of the 2025 10th International Conference on Robotics and Automation Engineering (ICRAE), Haikou, China, 14–16 November 2025; pp. 240–246. [Google Scholar]
- Niu, X.; Zhang, D.; Qu, C.; Ren, L.; Qian, Z.; Wu, J.; Wang, K.; Ren, L. Decoding Hand Gestures Under Arm Movements Based on Electromyography and Acceleration Signals. J. Bionic Eng. 2026, 23, 880–897. [Google Scholar] [CrossRef] [Scilit]
- Sharma, V.; Lloyd, E.; Faltys, M.; Ortiz-Catalan, M.; Glass, C. Assessment of Gesture Accuracy for a Multi-Electrode EMG-Sensor-Array-Based Prosthesis Control System. Prosthesis 2025, 7, 99. [Google Scholar] [CrossRef] [Scilit]
- Yasen, M.; Jusoh, S. A systematic review on hand gesture recognition techniques, challenges and applications. PeerJ Comput. Sci. 2019, 5, e218. [Google Scholar] [CrossRef] [Scilit]
- Chowdhury, R.H.; Reaz, M.B.; Ali, M.A.; Bakar, A.A.; Chellappan, K.; Chang, T.G. Surface electromyography signal processing and classification techniques. Sensors 2013, 13, 12431–12466. [Google Scholar] [CrossRef] [Scilit]
- Roberto, M.; Philip, P. Biophysics of the Generation of EMG Signals. In Electromyography: Physiology, Engineering, and Non-Invasive Applications; IEEE: New York, NY, USA, 2004; pp. 81–105. [Google Scholar]
- De Luca, C.J.; Contessa, P. Hierarchical control of motor units in voluntary contractions. J. Neurophysiol. 2012, 107, 178–195. [Google Scholar] [CrossRef] [Scilit]
- Shafiq, U.; Waris, A.; Amin, F.; Ullah, A.; Ashraf, H.; Khan, M.J.; Ijaz, M.A.; Hazzazi, F.; Ansari, K.; Gilani, S.O. Enhanced spectro-temporal feature extraction for prosthetic control using variational mode decomposition. Sci. Rep. 2025, 15, 44386. [Google Scholar] [CrossRef] [Scilit]
- Li, J.; Wei, L.; Wen, Y.; Liu, X.; Wang, H. An approach to continuous hand movement recognition using SEMG based on features fusion. Vis. Comput. 2023, 39, 2065–2079. [Google Scholar] [CrossRef] [Scilit]
- Ma, J.; Bao, X.; Qin, F.; He, W.; Yang, G.; Ma, J.; Zeng, S. CNN-MSTINet: A lightweight hybrid network with multi-scale temporal interaction for sparse sEMG-based gesture recognition. Meas. Sci. Technol. 2026, 37, 076111. [Google Scholar] [CrossRef] [Scilit]
- Zhang, W.; Zhao, T.; Zhang, J.; Wang, Y. LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition. Front. Neurorobot. 2023, 17, 1127338. [Google Scholar] [CrossRef] [Scilit]
- Mian, X.; Bingtao, Z.; Shiqiang, C.; Song, L. MCMP-Net: MLP combining max pooling network for sEMG gesture recognition. Biomed. Signal Process. Control 2024, 90, 105846. [Google Scholar] [CrossRef] [Scilit]
- Sijin, W.; Jianjun, T.; Bingtao, Z.; Tao, H.; Li, Z.; Mian, X. STMS-Net: Spatial Temporal Multi-Spectral Network for sEMG Gesture Recognition. IEEE Access 2025, 13, 67867–67881. [Google Scholar] [CrossRef] [Scilit]
- Fratti, R.; Marini, N.; Atzori, M.; Müller, H.; Tiengo, C.; Bassetto, F. A Multi-Scale CNN for Transfer Learning in sEMG-Based Hand Gesture Recognition for Prosthetic Devices. Sensors 2024, 24, 7147. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ren, H.; Jiang, X.; Dai, C. Exploring Control Mechanism of Motoneuron Pools for the Forearm Antagonist Synergistic Muscles. IEEE Trans. Neural Syst. Rehabil. Eng. 2025, 33, 750–759. [Google Scholar] [CrossRef] [Scilit]
- Huesler, E.J.; Maier, M.A.; Hepp-Reymond, M.C. EMG activation patterns during force production in precision grip. III. Synchronisation of single motor units. Exp. Brain Res. 2000, 134, 441–455. [Google Scholar] [CrossRef] [Scilit]
- Datta, A.K.; Farmer, S.F.; Stephens, J.A. Central nervous pathways underlying synchronization of human motor unit firing studied during voluntary contractions. J. Physiol. 1991, 432, 401–425. [Google Scholar] [CrossRef] [Scilit]
- Cai, L.; Yan, S.; Ouyang, C.; Zhang, T.; Zhu, J.; Chen, L.; Ma, X.; Liu, H. Muscle synergies in joystick manipulation. Front. Physiol. 2023, 14, 1282295. [Google Scholar] [CrossRef] [Scilit]












| HS | LS | MS | SS | |
|---|---|---|---|---|
| Sample size | 21 | 5 | 7 | 8 |
| Age | 44.00 ± 14.86 | 44.80 ± 15.32 | 44.87 ± 6.59 | 62.13 ± 6.56 |
| Residual limb length ratio (%) | / | 82.38 ± 4.50 | 52.30 ± 4.07 | 28.61 ± 6.22 |
| Gender (Male/Female) | 12/9 | 3/2 | 7/0 | 3/5 |
| Residual Limb/Dominant Side (Left/Right) | 7/14 | 4/1 | 0/7 | 5/3 |
| Configuration Item | MSCB-DualAttn & MSCB-NoAttn | Baseline CNN |
|---|---|---|
| Optimizer | Adam | Adam |
| Initial Learning Rate | 0.001 | 0.001 |
| Batch Size | 128 | 128 |
| Training Epochs | 50 | 30 |
| Loss Function | Cross-Entropy Loss | Cross-Entropy Loss |
| Learning Rate Scheduler | ReduceLROnPlateau (patience = 5, monitored on val accuracy) | Not used |
| Random Seed | 42 | 42 |
| Category | Metric | Mean ± Std | 95% Confidence Interval |
|---|---|---|---|
| HS | Accuracy | 0.9379 ± 0.0348 | [0.9220, 0.9537] |
| F1 | 0.9349 ± 0.0384 | [0.9175, 0.9524] | |
| MSE | 0.0066 ± 0.0038 | [0.0049, 0.0084] | |
| RMSE | 0.0814 ± 0.0230 | [0.0678, 0.0888] | |
| MAE | 0.0092 ± 0.0044 | [0.0072, 0.0112] | |
| LS | Accuracy | 0.8614 ± 0.0677 | [0.7773, 0.9454] |
| F1 | 0.8541 ± 0.0695 | [0.7678, 0.9404] | |
| MSE | 0.0148 ± 0.0069 | [0.0062, 0.0233] | |
| RMSE | 0.1216 ± 0.0320 | [0.0786, 0.1579] | |
| MAE | 0.0200 ± 0.0095 | [0.0082, 0.0319] | |
| MS | Accuracy | 0.7809 ± 0.0718 | [0.7146, 0.8473] |
| F1 | 0.7660 ± 0.0821 | [0.6901, 0.8421] | |
| MSE | 0.0242 ± 0.0083 | [0.0165, 0.0319] | |
| RMSE | 0.1555 ± 0.0259 | [0.1297, 0.1776] | |
| MAE | 0.0315 ± 0.0093 | [0.0229, 0.0401] | |
| SS | Accuracy | 0.6269 ± 0.0896 | [0.5520, 0.7019] |
| F1 | 0.6066 ± 0.0943 | [0.5277, 0.6855] | |
| MSE | 0.0380 ± 0.0096 | [0.0300, 0.0460] | |
| RMSE | 0.1950 ± 0.0247 | [0.1730, 0.2143] | |
| MAE | 0.0537 ± 0.0117 | [0.0439, 0.0634] |
| Model | Input | Sliding Window Parameters | Partition Scheme | F1-Score | Accuracy (%) | Recall (Macro) | Data |
|---|---|---|---|---|---|---|---|
| MSCB-DualAttn | sEMG raw data | Window 250 ms, step 100 ms | Temporally ordered 80%/20% split | 93.89 | 95.81 | 96.21 | DB8 |
| MSCB-DualAttn | sEMG raw data | Window 250 ms, step 100 ms | Temporally ordered 80%/20% split | 85.94 | 86.42 | 87.12 | DB2 |
| MSCB-DualAttn | sEMG raw data | Window 150 ms, step 50 ms | Trials 1/3/4/6 Train, 2/5 Test | 86.94 | 88.79 | 88.93 | DB2 |
| CviT [19] | Time domain And Frequency domain Data | Window 200 ms, step 100 ms | Trials 1/3/4/6 Train, 2/5 Test | - | 80.02 | - | DB2 |
| MSDS-FusionNet [20] | sEMG raw data | Window 200 ms, overlap 5 ms | Trials 1/3/4/6 Train, 2/5 Test | - | 90.15 | 89.34 | DB2 |
| MSCANN [21] | sEMG raw data | Window 150 ms, step 50 ms | Trials 1/3/4/6 Train, 2/5 Test | - | 93.80 | - | DB2 |
| RF (spectro-temporal feature) [36] | Spectro-temporal feature | Window 250 ms, overlap ratio 10% | 10-fold cross-validation | - | 98.16 | - | DB8 |
| CNN-MSTINet [38] | sEMG raw data | Window 200 ms | Trials 1/3/4/6 Train, 2/5 Test | - | 85.77 | - | DB2 |
| LST-EMG-Net [39] | Signal augmentation based on sEMG window | Window 300 ms, step 10 ms | Trials 1/3/4/6 Train, 2/5 Test | / | 81.47 | - | DB2 |
| MCMP-Net [40] | Rms calculation | Window 20 points, sliding RMS | Trials 1/3/4/6 Train, 2/5 Test | 86.4 | 84.50 | 88.3 | DB2 |
| STMS-Net [41] | Rms calculation | Window 20 points, sliding RMS | Trials 1/3/4/6 Train, 2/5 Test | 90.1 | 90.00 | 91.8 | DB2 |
| SVM [37] | Spectral Features | Window 400 points, step 20 points | 1st set Train, 2nd set Test | - | 85.50 | - | DB8 (5 subjects) |
| CNN [37] | sEMG raw data | Window 400 points, step 20 points | 1st set Train, 2nd set Test | - | 83.25 | - | DB8 (5 subjects) |
| LSTM [37] | sEMG raw data | Window 400 points, step 20 points | 1st set Train, 2nd set Test | - | 95.10 | - | DB8 (5 subjects) |
| FDM [37] | sEMG raw data | Window 400 points, step 20 points | 1st set Train, 2nd set Test | - | 93.53 | - | DB8 (5 subjects) |
| MFFCNN-LSTM [37] | sEMG raw data | Window 400 points, step 20 points | 1st set Train, 2nd set Test | - | 98.50 | - | DB8 (5 subjects) |
| MS-CLSTM [24] | sEMG grayscale image | Window 200 ms, step 50 ms | 1st set Train, 2nd set Test | - | 86.66 | - | DB2 |
| MSCNN [42] | sEMG raw data | Window 100 ms, overlap ratio 75% | Train: 2/4/6; Val:1/5; Test:3 | 77.0 | 82.4 | - | DB2 |
| Evaluation Metric | MSCB-DualAttn |
|---|---|
| Total Parameters | 308,967 |
| Model Size (MB) | 1.178616 |
| Single-sample Inference Time (ms) | 3.358563 |
| Throughput (Samples per Second) | 297.75 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Shi, X.; He, Z.; Zheng, L.; Chen, Y.; Bai, W.; Xu, M.; Zhu, R. MSCB-DualAttn Network for sEMG-Based Gesture Recognition in Transradial Amputees with Varying Residual Limb Lengths. Symmetry 2026, 18, 869. https://doi.org/10.3390/sym18050869
Shi X, He Z, Zheng L, Chen Y, Bai W, Xu M, Zhu R. MSCB-DualAttn Network for sEMG-Based Gesture Recognition in Transradial Amputees with Varying Residual Limb Lengths. Symmetry. 2026; 18(5):869. https://doi.org/10.3390/sym18050869
Chicago/Turabian StyleShi, Xinwei, Zuxiang He, Liangdong Zheng, Yu Chen, Wenxia Bai, Menglei Xu, and Rui Zhu. 2026. "MSCB-DualAttn Network for sEMG-Based Gesture Recognition in Transradial Amputees with Varying Residual Limb Lengths" Symmetry 18, no. 5: 869. https://doi.org/10.3390/sym18050869
APA StyleShi, X., He, Z., Zheng, L., Chen, Y., Bai, W., Xu, M., & Zhu, R. (2026). MSCB-DualAttn Network for sEMG-Based Gesture Recognition in Transradial Amputees with Varying Residual Limb Lengths. Symmetry, 18(5), 869. https://doi.org/10.3390/sym18050869
