Teaching-Based Robotic Arm System with BiLSTM Pattern Recognition for Food Processing Automation
Featured Application
Abstract
1. Introduction
2. Materials and Methods
2.1. System Overview
2.2. Mechanical Design and Fabrication
2.2.1. Kinematic Structure
2.2.2. Link Design and Fabrication
2.2.3. End-Effector Design
2.2.4. CAN Communication Hardware
2.3. Software Implementation
2.3.1. CAN Communication Driver Implementation
2.3.2. Robot Control System
2.3.3. Homing Initialization
2.3.4. Teaching Mode
2.4. Pattern Recognition and Classification
2.4.1. Data Collection and Preprocessing
2.4.2. Model Architecture
2.4.3. Training Procedure
3. Results
3.1. System Integration and Functionality
3.2. Teaching Mode Data Collection
3.3. Model Training and Evaluation
4. Discussion
4.1. Teaching-Based Data Collection
4.2. Pattern Recognition Performance
4.3. System Repeatability and Practical Considerations
4.4. Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Li, D.; Xu, X. Industry 4.0—Frontiers of Fourth Industrial Revolution. Syst. Res. Behav. Sci. 2020, 37, 531–534. [Google Scholar] [CrossRef]
- Raja Santhi, A.; Muthuswamy, P. Influence of Blockchain Technology in Manufacturing Supply Chain and Logistics. Logistics 2022, 6, 15. [Google Scholar] [CrossRef]
- Kok, C.L.; Heng, J.B.; Koh, Y.Y.; Teo, T.H. Energy-, Cost-, and Resource-Efficient IoT Hazard Detection System with Adaptive Monitoring. Sensors 2025, 25, 1761. [Google Scholar] [CrossRef] [PubMed]
- Qiu, F.; Kumar, A.; Hu, J.; Sharma, P.; Tang, Y.B.; Xu Xiang, Y.; Hong, J. A Review on Integrating IoT, IIoT, and Industry 4.0: A Pathway to Smart Manufacturing and Digital Transformation. IET Inf. Secur. 2025, 2025, 9275962. [Google Scholar] [CrossRef]
- Soori, M.; Arezoo, B.; Dastres, R. Internet of Things for Smart Factories in Industry 4.0, a Review. Internet Things Cyber-Phys. Syst. 2023, 3, 192–204. [Google Scholar] [CrossRef]
- Soori, M.; Dastres, R.; Arezoo, B.; Karimi Ghaleh Jough, F. Intelligent Robotic Systems in Industry 4.0: A Review. J. Adv. Manuf. Sci. Technol. 2024, 4, 2024007. [Google Scholar] [CrossRef]
- Bader, F.; Rahimifard, S. Challenges for Industrial Robot Applications in Food Manufacturing. In Proceedings of the 2nd International Symposium on Computer Science and Intelligent Control, Stockholm, Sweden, 21 September 2018; pp. 1–8. [Google Scholar]
- Wakchaure, Y.B.; Patle, B.K.; Pawar, S. Prospects of Robotics in Food Processing: An Overview. J. Mech. Eng. Autom. Control. Syst. 2023, 4, 17–37. [Google Scholar] [CrossRef]
- Woo, S.; Kim, Y.; Kim, S. Converging Extended Reality and Robotics for Innovation in the Food Industry. AgriEngineering 2025, 7, 322. [Google Scholar] [CrossRef]
- Raja Santhi, A.; Muthuswamy, P. Industry 5.0 or Industry 4.0S? Introduction to Industry 4.0 and a Peek into the Prospective Industry 5.0 Technologies. Int. J. Interact. Des. Manuf. 2023, 17, 947–979. [Google Scholar] [CrossRef]
- Iqbal, J.; Islam, R.U.; Abbas, S.Z.; Khan, A.A.; Ajwad, S.A. Automating Industrial Tasks Through Mechatronic Systems—A Review of Robotics in Industrial Perspective. Teh. Vjesn. 2016, 23, 881–887. [Google Scholar]
- Hossain, D.; Capi, G.; Jindai, M.; Kaneko, S. Pick-Place of Dynamic Objects by Robot Manipulator Based on Deep Learning and Easy User Interface Teaching Systems. Ind. Robot 2017, 44, 11–20. [Google Scholar] [CrossRef]
- Phuyal, S.; Bista, D.; Bista, R. Challenges, Opportunities and Future Directions of Smart Manufacturing: A State of Art Review. Sustain. Futures 2020, 2, 100023. [Google Scholar] [CrossRef]
- Su, B. Tracking Control of Robotic Manipulator End-Effector Trajectory Based on Robust Sliding Mode Method. PLoS ONE 2025, 20, e0320118. [Google Scholar] [CrossRef] [PubMed]
- Zhao, C.; Wei, Y.; Xiao, J.; Sun, Y.; Zhang, D.; Guo, Q.; Yang, J. Inverse Kinematics Solution and Control Method of 6-Degree-of-Freedom Manipulator Based on Deep Reinforcement Learning. Sci. Rep. 2024, 14, 12467. [Google Scholar] [CrossRef]
- Gao, R. Inverse Kinematics Solution of Robotics Based on Neural Network Algorithms. J. Ambient Intell. Humaniz. Comput. 2020, 11, 6199–6209. [Google Scholar] [CrossRef]
- Stifter, S. Algebraic Methods for Computing Inverse Kinematics. J. Intell. Robot. Syst. 1994, 11, 79–89. [Google Scholar] [CrossRef]
- Lee, C.S.G.; Ziegler, M. Geometric Approach in Solving Inverse Kinematics of PUMA Robots. IEEE Trans. Aerosp. Electron. Syst. 1984, 20, 695–706. [Google Scholar] [CrossRef]
- Angeles, J. On the Numerical Solution of the Inverse Kinematic Problem. Int. J. Robot. Res. 1985, 4, 21–37. [Google Scholar] [CrossRef]
- Kucuk, S.; Bingul, Z. The Inverse Kinematics Solutions of Industrial Robot Manipulators. In Proceedings of the 2004 IEEE International Conference on Mechatronics, ICM’04, Istanbul, Turkey, 3–5 June 2004; pp. 274–279. [Google Scholar]
- Peiper, D.L. The Kinematics of Manipulators Under Computer Control; Technical Report CS-116; Department of Computer Science, Stanford University: Stanford, CA, USA, 1968. [Google Scholar]
- Primrose, E.J.F. On the Input-Output Equation of the General 7R-Mechanism. Mech. Mach. Theory 1986, 21, 509–510. [Google Scholar] [CrossRef]
- Liao, Q.; Liang, C.; Zhang, Q. A Novel Approach to the Displacement Analysis of General Spatial 7R Mechanism. Chin. J. Mech. Eng. 2009, 22, 336–344. [Google Scholar]
- Lee, H.Y.; Liang, C.G. Displacement Analysis of the General Spatial 7-Link 7R Mechanism. Mech. Mach. Theory 1988, 23, 219–226. [Google Scholar] [CrossRef]
- Raghavan, M.; Roth, B. Inverse Kinematics of the General 6R Manipulator and Related Linkages. J. Mech. Des. 1993, 115, 502–508. [Google Scholar] [CrossRef]
- Köker, R.; Öz, C.; Çakar, T.; Ekiz, H. A Study of Neural Network Based Inverse Kinematics Solution for a Three-Joint Robot. Robot. Auton. Syst. 2004, 49, 227–234. [Google Scholar] [CrossRef]
- Köker, R. A Genetic Algorithm Approach to a Neural-Network-Based Inverse Kinematics Solution of Robotic Manipulators Based on Error Minimization. Inf. Sci. 2013, 222, 528–543. [Google Scholar] [CrossRef]
- Csiszar, A.; Eilers, J.; Verl, A. On Solving the Inverse Kinematics Problem Using Neural Networks. In Proceedings of the 2017 24th International Conference on Mechatronics and Machine Vision in Practice (M2VIP), Auckland, New Zealand, 21–23 November 2017; pp. 1–6. [Google Scholar]
- Hasan, A.T.; Hamouda, A.M.S.; Ismail, N.; Al-Assadi, H.M.A.A. An Adaptive-Learning Algorithm to Solve the Inverse Kinematics Problem of a 6 DOF Serial Robot Manipulator. Adv. Eng. Softw. 2006, 37, 432–438. [Google Scholar] [CrossRef]
- Lu, J.; Zou, T.; Jiang, X. A Neural Network Based Approach to Inverse Kinematics Problem for General Six-Axis Robots. Sensors 2022, 22, 8909. [Google Scholar] [CrossRef]
- Argall, B.D.; Chernova, S.; Veloso, M.; Browning, B. A Survey of Robot Learning from Demonstration. Robot. Auton. Syst. 2009, 57, 469–483. [Google Scholar] [CrossRef]
- Ravichandar, H.; Polydoros, A.S.; Chernova, S.; Billard, A. Recent Advances in Robot Learning from Demonstration. Annu. Rev. Control Robot. Auton. Syst. 2020, 3, 297–330. [Google Scholar] [CrossRef]
- Kormushev, P.; Calinon, S.; Caldwell, D.G. Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input. Adv. Robot. 2011, 25, 581–603. [Google Scholar] [CrossRef]
- Ye, Y.; Nie, Z.; Liu, X.; Xie, F.; Li, Z.; Li, P. ROS2 Real-Time Performance Optimization and Evaluation. Chin. J. Mech. Eng. 2023, 36, 144. [Google Scholar] [CrossRef]
- Macenski, S.; Foote, T.; Gerkey, B.; Lalancette, C.; Woodall, W. Robot Operating System 2: Design, Architecture, and Uses in the Wild. Sci. Robot. 2022, 7, eabm6074. [Google Scholar] [CrossRef]
- Kim, Y.; Kim, S. Automation and Optimization of Food Process Using CNN and Six-Axis Robotic Arm. Foods 2024, 13, 3826. [Google Scholar] [CrossRef]
- Iwana, B.K.; Uchida, S. An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks. PLoS ONE 2021, 16, e0254841. [Google Scholar] [CrossRef] [PubMed]
- Wen, Q.; Sun, L.; Yang, F.; Song, X.; Gao, J.; Wang, X.; Xu, H. Time Series Data Augmentation for Deep Learning: A Survey. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, Montreal, QC, Canada, 19–27 August 2021; pp. 4653–4660. [Google Scholar]
- Iglesias, G.; Talavera, E.; González-Prieto, Á.; Mozo, A.; Gómez-Canaval, S. Data Augmentation Techniques in Time Series Domain: A Survey and Taxonomy. Neural Comput. Applic. 2023, 35, 10123–10145. [Google Scholar] [CrossRef]
- Siami-Namini, S.; Tavakoli, N.; Namin, A.S. The Performance of LSTM and BiLSTM in Forecasting Time Series. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 9–12 February 2019; pp. 3285–3292. [Google Scholar]
- Fan, Y.; Tang, Q.; Guo, Y.; Wei, Y. BiLSTM-MLAM: A Multi-Scale Time Series Prediction Model for Sensor Data Based on Bi-LSTM and Local Attention Mechanisms. Sensors 2024, 24, 3962. [Google Scholar] [CrossRef]
- Xu, Y.; Pan, Q.; Wang, Z.; Hu, B. A Novel Trajectory Prediction Method Based on CNN, BiLSTM, and Multi-Head Attention Mechanism. Aerospace 2024, 11, 822. [Google Scholar] [CrossRef]
- Hochreiter, S.; Schmidhuber, J. Long Short-Term Memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
- Khanesar, M.A.; Yan, M.; Isa, M.; Piano, S.; Branson, D.T. Precision Denavit–Hartenberg Parameter Calibration for Industrial Robots Using a Laser Tracker System and Intelligent Optimization Approaches. Sensors 2023, 23, 5368. [Google Scholar] [CrossRef]
- Hazem, Z.B.; Saidi, F.; Guler, N.; Altaif, A.H. Reinforcement Learning-Based Intelligent Trajectory Tracking for a 5-DOF Mitsubishi Robotic Arm: Comparative Evaluation of DDPG, LC-DDPG, and TD3-ADX. Int. J. Intell. Robot Appl. 2025. [Google Scholar] [CrossRef]










| Model | Rated Voltage (V) | Rated Current (A) | Rated Torque (N∙m) | Rated Speed (RPM) | Pole Pairs | Reduction Ratio | Weight (g) |
|---|---|---|---|---|---|---|---|
| AK80-64 KV80 | 24 | 7 | 48 | 23 | 21 | 64:1 | 850 |
| AK70-10 KV100 | 24 | 7.2 | 8.3 | 148 | 21 | 10:1 | 521 |
| AK60-6 V1.1 KV80 | 24 | 6.5 | 3 | 420 | 14 | 6:1 | 368 |
| Joint | Rotation Axis | Model | Range of Motion (Degrees) |
|---|---|---|---|
| 1 | Z | AK80-64 KV80 | −210–+80 |
| 2 | X | AK80-64 KV80 | −90–+90 |
| 3 | Z | AK70-10 KV100 | −50–+240 |
| 4 | X | AK70-10 KV100 | −95–+95 |
| 5 | Z | AK60-6 V1.1 KV80 | −200–+120 |
| 6 | X | AK60-6 V1.1 KV80 | −95–+95 |
| True\Predicted | Rectangle | Triangle | Circle |
|---|---|---|---|
| Rectangle | 11 | 0 | 1 |
| Triangle | 4 | 8 | 0 |
| Circle | 1 | 0 | 11 |
| Pattern | Precision | Recall | F1-Score | Support |
|---|---|---|---|---|
| Rectangle | 68.75% | 91.67% | 78.57% | 12 |
| Triangle | 100.00% | 66.67% | 80.00% | 12 |
| Circle | 91.67% | 91.67% | 91.67% | 12 |
| Model | Accuracy | Precision | Recall | F1-Score | Parameters |
|---|---|---|---|---|---|
| Random Forest | 86.11% | 88.55% | 86.11% | 85.83% | N/A |
| 1D-CNN | 77.78% | 81.04% | 77.78% | 77.61% | 183,875 |
| GRU | 44.44% | 49.05% | 44.44% | 45.18% | 176,259 |
| TCN | 66.67% | 74.60% | 66.67% | 65.51% | 467,907 |
| BiLSTM+Attention | 83.33% | 86.81% | 83.33% | 83.41% | 608,900 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kim, Y.; Kim, S. Teaching-Based Robotic Arm System with BiLSTM Pattern Recognition for Food Processing Automation. Appl. Sci. 2025, 15, 12936. https://doi.org/10.3390/app152412936
Kim Y, Kim S. Teaching-Based Robotic Arm System with BiLSTM Pattern Recognition for Food Processing Automation. Applied Sciences. 2025; 15(24):12936. https://doi.org/10.3390/app152412936
Chicago/Turabian StyleKim, Youngjin, and Sangoh Kim. 2025. "Teaching-Based Robotic Arm System with BiLSTM Pattern Recognition for Food Processing Automation" Applied Sciences 15, no. 24: 12936. https://doi.org/10.3390/app152412936
APA StyleKim, Y., & Kim, S. (2025). Teaching-Based Robotic Arm System with BiLSTM Pattern Recognition for Food Processing Automation. Applied Sciences, 15(24), 12936. https://doi.org/10.3390/app152412936

