Voice-Controlled Intralogistics on an Open Cyber–Physical Middleware: Deep Learning-Based Speech Processing and Validation in an Industrial Noisy Environment
Abstract
1. Introduction
2. Related Work
3. Materials and Methods
3.1. Overall Architecture of the VCLMP Solution
3.2. OPIL
4. Voice-Controlled Logistics System Design and Development
4.1. Speech Denoising Application
4.1.1. Datasets and Data Preparation
4.1.2. Speech Denoising Procedure
4.1.3. Neural Network Architecture
4.1.4. Training Procedure
4.1.5. Results and Discussion
4.2. Voice Recognition Application
4.2.1. Datasets and Data Preparation
- mapping—A list of labels corresponding to sub-directory names.
- labels—Numerical class identifiers for each file.
- MFCCs—The extracted feature arrays.
- files—Paths to the original audio files.
4.2.2. Voice Recognition Procedure
4.2.3. Neural Network Architecture
- A Conv2D layer applying multiple filters to the MFCC input, with 64 filters of size [3 × 3] in the first layer, followed by 32 filters of sizes [3 × 3] and [2 × 2], respectively, using ReLU activation and L2 weight regularization to improve generalization and reduce overfitting.
- A Batch Normalization layer applied after each convolution.
- A MaxPooling2D layer with a pooling window of [3 × 3] (or [2 × 2] for the last block), stride 2 in each dimension, and ‘same’ padding, ensuring consistent spatial downsampling across layers.
4.2.4. Training Procedure
4.2.5. Results and Discussion
5. VCLMP End-to-End Evaluation of the Integrated Voice-Command Processing Pipeline
6. Industrial Validation
6.1. Presentation of Validation Case
6.2. Findings and Discussion
6.2.1. Operational Validation in the Production Environment
6.2.2. Quantitative Summary of VCLMP Performance
7. Conclusions
- The voice interaction subsystem will be further developed toward more advanced natural language understanding, enabling context-aware and conversational command execution beyond predefined keyword sets.
- Improvements in speech processing will be explored, including more advanced neural architectures and enhanced robustness to diverse acoustic conditions and speaker variability.
- Adaptive learning mechanisms and user-specific model tuning will also be investigated to improve performance across different users and accents.
- Integration with digital twin technologies and predictive analytics will be explored to enable higher levels of automation, optimization, and decision support in intralogistics processes.
- Advancement towards Industry 5.0 standards.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. VCLMP Design and Development: IoT Sensing Integration and High-Level Orchestration Logic
Appendix A.1. Speech Recording Application
Appendix A.1.1. Architectural Overview
- audio/VoiceStreamSamplerTask—Implements asynchronous audio acquisition using the device microphone, including voice activity detection (VAD) and acoustic echo cancellation (AEC). It monitors signal energy to detect speech segments, records them into a buffer, and outputs a WAV file once silence is detected, notifying higher layers via a callback interface.
- core/AudioStreamingController—Acts as the central orchestration component running in its own thread, coordinating audio capture, file transmission, and response handling. It starts the sampling process, uploads recorded audio to a server, processes responses (optionally parsing JSON), and triggers feedback actions while maintaining a continuous listening loop.
- httpserver/HTTPPostMultipart—Handles construction and execution of multipart HTTP POST requests, enabling file uploads along with optional form data. It manages connection setup, stream writing, and response retrieval from the server.
- httpserver/HTTPServerResponse—Serves as a simple data container encapsulating the HTTP response status code and response body. It standardizes how server responses are passed and processed within the system.
- httpserver/HTTPServerResponseContent—Represents a structured model for parsing JSON responses returned by the server, specifically mapping fields such as play_code. It is used in conjunction with a JSON parser to convert raw responses into usable objects.
- interfaces/IVSSCallback—Defines a callback interface used by the audio sampling component to communicate with the controller. It provides methods for delivering the generated audio file path and reporting real-time status updates.
- interfaces/IASCCallback—Defines a callback interface used by the controller to communicate with the user interface layer. It enables status updates and triggers playback of notification sounds based on system events.
- model/VoiceStreamSamplerConfig—Encapsulates all configurable parameters related to audio recording and processing, such as sampling rate, encoding format, silence thresholds, and timing constraints. It allows centralized tuning of the voice acquisition behavior without modifying core logic.
- enums/EnumNotifications—Defines a set of predefined notification types used to represent system outcomes, such as successful command recognition or the need to repeat input. These values are used to standardize feedback behavior across the application.
- ui/VCLMPContinualMainActivity—Serves as the main user interface and entry point of the application, handling user interactions such as start/stop control, dataset configuration, and push-to-talk functionality. It initializes and connects all major components, bridging the UI with the underlying processing pipeline through callbacks.
- utility/NotificationPlayer—Provides utility functionality for playing predefined audio feedback signals corresponding to system states. It uses a blocking playback mechanism to ensure that notification sounds are fully played before proceeding.
- wav/WavWriter—Implements low-level logic for converting raw PCM audio data into a properly formatted WAV file. It manually constructs the WAV header and appends recorded audio data, ensuring compatibility with standard audio processing systems.
Appendix A.1.2. Interaction Logic, Audio Capture and Network Communication
Appendix A.2. AGV and Industrial Robot Manipulator Arm

Appendix A.2.1. AGV Subsystem Implementation
Appendix A.2.2. ABB IRB 140 Subsystem Implementation
Appendix A.2.3. AGV and ABB IRB 140 Integrations
Appendix A.3. Sensor Agent Node (SAN) Implementation
Appendix A.3.1. Hardware Platform and Deployment
- Sensing SANs, equipped with LM393 Infrared (IR) sensors and DHT11 sensors. IR sensors are positioned around the ABB IRB 140 robot arm to detect pallet placement, with five monitored positions enabling precise spatial awareness. Stated robot arm with a gripper is fully ROS based and integrated with OPIL trough RAN (Robot Agent Node) module. Also, DHT11 sensors provide environmental monitoring by tracking temperature variations in production facilities.
- Identification SANs, equipped with the Waveshare PN532 HAT via SPI interface, enabling reading and writing of NFC/RFID tags for product identification and traceability within the logistics system. Stated nodes are also placed near mentioned robot arm.

Appendix A.3.2. Software Architecture and Containerization
Appendix A.3.3. Data Communication and OPIL Integration
Appendix A.4. The Orchestration Layer—Enterprise Resource Planning


Appendix A.4.1. OPIL Integration Architecture
Appendix A.4.2. Driven Operational Workflows
- Product identification at the slaughter line—A worker positioned on the production line transmits product information (e.g., a barcode) to the ERP via the SRX3 Wireless headset and the voice recognition pipeline. Upon receiving the command, the ERP issues a request to the OPIL ERP Integration Module to generate and write a new NFC tag identifier to the corresponding Sensor Agent Node (e.g., SENHUF001). Confirmation of the successful write operation is propagated back through OPIL to the ERP and reflected in the HMI view, ensuring that each carcass is uniquely traceable from the very first stage of production.
- Box-level identification at the deboning stage—Once a worker has filled an E2 meat crate with the requested products, a voice-issued instruction prompts the ERP to generate a new NFC tag code and write it through MOD.IOT.SAN (e.g., SENUHF1002), thereby associating the box content with a unique identifier and ensuring full backward and forward traceability across all subsequent processing stages.
- Voice-initiated transport order—When a worker requests the relocation of containers via voice command, the ERP receives the request, formulates an ERP Trigger containing the FROM/TO logical positions, and forwards it through the Integration Module to the Task Planner. The AGV, communicating through the Robot Agent Node (MOD.IOT.RAN), executes the navigation task and reports arrival, destination, and current load status back to the Task Planner and the ERP, closing the feedback loop. The same triggering mechanism is also exposed through the HMI module, allowing manual dispatch when needed.
- Pallet consolidation—Upon completion of box transfer to a Euro pallet, the ABB IRB 140 robotic manipulator—operating through the same RAN interface—autonomously generates a transport order, which the ERP Integration Module translates into a new ERP Trigger and dispatches to the Task Planner. This eliminates the need for manual intervention during the consolidation phase and preserves the uniform integration pattern used throughout the system.
- Box relocation by the robotic manipulator—When the ERP issues a relocation command, the manipulator’s RAN initiates motion while a co-located SAN (e.g., SENUHF1003) performs NFC tag reading. The detected tag identifier is propagated through the ERP Integration Module, mapped against the corresponding logical (x, y, z) position, and translated into the appropriate Task Planner action. This mechanism enables context-aware pick-and-place operations driven by real-time identification data rather than by static, predefined sequences.
- Automatic door opening—When the AGV approaches a doorway separating two production zones, its RAN issues an opening command through the OPIL system to a PLC governing the I/O interface. The PLC opens the door, updates its state, and informs the OPIL infrastructure once the passage has been cleared, after which the door is closed in a similar manner. This functionality is fully driven by ERP-level workflow logic and ensures uninterrupted material flow between zones with strict hygienic separation.
Appendix A.4.3. Optimization and Decision Logic
Appendix B. A Brief Economic Analysis
| Discount Rate (r) | Base OPEX | OPEX + 10% | OPEX + 20% |
|---|---|---|---|
| 8% | NPV = 239,706 EUR | NPV = 244,826 EUR | NPV = 249,947 EUR |
| 10% | NPV = 237,506 EUR | NPV = 242,407 EUR | NPV = 247,308 EUR |
| 12% | NPV = 235,458 EUR | NPV = 240,153 EUR | NPV = 244,849 EUR |
Appendix C. Additional VCLMP Solution Evaluation

References
- Gunasekaran, A.; Subramanian, N.; Papadopoulos, T. Information technology for competitive advantage within logistics and supply chains: A review. Transp. Res. Part E Logist. Transp. Rev. 2017, 99, 14–33. [Google Scholar] [CrossRef] [Scilit]
- Fernandes, J.; Silva, F.J.G.; Campilho, R.D.S.G.; Pinto, G.F.L.; Baptista, A. Intralogistics and industry 4.0: Designing a novel shuttle with picking system. Procedia Manuf. 2019, 38, 1801–1832. [Google Scholar] [CrossRef] [Scilit]
- Placzek, E.; Osieczko-Potoczna, K. Current State of Knowledge and Research Needs of Intralogistics. Eur. Res. Stud. J. 2024, 27, 97–112. [Google Scholar] [CrossRef] [Scilit]
- Koster, R.D.; Roy, D.; Lim, Y.F.; Kumar, S. Internet of Things in Intralogistics: Applications and Emerging Research. Prod. Oper. Manag. 2025, 34, 3343–3363. [Google Scholar] [CrossRef] [Scilit]
- Pecev, P.; Ivanković, Z.; Todorović, V.; Maslarić, M.; Bojić, S.; Milosavljević, A. Exploring a Cost-Effective Approach to AGV Solutions: A Case Study in the Textile Industry. Automation 2025, 6, 72. [Google Scholar] [CrossRef] [Scilit]
- Björk, A. Automated Guided Vehicles: Investment and Implementation. Bachelor’s Thesis, University of Vaasa, Vaasa, Finland, 2022. Available online: https://www.theseus.fi/handle/10024/748499 (accessed on 8 May 2026).
- Horizon 2020—Logistics for Manufacturing SMEs. European Commision. Available online: https://cordis.europa.eu/project/id/767642 (accessed on 10 May 2026).
- Karamanos, X.; Mallioris, P.; Poulimenos, D.; Bechtsis, D.; Vlachos, D. A ROS Tool for Optimal Routing in Intralogistics. In Proceedings of the 30th International DAAAM Symposium 2019 “Intelligent Manufacturing & Automation”, Zadar, Croatia; DAAAM International: Vienna, Austria, 2019; pp. 0832–0838. [Google Scholar] [CrossRef] [Scilit]
- Govindan, K.; Kannan, D.; Jørgensen, T.B.; Nielsen, T.S. Supply Chain 4.0 performance measurement: A systematic literature review, framework development, and empirical evidence. Transp. Res. Part E Logist. Transp. Rev. 2022, 164, 102725. [Google Scholar] [CrossRef] [Scilit]
- Zhong, R.Y.; Xu, X.; Klotz, E.; Newman, S.T. Intelligent Manufacturing in the Context of Industry 4.0: A Review. Engineering 2017, 3, 616–630. [Google Scholar] [CrossRef] [Scilit]
- Xu, L.D.; He, W.; Li, S. Internet of Things in Industries: A Survey. IEEE Trans. Ind. Inform. 2014, 10, 2233–2243. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Guo, Z.; Lv, J.; Liu, Y. A Framework for Smart Production-Logistics Systems Based on CPS and Industrial IoT. IEEE Trans. Ind. Inform. 2018, 14, 4019–4032. [Google Scholar] [CrossRef] [Scilit]
- Mörth, O.; Emmanouilidis, C.; Hafner, N.; Schadler, M. Cyber-physical systems for performance monitoring in production intralogistics. Comput. Ind. Eng. 2020, 142, 106333. [Google Scholar] [CrossRef] [Scilit]
- Seder, M.; Petrović, L.; Peršić, J.; Popović, G.; Petković, T.; Šelek, A.; Bićanić, B.; Cvišić, I.; Josić, D.; Marković, I.; et al. Open Platform Based Mobile Robot Control for Automation in Manufacturing Logistics. IFAC PapersOnLine 2019, 52, 95–100. [Google Scholar] [CrossRef] [Scilit]
- Körösi, L.; Duchoň, F.; Lukáč, P. Open Platform for Innovation in Logistics—Agent Optimization. In Proceedings of the 2022 Cybernetics & Informatics (K&I), Visegrád, Hungary; IEEE: Piscataway, NJ, USA, 2022; pp. 1–5. [Google Scholar] [CrossRef] [Scilit]
- Körösi, L.; Duchoň, F. Analytical fleet-sizing method for the Open Platform for Innovation in Logistics (OPIL). Sci. Rep. 2026, 16, 16797. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kosacka-Olejnik, M.; Kostrzewski, M.; Marczewska, M.; Mrówczynska, B.; Pawlewski, P. How Digital Twin Concept Supports Internal Transport Systems?—Literature Review. Energies 2021, 14, 4919. [Google Scholar] [CrossRef] [Scilit]
- Galkin, A.; Samchuk, G.; Kopytkov, D.; Thompson, R.G. Digital twins in logistics: A comprehensive bibliometric analysis for advancing smart cities and sustainable development. Discov. Sustain. 2025, 6, 853. [Google Scholar] [CrossRef] [Scilit]
- Wu, S.; Xiang, W.; Li, W.; Chen, L.; Wu, C. Dynamic Scheduling and Optimization of AGV in Factory Logistics Systems Based on Digital Twin. Appl. Sci. 2023, 73, 1762. [Google Scholar] [CrossRef] [Scilit]
- Xu, Y.; Du, J.; Dai, L.-R.; Lee, C.-H. An Experimental Study on Speech Enhancement Based on Deep Neural Networks. IEEE Signal Process. Lett. 2014, 21, 65–68. [Google Scholar] [CrossRef] [Scilit]
- Fu, S.-W.; Tsao, Y.; Lu, X.; Kawai, H. Raw Waveform-based Speech Enhancement by Fully Convolutional Networks. In Proceedings of the APSIPA Annual Summit and Conference 2017, Malaysia, 12–15 December 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 1–7. [Google Scholar] [CrossRef] [Scilit]
- Rethage, D.; Pons, J.; Serra, X. A Wavenet for Speech Denoising. In Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada, 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 5069–5073. [Google Scholar] [CrossRef] [Scilit]
- Wang, L.; Zheng, W.; Ma, X.; Lin, S. Denoising Speech Based on Deep Learning and Wavelet Decomposition. Sci. Program. 2021, 2021, 8677043. [Google Scholar] [CrossRef] [Scilit]
- Zhao, H.; Zarar, S.; Tashev, I.; Lee, C.-H. Convolutional-Recurrent Neural Networks for Speech Enhancement. In Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada, 15–20 April 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 2401–2405. [Google Scholar] [CrossRef] [Scilit]
- Natarajan, S.; Al-Haddad, S.A.R.; Ahmad, F.A.; Kamil, R.; Hassan, M.K.; Azrad, S.; Macleans, J.F.; Abdulhussain, S.H.; Mahmmod, B.M.; Saparkhojayev, N.; et al. Deep neural networks for speech enhancement and speech recognition: A systematic review. Ain Shams Eng. J. 2025, 16, 103405. [Google Scholar] [CrossRef] [Scilit]
- Azarang, A.; Kehtarnavaz, N. A review of multi-objective deep learning speech denoising methods. Speech Commun. 2020, 122, 1–10. [Google Scholar] [CrossRef] [Scilit]
- Ma, X.; Cui, Y. A Comparative Analysis of FCNN and CNN Architectures for Speech Denoising Across Diverse Noise Frequencies. Comput. Artif. Intell. 2025, 2, 45–54. [Google Scholar] [CrossRef] [Scilit]
- Schröter, H.; Rosenkranz, T.; Escalante-B, A.-N.; Maier, A. Low Latency Speech Enhancement for Hearing Aids Using Deep Filtering. IEEE/ACM Trans. Audio Speech Lang. Process. 2022, 30, 2716–2728. [Google Scholar] [CrossRef] [Scilit]
- Diehl, P.U.; Zilly, H.; Sattler, F.; Singer, Y.; Kepp, K.; Berry, M.; Hasemann, H.; Zippel, M.; Kaya, M.; Meyer-Rachner, P.; et al. Deep learning-based denoising streamed from mobile phones improves speech-in-noise understanding for hearing aid users. Front. Med. Eng. 2023, 1, 1281904. [Google Scholar] [CrossRef] [Scilit]
- Kulkarni, N.A.; Deshpande, S.P. Speech Recognition Using Convolutional Neural Networks. Int. Res. J. Eng. Technol. 2019, 6, 4577–4580. Available online: https://www.irjet.net/archives/V6/i5/IRJET-V6I5532.pdf (accessed on 10 May 2026).
- Dua, S.; Kumar, S.S.; Albagory, Y.; Ramalingam, R.; Dumka, A.; Singh, R.; Rashid, M.; Gehlot, A.; Alshamrani, S.S.; AlGhamdi, A.S. Developing a Speech Recognition System for Recognizing Tonal Speech Signals Using a Convolutional Neural Network. Appl. Sci. 2022, 12, 6223. [Google Scholar] [CrossRef] [Scilit]
- Hema, C.; Marquez, F.P.G. Emotional speech Recognition using CNN and Deep learning techniques. Appl. Acoust. 2023, 211, 109492. [Google Scholar] [CrossRef] [Scilit]
- Pronina, O.; Piatykop, O. The recognition of speech defects using convolutional neural network. In Proceedings of the CTE Workshop; Academy of Cognitive and Natural Sciences: Kryvyi Rih, Ukraine, 2023; Volume 10, pp. 153–166. [Google Scholar] [CrossRef] [Scilit]
- Ilgaza, H.; Akkoyuna, B.; Alpaya, Ö.; Akcayola, M.A. CNN Based Automatic Speech Recognition: A Comparative Study. ADCAIJ Adv. Distrib. Comput. Artif. Intell. J. 2024, 13, e29191. [Google Scholar] [CrossRef] [Scilit]
- Sayed, S.A.; Seoud, R.A.A.A.A.; Naby, H.Y.A. Convolutional Neural Networks to Facilitate the Continuous Recognition of Arabic Speech with Independent Speakers. J. Electr. Comput. Eng. 2024, 2024, 4976944. [Google Scholar] [CrossRef] [Scilit]
- Diep, Q.B.; Phan, H.Y.; Truong, T.-C. Crossmixed convolutional neural network for digital speech recognition. PLoS ONE 2024, 19, 1–22. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cantiabela, Z.; Pardede, H.F.; Zilvan, V.; Sulandari, W.; Yuwana, R.S.; Supianto, A.A.; Krisnandi, D. Deep Learning for Robust Speech Command Recognition Using Convolutional Neural Networks (CNN). In Proceedings of the IC3INA ‘22: International Conference on Computer, Control, Informatics and Its Applications, New York, NY, USA, 2023; Association for Computing Machinery: New York, NY, USA, 2023; pp. 101–105. [Google Scholar] [CrossRef] [Scilit]
- Petrizzo, D.; Popolo, P.S. Smartphone Use in Clinical Voice Recording and Acoustic Analysis: A Literature Review. J. Voice 2021, 35, 499.e423–499.e428. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sehgal, A.; Kehtarnavaz, N. A Convolutional Neural Network Smartphone App for Real-Time Voice Activity Detection. IEEE Access 2018, 6, 9017–9026. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Barnawi, N.; Alnuem, M. A Machine Learning-Based App for Sound Detection and Speech Recognition for the Deaf and Hard of Hearing. Open J. Appl. Sci. 2025, 15, 2442–2463. [Google Scholar] [CrossRef]
- Feledy, C.; Luttenberger, M.S. A State-of-the-Art Map of the AGVs Technology and a Guidelines for How and Where to Use It. Masters’s Thesis, University of Lund, Lund, Sweden, 2017. Available online: https://lup.lub.lu.se/student-papers/search/publication/8911830 (accessed on 10 May 2026).
- Wang, W.; Bao, Z.; Zheng, J.; Wang, T. Research on automated guided vehicle (AGV) path tracking control based on laser simultaneous localization and mapping (SLAM). Mech. Sci. 2025, 16, 1–24. [Google Scholar] [CrossRef] [Scilit]
- Ito, S.; Hiratsuka, S.; Ohta, M.; Matsubara, H.; Ogawa, M. Small Imaging Depth LIDAR and DCNN-Based Localization for Automated Guided Vehicle. Sensors 2018, 18, 177. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhang, J.; Yang, X.; Wang, W.; Guan, J.; Ding, L.; Lee, V.C.S. Automated guided vehicles and autonomous mobile robots for recognition and tracking in civil engineering. Autom. Constr. 2023, 146, 104699. [Google Scholar] [CrossRef] [Scilit]
- Biernacki, P.; Ziebinski, A. The method of reflection-based marker detection and identification to ensure accurate AGV docking. Sci. Rep. 2025, 15, 41343. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Schichler, L.; Festl, K.; Solmaz, S. Robust Multi-Sensor Fusion for Localization in Hazardous Environments Using Thermal, LiDAR, and GNSS Data. Sensors 2025, 25, 2032. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tran, Q.-K.; Ryoo, Y.-J. Multi-Sensor Fusion Framework for Reliable Localization and Trajectory Tracking of Mobile Robot by Integrating UWB, Odometry, and AHRS. Biomimetics 2025, 10, 478. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nises, M. ROS-Based Implementation of a Model Car with a LiDAR and Camera Setup. Master’s Thesis, Uppsala University, Uppsala, Sweeden, 2023. Available online: https://uu.diva-portal.org/smash/record.jsf?pid=diva2%3A1773842&dswid=6447 (accessed on 11 May 2026).
- Nicolescu, A.F.; Cristoiu, C. Status check and calibration method for robot ABB IRB 140. In Proceedings of the 8th International Conference on Advanced Concepts in Mechanical Engineering; IOP Publishing: Bristol, UK, 2018; p. 052022. [Google Scholar] [CrossRef] [Scilit]
- Novak-Marcincin, J.; Janak, M.; Takac, D. Computer Design of Robot ABB IRB 140 Transport System from Manufacturing Point of View. Manuf. Technol. 2014, 14, 79–84. [Google Scholar] [CrossRef] [Scilit]
- Giannoccaro, N.I.; Rausa, G.; Rizzi, R.; Visconti, P.; Fazio, R.D. An Innovative Vision-Guided Feeding System for Robotic Picking of Different-Shaped Industrial Components Randomly Arranged. Technologies 2024, 12, 153. [Google Scholar] [CrossRef] [Scilit]
- Yoon, J.; Han, J.; Nguyen, T.P. Logistics box recognition in robotic industrial de-palletising procedure with systematic RGB-D image processing supported by multiple deep learning methods. Eng. Appl. Artif. Intell. 2023, 123, 106311. [Google Scholar] [CrossRef] [Scilit]
- Valero, S.; Martinez, J.C.; Montes, A.M.; Marín, C.; Bolaños, R.; Álvarez, D. Machine Vision-Assisted Design of End Effector Pose in Robotic Mixed Depalletizing of Heterogeneous Cargo. Sensors 2025, 25, 1137. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mišković, D.; Milić, L.; Čilag, A.; Berisavljević, T.; Gottscheber, A.; Raković, M. Implementation of Robots Integration in Scaled Laboratory Environment for Factory Automation. Appl. Sci. 2022, 12, 1228. [Google Scholar] [CrossRef] [Scilit]
- OPIL Architecture. 2018. Available online: https://opil-documentation.readthedocs.io/en/latest/OPIL_Intro/OPIL_Architecture.html (accessed on 13 June 2026).
- Mozilla Foundation. Common Voice Dataset, 6.1 ed.; Mozilla Foundation: Mountain View, CA, USA, 2020. [Google Scholar]
- Ardila, R.; Branson, M.; Davis, K.; Kohler, M.; Meyer, J.; Henretty, M.; Morais, R.; Saunders, L.; Tyers, F.; Weber, G. Common Voice: A Massively-Multilingual Speech Corpus. In Proceedings of the 12th Language Resources and Evaluation Conference (LREC 2020); European Language Resources Association (ELRA): Marseille, France, 2020; pp. 4218–4222. Available online: https://aclanthology.org/2020.lrec-1.520/ (accessed on 10 May 2026).
- New York University. UrbanSound8K Dataset, 1.0 ed.; New York University: New York, NY, USA, 2014. [Google Scholar]
- Salamon, J.; Jacoby, C.; Bello, J.P. A Dataset and Taxonomy for Urban Sound Research. In Proceedings of the 22nd ACM International Conference on Multimedia (ACM MM 2014), Orlando, FL, USA, 2014; Association for Computing Machinery: New York, NY, USA, 2014; pp. 1041–1044. [Google Scholar]
- OpenSLR. LibriSpeech ASR Corpus. In LibriSpeech; OpenSLR: Baltimore, MD, USA, 2020. [Google Scholar]
- Panayotov, V.; Chen, G.; Povey, D.; Khudanpur, S. Librispeech: An ASR corpus based on public domain audio books. In Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, QLD, Australia, 19–24 April 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 5206–5210. [Google Scholar] [CrossRef] [Scilit]
- Warden, P. Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition. arXiv 2018. [Google Scholar] [CrossRef] [Scilit]
- Google. Speech Commands Dataset v0.02, v0.02 ed.; Google: Mountain View, CA, USA, 2020. [Google Scholar]
- Sarkar, A. The Assessment of Return on Investment for Robotic and Automated Construction Technologies When Compared to Conventional Construction Practices. Soc. Sci. Res. Netw. 2025, 1–18. [Google Scholar] [CrossRef] [Scilit]












| Block | Layers (Exact) | Output Shape | TP | NTP |
|---|---|---|---|---|
| Input Layer | Input + ZeroPadding2D | [137 × 8 × 1] | 0 | 0 |
| Initial Conv | Conv2D [9 × 8, 18] (conv2d) + BN + ReLU | [129 × 1 × 18] | 1332 | 36 |
| Block A | Conv2D [5 × 1, 30] (conv2d_1) + BN + ReLU Conv2D [9 × 1, 8] (conv2d_2) + BN + ReLU | [129 × 1 × 18] | 4936 | 76 |
| Block B (1) | Conv2D [9 × 1, 18] (conv2d_3) + BN + ReLU Conv2D [5 × 1, 30] (conv2d_4) + BN + ReLU Conv2D [9 × 1, 8] (conv2d_5) + BN + ReLU | [129 × 1 × 8] | 6268 | 112 |
| Block B (2) | Conv2D [9 × 1, 18] (conv2d_6) + BN + ReLU Conv2D [5 × 1, 30] (conv2d_7) + BN + ReLU Conv2D [9 × 1, 8] (conv2d_8) + BN + ReLU | [129 × 1 × 8] | 6268 | 112 |
| Conv Stage 1 | Conv2D [9 × 1, 18] (conv2d_9) + BN + ReLU Conv2D [5 × 1, 30] (conv2d_10) + ReLU + BN | [129 × 1 × 8] | 4092 | 96 |
| Skip Connection 1 | conv2d_10 + conv2d_4 | [129 × 1 × 30] | 0 | 0 |
| Conv Stage 2 | Conv2D [9 × 1, 8] (conv2d_11) + BN + ReLU | [129 × 1 × 30] | 2176 | 16 |
| Conv Stage 3 | Conv2D [9 × 1, 18] (conv2d_12) + BN + ReLU Conv2D [5 × 1, 30] (conv2d_13) + BN + ReLU | [129 × 1 × 8] | 4092 | 96 |
| Skip Connection 2 | conv2d_13 + conv2d_1 | [129 × 1 × 30] | 0 | 0 |
| Final Conv Block | Conv2D [9 × 1, 8] (conv2d_14) + BN + ReLU + SpatialDropout2D | [129 × 1 × 8] | 2176 | 16 |
| Output Layer | Conv2D [129 × 1, 1] (conv2d_15, bias = true) | [129 × 1 × 1] | 1033 | 0 |
| Total Parameters: 32,933 | 32,373 | 560 | ||
| Layer Type | Count | Purpose |
|---|---|---|
| Conv2D | 15 | Extracts time–frequency features using 2D filters of varying kernel sizes, primarily [9 × 1] and [5 × 1]. These layers capture temporal dynamics and local spectral patterns in the input representation, progressively refining feature maps through the network. |
| Batch Normalization | 13 | Applied after most convolutional layers to normalize activations, stabilize training, and improve convergence. It reduces internal covariate shift and enables more efficient gradient propagation. |
| ReLU Activation | 13 | Introduces non-linearity after convolutional operations, allowing the network to learn complex feature representations and improving model expressiveness. |
| ZeroPadding2D | 1 | Preserves spatial dimensions at the input stage, ensuring compatibility with subsequent convolutional operations and maintaining edge information. |
| SpatialDropout2D | 1 | Regularization technique applied in the final convolutional block, randomly dropping entire feature maps during training to reduce overfitting and improve generalization. |
| Skip Connections | 2 | Implements residual learning by combining outputs from earlier and deeper layers, improving gradient flow and enabling the preservation of low-level features alongside higher-level abstractions. |
| Output Conv2D | 1 | Final projection layer using a kernel spanning the full frequency dimension [129 × 1 × 1] to generate the output signal representation, enabling end-to-end speech enhancement. |
| Noise Source | Input SNR | Output SNR | ΔSNR | PESQ | STOI |
|---|---|---|---|---|---|
| Severe Noise (0 dB)—AVG: ~1.12 dB | |||||
| Cutting Machinery (Drilling) | 1.10 | 4.98 | +3.88 ± 1.72 | 1.15 ± 0.07 | 0.73 ± 0.08 |
| Conveyor Systems (Engine Idling) | 0.94 | 5.62 | +4.68 ± 1.72 | 1.18 ± 0.07 | 0.73 ± 0.08 |
| Impact Operations (Jackhammer) | 1.33 | 5.35 | +4.02 ± 2.32 | 1.18 ± 0.15 | 0.74 ± 0.10 |
| Moderate Noise (5 dB)—AVG: ~5.38 dB | |||||
| Cutting Machinery (Drilling) | 5.40 | 6.87 | +1.47 ± 1.67 | 1.33 ± 0.12 | 0.80 ± 0.07 |
| Conveyor Systems (Engine Idling) | 5.33 | 7.52 | +2.19 ± 1.77 | 1.35 ± 0.13 | 0.82 ± 0.07 |
| Impact Operations (Jackhammer) | 5.42 | 7.29 | +1.87 ± 1.76 | 1.31 ± 0.23 | 0.82 ± 0.08 |
| Mild Noise (10 dB)—AVG: ~10.12 dB | |||||
| Cutting Machinery (Drilling) | 10.12 | 8.15 | −1.97 ± 1.85 | 1.58 ± 0.19 | 0.86 ± 0.06 |
| Conveyor Systems (Engine Idling) | 10.10 | 8.57 | −1.53 ± 1.92 | 1.62 ± 0.19 | 0.88 ± 0.05 |
| Impact Operations (Jackhammer) | 10.13 | 8.37 | −1.76 ± 1.84 | 1.51 ± 0.29 | 0.87 ± 0.07 |
| Layer Type | Output Shape | TP | NTP |
|---|---|---|---|
| Conv2D | [42 × 11 × 64] | 640 | 0 |
| BatchNormalization | [42 × 11 × 64] | 128 | 128 |
| MaxPooling2D | [21 × 6 × 64] | 0 | 0 |
| Conv2D | [19 × 4 × 32] | 18,464 | 0 |
| BatchNormalization | [19 × 4 × 32] | 64 | 64 |
| MaxPooling2D | [10 × 2 × 32] | 0 | 0 |
| Conv2D | [9 × 1 × 32] | 4128 | 0 |
| BatchNormalization | [9 × 1 × 32] | 64 | 64 |
| MaxPooling2D | [5 × 1 × 32] | 0 | 0 |
| Flatten | [160] | 0 | 0 |
| Dense | [64] | 10,304 | 0 |
| Dense | [20] | 1300 | 0 |
| Total Parameters: 35,348 | 35,092 | 256 | |
| Layer Type | Count | Purpose |
|---|---|---|
| Conv2D | 3 | Extracts spatial features from MFCC spectrogram input by applying 2D filters (kernels) over the input data to detect local patterns. |
| BatchNormalization | 3 | Normalizes the activations of the previous layer to stabilize and speed up training. It also helps reduce internal covariate shift and allows for higher learning rates and is used after each Conv2D layer to maintain stable distribution of feature maps. |
| MaxPooling2D | 3 | Reduces spatial dimensions (width and height), keeping only the most significant features by taking the maximum value over a [3 × 3] or [2 × 2] window. By doing so it downsamples data, reduces computation, and introduces translation invariance. |
| Flatten | 1 | Converts 2D feature maps (after pooling) into a 1D vector to feed into dense layers because Dense layers require 1D input vectors. |
| Dense | 2 | First Dense Layer: 64 units, Activation: ReLU
|
| Dataset | Classes | TRA (%) | VAA (%) | TEA (%) | TRL | VAL | TEL |
|---|---|---|---|---|---|---|---|
| Dataset v3.0 | 20 | 96.43 | 92.57 | 92.22 | 0.161 | 0.299 | 0.309 |
| Dataset v2.0 | 20 | 96.31 | 92.28 | 92.59 | 0.165 | 0.317 | 0.312 |
| Dataset v2.0 (NO) | 10 | 98.58 | 93.32 | 94.17 | 0.108 | 0.296 | 0.257 |
| Dataset | Denoising | Samples | CNN Pass | ERP Valid |
|---|---|---|---|---|
| Generated | No | 10 | 7 (70.00%) | 7 (70.00%) |
| Generated | Yes | 10 | 9 (90.00%) | 9 (90.00%) |
| Industrial | No | 100 | 83 (83.00%) | 77 (77.00%) |
| Industrial | Yes | 100 | 94 (94.00%) | 91 (91.00%) |
| Group | Indicators | Measured Value | Source |
|---|---|---|---|
| AI/Voicing | Mean SNR improvement of noisy audio input at 0 and 5 dB input. In contrast, at higher SNR levels (10 dB), the model introduces slight degradation suggesting over-suppression when the input signal is already relatively clean. |
| Test bed environment |
| AI/Voicing | Background noise reduction in real plant recordings | Reduction of −21.11 dB (~99.23% noise power) | Case company environment |
| AI/Voicing | Keyword recognition accuracy on test set |
| Test bed environment |
| AI/Voicing | Industrial command execution success (without denoising) | 77.0% | Case company environment |
| AI/Voicing | Industrial command execution success (with denoising) | 91.0% | Case company environment |
| Operational | Voice-driven workflows validated end-to-end | 6 of 6 (slaughter ID, deboning ID, transport, consolidation, relocation, doors) | Case company environment |
| Operational | Carcass/crate traceability coverage | LOT → per-unit (NFC) tagging | Case company environment |
| Operational | Manual cart handling reduction (three-operator task) | Replaced by AGV transport | Case company environment |
| Economic | Total cost of ownership (4-year, undiscounted) | 250,340 EUR (CapEx 188.5 k + OpEx 61.8 k) | Case company environment |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Pecev, P.; Maslarić, M.; Todorović, V.; Sudar, S.; Nikoličić, S. Voice-Controlled Intralogistics on an Open Cyber–Physical Middleware: Deep Learning-Based Speech Processing and Validation in an Industrial Noisy Environment. Appl. Sci. 2026, 16, 8524. https://doi.org/10.3390/app16178524
Pecev P, Maslarić M, Todorović V, Sudar S, Nikoličić S. Voice-Controlled Intralogistics on an Open Cyber–Physical Middleware: Deep Learning-Based Speech Processing and Validation in an Industrial Noisy Environment. Applied Sciences. 2026; 16(17):8524. https://doi.org/10.3390/app16178524
Chicago/Turabian StylePecev, Predrag, Marinko Maslarić, Vladimir Todorović, Saša Sudar, and Svetlana Nikoličić. 2026. "Voice-Controlled Intralogistics on an Open Cyber–Physical Middleware: Deep Learning-Based Speech Processing and Validation in an Industrial Noisy Environment" Applied Sciences 16, no. 17: 8524. https://doi.org/10.3390/app16178524
APA StylePecev, P., Maslarić, M., Todorović, V., Sudar, S., & Nikoličić, S. (2026). Voice-Controlled Intralogistics on an Open Cyber–Physical Middleware: Deep Learning-Based Speech Processing and Validation in an Industrial Noisy Environment. Applied Sciences, 16(17), 8524. https://doi.org/10.3390/app16178524

