Next Article in Journal
Improved Self-Calibration of a Multilateration System Based on Absolute Distance Measurement
Previous Article in Journal
A General Grid-Less Design Method for Location and Pressure Sensors with High Precision
Article

Integration of Industrially-Oriented Human-Robot Speech Communication and Vision-Based Object Recognition

Department of Automation and Metal Cutting, Warsaw University of Technology, 02-524 Warsaw, Poland
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(24), 7287; https://doi.org/10.3390/s20247287
Received: 7 November 2020 / Revised: 10 December 2020 / Accepted: 16 December 2020 / Published: 18 December 2020
(This article belongs to the Section Intelligent Sensors)
This paper presents a novel method for integration of industrially-oriented human-robot speech communication and vision-based object recognition. Such integration is necessary to provide context for task-oriented voice commands. Context-based speech communication is easier, the commands are shorter, hence their recognition rate is higher. In recent years, significant research was devoted to integration of speech and gesture recognition. However, little attention was paid to vision-based identification of objects in industrial environment (like workpieces or tools) represented by general terms used in voice commands. There are no reports on any methods facilitating the abovementioned integration. Image and speech recognition systems usually operate on different data structures, describing reality on different levels of abstraction, hence development of context-based voice control systems is a laborious and time-consuming task. The aim of our research was to solve this problem. The core of our method is extension of Voice Command Description (VCD) format describing syntax and semantics of task-oriented commands, as well as its integration with Flexible Editable Contour Templates (FECT) used for classification of contours derived from image recognition systems. To the best of our knowledge, it is the first solution that facilitates development of customized vision-based voice control applications for industrial robots. View Full-Text
Keywords: human-robot speech communication; vision systems; industrial robotics human-robot speech communication; vision systems; industrial robotics
Show Figures

Figure 1

MDPI and ACS Style

Rogowski, A.; Bieliszczuk, K.; Rapcewicz, J. Integration of Industrially-Oriented Human-Robot Speech Communication and Vision-Based Object Recognition. Sensors 2020, 20, 7287. https://doi.org/10.3390/s20247287

AMA Style

Rogowski A, Bieliszczuk K, Rapcewicz J. Integration of Industrially-Oriented Human-Robot Speech Communication and Vision-Based Object Recognition. Sensors. 2020; 20(24):7287. https://doi.org/10.3390/s20247287

Chicago/Turabian Style

Rogowski, Adam, Krzysztof Bieliszczuk, and Jerzy Rapcewicz. 2020. "Integration of Industrially-Oriented Human-Robot Speech Communication and Vision-Based Object Recognition" Sensors 20, no. 24: 7287. https://doi.org/10.3390/s20247287

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop