A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots
AbstractObject detection and classification have countless applications in human–robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means dealing with constant environment changes and relatively low-quality sensor data due to the distance at which objects are often found. Ambient intelligence systems equipped with different sensors can also benefit from the ability to find objects, enabling them to inform humans about their location. For these applications to succeed, systems need to detect the objects that may potentially contain other objects, working with relatively low-resolution sensor data. A passive learning architecture for sensors has been designed in order to take advantage of multimodal information, obtained using an RGB-D camera and trained semantic language models. The main contribution of the architecture lies in the improvement of the performance of the sensor under conditions of low resolution and high light variations using a combination of image labeling and word semantics. The tests performed on each of the stages of the architecture compare this solution with current research labeling techniques for the application of an autonomous social robot working in an apartment. The results obtained demonstrate that the proposed sensor architecture outperforms state-of-the-art approaches. View Full-Text
Share & Cite This Article
Gutiérrez, M.A.; Manso, L.J.; Pandya, H.; Núñez, P. A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots. Sensors 2017, 17, 353.
Gutiérrez MA, Manso LJ, Pandya H, Núñez P. A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots. Sensors. 2017; 17(2):353.Chicago/Turabian Style
Gutiérrez, Marco A.; Manso, Luis J.; Pandya, Harit; Núñez, Pedro. 2017. "A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots." Sensors 17, no. 2: 353.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.