Next Article in Journal
Deep Learning Driven Noise Reduction for Reduced Flux Computed Tomography
Previous Article in Journal
Visualizing and Evaluating Finger Movement Using Combined Acceleration and Contact-Force Sensors: A Proof-of-Concept Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Robot Object Recognition Method Based on Scene Text Reading in Home Environments

School of Information Science and Technology, Northeast Normal University, Changchun 130117, China
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(5), 1919; https://doi.org/10.3390/s21051919
Submission received: 26 January 2021 / Revised: 26 February 2021 / Accepted: 5 March 2021 / Published: 9 March 2021

Abstract

With the aim to solve issues of robot object recognition in complex scenes, this paper proposes an object recognition method based on scene text reading. The proposed method simulates human-like behavior and accurately identifies objects with texts through careful reading. First, deep learning models with high accuracy are adopted to detect and recognize text in multi-view. Second, datasets including 102,000 Chinese and English scene text images and their inverse are generated. The F-measure of text detection is improved by 0.4% and the recognition accuracy is improved by 1.26% because the model is trained by these two datasets. Finally, a robot object recognition method is proposed based on the scene text reading. The robot detects and recognizes texts in the image and then stores the recognition results in a text file. When the user gives the robot a fetching instruction, the robot searches for corresponding keywords from the text files and achieves the confidence of multiple objects in the scene image. Then, the object with the maximum confidence is selected as the target. The results show that the robot can accurately distinguish objects with arbitrary shape and category, and it can effectively solve the problem of object recognition in home environments.
Keywords: robot object recognition; complex scenes; scene text detection; text recognition robot object recognition; complex scenes; scene text detection; text recognition

Share and Cite

MDPI and ACS Style

Liu, S.; Xu, H.; Li, Q.; Zhang, F.; Hou, K. A Robot Object Recognition Method Based on Scene Text Reading in Home Environments. Sensors 2021, 21, 1919. https://doi.org/10.3390/s21051919

AMA Style

Liu S, Xu H, Li Q, Zhang F, Hou K. A Robot Object Recognition Method Based on Scene Text Reading in Home Environments. Sensors. 2021; 21(5):1919. https://doi.org/10.3390/s21051919

Chicago/Turabian Style

Liu, Shuhua, Huixin Xu, Qi Li, Fei Zhang, and Kun Hou. 2021. "A Robot Object Recognition Method Based on Scene Text Reading in Home Environments" Sensors 21, no. 5: 1919. https://doi.org/10.3390/s21051919

APA Style

Liu, S., Xu, H., Li, Q., Zhang, F., & Hou, K. (2021). A Robot Object Recognition Method Based on Scene Text Reading in Home Environments. Sensors, 21(5), 1919. https://doi.org/10.3390/s21051919

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop