Next Article in Journal
AirSign: Smartphone Authentication by Signing in the Air
Previous Article in Journal
Advanced Statistical Analysis of 3D Kinect Data: Mimetic Muscle Rehabilitation Following Head and Neck Surgeries Causing Facial Paresis
Article

Estimation of Flat Object Deformation Using RGB-D Sensor for Robot Reproduction

Graduate School of Information, Production and Systems (IPS), Waseda University, Kitakyushu 808-0135, Japan
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(1), 105; https://doi.org/10.3390/s21010105
Received: 26 November 2020 / Revised: 21 December 2020 / Accepted: 24 December 2020 / Published: 26 December 2020
(This article belongs to the Section Sensors and Robotics)
This paper introduces a system that can estimate the deformation process of a deformed flat object (folded plane) and generate the input data for a robot with human-like dexterous hands and fingers to reproduce the same deformation of another similar object. The system is based on processing RGB data and depth data with three core techniques: a weighted graph clustering method for non-rigid point matching and clustering; a refined region growing method for plane detection on depth data based on an offset error defined by ourselves; and a novel sliding checking model to check the bending line and adjacent relationship between each pair of planes. Through some evaluation experiments, we show the improvement of the core techniques to conventional studies. By applying our approach to different deformed papers, the performance of the entire system is confirmed to have around 1.59 degrees of average angular error, which is similar to the smallest angular discrimination of human eyes. As a result, for the deformation of the flat object caused by folding, if our system can get at least one feature point cluster on each plane, it can get spatial information of each bending line and each plane with acceptable accuracy. The subject of this paper is a folded plane, but we will develop it into a robotic reproduction of general object deformation. View Full-Text
Keywords: deformation understanding; depth camera; bending line and folding angle; SIFT descriptor; weighted graph clustering; non-rigid point matching; plane detection; region growing; overgrowing avoiding; sliding checking model; deformation reproducing deformation understanding; depth camera; bending line and folding angle; SIFT descriptor; weighted graph clustering; non-rigid point matching; plane detection; region growing; overgrowing avoiding; sliding checking model; deformation reproducing
Show Figures

Figure 1

MDPI and ACS Style

He, X.; Matsumaru, T. Estimation of Flat Object Deformation Using RGB-D Sensor for Robot Reproduction. Sensors 2021, 21, 105. https://doi.org/10.3390/s21010105

AMA Style

He X, Matsumaru T. Estimation of Flat Object Deformation Using RGB-D Sensor for Robot Reproduction. Sensors. 2021; 21(1):105. https://doi.org/10.3390/s21010105

Chicago/Turabian Style

He, Xin, and Takafumi Matsumaru. 2021. "Estimation of Flat Object Deformation Using RGB-D Sensor for Robot Reproduction" Sensors 21, no. 1: 105. https://doi.org/10.3390/s21010105

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop