Next Article in Journal
Analysis of the Critical Bits of a RISC-V Processor Implemented in an SRAM-Based FPGA for Space Applications
Previous Article in Journal
Hybrid Intrusion Detection System Based on the Stacking Ensemble of C5 Decision Tree Classifier and One Class Support Vector Machine
Previous Article in Special Issue
Optimal Feature Search for Vigilance Estimation Using Deep Reinforcement Learning
Open AccessArticle

Motor Imagery Based Continuous Teleoperation Robot Control with Tactile Feedback

1
School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
2
College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210003, China
*
Author to whom correspondence should be addressed.
Electronics 2020, 9(1), 174; https://doi.org/10.3390/electronics9010174
Received: 16 December 2019 / Revised: 9 January 2020 / Accepted: 15 January 2020 / Published: 17 January 2020
Brain computer interface (BCI) adopts human brain signals to control external devices directly without using normal neural pathway. Recent study has explored many applications, such as controlling a teleoperation robot by electroencephalography (EEG) signals. However, utilizing the motor imagery EEG-based BCI to perform teleoperation for reach and grasp task still has many difficulties, especially in continuous multidimensional control of robot and tactile feedback. In this research, a motor imagery EEG-based continuous teleoperation robot control system with tactile feedback was proposed. Firstly, mental imagination of different hand movements was translated into continuous command to control the remote robotic arm to reach the hover area of the target through a wireless local area network (LAN). Then, the robotic arm automatically completed the task of grasping the target. Meanwhile, the tactile information of remote robotic gripper was detected and converted to the feedback command. Finally, the vibrotactile stimulus was supplied to users to improve their telepresence. Experimental results demonstrate the feasibility of using the motor imagery EEG acquired by wireless portable equipment to realize the continuous teleoperation robot control system to finish the reach and grasp task. The average two-dimensional continuous control success rates for online Task 1 and Task 2 of the six subjects were 78.0% ± 6.1% and 66.2% ± 6.0%, respectively. Furthermore, compared with the traditional EEG triggered robot control using the predefined trajectory, the continuous fully two-dimensional control can not only improve the teleoperation robot system’s efficiency but also give the subject a more natural control which is critical to human–machine interaction (HMI). In addition, vibrotactile stimulus can improve the operator’s telepresence and task performance. View Full-Text
Keywords: brain computer interface; motor imagery; continuous teleoperation robot control; vibrotactile feedback brain computer interface; motor imagery; continuous teleoperation robot control; vibrotactile feedback
Show Figures

Figure 1

MDPI and ACS Style

Xu, B.; Li, W.; He, X.; Wei, Z.; Zhang, D.; Wu, C.; Song, A. Motor Imagery Based Continuous Teleoperation Robot Control with Tactile Feedback. Electronics 2020, 9, 174.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop