Next Article in Journal
Development of CdSe–ZnO Flower-Rod Core-Shell Structure Based Photoelectrochemical Biosensor for Detection of Norovirous RNA
Previous Article in Journal
Real-Time Safety Evaluation for Slope during Construction Using Numerical Forecast and Sensor Monitoring Platform
Article Menu
Issue 9 (September) cover image

Export Article

Open AccessArticle
Sensors 2018, 18(9), 2979;

Modeling the Human Visuo-Motor System to Support Remote-Control Operation

Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN 55455, USA
International Computer Science Institute (ICSI), Berkeley, CA 94704, USA
Author to whom correspondence should be addressed.
Received: 29 June 2018 / Revised: 11 August 2018 / Accepted: 28 August 2018 / Published: 6 September 2018
(This article belongs to the Section Biosensors)
Full-Text   |   PDF [1864 KB, uploaded 7 September 2018]   |  


The working hypothesis in this project is that gaze interactions play a central role in structuring the joint control and guidance strategy of the human operator performing spatial tasks. Perceptual guidance and control is the idea that the visual and motor systems form a unified perceptuo-motor system where necessary information is naturally extracted by the visual system. As a consequence, the response of this system is constrained by the visual and motor mechanisms and these effects should manifest in the behavioral data. Modeling the perceptual processes of the human operator provides the foundation necessary for a systems-based approach to the design of control and display systems used by remotely operated vehicles. This paper investigates this hypothesis using flight tasks conducted with remotely controlled miniature rotorcraft, taking place in indoor settings that provide rich environments to investigate the key processes supporting spatial interactions. This work also applies to spatial control tasks in a range of application domains that include tele-operation, gaming, and virtual reality. The human-in-the-loop system combines the dynamics of the vehicle, environment, and human perception–action with the response of the overall system emerging from the interplay of perception and action. The main questions to be answered in this work are as follows: (i) what is the general control and guidance strategy of the human operator, and (ii) how is information about the vehicle and environment extracted visually by the operator. The general approach uses gaze as the primary sensory mechanism by decoding the gaze patterns of the pilot to provide information for estimation, control, and guidance. This work differs from existing research by taking what have largely been conceptual ideas on action–perception and structuring them to be implemented for a real-world problem. The paper proposes a system model that captures the human pilot’s perception–action loop; the loop that delineates the main components of the pilot’s perceptuo-motor system, including estimation of the vehicle state and task elements based on operator gaze patterns, trajectory planning, and tracking control. The identified human visuo-motor model is then exploited to demonstrate how the perceptual and control functions system can be augmented to reduce the operator workload. View Full-Text
Keywords: visuo-motor; teleoperation; human–machine interface visuo-motor; teleoperation; human–machine interface

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Andersh, J.; Mettler, B. Modeling the Human Visuo-Motor System to Support Remote-Control Operation. Sensors 2018, 18, 2979.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top