Next Article in Journal
Innovative Teacher Education with the Augmented Reality Device Microsoft HoloLens—Results of an Exploratory Study and Pedagogical Considerations
Next Article in Special Issue
Accuracy and Repeatability Tests on HoloLens 2 and HTC Vive
Previous Article in Journal
Security Issues in Shared Automated Mobility Systems: A Feminist HCI Perspective
Previous Article in Special Issue
BookTubers as Multimodal Reading Influencers: An Analysis of Subscriber Interactions

Multimodal Warnings in Remote Operation: The Case Study on Remote Driving

The Unit of Computing Sciences, Tampere University, 33100 Tampere, Finland
Stratford School of Interaction Design and Business, University Of Waterloo, Stratford, ON N5A 0C1, Canada
Authors to whom correspondence should be addressed.
Academic Editor: Abdulmotaleb El Saddik
Multimodal Technol. Interact. 2021, 5(8), 44;
Received: 28 April 2021 / Revised: 15 July 2021 / Accepted: 5 August 2021 / Published: 12 August 2021
(This article belongs to the Special Issue Feature Papers of MTI in 2021)
Developments in sensor technology, artificial intelligence, and network technologies like 5G has made remote operation a valuable method of controlling various types of machinery. The benefits of remote operations come with an opportunity to access hazardous environments. The major limitation of remote operation is the lack of proper sensory feedback from the machine, which in turn negatively affects situational awareness and, consequently, may risk remote operations. This article explores how to improve situational awareness via multimodal feedback (visual, auditory, and haptic) and studies how it can be utilized to communicate warnings to remote operators. To reach our goals, we conducted a controlled, within-subjects experiment in eight conditions with twenty-four participants on a simulated remote driving system. Additionally, we gathered further insights with a UX questionnaire and semi-structured interviews. Gathered data showed that the use of multimodal feedback positively affected situational awareness when driving remotely. Our findings indicate that the combination of added haptic and visual feedback was considered the best feedback combination to communicate the slipperiness of the road. We also found that the feeling of presence is an important aspect of remote driving tasks, and a requested one, especially by those with more experience in operating real heavy machinery. View Full-Text
Keywords: remote operations; multimodal feedback; human factors remote operations; multimodal feedback; human factors
Show Figures

Figure 1

MDPI and ACS Style

Kallioniemi, P.; Burova, A.; Mäkelä, J.; Keskinen, T.; Ronkainen, K.; Mäkelä, V.; Hakulinen, J.; Turunen, M. Multimodal Warnings in Remote Operation: The Case Study on Remote Driving. Multimodal Technol. Interact. 2021, 5, 44.

AMA Style

Kallioniemi P, Burova A, Mäkelä J, Keskinen T, Ronkainen K, Mäkelä V, Hakulinen J, Turunen M. Multimodal Warnings in Remote Operation: The Case Study on Remote Driving. Multimodal Technologies and Interaction. 2021; 5(8):44.

Chicago/Turabian Style

Kallioniemi, Pekka, Alisa Burova, John Mäkelä, Tuuli Keskinen, Kimmo Ronkainen, Ville Mäkelä, Jaakko Hakulinen, and Markku Turunen. 2021. "Multimodal Warnings in Remote Operation: The Case Study on Remote Driving" Multimodal Technologies and Interaction 5, no. 8: 44.

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop