Next Article in Journal
Modelling of Acoustic Emission Signals Due to Fiber Break in a Model Composite Carbon/Epoxy: Experimental Validation and Parametric Study
Next Article in Special Issue
Methodologies of Learning Served by Virtual Reality: A Case Study in Urban Interventions
Previous Article in Journal
H Iterative Learning Boundary Vibration Control of Uncertain Vibrating String with Iteration-Varying Distributed Disturbance and Boundary Disturbance
Previous Article in Special Issue
Haptic Hybrid Prototyping (HHP): An AR Application for Texture Evaluation with Semantic Content in Product Design
Article

Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback

Information Processing and Telecommunications Center, Universidad Politécnica de Madrid, 28040 Madrid, Spain
*
Author to whom correspondence should be addressed.
Current address: ETSIT, Av. Complutense 30, 28040 Madrid, Spain.
Appl. Sci. 2019, 9(23), 5123; https://doi.org/10.3390/app9235123
Received: 30 October 2019 / Revised: 18 November 2019 / Accepted: 20 November 2019 / Published: 26 November 2019
(This article belongs to the Special Issue Augmented Reality: Current Trends, Challenges and Prospects)
Nowadays, Augmented-Reality (AR) head-mounted displays (HMD) deliver a more immersive visualization of virtual contents, but the available means of interaction, mainly based on gesture and/or voice, are yet limited and obviously lack realism and expressivity when compared to traditional physical means. In this sense, the integration of haptics within AR may help to deliver an enriched experience, while facilitating the performance of specific actions, such as repositioning or resizing tasks, that are still dependent on the user’s skills. In this direction, this paper gathers the description of a flexible architecture designed to deploy haptically enabled AR applications both for mobile and wearable visualization devices. The haptic feedback may be generated through a variety of devices (e.g., wearable, graspable, or mid-air ones), and the architecture facilitates handling the specificity of each. For this reason, within the paper, it is discussed how to generate a haptic representation of a 3D digital object depending on the application and the target device. Additionally, the paper includes an analysis of practical, relevant issues that arise when setting up a system to work with specific devices like HMD (e.g., HoloLens) and mid-air haptic devices (e.g., Ultrahaptics), such as the alignment between the real world and the virtual one. The architecture applicability is demonstrated through the implementation of two applications: (a) Form Inspector and (b) Simon Game, built for HoloLens and iOS mobile phones for visualization and for UHK for mid-air haptics delivery. These applications have been used to explore with nine users the efficiency, meaningfulness, and usefulness of mid-air haptics for form perception, object resizing, and push interaction tasks. Results show that, although mobile interaction is preferred when this option is available, haptics turn out to be more meaningful in identifying shapes when compared to what users initially expect and in contributing to the execution of resizing tasks. Moreover, this preliminary user study reveals some design issues when working with haptic AR. For example, users may be expecting a tailored interface metaphor, not necessarily inspired in natural interaction. This has been the case of our proposal of virtual pressable buttons, built mimicking real buttons by using haptics, but differently interpreted by the study participants. View Full-Text
Keywords: augmented reality; haptics; wearable AR; software architecture; interaction; mid-air; HMD augmented reality; haptics; wearable AR; software architecture; interaction; mid-air; HMD
Show Figures

Figure 1

MDPI and ACS Style

Vaquero-Melchor, D.; Bernardos, A.M. Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback. Appl. Sci. 2019, 9, 5123. https://doi.org/10.3390/app9235123

AMA Style

Vaquero-Melchor D, Bernardos AM. Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback. Applied Sciences. 2019; 9(23):5123. https://doi.org/10.3390/app9235123

Chicago/Turabian Style

Vaquero-Melchor, Diego, and Ana M. Bernardos 2019. "Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback" Applied Sciences 9, no. 23: 5123. https://doi.org/10.3390/app9235123

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop