Next Article in Journal
The Feature Extraction through Wavelet Coefficients of Metal Friction Noise for Adhesive and Abrasive Wear Monitoring
Next Article in Special Issue
Virtual Marker Technique to Enhance User Interactions in a Marker-Based AR System
Previous Article in Journal
Quantum Circuit Design of Toom 3-Way Multiplication
Previous Article in Special Issue
Augmented Reality, Virtual Reality and Artificial Intelligence in Orthopedic Surgery: A Systematic Review
Article

High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation

School of Engineering, Tokyo Institute of Technology, Kanagawa 226-8503, Japan
*
Author to whom correspondence should be addressed.
This paper is an extended version of Peng, H.-L.; Watanabe, Y. High-Speed Human Arm Projection Mapping with Skin Deformation. In SIGGRAPH Asia 2020 Emerging Technologies; Association for Computing Machinery: New York, NY, USA, 2020; article 13, pp. 1–2, doi:10.1145/3415255.3422887.
Academic Editor: Chang-Hun Kim
Appl. Sci. 2021, 11(9), 3753; https://doi.org/10.3390/app11093753
Received: 31 March 2021 / Revised: 17 April 2021 / Accepted: 20 April 2021 / Published: 21 April 2021
(This article belongs to the Special Issue Virtual and Augmented Reality Systems)
Dynamic projection mapping for a moving object according to its position and shape is fundamental for augmented reality to resemble changes on a target surface. For instance, augmenting the human arm surface via dynamic projection mapping can enhance applications in fashion, user interfaces, prototyping, education, medical assistance, and other fields. For such applications, however, conventional methods neglect skin deformation and have a high latency between motion and projection, causing noticeable misalignment between the target arm surface and projected images. These problems degrade the user experience and limit the development of more applications. We propose a system for high-speed dynamic projection mapping onto a rapidly moving human arm with realistic skin deformation. With the developed system, the user does not perceive any misalignment between the arm surface and projected images. First, we combine a state-of-the-art parametric deformable surface model with efficient regression-based accuracy compensation to represent skin deformation. Through compensation, we modify the texture coordinates to achieve fast and accurate image generation for projection mapping based on joint tracking. Second, we develop a high-speed system that provides a latency between motion and projection below 10 ms, which is generally imperceptible by human vision. Compared with conventional methods, the proposed system provides more realistic experiences and increases the applicability of dynamic projection mapping. View Full-Text
Keywords: projection mapping; augmented reality; human-centered computing; human–computer interface; skin deformation projection mapping; augmented reality; human-centered computing; human–computer interface; skin deformation
Show Figures

Figure 1

MDPI and ACS Style

Peng, H.-L.; Watanabe, Y. High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation. Appl. Sci. 2021, 11, 3753. https://doi.org/10.3390/app11093753

AMA Style

Peng H-L, Watanabe Y. High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation. Applied Sciences. 2021; 11(9):3753. https://doi.org/10.3390/app11093753

Chicago/Turabian Style

Peng, Hao-Lun, and Yoshihiro Watanabe. 2021. "High-Speed Dynamic Projection Mapping onto Human Arm with Realistic Skin Deformation" Applied Sciences 11, no. 9: 3753. https://doi.org/10.3390/app11093753

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop