Next Article in Journal
Estimation of Adaptation Parameters for Dynamic Video Adaptation in Wireless Network Using Experimental Method
Previous Article in Journal
Novel Approach for Emotion Detection and Stabilizing Mental State by Using Machine Learning Techniques
Previous Article in Special Issue
A Computer Vision Encyclopedia-Based Framework with Illustrative UAV Applications
 
 
Article

Emotion Transfer for 3D Hand and Full Body Motion Using StarGAN

1
Department of Computer Science, Hong Kong Baptist University, Hong Kong, China
2
Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK
*
Author to whom correspondence should be addressed.
Academic Editor: Panagiotis D. Ritsos
Computers 2021, 10(3), 38; https://doi.org/10.3390/computers10030038
Received: 15 February 2021 / Revised: 11 March 2021 / Accepted: 19 March 2021 / Published: 22 March 2021
(This article belongs to the Special Issue Computer Graphics & Visual Computing (CGVC 2020))
In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method’s effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality. View Full-Text
Keywords: hand animation; body motion; skeletal motion; emotion; motion capture; generative adversarial network; style transfer; user study hand animation; body motion; skeletal motion; emotion; motion capture; generative adversarial network; style transfer; user study
Show Figures

Figure 1

MDPI and ACS Style

Chan, J.C.P.; Ho, E.S.L. Emotion Transfer for 3D Hand and Full Body Motion Using StarGAN. Computers 2021, 10, 38. https://doi.org/10.3390/computers10030038

AMA Style

Chan JCP, Ho ESL. Emotion Transfer for 3D Hand and Full Body Motion Using StarGAN. Computers. 2021; 10(3):38. https://doi.org/10.3390/computers10030038

Chicago/Turabian Style

Chan, Jacky C. P., and Edmond S. L. Ho. 2021. "Emotion Transfer for 3D Hand and Full Body Motion Using StarGAN" Computers 10, no. 3: 38. https://doi.org/10.3390/computers10030038

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop