Next Article in Journal
A Recursive Trigonometric Technique for Direct Digital Frequency Synthesizer Implementation
Next Article in Special Issue
BGI-YOLO: Background Image-Assisted Object Detection for Stationary Cameras
Previous Article in Journal
Static Map Construction Based on Dense Constraints and Graph Optimization
Previous Article in Special Issue
Optimum Pitch of Volumetric Computational Reconstruction in Integral Imaging
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation

1
Department of Computer Science and Information Engineering, National Central University, Taoyuan 320, Taiwan
2
Department of Information and Computer Engineering, Chun-Yuan Christian University, Taoyuan 320, Taiwan
*
Authors to whom correspondence should be addressed.
Electronics 2024, 13(23), 4761; https://doi.org/10.3390/electronics13234761
Submission received: 23 October 2024 / Revised: 24 November 2024 / Accepted: 30 November 2024 / Published: 2 December 2024
(This article belongs to the Special Issue Applications and Challenges of Image Processing in Smart Environment)

Abstract

We propose an anime style transfer model to generate anime faces from human face images. We improve the model by modifying the normalization function to obtain more feature information. To make the face feature position of the anime face similar to the human face, we propose facial landmark loss to calculate the error between the generated image and the real human face image. To avoid obvious color deviation in the generated images, we introduced perceptual color loss into the loss function. In addition, due to the lack of reasonable metrics to evaluate the quality of the animated images, we propose the use of Fréchet anime inception distance to calculate the distance between the distribution of the generated animated images and the real animated images in high-dimensional space, so as to understand the quality of the generated animated images. In the user survey, up to 74.46% of users think that the image produced by the proposed method is the best compared with other models. Also, the proposed method reaches a score of 126.05 for Fréchet anime inception distance. Our model performs the best in both user studies and FAID, showing that we have achieved better performance in human visual perception and model distribution. According to the experimental results and user feedback, our proposed method can generate results with better quality compared to existing methods.
Keywords: generative adversarial network; anime face style transfer; artificial intelligence generative adversarial network; anime face style transfer; artificial intelligence

Share and Cite

MDPI and ACS Style

Lo, S.-L.; Cheng, H.-Y.; Yu, C.-C. Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation. Electronics 2024, 13, 4761. https://doi.org/10.3390/electronics13234761

AMA Style

Lo S-L, Cheng H-Y, Yu C-C. Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation. Electronics. 2024; 13(23):4761. https://doi.org/10.3390/electronics13234761

Chicago/Turabian Style

Lo, Shih-Lun, Hsu-Yung Cheng, and Chih-Chang Yu. 2024. "Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation" Electronics 13, no. 23: 4761. https://doi.org/10.3390/electronics13234761

APA Style

Lo, S.-L., Cheng, H.-Y., & Yu, C.-C. (2024). Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation. Electronics, 13(23), 4761. https://doi.org/10.3390/electronics13234761

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop