Next Article in Journal
The Impact of Skinsuit Zigzag Tape Turbulators on Speed Skating Performance
Previous Article in Journal
A Novel Disruptive Innovation-Like Algorithm for Single-Machine Scheduling with Sequence-Dependent Family Setup Times
Article

SADG: Self-Aligned Dual NIR-VIS Generation for Heterogeneous Face Recognition

1
School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China
2
Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
3
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(3), 987; https://doi.org/10.3390/app11030987
Received: 21 December 2020 / Revised: 16 January 2021 / Accepted: 20 January 2021 / Published: 22 January 2021
Heterogeneous face recognition (HFR) has aroused significant interest in recent years, with some challenging tasks such as misalignment problems and limited HFR data. Misalignment occurs among different modalities’ images mainly because of misaligned semantics. Although recent methods have attempted to settle the low-shot problem, they suffer from the misalignment problem between paired near infrared (NIR) and visible (VIS) images. Misalignment can bring performance degradation to most image-to-image translation networks. In this work, we propose a self-aligned dual generation (SADG) architecture for generating semantics-aligned pairwise NIR-VIS images with the same identity, but without the additional guidance of external information learning. Specifically, we propose a self-aligned generator to align the data distributions between two modalities. Then, we present a multiscale patch discriminator to get high quality images. Furthermore, we raise the mean landmark distance (MLD) to test the alignment performance between NIR and VIS images with the same identity. Extensive experiments and an ablation study of SADG on three public datasets show significant alignment performance and recognition results. Specifically, the Rank1 accuracy achieved was close to 99.9% for the CASIA NIR-VIS 2.0, Oulu-CASIA NIR-VIS and BUAA VIS-NIR datasets, respectively. View Full-Text
Keywords: heterogeneous face recognition; NIR-VIS data generation; semantic alignment heterogeneous face recognition; NIR-VIS data generation; semantic alignment
Show Figures

Figure 1

MDPI and ACS Style

Zhao, P.; Zhang, F.; Wei, J.; Zhou, Y.; Wei, X. SADG: Self-Aligned Dual NIR-VIS Generation for Heterogeneous Face Recognition. Appl. Sci. 2021, 11, 987. https://doi.org/10.3390/app11030987

AMA Style

Zhao P, Zhang F, Wei J, Zhou Y, Wei X. SADG: Self-Aligned Dual NIR-VIS Generation for Heterogeneous Face Recognition. Applied Sciences. 2021; 11(3):987. https://doi.org/10.3390/app11030987

Chicago/Turabian Style

Zhao, Pengcheng, Fuping Zhang, Jianming Wei, Yingbo Zhou, and Xiao Wei. 2021. "SADG: Self-Aligned Dual NIR-VIS Generation for Heterogeneous Face Recognition" Applied Sciences 11, no. 3: 987. https://doi.org/10.3390/app11030987

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop