A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion
AbstractFacial landmarking locates the key facial feature points on facial data, which provides not only information on semantic facial structures, but also prior knowledge for other kinds of facial analysis. However, most of the existing works still focus on the 2D facial image which may suffer from lighting condition variations. In order to address this limitation, this paper presents a coarse-to-fine approach to accurately and automatically locate the facial landmarks by using deep feature fusion on 3D facial geometry data. Specifically, the 3D data is converted to 2D attribute maps firstly. Then, the global estimation network is trained to predict facial landmarks roughly by feeding the fused CNN (Convolutional Neural Network) features extracted from facial attribute maps. After that, input the local fused CNN features extracted from the local patch around each landmark estimated previously, and other local models are trained separately to refine the locations. Tested on the Bosphorus and BU-3DFE datasets, the experimental results demonstrated effectiveness and accuracy of the proposed method for locating facial landmarks. Compared with existed methods, our results have achieved state-of-the-art performance. View Full-Text
Share & Cite This Article
Wang, K.; Zhao, X.; Gao, W.; Zou, J. A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion. Symmetry 2018, 10, 308.
Wang K, Zhao X, Gao W, Zou J. A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion. Symmetry. 2018; 10(8):308.Chicago/Turabian Style
Wang, Kai; Zhao, Xi; Gao, Wanshun; Zou, Jianhua. 2018. "A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion." Symmetry 10, no. 8: 308.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.