Next Article in Journal
Optical Vapor Sensing on Single Wing Scales and on Whole Wings of the Albulina metallica Butterfly
Previous Article in Journal
Reference Phase Stabilizer for Distributed Underwater Sonar Systems
Article Menu

Export Article

Open AccessArticle
Sensors 2018, 18(12), 4280; https://doi.org/10.3390/s18124280

Highly Accurate and Fully Automatic 3D Head Pose Estimation and Eye Gaze Estimation Using RGB-3D Sensors and 3D Morphable Models

Computer Vision and Systems Laboratory, Laval University, 1665 Rue de l’Universite, Universite Laval, Quebec City, QC G1V 0A6, Canada
*
Author to whom correspondence should be addressed.
Received: 14 October 2018 / Revised: 27 November 2018 / Accepted: 30 November 2018 / Published: 5 December 2018
(This article belongs to the Section Physical Sensors)
Full-Text   |   PDF [1398 KB, uploaded 5 December 2018]   |  

Abstract

This work addresses the problem of automatic head pose estimation and its application in 3D gaze estimation using low quality RGB-D sensors without any subject cooperation or manual intervention. The previous works on 3D head pose estimation using RGB-D sensors require either an offline step for supervised learning or 3D head model construction, which may require manual intervention or subject cooperation for complete head model reconstruction. In this paper, we propose a 3D pose estimator based on low quality depth data, which is not limited by any of the aforementioned steps. Instead, the proposed technique relies on modeling the subject’s face in 3D rather than the complete head, which, in turn, relaxes all of the constraints in the previous works. The proposed method is robust, highly accurate and fully automatic. Moreover, it does not need any offline step. Unlike some of the previous works, the method only uses depth data for pose estimation. The experimental results on the Biwi head pose database confirm the efficiency of our algorithm in handling large pose variations and partial occlusion. We also evaluated the performance of our algorithm on IDIAP database for 3D head pose and eye gaze estimation. View Full-Text
Keywords: 3D morphable models; 3D head pose estimation; 3D eye gaze estimation; iterative closest point; RGB-D sensors 3D morphable models; 3D head pose estimation; 3D eye gaze estimation; iterative closest point; RGB-D sensors
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Shoja Ghiass, R.; Laurendeau, D. Highly Accurate and Fully Automatic 3D Head Pose Estimation and Eye Gaze Estimation Using RGB-3D Sensors and 3D Morphable Models. Sensors 2018, 18, 4280.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top