Next Article in Journal
Let’s Talk about TEX—Understanding Consumer Preferences for Smart Interactive Textile Products Using a Conjoint Analysis Approach
Previous Article in Journal
A Type of Annulus-Based Energy Balanced Data Collection Method in Wireless Rechargeable Sensor Networks
Open AccessArticle

Performance Evaluation Strategies for Eye Gaze Estimation Systems with Quantitative Metrics and Visualizations

Department of Electrical & Electronic Engineering, National University of Ireland, Galway H91 TK33, Ireland
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(9), 3151; https://doi.org/10.3390/s18093151
Received: 10 August 2018 / Revised: 7 September 2018 / Accepted: 15 September 2018 / Published: 18 September 2018
(This article belongs to the Section Physical Sensors)
An eye tracker’s accuracy and system behavior play critical roles in determining the reliability and usability of eye gaze data obtained from them. However, in contemporary eye gaze research, there exists a lot of ambiguity in the definitions of gaze estimation accuracy parameters and lack of well-defined methods for evaluating the performance of eye tracking systems. In this paper, a set of fully defined evaluation metrics are therefore developed and presented for complete performance characterization of generic commercial eye trackers, when they operate under varying conditions on desktop or mobile platforms. In addition, some useful visualization methods are implemented, which will help in studying the performance and data quality of eye trackers irrespective of their design principles and application areas. Also the concept of a graphical user interface software named GazeVisual v1.1 is proposed that would integrate all these methods and enable general users to effortlessly access the described metrics, generate visualizations and extract valuable information from their own gaze datasets. We intend to present these tools as open resources in future to the eye gaze research community for use and further advancement, as a contribution towards standardization of gaze research outputs and analysis.
View Full-Text
Keywords: eye gaze estimation; eye tracker; performance evaluation; metrics; visualizations; mobile devices; graphical user interface; open source; standardization eye gaze estimation; eye tracker; performance evaluation; metrics; visualizations; mobile devices; graphical user interface; open source; standardization
Show Figures

Graphical abstract

MDPI and ACS Style

Kar, A.; Corcoran, P. Performance Evaluation Strategies for Eye Gaze Estimation Systems with Quantitative Metrics and Visualizations. Sensors 2018, 18, 3151.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
  • Externally hosted supplementary file 1
    Link: https://www.youtube.com/watch?v=LvKOj3bcpTQ
    Description: The GazeVisual v1.1 is an open source graphical tool which is being currently developed to implement various metrics and visualizations for evaluating eye gaze datasets. It is in the form of a graphical user interface which will enable gaze researchers and general eye tracker users to effortlessly evaluate the data quality from their eye trackers. You can view a demo video of the software here showing some of its operations. More details can be found in the Github repository: https://github.com/anuradhakar49/GazeVisual
Back to TopTop