Skip to Content
  • Article
  • Open Access

8 September 2026

20 Pages

Systematic Performance Evaluation of WebGazer Webcam-Based Eye Tracking with Spatial and Angular Error Analysis

,
and
1
Department of Surveying & Geoinformatics Engineering, University of West Attica, Egaleo Park Campus, Ag. Spyridonos Str., Egaleo, 12243 Athens, Greece
2
Department of Informatics, University of Piraeus, Karaoli & Dimitriou 80, 18534 Piraeus, Greece
*
Author to whom correspondence should be addressed.

Abstract

Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer’s performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.

1. Introduction

Eye tracking has traditionally depended on specialized hardware, such as infrared-based systems, which can provide highly accurate measurements but are often costly and require controlled laboratory environments. As a result, their use has been largely limited to small-scale, in-lab studies. However, in recent years advances in computer vision and web technologies have made it possible to perform eye tracking using standard webcams. This shift has made eye tracking research more accessible, significantly lowering costs and allowing experiments to be conducted with larger and more diverse groups of participants in more natural settings [1,2,3]. Although webcam-based methods are generally less precise than dedicated devices, they have proven to be sufficiently reliable for many applications, such as usability studies, reading behavior analysis, and large-scale online experiments [4,5]. Overall, their ease of use and scalability have made them an increasingly attractive option for researchers in human–computer interaction and behavioral sciences.
Within this context, several tools have been developed to leverage these capabilities, with WebGazer [3] being one of the most widely used approaches. WebGazer offers several practical advantages, including low cost, ease of use, and the ability to support experiments with a large number of participants without requiring specialized eye-tracking hardware. In particular, it is an online eye tracker that uses common webcams, already present in mobile devices, to infer the eye-gaze locations of web visitors on a page in real time. Hutt et al. [6] conducted a study on text comprehension exercises among students using the WebGazer tool. Semmelmann and Weigelt [5] used WebGazer with consumer-grade webcams to investigate the potential of online eye tracking to benefit from the common advantages of online data collection. They compared three in-lab-conducted tasks (fixation, pursuit, and free viewing) with online-acquired data to analyze the spatial precision in the first two, and replicability of well-known gazing patterns in the third task. Yang et al. [7] studied the incorporation of WebGazer into the JavaScript library jsPsych [8] used by behavioral researchers, and adjusted the procedure and code to reduce the calibration/validation phase and improve the temporal resolution. Additionally, Steffan et al. [9] report a multi-lab study where they compared the remote web-based eye tracking with in-lab eye tracking in young children. In their study, they utilized WebGazer and jsPsych. Results of their remotely tested sample revealed that web-based eye tracking successfully captured the goal-based action predictions.
Beyond the development of eye tracking tools, an equally important research direction focuses on the evaluation of their performance, particularly in terms of accuracy and reliability. This is especially relevant for low-cost and webcam-based solutions, where measurement noise and experimental conditions can significantly affect the quality of the recorded gaze data. The evaluation of gaze data quality has attracted significant attention, especially in the context of low-cost eye tracking systems. Ooms and Krassanakis [10] and Ooms et al. [11] examined the accuracy and precision of gaze data by comparing recorded fixation locations with known reference points, using both artificial and human eye measurements. Their approach includes noise modeling and error analysis techniques [10], which are closely related to established post-processing tools such as the EyeMMV toolbox [12]. EyeMMV provides practical methods for detecting fixation events based on spatial dispersion criteria, making it a useful framework for analyzing gaze data, while its underlying algorithm is also used in fixation detection approaches adopted in such evaluation studies. This connection highlights the importance of combining reliable analysis tools with systematic evaluation procedures when assessing eye tracking performance.
Evaluating the performance of eye tracking systems is a key topic in the literature, with most studies focusing on metrics such as accuracy and precision. In particular, several works have examined the reliability of low-cost devices by comparing their outputs either with high-end systems or with known ground truth data. Previous studies have proposed methodological approaches for estimating spatial error and handling noise in gaze measurements, while others have explored how different experimental conditions influence performance. Overall, these findings suggest that, although webcam-based and low-cost solutions are generally less accurate than dedicated hardware, they can still provide sufficiently reliable data for many practical applications, especially when appropriate calibration and evaluation procedures are applied.
In addition to webcam-based eye tracking, alternative low-cost approaches such as mouse tracking have been explored for studying visual behavior. For example, the MatMouse toolbox [13] supports experimental studies based on cursor movement analysis, offering a complementary perspective on user interaction patterns. These approaches highlight a broader trend toward scalable and cost-effective methods for capturing behavioral data. In another eye-tracking application, Brandl et al. [14] studied the additional information provided by gaze data, such as total reading times, gaze entropy, and decoding accuracy, while comparing the implementation of the WebQAmGaze dataset on the language models mBERT, distil-mBERT, XLMR, and XLMR-L for three European languages.
Despite the growing adoption of webcam-based eye tracking systems, several important challenges remain. One of the main limitations is the lack of large-scale, reliable ground truth data, which are essential for understanding gaze behavior and for accurately evaluating system performance under realistic conditions. Collecting such data outside controlled laboratory environments remains a complex and resource-intensive process. In addition, existing studies often rely on isolated experimental setups, making it difficult to directly compare results across different configurations. This highlights the absence of unified platforms or applications that enable systematic and reproducible evaluation of eye tracking performance. At the same time, prior research has demonstrated that various experimental parameters can significantly influence the accuracy and reliability of eye tracking systems, particularly in low-cost and webcam-based settings. Factors such as calibration density, spatial distribution of calibration and evaluation points, stimulus duration, and visual characteristics have been shown to affect gaze estimation accuracy, either by modifying the experimental conditions or by introducing additional variability. However, these parameters are often studied independently, and there is limited work that investigates their combined impact within a consistent experimental framework. This gap motivates the need for a more systematic and unified approach to evaluating these factors.
To address this gap, this paper presents a comprehensive, multi-parameter evaluation framework designed to systematically investigate WebGazer performance under controlled and configurable conditions. The primary contribution of this study lies in the controlled one-factor-at-a-time manipulation of five experimental factors within the same participant group and software framework. The aim is not to claim a full factorial analysis of all possible parameter interactions, but to provide a reproducible framework and a participant-level quantitative comparison of selected experimental settings. To make the objectives explicit, the following research questions guide the analysis: RQ1: How is the joint calibration/evaluation point-density configuration associated with WebGazer spatial and angular error? RQ2: How do fixed and pseudo-random evaluation-point distributions compare in terms of gaze-estimation error? RQ3: How does recorded error vary across target presentation durations? RQ4: To what extent do recorded spatial and angular errors vary across stimulus colors and sizes? RQ5: Which examined parameter displays the largest descriptive differences across participants?
The remainder of this paper is organized as follows. Section 2 summarizes related work and recent state-of-the-art developments. Section 3 describes the experimental design, workflow, evaluation metrics, participant-level descriptive evidence, and participants/equipment used in the study. Section 4 presents the experimental results. Section 5 discusses the findings and limitations of the study. Finally, Section 6 concludes the paper and outlines directions for future work.

3. Materials and Methods

3.1. Experimental Design and Parameters

The experimental setup was guided by the need to systematically evaluate the impact of key experimental parameters on WebGazer performance under controlled conditions. The environment was configured to support real-time gaze estimation and flexible parameter manipulation, enabling the systematic variation in calibration density, spatial distribution, target presentation duration, color, and size.
The experimental design is based on the systematic variation in key parameters that are expected to influence eye tracking performance. These parameters, along with their corresponding units and tested values, are summarized in Table 1.
Table 1. Experimental parameters, units, and tested values used in the evaluation framework.
In the point-density analysis, calibration and evaluation density were varied jointly through matched configurations (5-5, 9-9, 12-12, and 18-18). Consequently, the results for this factor represent the combined calibration/evaluation point-density configuration and should not be interpreted as isolating either density component. The study followed a one-factor-at-a-time repeated-measures design. Each examined parameter was varied across its predefined levels while the remaining parameters were held at the reference values reported in the corresponding Results subsection. The study should therefore be interpreted as a controlled descriptive parameter-sensitivity analysis rather than as a full factorial experiment.
The systematic variation in these parameters enables a controlled descriptive comparison of the tested WebGazer configurations.
Each participant completed 19 calibration-evaluation runs. Table 2 presents the corresponding 19 distinct run configurations and repeats the common reference configuration (Run 1) in the final displayed row solely to make its role in the factor-wise comparisons explicit. The repeated final row does not represent an additional experimental run. The matrix is grouped by analytical factor rather than chronological order because the original trial-order log was not preserved.
Table 2. Reconstructed experimental-condition matrix for the 19 completed runs. The final row (1 *) repeats the reference condition (Run 1) for analytical purposes and does not represent an additional experimental run. Rows are grouped by analytical factor rather than chronological order.
The 18-18/fixed/5 s/blue-green/20-20 configuration served as the reference for the point-density, distribution, duration, and size comparisons. The color comparison used matched calibration and evaluation colors. A new calibration sequence was completed at the beginning of every run. The retained records do not document a formal randomized or counterbalanced sequence, and consequently, practice, fatigue, and order effects cannot be excluded.

3.2. Experimental Workflow

The experimental workflow consists of four main stages. First, the participant provides the active screen dimensions, screen resolution, and eye-to-screen-center distance required for the angular calculations. Second, a new calibration sequence is completed for the selected run configuration. Third, the evaluation stage presents the target sequence while WebGazer returns gaze predictions. Finally, each prediction is paired with the target visible at that time and the spatial and angular error metrics are calculated. One trial denotes one complete calibration-evaluation run under one of the 19 distinct configurations shown in Table 2. The final repeated reference row is included only for analytical presentation.
During the calibration stage, WebGazer is trained through a sequence of predefined calibration points. The participant successively clicks the displayed calibration targets using the selected point-density configuration (5, 9, 12, or 18 points). Each target requires one click and disappears immediately after that click, after which the next target appears. Target size was specified in browser/CSS pixels and could be set to 10, 12, 14, 16, 18, or 20 CSS pixels. The target color could be selected from blue, red, magenta, black, green, and brown. A new calibration sequence was initiated at the beginning of every calibration-evaluation run.
After calibration, the evaluation stage begins. Participants follow a circular target while keeping their head as still as possible. Each target remains visible for 2, 3, 4, or 5 s, according to the selected condition, and is immediately replaced by the next target. Evaluation sequences contain 5, 9, 12, or 18 targets. Every gaze prediction returned by WebGazer while a target was visible was associated with that target and included in the corresponding error calculation after application of the stated within-run exclusion rule. The retained implementation notes do not document additional temporal down-sampling or smoothing. No separate validation stage was performed. The evaluation sequence itself was used to assess prediction error.
The evaluation process also includes pseudo-random target positions. In this configuration, each evaluation target is shifted within a 14% range around its corresponding fixed position, preserving the overall spatial structure while introducing controlled positional variability. This condition enables a descriptive comparison with the fixed layout, and it does not by itself identify the mechanism responsible for any observed difference.

WebGazer Implementation Details

GazerApp, a browser application developed for this study, integrated the 2016 version of WebGazer.js, a client-side browser library. Each calibration target required one click, and all WebGazer predictions returned while the current evaluation target was visible were paired with that target. No separate validation stage was used. The study was conducted in accordance with applicable personal data protection requirements and the research ethics principles of the University of West Attica. Under Article 279.2.a of Act 4957/2022 and the Research Ethics and Conduct Regulation of the University of West Attica, submission to the Research Ethics Committee was not mandatory for this non-funded, low-risk technical evaluation, which did not raise serious or complex ethical issues. Before the experiment, each participant was informed about its purpose and procedure and provided consent to participate. Only estimated gaze coordinates, target coordinates, and derived error metrics were recorded. No directly identifiable or sensitive personal data were collected, and the procedure involved no medical intervention.

3.3. Evaluation Metrics

Both the target position rendered by the browser and the gaze prediction returned by WebGazer were recorded in native device pixels. Chrome browser zoom was fixed at 100%. With Windows display scaling set to 300%, the effective CSS-to-device conversion factor was d = 3.0, so one CSS pixel corresponded to three native device pixels along both axes. For every target point T and predicted gaze point P, both coordinate pairs were converted identically as x_device = d * x_CSS and y_device = d * y_CSS. The Euclidean target-prediction distance TP was then calculated in device pixels. This scale-adjusted device-pixel distance is the spatial prediction error reported in Table 3, Table 4, Table 5, Table 6 and Table 7. At the end of each participant-condition run, mean, minimum, maximum, and standard-deviation summaries were calculated. Errors exceeding three times the standard deviation of the values within the corresponding participant-condition run were excluded before the run-level summaries were computed. The criterion was not applied globally across the complete dataset.
Table 3. Aggregated WebGazer performance according to the number of calibration and evaluation points. For instance, 5-5 denotes the use of 5 points in both the calibration and evaluation processes.
Table 4. Aggregated WebGazer performance according to fixed and pseudo-random evaluation-point distribution.
Table 5. Aggregated WebGazer performance according to target presentation duration.
Table 6. Aggregated WebGazer performance according to stimulus (target) color.
Table 7. Aggregated WebGazer performance according to stimulus (target) size.
For angular-error calculation, the native device-pixel coordinates were converted separately to physical screen coordinates. Let W = 28.8 cm and H = 18.0 cm denote the active display width and height, and let R_x = 3840 and R_y = 2400 denote the native horizontal and vertical device-pixel resolutions. The physical scale factors were s_x = W/R_x = 0.0075 cm per device pixel and s_y = H/R_y = 0.0075 cm per device pixel. At d = 3.0, the corresponding scale is 0.0225 cm per CSS pixel in both directions. Consequently, px in Table 3, Table 4, Table 5, Table 6 and Table 7 denotes device pixels, whereas the target-diameter settings refer to CSS pixels.
For any CSS-coordinate point Q = (x_Q,CSS, y_Q,CSS), the corresponding device-pixel point is Q_device = (3 * x_Q,CSS, 3 * y_Q,CSS). Target point T, prediction point P, and screen center K were expressed in this same device-pixel coordinate system before the distances KT, KP, and TP were converted to centimeters using s_x and s_y. Point A is defined on the normal to the screen plane through K, with AK equal to the measured eye-to-screen-center distance of 41 cm. Thus, KT, KP, TP, AT, AP, and AK are expressed in centimeters for the angular calculations; spatial error is reported in device pixels, and angular error is reported in degrees. Windows display scaling was therefore handled once, through the CSS-to-device conversion, before the native-resolution scale factors were applied. All values in Table 3, Table 4, Table 5, Table 6 and Table 7 are in device pixel or in degrees.
For the observation-level angular metric, a deviation angle δi, as illustrated in Figure 1, is calculated for every target-prediction pair. KT, KP, and TP are first expressed in centimeters using the conversion described above. AT and AP are then obtained from the right triangles AKT and AKP, and δi is calculated from triangle ATP using the law of cosines:
δ i = arccos A T 2 + A P 2 − T P 2 2 · A T · A P
Figure 1. Setup geometry and evaluation metrics.
The overall angular error delta is the mean of the observation-level delta_i values. The delta metric is used as the primary angular error measure because it is calculated for each target-prediction pair before aggregation. Participant-level descriptive summaries underlying Table 3, Table 4, Table 5, Table 6 and Table 7 are provided in Appendix A. Across the aggregated condition summaries, the largest descriptive ranges are observed for target presentation duration and joint point-density configuration. Point density shows the wider device-pixel range, whereas duration shows the slightly wider angular range. The fixed versus pseudo-random contrast is smaller, and the color and size ranges are smaller still.

3.4. Participants, Experimental Trials, and Equipment

Twenty adult volunteers participated in the experimental study. All participants were positioned 41 cm from the center of the screen. In total, 380 calibration-evaluation runs were recorded, with each of the 20 participants completing 19 actual runs under the distinct configurations summarized in Table 2. The study focused on anonymous gaze-performance measurements rather than demographic profiling. Therefore, age, gender, visual correction status, and previous eye-tracking experience were not retained in the records. All data underlying Table 3, Table 4, Table 5, Table 6 and Table 7 were collected on a Dell XPS 13 Plus 9320 laptop equipped with a 13.4-inch display. The active display area, excluding bezels, was 28.8 cm × 18.0 cm. Its integrated HD RGB camera captured video at 1280 × 720 pixels and 30 fps. GazerApp was run in Google Chrome on Windows 11 Pro, under stable indoor lighting, with the integrated webcam positioned above the display and facing the participant.

4. Results

Results are organized by the parameter under examination. For each condition, the analysis reports scale-adjusted device-pixel spatial-error and angular-error summaries, including the mean, maximum, minimum, and standard deviation. The comparisons are descriptive. Participant-level values are provided in Appendix A.

4.1. Effect of Calibration and Evaluation Point Density

In Table 3, the final average values from the experimental trials of all participants are presented according to the number of calibration and evaluation points. These values were obtained from experimental trials where the following parameters were kept fixed:
  • Width of the calibration target: 20 px
  • Diameter of the evaluation target: 20 px
  • Target presentation duration: 5 s
  • Distribution of evaluation points: Fixed
  • Color of the calibration target: blue
  • Color of the evaluation target: green
Table 3 shows a descriptive association between the joint calibration/evaluation point-density configuration and the recorded errors. Within the tested configurations, denser layouts correspond to lower mean spatial and angular errors. Across the full tested range, mean spatial error decreases from 1383 device pixels in the 5-5 condition to 1009 device pixels in the 18-18 condition, a difference of 374 pixels (27.0%), while mean angular error decreases from 13.556 to 10.322 degrees, a difference of 3.234 degrees (23.9%). The largest adjacent reduction occurs from 9-9 to 12-12: mean spatial error is 186 device pixels lower (15.2%), and mean angular error is 1.737 degrees lower (14.2%). From 12-12 to 18-18, the corresponding differences are smaller, at 28 device pixels and 0.213 degrees. The minimum spatial error decreases from 97 device pixels in the 5-5 condition to 58 device pixels in the 18-18 condition, while the standard deviation is lower in the 12-12 and 18-18 configurations than in the two sparser configurations.
These aggregate summaries show a monotonic reduction in mean error across the denser joint point-density configurations. The comparison concerns the joint point-density configuration and does not separate calibration density from evaluation density.

4.2. Effect of Evaluation Point Distribution

Table 4 presents the final average values from the experimental trials of all participants according to the fixed or pseudo-random configuration of the evaluation points. These values were obtained from experimental trials where the following parameters were kept fixed:
  • Width of the calibration target: 20 px
  • Diameter of the evaluation target: 20 px
  • Target presentation duration: 5 s
  • Color of the calibration target: blue
  • Color of the evaluation target: green
  • Number of calibration points: 18
  • Number of evaluation points: 18
In Table 4, the pseudo-random configuration is associated with higher mean spatial and angular errors than the fixed configuration in this sample. This is a descriptive contrast and does not establish that reduced predictability caused the difference. Reduced spatial predictability is considered one possible explanation.
The minimum spatial error is 96 device pixels in the pseudo-random condition and 58 device pixels in the fixed condition, while the maximum values are 3121 and 2989 device pixels, respectively. The spatial-error standard deviation is also higher in the pseudo-random condition (666 versus 617 device pixels). The mean differences follow the same direction: 1160 versus 1009 device pixels for spatial error and 11.886 versus 10.322 degrees for angular error. These descriptive contrasts do not establish that reduced predictability caused the difference.

4.3. Effect of Target Presentation Duration

In Table 5, the final mean values from the experimental trials of all participants are presented according to target presentation duration. These values were obtained from experimental trials where the following parameters were kept fixed:
  • Width of the calibration target: 20 px
  • Diameter of the evaluation target: 20 px
  • Distribution of evaluation points: Fixed
  • Color of the calibration target: blue
  • Color of the evaluation target: green
  • Number of calibration points: 18
  • Number of evaluation points: 18
Table 5 shows that shorter target presentation durations are associated with higher mean spatial and angular errors in the tested sample. Mean spatial error ranges from 1334 device pixels at 2 s to 1009 device pixels at 5 s, while mean angular error ranges from 13.741 to 10.322 degrees. These values describe the observed conditions and do not constitute a formal repeated-measures test. The standard-deviation summaries are similar across durations and do not support a claim that the shortest duration produced the greatest variability.

4.4. Effect of Stimulus Color

In Table 6, the final mean values from the experimental trials of all participants are presented according to the color of the calibration targets and evaluation targets. These values were obtained from experimental trials where the following parameters were kept fixed:
  • Width of the calibration target: 20 px
  • Diameter of the evaluation target: 20 px
  • Target presentation duration: 5 s
  • Distribution of evaluation points: Fixed
  • Number of calibration points: 18
  • Number of evaluation points: 18
Across the aggregated condition summaries, differences across colors are comparatively small. Mean spatial error ranges from 956 device pixels for Black/Black to 1041 device pixels for Green/Green, and mean angular error ranges from 9.813 to 10.681 degrees. These ranges are smaller than those observed across duration and point-density conditions, so color is treated as a secondary setting in the present sample rather than as a demonstrated effect.

4.5. Effect of Stimulus Size

In Table 7, the final mean values from the experimental trials of all participants are presented according to the size of the calibration and evaluation targets. These values were obtained from experimental trials where the following parameters were kept fixed:
  • Target presentation duration: 5 s;
  • Distribution of evaluation points: Fixed
  • Color of the calibration target: blue
  • Color of the evaluation target: green
  • Number of calibration points: 18
  • Number of evaluation points: 18
Table 7 shows small, non-monotonic differences across target sizes. The lowest mean spatial and angular errors both occur at 12/12 (968 device pixels and 9.922 degrees), with 14/14 yielding the next-lowest mean values. The results do not show a consistent advantage for either larger or smaller targets across the tested range, supporting a cautious interpretation of target size as a secondary setting in this dataset.

5. Discussion

This study examines how recorded WebGazer error varies across selected experimental configurations using device-pixel spatial and angular metrics. In the present sample, target presentation duration and the joint calibration/evaluation point-density configuration show the largest descriptive differences, followed by evaluation-point distribution. Their relative ranking depends on the metric: point density has the wider mean device-pixel range, whereas duration has the slightly wider mean angular range. Shorter target presentation durations are associated with higher recorded errors. One possible explanation is that participants have less time to stabilize their gaze before the next target appears. Longer intervals correspond to lower mean errors in the present data, but this interpretation requires confirmation through a design that controls trial order and applies predefined repeated-measures analysis.
Denser joint calibration/evaluation point configurations are also associated with lower spatial and angular errors. Such configurations may provide broader screen coverage, but they also lengthen the procedure and may increase participant burden. Because calibration and evaluation density were varied together, their separate contributions cannot be determined from the present data. The pseudo-random distribution is associated with somewhat higher errors than the fixed distribution. Reduced predictability is one plausible explanation, but it was not directly measured and should not be treated as an established cause. Fixed layouts may support more regular transitions, whereas pseudo-random layouts may better represent less predictable interaction scenarios. The appropriate choice therefore depends on the intended use of the experiment. Stimulus color and size show smaller and less consistent descriptive differences. Color values vary within a narrow range, and errors are non-monotonic: both mean-error minima occur at 12/12, with 14/14 yielding the next-lowest values. These parameters should therefore be considered in relation to display type, contrast, lighting, and participant characteristics rather than interpreted as having a uniform effect. Overall, webcam-based eye tracking remains accessible and scalable, but the observed measurements are sensitive to experimental setup and implementation choices. The proposed framework supports structured comparison of selected settings under a common protocol. At the same time, its one-factor-at-a-time design supports descriptive within-sample comparisons only and does not establish interactions or causal effects among the tested parameters.
This study has several limitations. First, head movement, camera positioning, lighting, and participant-specific differences were not controlled with strict physical constraints. Second, all data were collected using one laptop, integrated webcam, browser, and operating system, limiting device-level generalization. Third, the study was exploratory and demographic covariates were not retained. Fourth, calibration and evaluation density were varied jointly. Fifth, the original chronological trial-order log was not preserved, and no formal randomization or counterbalancing schedule can be verified. Additionally, practice, fatigue, and order effects may therefore have contributed to condition differences. Finally, the reported mean values may nevertheless provide an indicative reference for studies using comparable settings, provided that these methodological limitations are taken into account. Spatial error expressed in device pixels is specific to the tested native resolution and display-scaling configuration. Cross-device comparisons should therefore use physical or angular units and explicitly account for the browser’s CSS-to-device-pixel mapping. The effects of changing native resolution, Windows scaling, or browser zoom were not experimentally evaluated.

6. Conclusions

This study presents a quantitative, one-factor-at-a-time evaluation of WebGazer across five experimental factors: joint calibration/evaluation point-density configuration, evaluation-point distribution, target presentation duration, stimulus color, and stimulus size. Spatial error in scale-adjusted device pixels and observation-level angular error are reported within the same participant group and browser-based framework.
Within the present sample, the largest descriptive differences occur across target presentation-duration conditions and joint point-density configurations. Their ranking depends on the metric: point density has the wider mean device-pixel range, whereas duration has the slightly wider mean angular range. Longer durations and denser configurations are associated with lower mean errors, while the pseudo-random layout is associated with somewhat higher errors than the fixed layout. These associations do not establish causality or population-level effects. Stimulus color and size show smaller and less consistent differences, with size displaying a non-monotonic pattern. The findings identify settings that warrant consideration and confirmatory evaluation when designing webcam-based eye-tracking studies.
Future work should use larger samples and full or partial factorial designs with predefined repeated-measures analyses. Studies should retain the complete chronological trial schedule, randomization or counterbalancing information. Additional experiments should compare hardware, browsers, webcams, and display sizes and should consider more controlled setups, such as a chin rest. Although the present approach is preliminary and exploratory, it provides a quantitative framework that can be refined alongside established gaze-data quality methods, including those discussed by Ooms and Krassanakis [10], and applied in future usability and human–computer interaction research.

Author Contributions

Conceptualization, E.P., V.K. and A.L.K.; methodology, E.P., V.K. and A.L.K.; software, E.P.; validation, E.P.; formal analysis, E.P.; data curation, E.P.; writing—original draft preparation, E.P.; writing—review and editing, E.P., V.K. and A.L.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study involved a non-funded, low-risk technical evaluation of a webcam-based eye-tracking system using anonymized gaze-coordinate data collected from 20 participants. No personally identifiable information or identifiable video recordings were collected or stored. According to Article 279.2.a of Act 4957/2022 and the Research Ethics and Conduct Regulation of the University of West Attica, submission to the Research Ethics Committee of the University of West Attica was not mandatory for this type of non-funded research without serious or complex ethical issues. The study was conducted under the responsibility of the principal investigator in accordance with research integrity principles and applicable national and international regulations regarding the protection of human participants and their personal data.

Data Availability Statement

Participant-level summary values supporting the descriptive analyses are provided in Appendix A.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. Participant-Level Descriptive Summaries Underlying Table 3, Table 4, Table 5, Table 6 and Table 7

Table A1, Table A2, Table A3, Table A4 and Table A5 present the participant-level summaries underlying Table 3, Table 4, Table 5, Table 6 and Table 7. Each cell reports spatial error in scale-adjusted device pixels on the first line and angular error δ in degrees on the second, as mean ± SD [minimum–maximum] after the within-run exclusion criterion in Section 3.3. Participants are anonymized as P01–P20. Spatial values are shown as whole device pixels by discarding the fractional component, consistent with Table 3, Table 4, Table 5, Table 6 and Table 7; angular values are shown to three decimals. In Table 3, Table 4, Table 5, Table 6 and Table 7, maximum, minimum, and standard-deviation entries are arithmetic means of participant-level run summaries, not pooled statistics. The shared reference run is repeated in Table A1, Table A2, Table A3 and Table A5 for factor-wise comparison and is not an additional run.
Table A1. Participant-level WebGazer performance according to the joint calibration/evaluation point-density configuration.
Table A2. Participant-level WebGazer performance according to evaluation-point distribution.
Table A3. Participant-level WebGazer performance according to target presentation duration.
Table A4. Participant-level WebGazer performance according to matched calibration/evaluation target color.
Table A5. Participant-level WebGazer performance according to calibration/evaluation target diameter.

References

  1. Duchowski, A.T. Eye Tracking Methodology: Theory and Practice, 2nd ed.; Springer: London, UK, 2007. [Google Scholar]
  2. Hansen, D.W.; Ji, Q. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32, 478–500. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Papoutsaki, A.; Sangkloy, P.; Laskey, J.; Daskalova, N.; Huang, J.; Hays, J. WebGazer: Scalable webcam eye tracking using user interactions. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), New York, NY, USA, 9–15 July 2016; pp. 3839–3845. [Google Scholar]
  4. Papoutsaki, A.; Laskey, J.; Huang, J. SearchGazer: Webcam eye tracking for remote studies of web search. In Proceedings of the Conference on Human Information Interaction and Retrieval (CHIIR), Oslo, Norway, 7–11 March 2017; pp. 17–26. [Google Scholar]
  5. Semmelmann, K.; Weigelt, S. Online webcam-based eye tracking in cognitive science: A first look. Behav. Res. Methods 2018, 50, 451–465. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Hutt, S.; Wong, A.; Papoutsaki, A.; Baker, R.S.; Gold, J.I.; Mills, C. Webcam-based eye tracking to detect mind wandering and comprehension errors. Behav. Res. Methods 2023, 56, 1–17. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Yang, X.; Krajbich, I. Webcam-based online eye tracking for behavioral research. Judgm. Decis. Mak. 2021, 16, 1485–1505. [Google Scholar] [CrossRef] [Scilit]
  8. de Leeuw, J.R. jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behav. Res. Methods 2015, 47, 1–12. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Steffan, A.; Zimmer, L.; Arias-Trejo, N.; Bohn, M.; Dal Ben, R.; Flores-Coronado, M.A.; Franchin, L.; Garbisch, I.; Grosse Wiesmann, C.; Hamlin, J.K.; et al. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood. Infancy 2024, 29, 31–55. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  10. Ooms, K.; Krassanakis, V. Measuring the Spatial Noise of a Low-Cost Eye Tracker to Enhance Fixation Detection. J. Imaging 2018, 4, 96. [Google Scholar] [CrossRef] [Scilit]
  11. Ooms, K.; Dupont, L.; Lapon, L.; Popelka, S. Accuracy and Precision of Fixation Locations Recorded with the Low-Cost Eye Tribe Tracker in Different Experimental Set-Ups. J. Eye Mov. Res. 2015, 8, 1–20. [Google Scholar] [CrossRef] [Scilit]
  12. Krassanakis, V.; Filippakopoulou, V.; Nakos, B. EyeMMV Toolbox: An Eye Movement Post-Analysis Tool Based on a Two-Step Spatial Dispersion Threshold for Fixation Identification. J. Eye Mov. Res. 2014, 7, 1–10. [Google Scholar] [CrossRef] [Scilit]
  13. Krassanakis, V.; Kesidis, A.L. MatMouse: A Mouse Movements Tracking and Analysis Toolbox for Visual Search Experiments. Multimodal Technol. Interact. 2020, 4, 83. [Google Scholar] [CrossRef] [Scilit]
  14. Brandl, S.; Eberle, O.; Ribeiro, T.; Søgaard, A.; Hollenstein, N. Evaluating webcam-based gaze data as an alternative for human rationale annotations. In Proceedings of the LREC-COLING, Torino, Italy, 20–25 May 2024; pp. 6544–6556. [Google Scholar]
  15. Chhimpa, G.R.; Kumar, A.; Garhwal, S.; Kumar, D.; Wani, N.A.; Wani, M.A.; Shakil, K.A. A Comprehensive Framework for Eye Tracking: Methods, Tools, Applications, and Cross-Platform Evaluation. J. Eye Mov. Res. 2025, 18, 47. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Lai, L.; Su, B.; She, L. Trends and Transformations: A Bibliometric Analysis of Eye-Tracking Research in Educational Technology. J. Eye Mov. Res. 2025, 18, 23. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.