Cross-Source Prediction of a Visual Load Index from Vehicle Kinematic Features: A Driver-Independent Validation Study
Highlights
- Across held-out drivers, vehicle kinematics retained measurable information about the eye-movement-derived visual load index (VLI) proxy beyond the road-type baseline (ΔAUC = 0.042; 95% CI: 0.006–0.078).
- The driving-style prior increased AUC from 0.589 to 0.633, but its driver-level incremental effect remained exploratory because the confidence interval included zero.
- By integrating within-fold proxy-label construction, source isolation, driver-grouped evaluation, and road-context controls, this study establishes a confounder-aware framework for identifying transferable information in proxy-label-based multisource sensing research.
- These findings position vehicle kinematics as a complementary sensing channel, rather than a replacement for eye tracking, and support its prospective evaluation in multisource driver-monitoring systems.
Abstract
1. Introduction
2. Materials and Methods
2.1. Data Acquisition and Preprocessing
2.1.1. Experimental Equipment and Sensor Configuration
2.1.2. Participants
2.1.3. Experimental Scenario
2.1.4. Data Acquisition Procedure
2.1.5. Analysis Samples and Driver-Independent Validation
2.2. Data Synchronization, Quality Control, and Windowing
2.3. VLI Proxy-Label Construction via Entropy–CRITIC Weighting
2.4. Vehicle Predictive Model and Input Constraints
2.5. Input Configurations and Driving-Style Prior
2.5.1. Vehicle-Kinematic Control Features
2.5.2. K-Means Driving-Style Extraction and Cluster Selection
2.6. Vehicle Sequence Encoder and Training Objective
| Algorithm 1. Driver-independent procedure for WESF→VLI label construction, reconstruction, and input-modality diagnosis |
| Input: Window-level WESF, vehicle-kinematic, and road-type features of all drivers; folds F = 5; style clusters K = 3; bootstrap replications B = 200 Output: Out-of-fold performance of M0–M4; increments ΔΦ with driver-level 95% CIs 1: Partition all drivers into F disjoint folds, with the driver as the partition unit 2: for f = 1 to F do 3: Training folds only: normalize the WESF features, estimate the entropy–CRITIC combined weights, and construct the VLI label with quantile thresholds (Equations (4)–(6)) 4: Training folds only: cluster the driver-level style vectors by K-means (K = 3) 5: Train the M0–M4 predictors (Table 5) on training-fold windows, with no eye-movement feature entering any predictor 6: Freeze all parameters; on held-out drivers, construct evaluation labels, assign the nearest style cluster, predict, and compute out-of-fold metrics 7: end for 8: Aggregate metrics across folds; compute the increments ΔΦ (Equation (8)) with driver-level bootstrap 95% CIs (B = 200) 9: return out-of-fold performance, increments, and diagnostic results (positive/negative controls; within-road stratification and relabeling) |
2.7. Future High-VLI Prediction and Persistence Baseline
3. Results
3.1. VLI Label Distribution and Robustness
3.2. Same-Window Reconstruction from Vehicle and Style Inputs
3.3. Model-Invariance Check
3.4. Interpretability Analysis via PDP and SHAP
3.5. Road-Confounding Control and Vehicle-Increment Test
3.6. Benchmarking Future High-VLI Prediction
3.7. VLI Distribution and Model Performance by Window Category
4. Discussion
4.1. Cross-Source Reconstructability and the Role of the Style Prior
4.2. Road-Confounding Control and Circularity Diagnosis
4.3. Capability Boundaries and Application Implications
4.4. Limitations and Future Work
5. Conclusions
- (1)
- Vehicle kinematics partially reconstructed the eye-movement-derived VLI label on held-out drivers, with an out-of-fold AUC of 0.589; this reconstruction ability exceeded the binary road-type proxy, with a ΔAUC of 0.042 after road control, whose driver-level 95% confidence interval [0.006, 0.078] excluded zero. The absolute discriminative performance nevertheless remained modest and was insufficient for standalone high-VLI warning.
- (2)
- The driving-style prior provided a directionally consistent, positive but statistically non-significant increment, whose effect was mainly manifested as an overall shift in the driver-level high-VLI base rate. The three-cluster partition underlying this prior is a dataset-specific description of the 33 drivers rather than a general driving-style taxonomy.
- (3)
- The two findings—vehicle reconstructability and the direction of the style increment—showed qualitatively consistent patterns across five model architectures and multiple label-construction schemes.
- (4)
- In future high-VLI state prediction, the vehicle sequence model did not materially outperform the persistence baseline over the evaluated horizons, and both approaches were close to chance level at the 20 s horizon.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
Appendix A.1. Model Interpretation and Illustrative Results


| Model | Input | Accuracy | Macro-F1 | High-VLI Recall | AUC | AP |
|---|---|---|---|---|---|---|
| Logistic | Vehicle | 0.673 | 0.489 | 0.109 | 0.589 | 0.430 |
| RF | 0.684 | 0.526 | 0.160 | 0.624 | 0.478 | |
| XGBoost | 0.684 | 0.479 | 0.085 | 0.570 | 0.455 | |
| GRU | 0.673 | 0.519 | 0.161 | 0.600 | 0.442 | |
| Transformer-GRU | 0.667 | 0.493 | 0.121 | 0.599 | 0.435 | |
| Logistic | Vehicle+Style | 0.690 | 0.520 | 0.143 | 0.633 | 0.490 |
| RF | 0.696 | 0.549 | 0.186 | 0.632 | 0.510 | |
| XGBoost | 0.697 | 0.512 | 0.123 | 0.587 | 0.485 | |
| GRU | 0.696 | 0.567 | 0.226 | 0.642 | 0.500 | |
| Transformer-GRU | 0.699 | 0.573 | 0.235 | 0.639 | 0.507 |
Appendix A.2. Context, Direction, and Window-Scheme Sensitivity Analyses
| Model | Road-Context Encoding | Vehicle Features | AUC | ΔAUC [95% CI] |
|---|---|---|---|---|
| M0 | Binary road type | No | 0.562 | — |
| M3 | Binary road type | Yes | 0.604 | +0.042 [0.006, 0.078] |
| M0′ | Segment ID (14 segments, one-hot) | No | 0.581 | — |
| M3′ | Segment ID (14 segments, one-hot) | Yes | 0.615 | +0.034 [0.003, 0.065] |
| (a) | |||||
| Window Category | Windows (n, %) | VLI Mean | High-VLI Proportion (%) | Mean Speed (km/h) | Mean |Angular Velocity| (rad/s) |
| Basic segment, Road A | 11,650 (47.7%) | 0.219 | 36.5 | 54.1 | 0.021 |
| Basic segment, Road B | 10,050 (41.1%) | 0.198 | 26.6 | 76.5 | 0.012 |
| Ramp-influenced zone | 2300 (9.4%) | 0.246 | 45.2 | 45.8 | 0.038 |
| Connecting ramp | 350 (1.4%) | 0.252 | 47.4 | 38.2 | 0.055 |
| Boundary-crossing | 87 (0.4%) | 0.231 | 39.1 | 49.6 | 0.032 |
| (b) | |||||
| Setting | M1 AUC | M2 AUC | Road-Control AUC (M0 Variant) | Vehicle Increment ΔAUC [95% CI] | Style Increment ΔAUC [95% CI] |
| Primary analysis | 0.589 | 0.633 | 0.562 | +0.042 [0.006, 0.078] | +0.044 [−0.005, 0.113] |
| Excluding boundary-crossing and connecting-ramp windows | 0.587 | 0.631 | 0.561 | +0.041 [0.005, 0.077] | +0.043 [−0.006, 0.111] |
| Three-category road coding R ∈ {A, B, Ramp} | 0.589 | 0.633 | 0.571 | +0.037 [0.004, 0.070] | +0.044 [−0.005, 0.113] |
| Basic-segment-only subsample | 0.578 | 0.619 | 0.549 | +0.036 [0.002, 0.070] | +0.040 [−0.008, 0.088] |
| Ramp-influenced-zone-only subsample | 0.601 | 0.634 | — | — | — |
| (a) | ||||
| Direction × Road | Windows (n) | Mean Speed (km/h) | VLI Mean | High-VLI Proportion (%) |
| Outbound, Road A | 6950 | 49.8 | 0.225 | 38.9 |
| Outbound, Road B | 5310 | 71.1 | 0.204 | 27.9 |
| Return, Road A | 6839 | 50.9 | 0.221 | 37.1 |
| Return, Road B | 5338 | 69.4 | 0.200 | 26.7 |
| (b) | ||||
| Setting | AUC/ΔAUC | Driver-Level 95% CI | ||
| M0″ Road × Direction only | 0.566 | — | ||
| M3″ Road × Direction + vehicle | 0.606 | — | ||
| Vehicle increment M3″ − M0″ | +0.040 | [0.005, 0.075] | ||
| M1 AUC, outbound/return strata | 0.585/0.592 | — | ||
| M2 AUC, outbound/return strata | 0.628/0.636 | — | ||
| Horizon | Persistence Baseline | M0 Road-Only | M1 Vehicle-Only | M2 Vehicle+Style | Vehicle Sequence Model |
|---|---|---|---|---|---|
| 10 s | 0.703 | 0.548 | 0.566 | 0.588 | 0.574 |
| 20 s | 0.531 | 0.541 | 0.552 | 0.569 | 0.560 |
| 30 s | 0.505 | 0.536 | 0.541 | 0.552 | 0.549 |
| Style Construction | K | Mean Silhouette | M1 AUC | M2 AUC | Style Increment M2 − M1 ΔAUC [95% CI] | M4 − M3 ΔAUC [95% CI] |
|---|---|---|---|---|---|---|
| Primary | 3 | 0.450 | 0.589 | 0.633 | +0.044 [−0.005, 0.113] | +0.038 [−0.012, 0.088] |
| Mean speed removed from clustering | 3 | 0.402 | 0.589 | 0.621 | +0.032 [−0.014, 0.089] | +0.028 [−0.019, 0.075] |
| Segment-referenced deviation features | 3 | 0.418 | 0.589 | 0.626 | +0.037 [−0.010, 0.096] | +0.031 [−0.016, 0.081] |
Appendix A.3. Cross-Validation and Label-Construction Reproducibility
| Fold | Drivers (n) | Driver IDs | Drivers with Two Sessions (n) |
|---|---|---|---|
| 1 | 6 | D05, D10, D13, D16, D22, D25 | 1 |
| 2 | 6 | D09, D15, D19, D26, D30, D33 | 1 |
| 3 | 7 | D02, D04, D06, D07, D18, D27, D29 | 2 |
| 4 | 7 | D08, D12, D14, D21, D23, D28, D31 | 2 |
| 5 | 7 | D01, D03, D11, D17, D20, D24, D32 | 2 |
| Total | 33 | — | 8 |
| Feature | Fold 1 | Fold 2 | Fold 3 | Fold 4 | Fold 5 | Mean ± SD |
|---|---|---|---|---|---|---|
| Number of fixations | 0.0938 | 0.0899 | 0.0915 | 0.0938 | 0.0920 | 0.0922 ± 0.0017 |
| SD of fixation duration | 0.1070 | 0.1078 | 0.1075 | 0.1068 | 0.1063 | 0.1071 ± 0.0006 |
| Total number of saccades | 0.1229 | 0.1185 | 0.1217 | 0.1198 | 0.1216 | 0.1209 ± 0.0018 |
| Total saccade time | 0.1383 | 0.1384 | 0.1372 | 0.1378 | 0.1381 | 0.1380 ± 0.0005 |
| SD of saccade time | 0.1621 | 0.1639 | 0.1618 | 0.1626 | 0.1631 | 0.1627 ± 0.0008 |
| Mean saccade amplitude | 0.0967 | 0.0999 | 0.0989 | 0.0988 | 0.0985 | 0.0986 ± 0.0012 |
| Mean pupil diameter | 0.1615 | 0.1640 | 0.1649 | 0.1636 | 0.1639 | 0.1636 ± 0.0013 |
| SD of pupil diameter | 0.0588 | 0.0614 | 0.0592 | 0.0611 | 0.0605 | 0.0602 ± 0.0011 |
| CV of pupil diameter | 0.0589 | 0.0562 | 0.0573 | 0.0557 | 0.0559 | 0.0568 ± 0.0013 |
Appendix A.4. Model Implementation and Hyperparameter Selection
| Model | Parameter | Value |
|---|---|---|
| Logistic regression (primary model, M0–M4) | Penalty | L2 (ridge) |
| Regularization strength | C = 1000 (λ = 0.001; intercept unpenalized) | |
| Solver | Newton–Raphson/IRLS | |
| Class weight | None | |
| Max iterations | 12 (convergence tolerance = 1 × 10−7) | |
| Random forest | Number of trees (n_estimators) | 300 |
| Max depth | 8 | |
| Min samples per leaf | 10 | |
| Max features | sqrt(p) | |
| Class weight | balanced | |
| XGBoost | n_estimators | 100 |
| max_depth | 1 | |
| learning_rate | 0.01 | |
| subsample | 0.8 | |
| colsample_bytree | 0.8 | |
| reg_lambda/reg_alpha | 1.0/0.0 | |
| scale_pos_weight | n_negative/n_positive within each training fold (≈2.0) | |
| GRU | Sequence length | 10 windows |
| Layers | 1 GRU layer | |
| Hidden size | 32 | |
| Dropout | 0.20 (post-GRU) | |
| Optimizer | Adam | |
| Learning rate | 0.001 | |
| Batch size | 512 | |
| Max epochs | 6 | |
| Early stopping | Validation loss; patience = 2 validation checks; validation every 20 mini-batches | |
| Loss function | Class-weighted cross-entropy | |
| Transformer-GRU | Sequence length | 10 windows |
| Positional embedding | Learned; dimension = 32 | |
| Self-attention blocks | 1 | |
| Attention heads | 4 | |
| Model dimension | 32 | |
| GRU hidden size | 32 | |
| Dropout | Attention 0.10; post-attention 0.20; post-GRU 0.20 | |
| Optimizer | Adam | |
| Learning rate | 0.001 | |
| Batch size | 512 | |
| Max epochs | 6 | |
| Early stopping | Validation loss; patience = 2 validation checks; validation every 20 mini-batches | |
| Loss function | Class-weighted cross-entropy | |
| K-means style prior | K (pre-specified) | 3 (fixed before the modeling analysis) |
| Initialization | k-means++ | |
| n_init | 100 | |
| Max iterations | 1000 | |
| Hyperparameter selection | Search space | RF: 300 trees; (max_depth, min_samples_leaf) = (4, 40), (6, 20), (8, 10), (10, 5), or (None, 10); max_features = sqrt. XGBoost: (n_estimators, max_depth, learning_rate) = (100, 1, 0.01), (200, 1, 0.03), (300, 1, 0.03), (200, 2, 0.01), (300, 2, 0.03), or (300, 3, 0.03). GRU and Transformer-GRU used the fixed configurations reported above. |
| Selection metric | Mean inner-fold ROC-AUC, maximized | |
| Inner validation scheme | Nested driver-grouped cross-validation: for each outer fold, the remaining four driver folds were rotated as inner validation folds; the selected configuration was refitted on all four outer-training folds and evaluated once on the held-out outer fold |
References
- Marquart, G.; Cabrall, C.; de Winter, J. Review of Eye-related Measures of Drivers’ Mental Workload. Procedia Manuf. 2015, 3, 2854–2861. [Google Scholar] [CrossRef] [Scilit]
- Recarte, M.A.; Nunes, L.M. Effects of verbal and spatial-imagery tasks on eye fixations while driving. J. Exp. Psychol. Appl. 2000, 6, 31–43. [Google Scholar] [CrossRef]
- Recarte, M.A.; Nunes, L.M. Mental workload while driving: Effects on visual search, discrimination, and decision making. J. Exp. Psychol. Appl. 2003, 9, 119–137. [Google Scholar] [CrossRef] [Scilit]
- Benedetto, S.; Pedrotti, M.; Minin, L.; Baccino, T.; Re, A.; Montanari, R. Driver workload and eye blink duration. Transp. Res. Part F Traffic Psychol. Behav. 2011, 14, 199–208. [Google Scholar] [CrossRef] [Scilit]
- May, J.G.; Kennedy, R.S.; Williams, M.C.; Dunlap, W.P.; Brannan, J.R. Eye movement indices of mental workload. Acta Psychol. 1990, 75, 75–89. [Google Scholar] [CrossRef] [Scilit]
- Xu, J.; Yang, X.M.; Zhang, X.Y.; Zhang, J.; Kong, F.X.; Jiao, C.W. An Investigation on Vehicle Trajectory Characteristics at Exit and Entrance of High-density Interchanges Based on Naturalistic Driving Data. J. Transp. Inf. Saf. 2023, 41, 20–31. [Google Scholar]
- Mu, J.L.; Yang, D.; Jiao, C.W.; Kong, F.X.; Chen, Z.H.; Xu, J. Drivers’ Mental Load Characteristics at the Entrance and Exit of High-density Interchanges Based on Heart Rate Variability. J. Transp. Inf. Saf. 2024, 42, 28–40. [Google Scholar]
- Zhang, Y.; Jiang, P.; Wang, S.; Cheng, S.; Xu, J.; Liu, Y. Study on the Driver Visual Workload in High-Density Interchange-Merging Areas Based on a Field Driving Test. Sensors 2024, 24, 6247. [Google Scholar] [CrossRef] [Scilit]
- Shahbakhti, M.; Beiramvand, M.; Nasiri, E.; Far, S.M.; Chen, W.; Solé-Casals, J.; Wierzchon, M.; Broniec-Wójcik, A.; Augustyniak, P.; Marozas, V. Fusion of EEG and Eye Blink Analysis for Detection of Driver Fatigue. IEEE Trans. Neural Syst. Rehabil. Eng. 2023, 31, 2037–2046. [Google Scholar] [CrossRef] [Scilit]
- Mehler, B.; Reimer, B.; Coughlin, J.F. Sensitivity of physiological measures for detecting systematic variations in cognitive demand from a working memory task: An on-road study across three age groups. Hum. Factors 2012, 54, 396–412. [Google Scholar] [CrossRef] [Scilit]
- Borghini, G.; Astolfi, L.; Vecchiato, G.; Mattia, D.; Babiloni, F. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 2014, 44, 58–75. [Google Scholar] [CrossRef] [Scilit]
- Brookhuis, K.A.; de Waard, D. Monitoring drivers’ mental workload in driving simulators using physiological measures. Accid. Anal. Prev. 2010, 42, 898–903. [Google Scholar] [CrossRef] [Scilit]
- Palinko, O.; Kun, A.L.; Shyrokov, A.; Heeman, P. Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (ETRA ’10), Austin, TX, USA, 22–24 March 2010; pp. 141–144. [Google Scholar] [CrossRef] [Scilit]
- Chen, W.; Sawaragi, T.; Hiraoka, T. Comparing driver reaction and mental workload of visual and auditory take-over request from perspective of driver characteristics and eye-tracking metrics. Transp. Res. Part F Traffic Psychol. Behav. 2023, 97, 396–410. [Google Scholar] [CrossRef] [Scilit]
- Le, A.S.; Suzuki, T.; Aoki, H. Evaluating driver cognitive distraction by eye tracking: From simulator to driving. Transp. Res. Interdiscip. Perspect. 2020, 4, 100087. [Google Scholar] [CrossRef] [Scilit]
- Son, J.; Oh, H.; Park, M. Identification of driver cognitive workload using support vector machines with driving performance, physiology and eye movement in a driving simulator. Int. J. Precis. Eng. Manuf. 2013, 14, 1321–1327. [Google Scholar] [CrossRef] [Scilit]
- Chen, W.; Sawaragi, T.; Hiraoka, T. Comparing eye-tracking metrics of mental workload caused by NDRTs in semi-autonomous driving. Transp. Res. Part F Traffic Psychol. Behav. 2022, 89, 109–128. [Google Scholar] [CrossRef] [Scilit]
- Cantin, V.; Lavallière, M.; Simoneau, M.; Teasdale, N. Mental workload when driving in a simulator: Effects of age and driving complexity. Accid. Anal. Prev. 2009, 41, 763–771. [Google Scholar] [CrossRef] [Scilit]
- Paxion, J.; Galy, E.; Berthelon, C. Mental workload and driving. Front. Psychol. 2014, 5, 1344. [Google Scholar] [CrossRef] [Scilit]
- Taubman-Ben-Ari, O.; Mikulincer, M.; Gillath, O. The multidimensional driving style inventory—Scale construct and validation. Accid. Anal. Prev. 2004, 36, 323–332. [Google Scholar] [CrossRef] [Scilit]
- Elander, J.; West, R.; French, D. Behavioral correlates of individual differences in road-traffic crash risk: An examination of methods and findings. Psychol. Bull. 1993, 113, 279–294. [Google Scholar] [CrossRef]
- Sagberg, F.; Selpi; Bianchi Piccinini, G.F.; Engström, J. A Review of Research on Driving Styles and Road Safety. Hum. Factors 2015, 57, 1248–1275. [Google Scholar] [CrossRef] [Scilit]
- Johnson, D.A.; Trivedi, M.M. Driving style recognition using a smartphone as a sensor platform. In Proceedings of the 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), Washington, DC, USA, 5–7 October 2011; pp. 1609–1615. [Google Scholar] [CrossRef] [Scilit]
- Xue, Q.; Wang, K.; Lu, J.J.; Liu, Y. Rapid Driving Style Recognition in Car-Following Using Machine Learning and Vehicle Trajectory Data. J. Adv. Transp. 2019, 2019, 9085238. [Google Scholar] [CrossRef] [Scilit]
- Cordero, J.; Aguilar, J.; Aguilar, K.; Chávez, D.; Puerto, E. Recognition of the Driving Style in Vehicle Drivers. Sensors 2020, 20, 2597. [Google Scholar] [CrossRef] [Scilit]
- Ullah, S.; Kim, D.-H. Lightweight Driver Behavior Identification Model with Sparse Learning on In-Vehicle CAN-BUS Sensor Data. Sensors 2020, 20, 5030. [Google Scholar] [CrossRef] [Scilit]
- Singh, H.; Kathuria, A. Analyzing driver behavior under naturalistic driving conditions: A review. Accid. Anal. Prev. 2021, 150, 105908. [Google Scholar] [CrossRef] [Scilit]
- Liu, Y.; Hansen, J.H.L. A Review of UTDrive Studies: Learning Driver Behavior from Naturalistic Driving Data. IEEE Open J. Intell. Transp. Syst. 2021, 2, 338–346. [Google Scholar] [CrossRef] [Scilit]
- Lee, J.; Jang, K. Characterizing driver behavior using naturalistic driving data. Accid. Anal. Prev. 2024, 208, 107779. [Google Scholar] [CrossRef] [Scilit]
- Precht, L.; Keinath, A.; Krems, J.F. Effects of driving anger on driver behavior—Results from naturalistic driving data. Transp. Res. Part F Traffic Psychol. Behav. 2017, 45, 75–92. [Google Scholar] [CrossRef] [Scilit]
- Richard, C.M.; Lee, J.; Atkins, R.; Brown, J.L. Using SHRP2 naturalistic driving data to examine driver speeding behavior. J. Saf. Res. 2020, 73, 271–281. [Google Scholar] [CrossRef] [Scilit]
- Liu, C.; Zhang, W. Learning the Driver Acceleration/Deceleration Behavior under High-Speed Environments from Naturalistic Driving Data. IEEE Intell. Transp. Syst. Mag. 2022, 14, 78–91. [Google Scholar] [CrossRef] [Scilit]
- Bender, A.; Agamennoni, G.; Ward, J.R.; Worrall, S.; Nebot, E.M. An Unsupervised Approach for Inferring Driver Behavior from Naturalistic Driving Data. IEEE Trans. Intell. Transp. Syst. 2015, 16, 3325–3336. [Google Scholar] [CrossRef] [Scilit]
- Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’16), San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar] [CrossRef] [Scilit]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention Is All You Need. In Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA, 4–9 December 2017; pp. 5998–6008. [Google Scholar]
- Cho, K.; van Merriënboer, B.; Gulcehre, C.; Bahdanau, D.; Bougares, F.; Schwenk, H.; Bengio, Y. Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, 25–29 October 2014; pp. 1724–1734. [Google Scholar] [CrossRef] [Scilit]
- Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Scilit]
- Lundberg, S.M.; Lee, S.-I. A Unified Approach to Interpreting Model Predictions. In Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA, 4–9 December 2017; pp. 4765–4774. [Google Scholar]
- Caber, N.; Ahmad, B.I.; Liang, J.; Godsill, S.; Bremers, A.; Thomas, P.; Oxtoby, D.; Skrypchuk, L. Driver Profiling and Bayesian Workload Estimation Using Naturalistic Peripheral Detection Study Data. IEEE Trans. Intell. Veh. 2024, 9, 3047–3060. [Google Scholar] [CrossRef] [Scilit]
- Zhu, J.; Lv, C.; Ma, Y.; Yang, H.; Zhang, Y. Quantitative Estimation of Driver Cognitive Workload: A Dual-Stage Learning Approach. IEEE Trans. Intell. Transp. Syst. 2024, 25, 20227–20239. [Google Scholar] [CrossRef] [Scilit]
- Shao, X.; Ma, X.; Chen, F.; Pan, X. Multimodal Machine Learning Framework for Driver Mental Workload Classification: A Comparative and Interpretable Approach. Appl. Sci. 2026, 16, 3581. [Google Scholar] [CrossRef] [Scilit]
- Huang, J.; Peng, Y.; Hu, L. A Multilayer Stacking Method Base on RFE-SHAP Feature Selection Strategy for Recognition of Driver’s Mental Load and Emotional State. Expert Syst. Appl. 2024, 238, 121729. [Google Scholar] [CrossRef] [Scilit]
- Salvucci, D.D.; Goldberg, J.H. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 Symposium on Eye Tracking Research & Applications (ETRA ’00), Palm Beach Gardens, FL, USA, 6–8 November 2000; pp. 71–78. [Google Scholar] [CrossRef] [Scilit]
- CJJ 129–2009; Specification for Design of Urban Expressway. China Architecture & Building Press: Beijing, China, 2009.
- JTG B01–2014; Technical Standard of Highway Engineering. China Communications Press: Beijing, China, 2014.
- National Academies of Sciences, Engineering, and Medicine. Highway Capacity Manual: A Guide for Multimodal Mobility Analysis, 7th ed.; The National Academies Press: Washington, DC, USA, 2022. [Google Scholar] [CrossRef] [Scilit]
- Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef] [Scilit]
- Diakoulaki, D.; Mavrotas, G.; Papayannakis, L. Determining objective weights in multiple criteria problems: The CRITIC method. Comput. Oper. Res. 1995, 22, 763–770. [Google Scholar] [CrossRef] [Scilit]
- Lai, C.; Chen, X.; Chen, X.; Wang, Z.; Wu, X.; Zhao, S. A fuzzy comprehensive evaluation model for flood risk based on the combination weight of game theory. Nat. Hazards 2015, 77, 1243–1259. [Google Scholar] [CrossRef] [Scilit]
- MacQueen, J. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; University of California Press: Berkeley, CA, USA, 1967; Volume 1, pp. 281–297. [Google Scholar]
- Fawcett, T. An introduction to ROC analysis. Pattern Recognit. Lett. 2006, 27, 861–874. [Google Scholar] [CrossRef] [Scilit]
- Saito, T.; Rehmsmeier, M. The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLoS ONE 2015, 10, e0118432. [Google Scholar] [CrossRef] [Scilit]
- Efron, B.; Tibshirani, R.J. An Introduction to the Bootstrap; Chapman & Hall/CRC: New York, NY, USA, 1994. [Google Scholar] [CrossRef] [Scilit]
- Friedman, J.H. Greedy Function Approximation: A Gradient Boosting Machine. Ann. Stat. 2001, 29, 1189–1232. [Google Scholar] [CrossRef] [Scilit]







| Data Source | Parameter | Specification |
|---|---|---|
| Eye tracker | Sampling rate | 60 Hz |
| Gaze accuracy | 0.5° (nominal); 0.8° (measured) 1 | |
| Fixation/saccade segmentation | I-VT algorithm, 30°/s velocity threshold | |
| Pupil validity criterion | Confidence > 0.9 | |
| Inertial navigation system (WTGAHRS3-TTL/232) | Speed accuracy | <0.1 m·s−1 |
| Attitude accuracy | 0.2° (roll/pitch); 0.5° (heading) | |
| Positioning accuracy | <2.5 m | |
| Signal synchronization and resampling | Time reference | GPS time (unified across all sources) |
| Resampling | Cubic-spline interpolation to 1 Hz |
| Indicator | Road A: Urban Expressway (80 km/h) | Road B: Freeway (120 km/h) | Overall |
|---|---|---|---|
| Operating speed, mean ± SD (km/h) | 50.3 ± 8.6 | 70.2 ± 11.4 | 58.7 ± 13.9 |
| Basic-segment mean speed (km/h) | 54.1 | 76.5 | — |
| Operating speed, P15-P85 (km/h) | 39.5–61.0 | 57.6–83.9 | 43.1–78.2 |
| Mean speed-to-limit ratio | 0.63 | 0.59 | — |
| Severely constrained windows (%) | 1.9 | 0.6 | 1.3 |
| One-way travel time, mean ± SD (min) | 13.9 ± 1.2 | 10.8 ± 1.0 | 24.7 ± 1.8 |
| Between-session CV of one-way travel time (%) | 8.6 | 9.3 | 7.3 |
| Feature Name | Symbol | Window-Level Definition | Unit |
|---|---|---|---|
| Speed | v | Statistics of speed within the window | m·s−1 |
| Longitudinal acceleration | ax | Statistics of longitudinal acceleration | m·s−2 |
| Lateral acceleration | ay | Statistics of lateral acceleration | m·s−2 |
| Jerk | j | Statistics of the rate of change of acceleration | m·s−3 |
| Angular velocity | ω | Statistics of heading and yaw angular velocity | rad·s−1 |
| Road-type/segment encoding | Ri | Road A/B encoding, by window-midpoint position | categorical |
| Feature | Category | Entropy Weight | CRITIC Weight | Combined Weight |
|---|---|---|---|---|
| Number of fixations | Fixation | 0.0734 | 0.1131 | 0.0922 |
| SD of fixation duration | Fixation | 0.0980 | 0.1173 | 0.1071 |
| Total number of saccades | Saccade | 0.1254 | 0.1158 | 0.1209 |
| Total saccade time | Saccade | 0.1597 | 0.1138 | 0.1380 |
| SD of saccade time | Saccade | 0.2239 | 0.0946 | 0.1627 |
| Mean saccade amplitude | Saccade | 0.1047 | 0.0918 | 0.0986 |
| Mean pupil diameter | Pupil | 0.1115 | 0.2194 | 0.1636 |
| SD of pupil diameter | Pupil | 0.0566 | 0.0642 | 0.0602 |
| CV of pupil diameter | Pupil | 0.0448 | 0.0701 | 0.0568 |
| Setting | Input | Role | Interpretive Purpose |
|---|---|---|---|
| M0 Road-only | Road type | Confounding baseline | Assess the discriminative ability of the road proxy itself |
| M1 Vehicle-only | Vehicle-kinematic window sequence | Primary model 1 | Test whether the vehicle modality can predict the VLI label |
| M2 Vehicle+Style | Vehicle sequence + within-fold style prior | Primary model 2 | Test the driving-style increment |
| M3 Road+Vehicle | Road type + vehicle kinematics | Road control | Test whether the vehicle exceeds the road proxy |
| M4 Road+Vehicle+Style | Road + vehicle + style prior | Sensitivity analysis | Test the style increment after road control |
| Distribution Item | Full Sample | Road A | Road B | Driver-Level Range |
|---|---|---|---|---|
| Number of windows | 24,437 | 13,789 | 10,648 | 573–974 |
| Low-VLI proportion | 33.2% | 28.1% | 39.9% | 0.0–81.3% |
| Medium-VLI proportion | 33.4% | 33.9% | 32.8% | 9.2–50.6% |
| High-VLI proportion | 33.3% | 38.0% | 27.3% | 5.2–89.1% |
| VLI mean | 0.214 | 0.223 | 0.202 | 0.120–0.351 |
| VLI median | 0.207 | 0.217 | 0.194 | 0.086–0.363 |
| Road A proportion | 56.4% | — | — | 49.7–63.7% |
| Road B proportion | 43.6% | — | — | 36.3–50.3% |
| VLI Construction Method | Label Agreement | Vehicle-Only AUC | Vehicle+Style AUC | ΔAUC (Style) |
|---|---|---|---|---|
| Combined weight (primary VLI) | 100.0% | 0.589 | 0.633 | 0.044 |
| Entropy weighting | 90.9% | 0.570 | 0.595 | 0.025 |
| CRITIC | 90.6% | 0.617 | 0.669 | 0.052 |
| Equal weighting | 93.3% | 0.580 | 0.614 | 0.033 |
| PCA-1 | 87.6% | 0.596 | 0.610 | 0.014 |
| Pupil-removed combined VLI | 73.3% | 0.562 | 0.564 | 0.003 |
| Input Setting | Acc. | Macro-F1 | High-VLI Recall | AUC | AP | ΔAUC vs. Veh. | 95% CI |
|---|---|---|---|---|---|---|---|
| Vehicle-only | 0.673 | 0.489 | 0.109 | 0.589 | 0.430 | — | — |
| Vehicle+Style | 0.690 | 0.520 | 0.143 | 0.633 | 0.490 | +0.044 | [−0.005, 0.113] |
| Style-only | 0.688 | 0.472 | 0.072 | 0.532 | 0.451 | −0.058 | [−0.188, 0.074] |
| Road-only | 0.667 | 0.400 | 0.000 | 0.562 | 0.400 | −0.027 | [−0.070, 0.032] |
| Road+Vehicle | 0.682 | 0.496 | 0.118 | 0.604 | 0.442 | +0.015 | [−0.035, 0.065] |
| Road+Vehicle+Style | 0.698 | 0.531 | 0.155 | 0.642 | 0.504 | +0.053 | [0.013, 0.093] |
| Model | Threshold Policy (Training Folds Only) | Precision | Recall | FPR | FPW/h |
|---|---|---|---|---|---|
| M1 Vehicle-only | Default 0.50 | 0.48 | 0.109 | 0.060 | 29 |
| M1 Vehicle-only | Max-F1 | 0.41 | 0.42 | 0.302 | 145 |
| M1 Vehicle-only | Recall ≥ 0.50 | 0.39 | 0.51 | 0.398 | 191 |
| M1 Vehicle-only | Recall ≥ 0.70 | 0.37 | 0.71 | 0.604 | 290 |
| M2 Vehicle+Style | Default 0.50 | 0.53 | 0.143 | 0.063 | 30 |
| M2 Vehicle+Style | Max-F1 | 0.44 | 0.47 | 0.299 | 143 |
| M2 Vehicle+Style | Recall ≥ 0.50 | 0.43 | 0.53 | 0.351 | 168 |
| M2 Vehicle+Style | Recall ≥ 0.70 | 0.40 | 0.72 | 0.539 | 259 |
| Style Cluster | No. of Drivers | Mean Speed (m·s−1) | Speed Fluctuation (m·s−1) | Mean Long. Accel. (m·s−2) | Long. Accel. Fluct. (m·s−2) | Mean Abs. Jerk (m·s−3) |
|---|---|---|---|---|---|---|
| Style 1 | 13 | 14.837 | 0.125 | 0.352 | 0.296 | 0.138 |
| Style 2 | 14 | 16.700 | 0.160 | −0.025 | 0.323 | 0.195 |
| Style 3 | 6 | 18.627 | 0.104 | 0.449 | 0.338 | 0.114 |
| Model | Vehicle AUC | Vehicle+Style AUC | Style Increment ΔAUC | High-VLI Recall (V → V+S) |
|---|---|---|---|---|
| Logistic | 0.589 | 0.633 | +0.044 | 0.109 → 0.143 |
| RF | 0.624 | 0.632 | +0.008 | 0.160 → 0.186 |
| XGBoost | 0.570 | 0.587 | +0.017 | 0.085 → 0.123 |
| GRU | 0.600 | 0.642 | +0.042 | 0.161 → 0.226 |
| Transformer-GRU | 0.599 | 0.639 | +0.040 | 0.121 → 0.235 |
| Rank | Feature | Sensing Source | Mean |SHAP| (Proportion) | Direction |
|---|---|---|---|---|
| 1 | Angular-velocity statistics | Vehicle kinematics | 0.293 | Positive |
| 2 | Speed statistics | Vehicle kinematics | 0.232 | Negative |
| 3 | Driving-style cluster | Vehicle-derived style | 0.223 | Cluster-dependent (n.s.) |
| 4 | Longitudinal-acceleration statistics | Vehicle kinematics | 0.140 | Positive |
| 5 | Lateral-acceleration statistics | Vehicle kinematics | 0.087 | Direction unclear |
| 6 | Jerk statistics | Vehicle kinematics | 0.025 | Positive |
| Comparison | Test Content | ΔAUC | Driver-Level 95% CI |
|---|---|---|---|
| M2 − M1 (road not controlled) | Style increment | +0.044 | [−0.005, 0.113] |
| M3 − M0 | Vehicle increment over road | +0.042 | [0.006, 0.078] |
| M4 − M3 | Style increment after road control | +0.038 | [−0.012, 0.088] |
| Maneuver Category | Windows (n, %) | VLI Mean | High-VLI Proportion (%) | M1 AUC | M2 AUC | Mean Predicted High-VLI Probability (M2) |
|---|---|---|---|---|---|---|
| Merge/diverge | 2650 (10.8%) | 0.247 | 45.5 | 0.603 | 0.641 | 0.41 |
| Lane change/overtaking | 1140 (4.7%) | 0.238 | 42.0 | 0.596 | 0.633 | 0.38 |
| Regular driving | 20,647 (84.5%) | 0.207 | 31.3 | 0.571 | 0.612 | 0.31 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Mamat, T.; Cheng, S.; He, C.; Wuyuncaicike, J. Cross-Source Prediction of a Visual Load Index from Vehicle Kinematic Features: A Driver-Independent Validation Study. Sensors 2026, 26, 5521. https://doi.org/10.3390/s26175521
Mamat T, Cheng S, He C, Wuyuncaicike J. Cross-Source Prediction of a Visual Load Index from Vehicle Kinematic Features: A Driver-Independent Validation Study. Sensors. 2026; 26(17):5521. https://doi.org/10.3390/s26175521
Chicago/Turabian StyleMamat, Tursun, Siyi Cheng, Chunguang He, and Jiake Wuyuncaicike. 2026. "Cross-Source Prediction of a Visual Load Index from Vehicle Kinematic Features: A Driver-Independent Validation Study" Sensors 26, no. 17: 5521. https://doi.org/10.3390/s26175521
APA StyleMamat, T., Cheng, S., He, C., & Wuyuncaicike, J. (2026). Cross-Source Prediction of a Visual Load Index from Vehicle Kinematic Features: A Driver-Independent Validation Study. Sensors, 26(17), 5521. https://doi.org/10.3390/s26175521

