sensors-logo

Journal Browser

Journal Browser

Deep Learning Sensor Fusion for Human–Machine Interaction in Intelligent Transportation Systems

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Intelligent Sensors".

Deadline for manuscript submissions: 15 May 2026 | Viewed by 685

Special Issue Editors

Institute of Industrial Science, The University of Tokyo, Tokyo 113-8654, Japan
Interests: driver assistance systems; human system interaction; intelligent transport systems
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Advanced Institute of Nano Technology, Sungkyunkwan University, Suwon 16228, Republic of Korea
Interests: artificial intelligence; human–machine interfaces; automotive control systems

E-Mail Website
Guest Editor
Information and Control Engineering, China University of Mining and Technology, Xuzhou 221000, China
Interests: driver modeling; human-machine shared control; sensing; decision-making and control of unmanned vehicles

Special Issue Information

Dear Colleagues,

The application of deep learning-driven human–machine interaction (HMI) in intelligent transportation systems (ITSs) facilitates smarter and safer transportation. Deep learning models can analyze multimodal data from human, environment, and vehicle systems, providing accurate recognition of human behavior, driver intention, and environmental factors and enabling the identification of the human–machine interaction relationship in an ITS. This will grant the creators of autonomous vehicles, traffic control systems, and personal devices an improved understanding of human behavior, improving the relevant decision-making processes and optimizing traffic flow. Furthermore, deep learning-driven HMI can improve safety by predicting accidents or near misses and providing timely interventions through automated alerts or corrective actions, enhancing users’ experience, acceptance, and trust.

This Special Issue invites researchers, academicians, and industry practitioners to contribute to the discourse on “Deep Learning Sensor Fusion for Human–Machine Interaction in Intelligent Transportation Systems”. Our aim is to compile state-of-the-art research contributing to advancements in deep learning approaches for HMI in ITSs.

Dr. Zheng Wang
Dr. Edric John Cruz Nacpil
Dr. Fei-Xiang Xu
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • deep learning-driven human–machine interaction
  • advanced control algorithms for ITSs
  • human–machine shared control
  • multimodal driver state perception and intention cognition
  • explainable and trustworthy deep learning models
  • sensor fusion and signal processing in ITSs
  • sensing for human behavior recognition in ITSs
  • advanced analytics and predictive modeling for ITSs
  • deep learning-driven interaction among vehicles in ITSs

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • Reprint: MDPI Books provides the opportunity to republish successful Special Issues in book format, both online and in print.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

17 pages, 4777 KB  
Article
Robust Occupant Behavior Recognition via Multimodal Sequence Modeling: A Comparative Study for In-Vehicle Monitoring Systems
by Jisu Kim and Byoung-Keon D. Park
Sensors 2025, 25(20), 6323; https://doi.org/10.3390/s25206323 - 13 Oct 2025
Viewed by 443
Abstract
Understanding occupant behavior is critical for enhancing safety and situational awareness in intelligent transportation systems. This study investigates multimodal occupant behavior recognition using sequential inputs extracted from 2D pose, 2D gaze, and facial movements. We conduct a comprehensive comparative study of three distinct [...] Read more.
Understanding occupant behavior is critical for enhancing safety and situational awareness in intelligent transportation systems. This study investigates multimodal occupant behavior recognition using sequential inputs extracted from 2D pose, 2D gaze, and facial movements. We conduct a comprehensive comparative study of three distinct architectural paradigms: a static Multi-Layer Perceptron (MLP), a recurrent Long Short-Term Memory (LSTM) network, and an attention-based Transformer encoder. All experiments are performed on the large-scale Occupant Behavior Classification (OBC) dataset, which contains approximately 2.1 million frames across 79 behavior classes collected in a controlled, simulated environment. Our results demonstrate that temporal models significantly outperform the static baseline. The Transformer model, in particular, emerges as the superior architecture, achieving a state-of-the-art Macro F1 score of 0.9570 with a configuration of a 50-frame span and a step size of 10. Furthermore, our analysis reveals that the Transformer provides an excellent balance between high performance and computational efficiency. These findings demonstrate the superiority of attention-based temporal modeling with multimodal fusion and provide a practical framework for developing robust and efficient in-vehicle occupant monitoring systems. Implementation code and supplementary resources are available (see Data Availability Statement). Full article
Show Figures

Figure 1

Back to TopTop