Search Results (160)

Healthcare professionals must acquire and maintain both declarative knowledge and fine psychomotor skills across a wide range of clinical procedures. Human working memory is physiologically limited, and the high cognitive demands of clinical environments frequently contribute to medical errors and adverse events. Intra-individual performance variability—driven by fatigue, stress, and motivation—represents a further challenge that conventional medical safety education has not adequately addressed. According to the World Health Organization, patient harm ranks fourteenth in the global burden of disease, with approximately 10% of hospitalised patients in high-income countries experiencing harm within healthcare facilities. This study reports the design, theoretical rationale, and preliminary outcomes of an augmented reality (AR) glasses system for hands-free, self-directed medical procedural training, developed from a human factors and ergonomics (HFE) perspective. The system integrates a see-through head-mounted display (HMD; Epson Moverio BT-40S), bone-conduction earphones (Shokz OpenComm), and an industrial-grade voice recognition application (NEC Solution Innovators), achieving fully hands-free operation compatible with aseptic technique. Content design is grounded in cognitive load theory (CLT) and the cognitive theory of multimedia learning (CTML), extended by neuroscientific evidence on multisensory integration and memory consolidation. More than 40 procedure-specific modules have been developed in-house at Tokyo University of Technology, spanning airway management, vascular access, respiratory therapy, dialysis, and cardiac support. In a four-year longitudinal survey (virtual reality (VR) simulator; n = 286), major satisfaction items consistently exceeded the scale midpoint. In an AR endotracheal suctioning cohort (n = 38/22), procedural flow understanding was rated 3.95/5.0. A peer-reviewed randomised controlled trial (Clinical Simulation in Nursing, n = 36) demonstrated significantly superior skill improvement (p < 0.001) and learning motivation (p = 0.001) in the AR group versus textbook self-practice. Principal ergonomic limitations of current HMD hardware—excessive weight, narrow field of view, and absence of medical-grade certification—are documented, and AI-based real-time procedural assessment is identified as a priority for the next research phase. Full article

The driving scenario and information load jointly influence the cognitive efficiency of augmented reality head-up display (AR-HUD) interfaces. However, the moderating role of drivers’ working memory capacity (WMC) remains unclear. To investigate this mechanism, a simulated driving experiment with a mixed design was conducted in a low-immersivity desktop virtual reality (VR) environment. First, 40 volunteers were screened using an automated operation span task, yielding 16 high- and low-WMC participants. They then drove under three scenarios (urban intersection, expressway, construction zone) and six levels of AR-HUD visual information load. Generalized linear models were applied to the reaction time, fixation duration, and pupil diameter. The results revealed a significant three-way interaction among WMC, scenario, and information load. High-WMC drivers maintained faster responses and lower subjective loads up to Levels 4–6, adopting a deep processing strategy; low-WMC drivers already showed cognitive overload at Level 4 and above, requiring an optimal load range of Level 2–3. The construction zone induced the steepest increase in cognitive load, whereas the expressway markedly reduced sensitivity to additional visual information. Therefore, the optimal AR-HUD information load must be adapted to drivers’ WMC: high-WMC drivers can safely handle Levels 4–6 in low- or medium-demand scenarios, whereas low-WMC drivers require a minimalist presentation of Levels 2–3 in high-demand situations. This study provides quantitative, empirically grounded guidelines for designing cognitively adaptive AR-HUD interfaces. Full article

The COVID-19 pandemic highlighted the need for effective disinfection strategies in order to minimize human exposure and reduce the risk of contagion in indoor environments. Ultraviolet-C (UV-C) irradiation has proven to be an effective solution for inactivating a wide range of pathogens. However, traditional fixed UV-C systems suffer from limited coverage and lack operational flexibility. To address these limitations, this paper proposes an augmented reality (AR)-based teleoperation framework for an omnidirectional mobile robot equipped with a UV-C disinfection light. Unlike traditional toolchain integrations, our framework synergizes immersive spatial visualization of a reconstructed environment, operator-guided waypoint-based remote navigation, and real-time interaction with the disinfection payload in a single operational workflow. The system is implemented using a ROSMASTER X3 Plus robotic platform, which generates a three-dimensional representation of the environment through visual simultaneous localization and mapping using RTAB-Map. The result is a 3D map that is imported into the Unity game engine and deployed to a Meta Quest 3 head-mounted display, enabling immersive visualization and interaction. Communication between the AR interface and the robotic system is achieved via the ROS-TCP-Connection, allowing real-time data exchange and remote robot control. Through the AR interface, the operator can navigate the robot within the scanned environment and activate the UV-C light. Experimental validation conducted in a classroom demonstrates the feasibility of the proposed approach and shows measurable reductions in surface microbial load. These results indicate that our system-level integration of AR-assisted teleoperation with mobile UV-C robotics represents a feasible proof-of-concept for flexible, operator-guided disinfection of indoor spaces. Full article

This study addresses the question of how augmented reality (AR) technologies can be designed and integrated into maritime navigation systems to meet the needs of young navigators within contemporary socio-technical bridge environments. The article is based on a qualitative, literature-based research methodology involving a structured analysis and synthesis of peer-reviewed journal articles and conference proceedings related to AR interfaces, human performance, decision support, and maritime training. The reviewed studies indicate that AR can enhance perceptual and situational awareness by overlaying navigational information directly into the navigator’s field of view, thereby reducing head-down time, improving spatial alignment of information, and supporting performance in low-visibility and high-traffic conditions. The literature also shows that AR-enabled visualizations and shared displays can support individual and team-based decision-making by facilitating real-time, context-aware information exchange on the ship’s bridge. Safety-related benefits are identified as indirect outcomes of improved perception and cognitive support rather than as isolated technological effects. Simultaneously, the findings highlight that these benefits depend strongly on human-centered interface design and appropriate training. The study concludes that AR has significant potential to enhance maritime navigation for young navigators when integrated as part of a balanced socio-technical system combining technology, human factors, and structured education. Full article

The automotive augmented reality head-up display (AR-HUD) system projects critical driving information directly into the driver’s line of sight, enhancing driving safety, user experience, and navigation efficiency. However, due to the intrinsic asymmetry of vehicle windshields, existing optical configurations are difficult to use as effective design starting points. The asymmetric transmission region of the windshield causes the AR-HUD optical system to deviate significantly from the YOZ plane, increasing the complexity of system design and optimization. To address these challenges, this paper proposes an automated design method for automotive AR-HUD optical systems. Given the windshield geometry and system design specifications, a normal-guided iterative construction method is first employed to generate a high-performance initial optical structure with low distortion. Subsequently, differentiable ray tracing combined with optimization algorithms is employed to further improve system performance. Based on the proposed method, an AR-HUD optical system with a 130 mm × 50 mm eye-box and a 13° × 4° field of view was designed. The design results indicate that the maximum optical distortion is 0.51%. At five sampled eye positions within the eye-box, the MTF exceeds 0.5 at the spatial frequency of 6 lp/mm, and the dynamic distortion remains below 5.36′. Finally, a complete experimental prototype was established, and the experimental results verified the feasibility and effectiveness of the proposed automated design method. Full article

Background: Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental disorder characterized by inattention, motor hyperactivity and verbal and cognitive impulsivity. Impairments in executive functions (EFs), in particular working memory, monitoring and organization of daily life, are frequently observed in children diagnosed with ADHD, and are reflected in behavioural, social-emotional and learning difficulties. The development and use of technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR) for ADHD have increased in recent years, using a variety of tools to support including PC, video games, wearable devices and tangible interfaces. Objectives: To systematically map the current state of research on the use of AR, VR and MR technologies to assess and/or enhance EFs in children with ADHD. To evaluate the effects on their quality of life and on families’ and caregivers’ burden reduction. To explore the interventions’ clinical validity. Methods: A scoping review according to PRISMA-ScR guidelines was conducted. A systematic search was carried out in the Scopus and Web of Science databases for studies published between 2015 and 2025. Empirical studies published in English that examined children with ADHD aged <13 years were included. AR-, VR-, or MR-based interventions focused on EF were considered. For each study, the following features were recorded: year and country of publication, design, objectives, EFs considered, technology and hardware used, main results, and limitations. Results: Twenty studies were identified. The most frequently addressed functional domains were sustained and selective visual attention, working memory, and inhibition. Assessment interventions primarily involved the use of a head-mounted display (HMD) in conjunction with the Continuous Performance Test (CPT). Training interventions included immersive VR, serious video games, VR with motor or dual-task training, and MR. The results suggest that VR can enhance cognitive performance and sustained attention; however, longitudinal studies are required to evaluate its long-term effectiveness and integrate emotional skills. Conclusions: The use of these technologies is a promising strategy for the assessment and training of EFs in children with ADHD. These tools provide positive, inclusive feedback and motivating tasks. Nevertheless, larger sample studies and longitudinal follow-ups to confirm the suitability and effectiveness of the technology-based programs are warranted. Full article

In complex urban traffic environments, the design of multimodal prompts in augmented reality head-up displays (AR-HUDs) plays a critical role in driving safety and operational efficiency. Despite growing interest in audiovisual navigation assistance, empirical evidence remains limited regarding when prompts should be delivered and whether visual and auditory information should remain temporally aligned. To address this gap, this study aims to examine how audiovisual prompt timing and prompt mode influence driving behavior in AR-HUD navigation systems at complex F-type-5 m intersections through a within-subject experimental design. A 2 (prompt mode: synchronized vs. asynchronous) × 3 (prompt timing: −1000 m, −600 m, −400 m) design was employed to assess driver response time, situational awareness, and eye-movement measures, including average fixation duration and fixation count. The results showed clear main effects of both prompt mode and prompt timing. Compared with asynchronous prompts, synchronized prompts consistently resulted in shorter response times, reduced visual demand, and higher situational awareness. Driving performance also improved as prompt timing shifted closer to the intersection, from −1000 m to −400 m. But no significant interaction effects were found, suggesting that prompt mode and prompt timing can be treated as relatively independent design factors. In addition, among the six experimental conditions, the −400 m synchronized condition yielded the most favorable overall performance, whereas the −1000 m asynchronous condition performed worst. These findings indicate that in time-critical and low-tolerance scenarios, such as F-type-5 m intersections, near-distance synchronized multimodal prompts should be prioritized. This study provides empirical support for optimizing prompt timing and cross-modal temporal alignment in AR-HUD systems and offers actionable implications for interface and timing design. Full article

A prominent application of Augmented Reality (AR) is to provide step-by-step guidance for procedural tasks as it allows information to be displayed in situ by overlaying it directly onto the user’s physical environment. While the potential of AR is well known, the perspectives and requirements of individuals with mental disabilities, who face both cognitive and psychological barriers at work, have yet to be addressed, particularly on Head-Mounted Displays (HMDs). To understand practical limitations of such a system, we conducted a mixed-methods user study with 29 participants, including individuals with mental disabilities, their colleagues, and support professionals. Participants used a commercially available system on an AR HMD to perform a machine setup task. Quantitative results revealed that participants with mental disabilities perceived the system as less usable than those without. Qualitative findings point towards actionable leverage points of improvement such as privacy-aware human support, motivating but lightweight gamification, user-controlled pacing with clear feedback, confidence-building interaction patterns, and clearer task intent of multimodal instructions. Full article

The health and operational continuity of emergency responders are fundamental pillars of sustainable and resilient disaster management systems. These personnel operate in high-risk environments, exposed to intense physical, environmental, and psychological stress. This makes it crucial to monitor their health to safeguard their well-being and performance. Traditional methods, which rely on intermittent, voice-based check-ins, are reactive and create a dangerous information gap regarding a responder’s real-time health and safety. To address this sustainability challenge, the convergence of the Internet of Things (IoT) and wearable biosensors presents a transformative opportunity to shift from reactive to proactive safety monitoring, enabling the continuous capture of high-resolution physiological and environmental data. However, realizing a field-deployable system is a complex “system-of-systems” challenge. This review contributes to the field of sustainable emergency management by analyzing the complete technological chain required to build such a solution, structured along the data workflow from acquisition to action. It examines: (1) foundational health sensing technologies for bioelectrical, biophysical, and biochemical signals; (2) powering strategies, including low-power design and self-powering systems via energy harvesting; (3) ad hoc communication networks (terrestrial, aerial, and space-based) essential for infrastructure-denied disaster zones; (4) data processing architectures, comparing edge, fog, and cloud computing for real-time analytics; and (5) visualization tools, such as augmented reality (AR) and heads-up displays (HUDs), for decision support. The review synthesizes these components by discussing their integrated application in scenarios like firefighting and urban search and rescue. It concludes that a robust system depends not on a single component but on the seamless integration of this entire technological chain, and highlights future research directions crucial for quantifying and maximizing its impact on sustainable development goals (SDGs 3, 9, and 11) related to health, sustainable cities, and resilient infrastructure. Full article

Extended reality (XR) is increasingly used to address productivity, communication, and safety challenges in the construction industry, but large-scale adoption within Construction 4.0 remains limited. The existing reviews rarely provide an integrated perspective that jointly examines XR applications, underlying technology stacks, and the barriers that constrain implementation. This study fills that gap by combining a PRISMA-compliant systematic review with a bibliometric analysis of 76 journal articles published between 2019 and 2024. The review maps XR usage in construction, which XR modes, devices, and graphics engines are most prevalent, and which barriers hinder deployment in real projects. Design visualization and coordination, immersive training, and remote assistance or inspection emerge as the dominant application areas. Augmented reality (AR) and virtual reality (VR) lead the technology landscape, with Microsoft HoloLens and Meta Quest as the most frequently reported head-mounted displays and Unity as the main graphics engine. Implementation barriers are categorized into five groups—technological, organizational, economic, infrastructural, and methodological—with interoperability issues, hardware performance limitations, and the lack of standardized BIM-to-XR workflows being particularly recurrent. The review contributes to the Construction 4.0 agenda by providing a consolidated map of XR applications, technologies, and barriers, and by highlighting enablers such as open data schemas and competency-based training programs. Future research should validate AI-assisted, bidirectional BIM–XR workflows in real projects, report cost–benefit metrics, and advance interoperability standards that integrate XR into broader Construction 4.0 strategies. Full article

In-vehicle Augmented Reality Head-Up Displays (AR-HUDs) enhance driving performance and experience by presenting critical information such as navigation cues and collision warnings. Although many studies have investigated the efficacy of AR-HUD navigation and collision warning interface designs, existing research has overlooked the critical interplay between graphic spatial positioning and safety risks arising from inattentional blindness. This study employed a single-factor within-subjects design, with Experiment 1 and Experiment 2 separately examining the impact of the spatial planar position (horizontal planar position, vertical planar position, mixed planar position) of AR-HUD navigation graphics and collision warning graphics on drivers’ inattentional blindness. The results revealed that the spatial planar position of AR-HUD navigation graphics has no significant effect on inattentional blindness behavior or reaction time. However, the horizontal planar position yielded the best user experience with low workload, followed by the mixed planar position. For AR-HUD collision warning graphics, their spatial planar position does not significantly influence the frequency of inattentional blindness; From the perspectives of workload and user experience, the vertical planar position of collision warning graphics provides the best experience with the lowest workload, while the mixed planar position demonstrates superior hedonic qualities. Overall, this study offers design guidelines for in-vehicle AR-HUD interfaces. Full article

Background: In recent years, extended reality has gained traction in people with multiple sclerosis (MS) for their ability to deliver engaging, task-specific, and multisensory therapeutic experiences. Aim: This systematic review investigates the application of Mixed Reality (MR) and Augmented Reality (AR) technologies in neurorehabilitation for individuals with MS. Method: A comprehensive systematic review was conducted across seven databases and seven eligible studies were identified involving MR/AR interventions targeting motor and cognitive functions, in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). The review protocol was prospectively registered in the International Prospective Register of Systematic Reviews (PROSPERO). Data extraction was performed independently by the two reviewers and discrepancies were resolved by consensus or consultation with a third reviewer. Participants were predominantly diagnosed with relapsing-remitting MS and presented mild to moderate disability. Technologies ranged from head-mounted displays to home-based AR platforms, with interventions addressing gait, upper-limb coordination, and dual-task performance. Outcome measures were mapped to the ICF framework, encompassing body function, activity, participation, and contextual factors. Results: Findings suggest short-term improvements in gait parameters, grip strength, and motor coordination, with enhanced engagement and usability reported. Methodological quality was moderate, with small sample sizes and heterogeneous protocols limiting generalizability. Risk of bias varied across study designs. Despite promising results, further research is needed to validate long-term efficacy, optimize cognitive load, and standardize intervention protocols. Conclusions: MR and AR may serve as effective complements to conventional and VR-based rehabilitation, particularly in personalized, task-oriented training for MS populations. Full article

Background/Objectives: Projected augmented reality (PAR) enables real-time projection of digital surgical information directly onto the operative field. This offers a hands-free, headset-free platform that is universally visible to all members of the surgical team. Compared to head-mounted display systems, which are limited by restricted fields of view, ergonomic challenges, and user exclusivity, PAR provides a more intuitive and collaborative surgical interface. When paired with artificial intelligence (AI), PAR has the potential to automate aspects of surgical planning and deliver high-precision guidance in both high-resource and global health settings. Our team is working on the development and validation of a PAR platform to dynamically project surgical and anatomic markings directly onto the patients intraoperatively. Methods: We developed a PAR system using a structured light scanner and depth camera to generate digital 3D surface reconstructions of a patient’s anatomy. Surgical markings were then made digitally, and a projector was used to precisely project these points directly onto the patient’s skin. We also developed a trained machine learning model that detects cleft lip landmarks and automatically designs surgical markings, with the plan to integrate this into our PAR system. Results: The PAR system accurately projected surgeon and AI-generated surgical markings onto anatomical models with sub-millimeter precision. Projections remained aligned during movement and were clearly visible to the entire surgical team without requiring wearable hardware. Conclusions: PAR integrated with AI provides accurate, real-time, and shared intraoperative guidance. This platform improves surgical precision and has broad potential for remote mentorship and global surgical training. Full article

The adoption of immersive technologies is increasing in sensory, consumer, and marketing research, yet existing extended reality (XR) systems face limitations in realism, ease of product interaction, presence, data collection, and scalability. This study presents Sense-AV, an augmented virtuality (AV) system designed for large-scale sensory and consumer tests with enhanced immersion and realism. 102 participants evaluated two foods and one beverage across two sessions: a conventional sensory booth and the Sense-AV system, which simulated a sports bar environment. Real-time data collection was supported through API-linked mobile questionnaires, audio prompts via the head-mounted display (HMD), and open comments recorded by voice. Sense-AV was rated highly for usability, efficiency, satisfaction, presence, and sensory awareness. Older participants reported greater ease in handling products, while some difficulties with mobile input were noted but had minimal impact on the overall user experience (UX). Interviews emphasized immersion, intuitive use, and minor technical adjustments. No significant differences in overall product liking were found between methods, except for the mayonnaise, which scored higher in the immersive setting. Although food intake was lower in Sense-AV, oral feedback was more detailed and expressive. The system demonstrates innovation by improving realism and external validity in large-scale sensory evaluations. Full article

In-vehicle voice assistants face usability challenges due to limitations in delivering feedback within the constraints of the driving environment. The presented study explores the potential of Rich Visual Feedback (RVF) on Head-Up Displays (HUDs) as a multimodal solution to enhance system usability. A user study with 32 participants evaluated three HUD User Interface (UI) designs: the AR Fusion UI, which integrates augmented reality elements for layered, dynamic information presentation; the Baseline UI, which displays only essential keywords; and the Flat Fusion UI, which uses conventional vertical scrolling. To explore HUD interface principles and inform future HUD design without relying on specific hardware, a simulated near-field overlay was used. Usability was measured using the System Usability Scale (SUS), and distraction was assessed with a penalty point method. Results show that RVF on the HUD significantly influences usability, with both content quantity and presentation style affecting outcomes. The minimal Baseline UI achieved the highest overall usability. However, among the two Fusion designs, the AR-based layered information mechanism outperformed the flat scrolling method. Distraction effects were not statistically significant, indicating the need for further research. These findings suggest RVF-enabled HUDs can enhance in-vehicle voice assistant usability, potentially contributing to safer, more efficient driving. Full article