Search Results (13)

Background/Objectives: Projected augmented reality (PAR) enables real-time projection of digital surgical information directly onto the operative field. This offers a hands-free, headset-free platform that is universally visible to all members of the surgical team. Compared to head-mounted display systems, which are limited by restricted fields of view, ergonomic challenges, and user exclusivity, PAR provides a more intuitive and collaborative surgical interface. When paired with artificial intelligence (AI), PAR has the potential to automate aspects of surgical planning and deliver high-precision guidance in both high-resource and global health settings. Our team is working on the development and validation of a PAR platform to dynamically project surgical and anatomic markings directly onto the patients intraoperatively. Methods: We developed a PAR system using a structured light scanner and depth camera to generate digital 3D surface reconstructions of a patient’s anatomy. Surgical markings were then made digitally, and a projector was used to precisely project these points directly onto the patient’s skin. We also developed a trained machine learning model that detects cleft lip landmarks and automatically designs surgical markings, with the plan to integrate this into our PAR system. Results: The PAR system accurately projected surgeon and AI-generated surgical markings onto anatomical models with sub-millimeter precision. Projections remained aligned during movement and were clearly visible to the entire surgical team without requiring wearable hardware. Conclusions: PAR integrated with AI provides accurate, real-time, and shared intraoperative guidance. This platform improves surgical precision and has broad potential for remote mentorship and global surgical training. Full article

Background: Augmented Reality (AR) and Mixed Reality (MR) are emerging technologies with notable potential for motor rehabilitation. Given the novelty and breadth of this field, this scoping review aims to identify how and to what extent AR and MR technologies are used in motor rehabilitation. Methods: We conducted a search in Scopus and PubMed (2010–2024), following PRISMA-ScR guidelines. In the analysis, we focused on four key aspects: (I) the AR/MR display technologies, (II) the sensors used to collect data to generate the augmented information, (III) the pathologies addressed, and (IV) the assessment of usability and acceptability. Results: Among 105 selected studies, 58% developed new prototypes, while 42% tested existing systems. Head-mounted displays were the most common device (56.2%), followed by monitors (34.3%) and video projectors (14.3%). The most commonly used sensors were RGB-D cameras (31.4%), sensors for localization and mapping (33.3%), normal cameras (17.1%), and electromyography sensors (14.3%). Regarding the target pathology, 34.2% of studies did not focus on a specific pathology, 26.7% were on stroke, 10.5% on limb loss, and 9.5% on Parkinson’s disease. Over half (51.4%) of the studies investigated usability and acceptance. Conclusions: AR/MR technologies hold promise for motor rehabilitation, but limited comparative studies and long-term investigations currently hinder a clear understanding of their benefits. Full article

The growing interest in augmented reality applications has led to an in-depth look at the performance of head-mounted displays and their testing in numerous domains. Other devices for augmenting the real world with virtual information are presented less frequently and usually focus on the description of the device rather than on its performance analysis. This is the case of projected augmented reality, which, compared to head-worn AR displays, offers the advantages of being simultaneously accessible by multiple users whilst preserving user awareness of the environment and feeling of immersion. This work provides a general evaluation of a custom-made head-mounted projector for the aid of precision manual tasks through an experimental protocol designed for investigating spatial and temporal registration and their combination. The results of the tests show that the accuracy ($0.6\pm 0.1$ mm of spatial registration error) and motion-to-photon latency ($113\pm 12$ ms) make the proposed solution suitable for guiding precision tasks. Full article

With the continuously growing usage of collaborative robots in industry, the need for achieving a seamless human–robot interaction has also increased, considering that it is a key factor towards reaching a more flexible, effective, and efficient production line. As a prominent and prospective tool to support the human operator to understand and interact with robots, Augmented Reality (AR) has been employed in numerous human–robot collaborative and cooperative industrial applications. Therefore, this systematic literature review critically appraises 32 papers’ published between 2016 and 2021 to identify the main employed AR technologies, outline the current state of the art of augmented reality for human–robot collaboration and cooperation, and point out future developments for this research field. Results suggest that this is still an expanding research field, especially with the advent of recent advancements regarding head-mounted displays (HMDs). Moreover, projector-based and HMDs developed approaches are showing promising positive influences over operator-related aspects such as performance, task awareness, and safety feeling, even though HMDs need further maturation in ergonomic aspects. Further research should focus on large-scale assessment of the proposed solutions in industrial environments, involving the solution’s target audience, and on establishing standards and guidelines for developing AR assistance systems. Full article

Tonpilz is a popular transducer for underwater projector arrays for sonar systems. For low-frequency transmission, a larger axial dimension of the conventional Tonpilz transducer is required. However, a bulky and heavy Tonpilz element is not suitable due to limitations in terms of the space and payload of the array platform. To address this problem, we developed a rear-mounted Tonpilz transducer to generate a sub-fundamental resonance in addition to the common longitudinal resonance. For this purpose, we developed a new equivalent circuit model that can reflect all the effects of the key design parameters of the transducer, such as suspension thickness (stiffness), tail mass thickness, and head mass thickness. The impedance and transmitting voltage response were evaluated as performance factors at both resonance frequencies. The validity of the circuit was verified by comparing the analysis results with those from the finite element analysis of the same transducer. Based on the results, the transducer structure was designed to have comparable transmitting performance at both resonance frequencies by employing relatively high suspension stiffness, light tail mass, and heavy head mass. The novel design can permit the dual-band operation of the transducer so that the transducer can operate as a wideband projector. Full article

Enabling the effective representation of an object’s position and depth in augmented reality (AR) is crucial not just for realism, but also to enable augmented reality’s wider utilization in real world applications. Domains such as architecture and building design cannot leverage AR’s advantages without the effective representation of position. Prior work has examined how the human visual system perceives and interprets such cues in AR. However, it has focused on application systems that only use a single AR modality, i.e., head-mounted display, tablet/handheld, or projection. However, given the respective limitations of each modality regarding shared experience, stereo display, field of view, etc., prior work has ignored the possible benefits of utilizing multiple AR modalities together. By using multiple AR systems together, we can attempt to address the deficiencies of one modality by leveraging the features of other modalities. This work examines methods for representing position in a multi-modal AR system consisting of a stereo head-mounted display and a ceiling mounted projection system. Given that the AR content is now rendered across two separate AR realities, how does the user know which projected object matches the object shown in their head-mounted display? We explore representations to correlate and fuse objects across modalities. In this paper, we review previous work on position and depth in AR, before then describing multiple representations for head-mounted and projector-based AR that can be paired together across modalities. To the authors’ knowledge, this work represents the first step towards utilizing multiple AR modalities in which the AR content is designed directly to compliment deficiencies in the other modality. Full article

For some people with severe physical disabilities, the main assistive device to improve their independence and to enhance overall well-being is an electric-powered wheelchair (EPW). However, there is a necessity to offer users EPW training. In this work, the Simcadrom is introduced, which is a virtual reality simulator for EPW driving learning purposes, testing of driving skills and performance, and testing of input interfaces. This simulator uses a joystick as the main input interface, and a virtual reality head-mounted display. However, it can also be used with an eye-tracker device as an alternative input interface and a projector to display the virtual environment (VE). Sense of presence, and user experience questionnaires were implemented to evaluate this version of the Simcadrom in addition to some statistical tests for performance parameters like: total elapsed time, path following error, and total number of commands. A test protocol was proposed and, considering the overall results, the system proved to simulate, very realistically, the usability, kinematics, and dynamics of a real EPW in a VE. Most subjects were able to improve their EPW driving performance in the training session. Furthermore, all skills learned are feasible to be transferred to a real EPW. Full article

Although visual attention is one of the most thoroughly investigated topics in experimental psychology and vision science, most of this research tends to be restricted to the near periphery. Eccentricities used in attention studies usually do not exceed 20° to 30°, but most studies even make use of considerably smaller maximum eccentricities. Thus, empirical knowledge about attention beyond this range is sparse, probably due to a previous lack of suitable experimental devices to investigate attention in the far periphery. This is currently changing due to the development of temporal high-resolution projectors and head-mounted displays (HMDs) that allow displaying experimental stimuli at far eccentricities. In the present study, visual attention was investigated beyond the near periphery (15°, 30°, 56° Exp. 1) and (15°, 35°, 56° Exp. 2) in a peripheral Posner cueing paradigm using a discrimination task with placeholders. Interestingly, cueing effects were revealed for the whole range of eccentricities although the inhomogeneity of the visual field and its functional subdivisions might lead one to suspect otherwise. Full article

Virtual reality (VR) has the potential to help clinical medicine manage generalized anxiety disorder (GAD). However, patients with GAD who use traditional head-mounted VR to cycle may cause them to feel motion sickness and fatigue. To solve this problem, a projection-based virtual environment (VE) system was built to provide GAD patients with a sense of immersion while they are cycling. This projection-based VE system allows patients with GAD to interact with the virtual environment and produce experiences similar to cycling in the outdoors. Sixty GAD patients met several screening criteria and were selected as participants. All participants were randomly assigned to one of the two 20-min conditions: (1) Observing watercolor paintings projected by the projector while engaged in cycling with a stationary bicycle; or (2) observing the scenes (i.e., forest or park) projected by the VE system and engaging in cycling with a stationary bicycle. Finally, this study confirmed that patients with GAD in the projection-based VE group exhibited higher alpha values and lower galvanic skin responses (GSR) after cycling than those cycling in the control group. These results showed that cycling in the projection-based VE group allowed the patient with GAD to achieve higher exercise intensity and lower perceived emotional stress. Full article

High-speed recognition of the shape of a target object is indispensable for robots to perform various kinds of dexterous tasks in real time. In this paper, we propose a high-speed 3-D sensing system with active target-tracking. The system consists of a high-speed camera head and a high-speed projector, which are mounted on a two-axis active vision system. By measuring a projected coded pattern, 3-D measurement at a rate of 500 fps was achieved. The measurement range was increased as a result of the active tracking, and the shape of the target was accurately observed even when it moved quickly. In addition, to obtain the position and orientation of the target, 500 fps real-time model matching was achieved. Full article

In our previous work, we proposed a user interface in which a user wears a projector and a depth camera on his or her head and performs touch operations on an image projected on a flat surface. By using the head-mounted projector, images are always projected in front of the user in the direction of the user’s gaze. The image to be projected is changed according to the user’s head pose so as to fix the superimposed image on the surface, which realizes a large effective screen size. In this paper, we conducted an experiment for evaluating the accuracy of registration by measuring the positional and rotational errors between the real world and the superimposed image using our experimental system. As a result, the mean absolute errors of translation were about 10 mm when the user stopped his head, and the delay was estimated to be about 0.2 s. We also discuss the limitations of our prototype and show the direction of future development. Full article

The main aim of this work is to solve a problem that Augmented Reality is facing by using phenomenological and phenomenological analyses and projectors. Augmented reality seeks to merge the digital and real world by producing a mixed reality where the digital objects are usually visualised thanks to the head mounted or mobile devices. However, this technology is facing problems because the objects generated by the digital devices are existing merely inside the small group of people while using specific devices. Therefore, these objects look fictitious for the other members of the society who are not using them. In order to analyse the elements which make these objects fictitious for the other member of the society, we will take into account the story of The Emperor’s new clothes because, even in this story, there are fictional entities not perceivable by other members of the community. Thanks to this story, it will be possible to highlight some elements which make the objects part of the everyday world. Moreover, it will show how the intersubjectivity of these objects is directly related to their way of being perceived by the subjects and, in the case of augmented reality, to the devices used to make them perceivable. For this reason, it is possible to solve the problem Augmented Reality is facing by changing the devices used to produce these digital objects. At the end of the work, we will propose a project which can solve the problem by following the elements previously highlighted. We will show how, thanks to wearable projectors, it is possible to produce digital clothes as part of the everyday world of every subject. Thanks to these digital clothes people will be able to wear the digital objects as if they were common, usual objects without being naked. Full article

Automotive manufacturers and suppliers develop new vehicle systems, such as Advanced Driver Assistance Systems (ADAS), to increase traffic safety and driving comfort. ADAS are technologies that provide drivers with essential information or take over demanding driving tasks. More complex and intelligent vehicle systems are being developed toward fully autonomous and cooperative driving. Apart from the technical development challenges, training of drivers with these complex vehicle systems represents an important concern for automotive manufacturers. This paper highlights the new evolving requirements concerning the training of drivers with future complex vehicle systems. In accordance with these requirements, a new training concept is introduced, and a prototype of a training platform is implemented for utilization in future driving schools. The developed training platform has a scalable and modular architecture so that more than one driving simulator can be networked to a common driving instructor unit. The participating driving simulators provide fully immersive visualization to the drivers by utilizing head-mounted displays instead of conventional display screens and projectors. The driving instructor unit consists of a computer with a developed software tool for training session control, monitoring, and evaluation. Moreover, the driving instructor can use a head-mounted display to participate interactively within the same virtual environment of any selected driver. A simulation model of an autonomous driving system was implemented and integrated in the participating driving simulators. Using this simulation model, training sessions were conducted with the help of a group of test drivers and professional driving instructors to prove the validity of the developed concept and show the usability of the implemented training platform. Full article