It is still unknown whether the very application of gaze for interaction has effects on cognitive strategies users employ and how these effects materialize. We conducted a between-subject experiment in which thirty-six participants interacted with a...
17 January 2023
The diffusion of virtual reality applications dedicated to aging urges us to appraise its acceptance by target populations, especially the oldest olds. We investigated whether immersive virtual biking, and specifically a visuomotor manipulation aimed...
This paper proposes a lightweight gaze-tracking architecture named GhostBlock-Augmented Look to Coordinate Space (L2CS), which integrates GhostNet-based modules and depthwise separable convolution to achieve a better trade-off between model accuracy...
In this exploratory eye tracking study, gaze behavior during an experiment on electrolysis of a zinc iodide solution has been examined. The experiment is designed according to inquiry-based learning and therefore well suited to students’ self-d...
Visual grounding aims to recognize and locate the target in the image according to human intention, which provides a new intelligent interaction idea and method for augmented reality (AR) and virtual reality (VR) devices. However, existing vision lan...
Data augmentation is commonly utilized to increase the size and diversity of training sets for deep learning tasks. In this study, we propose a novel application of an existing image generation approach in the domain of realistic eye images that leve...
With technological development and industrial transformation, the architecture, engineering, and construction (AEC) industry, comprising architecture, engineering, and construction, has shifted from a traditional drawing-based design mode to a digita...
6 June 2024
In this study, the challenges posed by limited annotated medical data in the field of eye movement AI analysis are addressed through the introduction of a novel physiologically based gaze data augmentation library. Unlike traditional augmentation met...
Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disorder that progressively impairs motor and communication abilities. Globally, the prevalence of ALS was estimated at approximately 222,800 cases in 2015 and is projected to increase by nea...
Wire harness assembly is a highly manual job performed on formboards. Augmented reality (AR)-assisted wiring operations can improve work efficiency and reduce operator workload. However, investigations into the effects of AR-assisted wiring assembly...
Any severe motor disability is a condition that limits the ability to interact with the environment, even the domestic one, caused by the loss of control over one’s mobility. This work presents RoboEYE, a power wheelchair designed to allow users to m...
This study addresses the importance of salience placement before or after scotoma development for an efficient target allocation in the visual field. Pre-allocation of attention is a mechanism known to induce a better gaze positioning towards the tar...
Eye gaze can be a potentially fast and ergonomic method for target selection in augmented reality (AR). However, the eye-tracking accuracy of current consumer-level AR systems is limited. While state-of-the-art AR target selection techniques based on...
Most eye tracking methods are light-based. As such, they can suffer from ambient light changes when used outdoors, especially for use cases where eye trackers are embedded in Augmented Reality glasses. It has been recently suggested that ultrasound c...
Gaze estimation is increasingly pivotal in applications spanning virtual reality, augmented reality, and driver monitoring systems, necessitating efficient yet accurate models for mobile deployment. Current methodologies often fall short, particularl...
The adoption of kiosks in public spaces is steadily increasing, with a trend toward providing more natural user experiences through embodied conversational agents (ECAs). To achieve human-like interactions, ECAs should be able to appropriately gaze a...
Visual information is crucial in human life, not only providing critical support for communication, learning, and decision-making, but also playing a key role in psychology, medicine, and science. Eye-tracking and gaze estimation have promoted the de...
Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interacti...
Oculometric data, such as gaze direction, pupil size and accommodative change, play a key role nowadays in the analysis of cognitive load and attentional activities, in particular with the development of Integrated Visual Augmentation Systems in many...
Eye tracking, a fundamental process in gaze analysis, involves measuring the point of gaze or eye motion. It is crucial in numerous applications, including human–computer interaction (HCI), education, health care, and virtual reality. This stud...
In the present study, the effects of an intervention based on an augmented reality technology called Pictogram Room were examined. The objective of the intervention was to improve the responding to joint attention (RJA) skills of gaze following and p...
4 August 2022
The present study investigates the effects of peripheral spatial cues and optically distorting augmentations over eccentric vision mechanisms in normally sighted participants with simulated scotoma. Five different augmentations were tested inside a v...
Mixed reality technology can give humans an intuitive visual experience, and combined with the multi-source information of the human body, it can provide a comfortable human–robot interaction experience. This paper applies a mixed reality devic...
Some of the barriers preventing virtual reality (VR) from being widely adopted are the cost and unfamiliarity of VR systems. Here, we propose that in many cases, the specialized controllers shipped with most VR head-mounted displays can be replaced b...
Against the backdrop of globalization, environmental pressures, and rapid tourism development, digital technologies are emerging as vital supplementary tools for cultural heritage preservation. This study investigates the impact of augmented reality...
The working hypothesis in this project is that gaze interactions play a central role in structuring the joint control and guidance strategy of the human operator performing spatial tasks. Perceptual guidance and control is the idea that the visual an...
In this paper, we explore the effect of using different convolutional layers, batch normalization and the global average pooling layer upon a convolutional neural network (CNN) based gaze tracking system. A novel method is proposed to label the parti...
This paper presents a new architecture that integrates Internet of Things (IoT) devices, service robots, and users in a smart assistive environment. A new intuitive and multimodal interaction system supporting people with disabilities and bedbound pa...
We study an individual’s propensity for rational thinking; the avoidance of cognitive biases (unconscious errors generated by our mental simplification methods) using a novel augmented reality (AR) platform. Specifically, we developed an odd-one-out...
Anthropology has long resisted becoming a nomothetic science, thus repeatedly missing opportunities to build upon empirical theoretical constructs, choosing instead to back away into a kind of natural history of sociocultural differences. What is req...
This Scoping Review (ScR) synthesizes advances in architectural eye-tracking (ET) research published between 2010 and 2024. Drawing on 75 peer-reviewed studies that met clear inclusion criteria, it monitors the field’s rapid expansion, from onl...
Rett syndrome (RTT) can restrict the motor and verbal responses needed for conventional assessment and rehabilitation. This non-systematic critical narrative review examines human RTT evidence on eye tracking, virtual reality (VR), electroencephalogr...
There are many children with disabilities who need specialised devices to communicate and to be understood, which poses an added challenge for their caregivers. This study aims to diagnose the training needs of informal caregivers concerning high-tec...
Current hand-held smart devices are supplied with powerful processors, high resolution screens, and sharp cameras that make them suitable for Augmented Reality (AR) applications. Such applications commonly use interaction techniques adapted for touch...
The vestibular system is dedicated to gaze stabilization, postural balance, and spatial orientation; this makes vestibular function crucial for our ability to interact effectively with our environment. Vestibular hypofunction (VH) progresses over tim...
Amyotrophic Lateral Sclerosis is a disease that compromises the motor system and the functional abilities of the person in an irreversible way, causing the progressive loss of the ability to communicate. Tools based on Augmentative and Alternative Co...
As large language models (LLMs) and vision–language models (VLMs) become increasingly used in robotics area, a crucial question arises: to what extent do these models replicate human-like cognitive processes, particularly within socially intera...
Background: Periorbital aging involves complex structural and functional changes, including decreased eyelid opening and alterations in infraorbital contour. Conventional collagen biostimulators mainly focus on localized volume augmentation and derma...
9 November 2022
Pedestrian understanding of driver intent is key to pedestrian safety on the road and in parking lots. With the development of autonomous vehicles (AVs), the human driver will be removed, and with it, the exchange that occurs between drivers and pede...
Immersive methods and biometric tools provide a rigorous, context-rich way to study how people perceive and choose food. Immersive methods use extended reality, including virtual, augmented, mixed, and augmented virtual environments, to recreate sett...
Mobile eye tracking captures egocentric vision and is well-suited for naturalistic studies. However, its data is noisy, especially when acquired outdoor with multiple participants over several sessions. Area of interest analysis on moving targets is...
Augmented Reality Head-Up Displays (AR-HUDs) enhance driver perception and safety, yet optimal hazard warning design remains unclear. This study examines three AR-HUD crash warning icon types (BD, BR, BW) across various turning scenarios. Using a 360...
We present the eyeglass-type switch, an eyeglass-mounted eye/blink switch designed for nurse-call operation by people with severe motor impairments, with a particular focus on amyotrophic lateral sclerosis (ALS). The system targets real-world bedside...
Level 3 automated driving necessitates rapid driver reengagement following a takeover request, making human–machine interface design critical for safety. As a sensor-based in-vehicle interface, the augmented reality head-up display (AR-HUD) int...
Wearable mobile eye trackers have great potential as they allow the measurement of eye movements during daily activities such as driving, navigating the world and doing groceries. Although mobile eye trackers have been around for some time, developin...
The reconstruction of complex orbitomaxillary defects requires biomaterials that can simultaneously provide structural stability, biocompatibility, and accurate restoration of facial volume and contour. While rigid polymers such as polyetheretherketo...
The cultivation of aesthetic appreciation through engagement with exemplary artworks constitutes a fundamental pillar in fostering children’s cognitive and emotional development, while simultaneously facilitating multidimensional learning exper...
As VR technology advances and network speeds rise, social VR platforms are gaining traction. These platforms enable multiple users to socialize and collaborate within a shared virtual environment using avatars. Virtual reality, with its ability to au...
Background: Decoding covert spatial attention (CSA) from dry, low-channel electroencephalography (EEG) is key for gaze-independent brain–computer interfaces (BCIs). Methods: We evaluate, on sixteen participants and three tasks (CSA, motor image...
The increasing ubiquity of wearable computing and multimodal interaction technologies has created unprecedented opportunities for natural and seamless human–computer interaction. However, most existing systems adapt only to external user action...
of 2