Autonomous vehicles (AV) increasingly allow drivers to engage in secondary tasks such as eating or working on a laptop and thus require easy and reliable interaction inputs to facilitate communication between the driver and the vehicle. However, driv...
This paper describes the motion control system for a powered wheelchair using eye gaze in an unknown environment. Recently, new Human-Computer Interfaces (HCIs) that have replaced joysticks have been developed for a person with a disability of the up...
Over the years, gaze input modality has been an easy and demanding human–computer interaction (HCI) method for various applications. The research of gaze-based interactive applications has advanced considerably, as HCIs are no longer constraine...
This research proposes a gaze pointer-based user interface to provide user-oriented interaction suitable for the virtual reality environment on mobile platforms. For this purpose, a mobile platform-based three-dimensional interactive content is produ...
With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a lo...
As smart eyewear becomes increasingly widespread, the need for hands-free input interfaces is growing. Although eye-based input is a promising approach, many everyday interactions do not necessarily require the high-precision gaze-point estimation us...
Eye tracking technology is now mature enough to be exploited in various areas of human–computer interaction. In this paper, we consider the use of gaze-based communication in museums and exhibitions, to make the visitor experience more engaging...
Proper feedback is essential in gaze based interfaces, where the same modality is used for both perception and control. We measured how vibrotactile feedback, a form of haptic feedback, compares with the commonly used visual and auditory feedback in...
With the increasing presence of robots in our daily lives, it is crucial to design interaction interfaces that are natural, easy to use and meaningful for robotic tasks. This is important not only to enhance the user experience but also to increase t...
Virtual reality (VR) headsets with built-in eye trackers can record binocular gaze, but prior biometric studies have largely emphasized monocular gaze or general spatial trajectories, leaving the identity value of interocular coordination largely unt...
Gaze target detection requires understanding where a person is looking by jointly reasoning about the gazer and the surrounding scene. While recent methods have benefited from powerful pretrained visual backbones, they often treat gaze prediction as...
Among the numerous gaze-estimation methods currently available, appearance-based methods predominantly use RGB images as input and employ convolutional neural networks (CNNs) to detect facial images to regressively obtain gaze angles or gaze points....
The goal of gaze estimation is to estimate a gaze vector from an image containing a face or eye(s). Most existing studies use pre-defined fixed-resolution images to estimate the gaze vector. However, images captured from in-the-wild environments may...
We present MultiNet, a multi-branch pipeline that directly predicts the gaze vector or the point of gaze from multiple modalities derived from a single camera capture. In particular, we address the under-explored use of metric face-to-camera distance...
Research on Virtual Reality (VR) interfaces for distant object interaction has been carried out to improve user experience. Since hand-only interfaces and gaze-only interfaces have limitations such as physical fatigue or restricted usage, VR interact...
Gaze is an excellent indicator and has utility in that it can express interest or intention and the condition of an object. Recent deep-learning methods are mainly appearance-based methods that estimate gaze based on a simple regression from entire f...
29 September 2014
Teleoperation has been widely used to perform tasks in dangerous and unreachable environments by replacing humans with controlled agents. The idea of human-robot interaction (HRI) is very important in teleoperation. Conventional HRI input devices inc...
Gaze estimation, a critical facet of understanding user intent and enhancing human–computer interaction, has seen substantial advancements with the integration of deep learning technologies. Despite the progress, the application of deep learnin...
Gaze, as a sole input modality must support complex navigation and selection tasks. Gaze interaction combines specific eye movements and graphic display objects (GDOs). This paper suggests a unifying taxonomy of gaze interaction principles. The taxon...
Based on experimental observations, there is a correlation between time and consecutive gaze positions in visual behaviors. Previous studies on gaze point estimation usually use images as the input for model trainings without taking into account the...
Gaze is a significant behavioral characteristic that can be used to reflect a person’s attention. In recent years, there has been a growing interest in estimating gaze from facial videos. However, gaze estimation remains a challenging problem d...
Most conventional gaze-tracking systems require that users look at many points during the initial calibration stage, which is inconvenient for them. To avoid this requirement, we propose a new gaze-tracking method with four important characteristics....
Recently, with the widespread application of deep learning networks, appearance-based gaze estimation has made breakthrough progress. However, most methods focus on feature extraction from the facial region while neglecting the critical role of the e...
Mixed reality (MR) technologies enable users to experience computer-generated content within the physical environment through spatial computing and head-mounted displays. By supporting real-time interaction through speech, gesture, gaze, and movement...
Most eye tracking methods are light-based. As such, they can suffer from ambient light changes when used outdoors, especially for use cases where eye trackers are embedded in Augmented Reality glasses. It has been recently suggested that ultrasound c...
General gaze following aims to infer the region attended to by a person within a natural scene and offers a computational perspective on visual attention and social scene understanding. Existing direction-guided methods usually reduce gaze direction...
Motion control of mobile robots in a cluttered environment with obstacles is an important problem. It is unsatisfactory to control a robot’s motion using traditional control algorithms in a complex environment in real time. Gaze tracking techno...
Content-based image retrieval (CBIR) aims to find desired images similar to the image input by the user, and it is extensively used in the real world. Conventional CBIR methods do not consider user preferences since they only determine retrieval resu...
Eye movement is an important tool used to investigate cognition. It also serves as input in human–computer interfaces for assistive technology. It can be measured with camera-based eye tracking and electro-oculography (EOG). EOG does not rely o...
Virtual reality (VR) can enrich neuropsychological testing, yet the ergonomic trade-offs of its input modes remain under-examined. Seventy-seven healthy volunteers—young (19–29 y) and middle-aged (35–56 y)—completed a VR Trail...
In smart interactive environments, such as digital museums or digital exhibition halls, it is important to accurately understand the user’s intent to ensure successful and natural interaction with the exhibition. In the context of predicting us...
Gaze data visualization constitutes one of the most critical processes during eye-tracking analysis. Considering that modern devices are able to collect gaze data in extremely high frequencies, the visualization of the collected aggregated gaze data...
Biomimetic humanoid control can emulate not only human morphology and motion but also the sensorimotor organization that couples visual anticipation with physical correction during joint action. Inspired by this principle, we propose a gaze–for...
The automatic detection of deceptive behaviors has recently attracted the attention of the research community due to the variety of areas where it can play a crucial role, such as security or criminology. This work is focused on the development of an...
With the development of human–computer interaction technology, non-contact interaction based on gaze tracking and facial movements has become a research hotspot. Traditional mouse-and-keyboard methods pose challenges for people with disabilitie...
This paper presents ITap, a novel interaction method utilizing hand tracking to create a virtual touchpad on a tabletop. ITap facilitates touch interactions such as tapping, dragging, and swiping using the index finger. The technique combines gaze-ba...
Recently, many studies have actively dealt with the issue of driver-gaze tracking for monitoring the forward gaze and physical condition. Driver-gaze tracking is an effective method of measuring a driver’s inattention that is one of the major causes...
An eye-of-origin singleton, e.g., a bar shown to the left eye among many other bars shown to the right eye, can capture attention and gaze exogenously or reflexively, even when it appears identical to other visual input items in the scene and when th...
User-centered design questions in gaze interfaces have been explored in multitude empirical investigations. Interestingly, the question of what eye should be the input device has never been studied. We compared tracking accuracy between the “cyclopea...
Eye-tracking allows researchers to infer cognitive processes from eye movements that are classified into distinct events. Parsing the events is typically done by algorithms. Here we aim at developing an unsupervised, generative model that can be fitt...
This paper describes a low-cost, robust, and accurate remote eye-tracking system that uses an industrial prototype smartphone with integrated infrared illumination and camera. Numerous studies have demonstrated the beneficial use of eye-tracking in d...
A scientific method for evaluating the design of interfaces is proposed to address the unique characteristics and user needs of infrequent-contact public service interfaces. This method is significant for enhancing service efficiency and promoting th...
Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figu...
Voice- and gaze-based hands-free input are increasingly used in human-machine interaction. Attempts to combine them into a hybrid technology typically employ the voice channel as an information-rich channel. Voice seems to be “overqualified&rdq...
Gaze-tracking, where the point of regard of a subject is mapped onto the image of the scene the subject sees, can be employed to study the visual attention of the users of prosthetic hands. It can show whether the user pays greater attention to the a...
Studies are being actively conducted on camera-based driver gaze tracking in a vehicle environment for vehicle interfaces and analyzing forward attention for judging driver inattention. In existing studies on the single-camera-based method, there are...
Monitoring driver attention using the gaze estimation is a typical approach used on road scenes. This indicator is of great importance for safe driving, specially on Level 3 and Level 4 automation systems, where the take over request control strategy...
This study provides a chronological analysis of how Extended Reality (XR) interaction techniques have evolved from early controller-centered interfaces to natural hand- and gaze-based input and, more recently, to multimodal input, with a particular f...
Gaze input, i.e., information input via eye of users, represents a promising method for contact- free interaction in human-machine systems. In this paper, we present the GazeVending interface (GaVe), which lets users control actions on a display with...
To obtain the optimal driving visual guidance methods in sudden low-visibility fog environments, it is crucial to analyze the changes in visual characteristics and information demand under low-visibility foggy conditions. The paper constructs a drivi...
of 2