You are currently on the new version of our website. Access the old version .

397 Results Found

  • Article
  • Open Access
6 Citations
8,051 Views
18 Pages

Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile Apps

  • Sergio Caro-Alvaro,
  • Eva Garcia-Lopez,
  • Alexander Brun-Guajardo,
  • Antonio Garcia-Cabot and
  • Aekaterini Mavri

4 February 2024

This study investigates the feasibility and functionality of accelerometer and gyroscope sensors for gesture-based interactions in mobile app user experience. The core of this innovative approach lies in introducing a dynamic and intuitive user inter...

  • Article
  • Open Access
33 Citations
6,899 Views
19 Pages

A Novel Gesture-Based Language for Underwater Human–Robot Interaction

  • Davide Chiarella,
  • Marco Bibuli,
  • Gabriele Bruzzone,
  • Massimo Caccia,
  • Andrea Ranieri,
  • Enrica Zereik,
  • Lucia Marconi and
  • Paola Cutugno

The underwater environment is characterized by hazardous conditions that make it difficult to manage and monitor even the simplest human operation. The introduction of a robot companion with the task of supporting and monitoring the divers during the...

  • Article
  • Open Access
10 Citations
7,677 Views
16 Pages

22 September 2020

Touchless interaction with electronic devices using gestures is gaining popularity and along with speech-based communication offers their users natural and intuitive control methods. Now, these interaction modes go beyond the entertainment industry a...

  • Article
  • Open Access
51 Citations
6,773 Views
17 Pages

Motion Estimation and Hand Gesture Recognition-Based Human–UAV Interaction Approach in Real Time

  • Minjeong Yoo,
  • Yuseung Na,
  • Hamin Song,
  • Gamin Kim,
  • Junseong Yun,
  • Sangho Kim,
  • Changjoo Moon and
  • Kichun Jo

25 March 2022

As an alternative to traditional remote controller, research on vision-based hand gesture recognition is being actively conducted in the field of interaction between human and unmanned aerial vehicle (UAV). However, vision-based gesture system has a...

  • Article
  • Open Access
5 Citations
2,488 Views
23 Pages

Existing virtual reality (VR) street view and 360-degree road view applications often rely on complex controllers or touch interfaces, which can hinder user immersion and accessibility. These challenges are particularly pronounced for under-represent...

  • Article
  • Open Access
784 Views
14 Pages

An Inclusive Offline Learning Platform Integrating Gesture Recognition and Local AI Models

  • Marius-Valentin Drăgoi,
  • Ionuț Nisipeanu,
  • Roxana-Adriana Puiu,
  • Florentina-Geanina Tache,
  • Teodora-Mihaela Spiridon-Mocioacă,
  • Alexandru Hank and
  • Cozmin Cristoiu

14 October 2025

This paper introduces a gesture-controlled conversational interface driven by a local AI model, aimed at improving accessibility and facilitating hands-free interaction within digital environments. The technology utilizes real-time hand gesture recog...

  • Communication
  • Open Access
2 Citations
2,687 Views
14 Pages

Development of Dual-Arm Human Companion Robots That Can Dance

  • Joonyoung Kim,
  • Taewoong Kang,
  • Dongwoon Song,
  • Gijae Ahn and
  • Seung-Joon Yi

18 October 2024

As gestures play an important role in human communication, there have been a number of service robots equipped with a pair of human-like arms for gesture-based human–robot interactions. However, the arms of most human companion robots are limit...

  • Article
  • Open Access
3,357 Views
22 Pages

Enhancing Drone Navigation and Control: Gesture-Based Piloting, Obstacle Avoidance, and 3D Trajectory Mapping

  • Ben Taylor,
  • Mathew Allen,
  • Preston Henson,
  • Xu Gao,
  • Haroon Malik and
  • Pingping Zhu

30 June 2025

Autonomous drone navigation presents challenges for users unfamiliar with manual flight controls, increasing the risk of collisions. This research addresses this issue by developing a multifunctional drone control system that integrates hand gesture...

  • Article
  • Open Access
8 Citations
3,288 Views
31 Pages

25 August 2023

Ancient manuscripts are precious and fragile objects, preserved in libraries, museums, and archives. Some of them are masterpieces, made with several materials and insights, but generally they are not accessible to wide communities of users. The purp...

  • Article
  • Open Access
4 Citations
2,715 Views
28 Pages

The underwater environment is a harmful environment, yet one of the richest and least exploited. For these reasons the idea of a robotic companion with the task of supporting and monitoring divers during their activities and operations has been propo...

  • Article
  • Open Access
4 Citations
3,744 Views
16 Pages

Enhancing User Engagement in Shared Autonomous Vehicles: An Innovative Gesture-Based Windshield Interaction System

  • Pierstefano Bellani,
  • Andrea Picardi,
  • Federica Caruso,
  • Flora Gaetani,
  • Fausto Brevi,
  • Venanzio Arquilla and
  • Giandomenico Caruso

1 September 2023

With the rapid advancement of autonomous vehicles, a transformative transportation paradigm is emerging in the automotive industry, necessitating a re-evaluation of how users engage with and utilize these evolving settings. This research paper introd...

  • Article
  • Open Access
7 Citations
6,290 Views
18 Pages

The interpretation and understanding of physical gestures play a significant role in various forms of art. Interactive technology and digital devices offer a plethora of opportunities for personal gesture-based experience and they assist in the creat...

  • Article
  • Open Access
2,763 Views
33 Pages

18 June 2025

As gesture-based interactions expand across traditional 2D screens and immersive XR platforms, designing intuitive input modalities tailored to specific contexts becomes increasingly essential. This study explores how users cognitively and experienti...

  • Article
  • Open Access
51 Citations
11,595 Views
25 Pages

8 January 2015

Vision-based hand gesture interactions are natural and intuitive when interacting with computers, since we naturally exploit gestures to communicate with other people. However, it is agreed that users suffer from discomfort and fatigue when using ges...

  • Proceeding Paper
  • Open Access

Assessing the Relationship Between Gesture Intuitiveness and Muscle Network Efficiency: A Comparison of NMF and Inter-Muscular Coherence Analysis Methods

  • Eduardo Oliveira Freire,
  • Leonardo Ariel Cano,
  • Gonzalo Daniel Gerez,
  • Manuel Parajón Víscido,
  • Ana Lía Albarracín and
  • Fernando Daniel Farfán

This pilot study investigates the relationship between gesture intuitiveness and muscle network efficiency in human–machine interactions (HMIs), emphasizing objective neurophysiological measures. EMG signals from 16 muscles were analyzed to con...

  • Communication
  • Open Access
8 Citations
4,966 Views
14 Pages

Gesture-Based Human Machine Interaction Using RCNNs in Limited Computation Power Devices

  • Alberto Tellaeche Iglesias,
  • Ignacio Fidalgo Astorquia,
  • Juan Ignacio Vázquez Gómez and
  • Surajit Saikia

8 December 2021

The use of gestures is one of the main forms of human machine interaction (HMI) in many fields, from advanced robotics industrial setups, to multimedia devices at home. Almost every gesture detection system uses computer vision as the fundamental tec...

  • Article
  • Open Access
13 Citations
4,923 Views
20 Pages

Fingertip Gestures Recognition Using Leap Motion and Camera for Interaction with Virtual Environment

  • Inam Ur Rehman,
  • Sehat Ullah,
  • Dawar Khan,
  • Shah Khalid,
  • Aftab Alam,
  • Gul Jabeen,
  • Ihsan Rabbi,
  • Haseeb Ur Rahman,
  • Numan Ali and
  • Sangeen Khan
  • + 1 author

24 November 2020

The emergence in computing and the latest hardware technologies realized the use of natural interaction with computers. Gesture-based interaction is one of the prominent fields of natural interactions. The recognition and application of hand gestures...

  • Article
  • Open Access
4 Citations
2,945 Views
28 Pages

Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control

  • Branislav Malobický,
  • Marián Hruboš,
  • Júlia Kafková,
  • Jakub Krško,
  • Mário Michálik,
  • Rastislav Pirník and
  • Pavol Kuchár

25 March 2025

This paper presents the development of a robotic workstation that integrates a collaborative robot as an assistant, leveraging advanced computer vision techniques to enhance human–robot interaction. The system employs state-of-the-art computer...

  • Systematic Review
  • Open Access
46 Citations
10,301 Views
19 Pages

Gesture recognition, as a core technology of human–computer interaction, has broad application prospects and brings new technical possibilities for smart homes, medical care, sports training, and other fields. Compared with the traditional huma...

  • Article
  • Open Access
4 Citations
2,252 Views
17 Pages

The Comfort and Measurement Precision-Based Multi-Objective Optimization Method for Gesture Interaction

  • Wenjie Wang,
  • Yongai Hou,
  • Shuangwen Tian,
  • Xiansheng Qin,
  • Chen Zheng,
  • Liting Wang,
  • Hepeng Shang and
  • Yuangeng Wang

As an advanced interaction mode, gestures have been widely used for human–computer interaction (HCI). This paper proposes a multi-objective optimization method based on the objective function JCP to solve the inconsistency between the gesture c...

  • Article
  • Open Access
29 Citations
8,331 Views
23 Pages

17 July 2020

Rings are widely accepted wearables for gesture interaction. However, most rings can sense only the motion of one finger or the whole hand. We present PeriSense, a ring-shaped interaction device enabling multi-finger gesture interaction. Gestures of...

  • Article
  • Open Access
37 Citations
8,972 Views
19 Pages

Recently, human–robot interaction technology has been considered as a key solution for smart factories. Surface electromyography signals obtained from hand gestures are often used to enable users to control robots through hand gestures. In this...

  • Article
  • Open Access
1 Citations
2,311 Views
44 Pages

Adaptive Augmented Reality User Interfaces for Real-Time Defect Visualization and On-the-Fly Reconfiguration for Zero-Defect Manufacturing

  • George Margetis,
  • Katerina Valakou,
  • Stavroula Ntoa,
  • Despoina Gavgiotaki and
  • Constantine Stephanidis

28 April 2025

Zero-defect manufacturing is one of the most promising strategies to mitigate failures within manufacturing processes, allowing industries to increase product quality efficiently and effectively. One of the challenges faced in the practical adoption...

  • Article
  • Open Access
1 Citations
1,105 Views
18 Pages

ITap: Index Finger Tap Interaction by Gaze and Tabletop Integration

  • Jeonghyeon Kim,
  • Jemin Lee,
  • Jung-Hoon Ahn and
  • Youngwon Kim

30 April 2025

This paper presents ITap, a novel interaction method utilizing hand tracking to create a virtual touchpad on a tabletop. ITap facilitates touch interactions such as tapping, dragging, and swiping using the index finger. The technique combines gaze-ba...

  • Article
  • Open Access
1 Citations
944 Views
29 Pages

This study focuses on the innovative application of HCI and XR technologies in behavioral skills training (BST) in the digital age, exploring their potential in education, especially experimental training. Despite the opportunities these technologies...

  • Article
  • Open Access
9 Citations
4,794 Views
19 Pages

6 December 2022

This paper presents the development of a visual-perception system on a dual-arm mobile robot for human-robot interaction. This visual system integrates three subsystems. Hand gesture recognition is utilized to trigger human-robot interaction. Engagem...

  • Article
  • Open Access
1,429 Views
24 Pages

Hand Gesture Recognition (HGR) is a vital technology that enables intuitive human–computer interaction in various domains, including augmented reality, smart environments, and assistive systems. Achieving both high accuracy and real-time perfor...

  • Article
  • Open Access
11 Citations
6,158 Views
27 Pages

6 June 2024

The affordability of equipment and availability of development tools have made immersive virtual reality (VR) popular across research fields. Gesture-based user interface has emerged as an alternative method to handheld controllers to interact with t...

  • Article
  • Open Access
84 Citations
16,075 Views
15 Pages

Real-Time Hand Gesture Spotting and Recognition Using RGB-D Camera and 3D Convolutional Neural Network

  • Dinh-Son Tran,
  • Ngoc-Huynh Ho,
  • Hyung-Jeong Yang,
  • Eu-Tteum Baek,
  • Soo-Hyung Kim and
  • Gueesang Lee

20 January 2020

Using hand gestures is a natural method of interaction between humans and computers. We use gestures to express meaning and thoughts in our everyday conversations. Gesture-based interfaces are used in many applications in a variety of fields, such as...

  • Article
  • Open Access
41 Citations
13,054 Views
27 Pages

4 August 2019

Smart glasses for wearable augmented reality (AR) are widely used in various applications, such as training and task assistance. However, as the field of view (FOV) in the current AR smart glasses is narrow, it is difficult to visualize all the infor...

  • Article
  • Open Access
23 Citations
484 Views
14 Pages

Human-Robot Interaction Based on Gaze Gestures for the Drone Teleoperation

  • Mingxin Yu,
  • Yingzi Lin,
  • Xiangzhou Wang,
  • David Schmidt and
  • Yu Wang
J. Eye Mov. Res.2014, 7(4), 1-14;https://doi.org/10.16910/jemr.7.4.4 
(registering DOI)

29 September 2014

Teleoperation has been widely used to perform tasks in dangerous and unreachable environments by replacing humans with controlled agents. The idea of human-robot interaction (HRI) is very important in teleoperation. Conventional HRI input devices inc...

  • Article
  • Open Access
2,186 Views
37 Pages

An Empirical Study on the Impact of Different Interaction Methods on User Emotional Experience in Cultural Digital Design

  • Jing Zhao,
  • Yiming Ma,
  • Xinran Zhang,
  • Hui Lin,
  • Yi Lu,
  • Ruiyan Wu,
  • Ziying Zhang and
  • Feng Zou

25 August 2025

Traditional culture plays a vital role in shaping national identity and emotional belonging, making it imperative to explore innovative strategies for its digital preservation and engagement. This study investigates how interaction design in cultural...

  • Article
  • Open Access
1 Citations
1,593 Views
17 Pages

A Symmetrical Leech-Inspired Soft Crawling Robot Based on Gesture Control

  • Jiabiao Li,
  • Ruiheng Liu,
  • Tianyu Zhang and
  • Jianbin Liu

This paper presents a novel soft crawling robot controlled by gesture recognition, aimed at enhancing the operability and adaptability of soft robots through natural human–computer interactions. The Leap Motion sensor is employed to capture han...

  • Proceeding Paper
  • Open Access

Hand Gesture to Sound: A Real-Time DSP-Based Audio Modulation System for Assistive Interaction

  • Laiba Khan,
  • Hira Mariam,
  • Marium Sajid,
  • Aymen Khan and
  • Zehra Fatima

7 November 2025

This paper presents the design, development, and evaluation of an embedded hardware and digital signal processing (DSP)-based real-time gesture-controlled system. The system architecture utilizes an MPU6050 inertial measurement unit (IMU), Arduino Un...

  • Article
  • Open Access
22 Citations
7,780 Views
22 Pages

Touchless, mid-air gesture-based interactions with remote devices have been investigated as alternative or complementary to interactions based on remote controls and smartphones. Related studies focus on user elicitation of a gesture vocabulary for o...

  • Article
  • Open Access
4 Citations
4,964 Views
21 Pages

16 July 2019

With intelligent big data, a variety of gesture-based recognition systems have been developed to enable intuitive interaction by utilizing machine learning algorithms. Realizing a high gesture recognition accuracy is crucial, and current systems lear...

  • Article
  • Open Access
1 Citations
2,403 Views
21 Pages

Novel Gesture-Based Robot Programming Approach with the Ability of Code Reuse

  • Vladyslav Andrusyshyn,
  • Kamil Židek,
  • Vitalii Ivanov and
  • Ján Piteľ

25 March 2024

Nowadays, there is a worldwide demand to create new, simpler, and more intuitive methods for the manual programming of industrial robots. Gestures can allow the operator to interact with the robot more simply and naturally, as gestures are used in ev...

  • Article
  • Open Access
2 Citations
2,272 Views
25 Pages

Impact of In-Air Gestures on In-Car Task’s Diver Distraction

  • Chengyong Cui,
  • Guojiang Shen,
  • Yu Wang,
  • Yile Xu,
  • Hao Du,
  • Wenyi Zhang and
  • Xiangjie Kong

As in-vehicle information systems (IVIS) grow increasingly complex, the demand for innovative artificial intelligence-based interaction methods that enhance cybersecurity becomes more crucial. In-air gestures offer a promising solution due to their i...

  • Article
  • Open Access
18 Citations
6,816 Views
21 Pages

11 February 2022

Natural user interfaces based on hand gestures are becoming increasingly popular. The need for expensive hardware left a wide range of interaction possibilities that hand tracking enables largely unexplored. Recently, hand tracking has been built int...

  • Article
  • Open Access
5 Citations
4,800 Views
22 Pages

1 January 2023

As an effective solution for data visualization and analysis, the large-scale high-resolution display wall system has been widely used in various scientific research fields. On the basis of investigating existing system cases and research results, th...

  • Article
  • Open Access
18 Citations
8,814 Views
24 Pages

Design of 3D Microgestures for Commands in Virtual Reality or Augmented Reality

  • Guangchuan Li,
  • David Rempel,
  • Yue Liu,
  • Weitao Song and
  • Carisa Harris Adamson

9 July 2021

Virtual and augmented reality (VR, AR) systems present 3D images that users can interact with using controllers or gestures. The design of the user input process is crucial and determines the interactive efficiency, comfort, and adoption. Gesture-bas...

  • Article
  • Open Access
1 Citations
2,615 Views
18 Pages

With the growing prevalence of modern technologies as part of everyday life, mid-air gestures have become a promising input method in the field of human–computer interaction. This paper analyses the gestures of actual users to define a prelimin...

  • Article
  • Open Access
5 Citations
4,211 Views
22 Pages

15 July 2020

The ever-growing and widespread use of touch, face, full-body, and 3D mid-air gesture recognition sensors in domestic and industrial settings is serving to highlight whether interactive gestures are sufficiently inclusive, and whether or not they can...

  • Article
  • Open Access
8 Citations
3,314 Views
14 Pages

Developing a smart classroom can make the modern classroom more efficient and intelligent. Much research has been conducted pertaining to smart classrooms for hearing-impaired college students. However, there have been few significant breakthroughs i...

  • Article
  • Open Access
1,111 Views
14 Pages

The objective of this study is to verify the usability of gesture interactions such as tilting or shaking, rather than conventional touch gestures, on mobile devices. To this end, a prototype was developed that manipulates the text size in a mobile t...

  • Article
  • Open Access
65 Citations
13,797 Views
19 Pages

Dynamic Hand Gesture Recognition Using 3DCNN and LSTM with FSM Context-Aware Model

  • Noorkholis Luthfil Hakim,
  • Timothy K. Shih,
  • Sandeli Priyanwada Kasthuri Arachchi,
  • Wisnu Aditya,
  • Yi-Cheng Chen and
  • Chih-Yang Lin

9 December 2019

With the recent growth of Smart TV technology, the demand for unique and beneficial applications motivates the study of a unique gesture-based system for a smart TV-like environment. Combining movie recommendation, social media platform, call a frien...

  • Article
  • Open Access
13 Citations
4,978 Views
18 Pages

Real-Time Monocular Skeleton-Based Hand Gesture Recognition Using 3D-Jointsformer

  • Enmin Zhong,
  • Carlos R. del-Blanco,
  • Daniel Berjón,
  • Fernando Jaureguizar and
  • Narciso García

10 August 2023

Automatic hand gesture recognition in video sequences has widespread applications, ranging from home automation to sign language interpretation and clinical operations. The primary challenge lies in achieving real-time recognition while managing temp...

  • Article
  • Open Access
2 Citations
3,165 Views
23 Pages

24 January 2025

Manually crafted features often suffer from being subjective, having an inadequate accuracy, or lacking in robustness in recognition. Meanwhile, existing deep learning methods often overlook the structural and dynamic characteristics of the human han...

  • Article
  • Open Access
25 Citations
7,859 Views
16 Pages

If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a...

  • Article
  • Open Access
8 Citations
3,648 Views
17 Pages

With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a lo...

of 8