Skip to Content

485 Results Found

  • Article
  • Open Access
4 Citations
4,538 Views
17 Pages

24 January 2025

Unlike traditional remote control systems for controlling unmanned aerial vehicles (UAVs) and drones, active research is being carried out in the domain of vision-based hand gesture recognition systems for drone control. However, contrary to static a...

  • Article
  • Open Access
18 Citations
4,973 Views
13 Pages

Multimodal Fusion of Voice and Gesture Data for UAV Control

  • Xiaojia Xiang,
  • Qin Tan,
  • Han Zhou,
  • Dengqing Tang and
  • Jun Lai

11 August 2022

To enable unmanned aerial vehicle (UAV) operators to efficiently and intuitively convey their commands to a swarm of UAVs, we propose the use of natural and human-centric input modalities, such as voices and gestures. This paper addresses the fusion...

  • Article
  • Open Access
5 Citations
4,632 Views
15 Pages

7 November 2024

Recent progress in hand gesture recognition has introduced several natural and intuitive approaches to drone control. However, effectively maneuvering drones in complex environments remains challenging. Drone movements are governed by four independen...

  • Article
  • Open Access
1 Citations
1,073 Views
17 Pages

Research on Deep Learning-Based Human–Robot Static/Dynamic Gesture-Driven Control Framework

  • Gong Zhang,
  • Jiahong Su,
  • Shuzhong Zhang,
  • Jianzheng Qi,
  • Zhicheng Hou and
  • Qunxu Lin

25 November 2025

For human–robot gesture-driven control, this paper proposes a deep learning-based approach that employs both static and dynamic gestures to drive and control robots for object-grasping and delivery tasks. The method utilizes two-dimensional Con...

  • Article
  • Open Access
8 Citations
2,672 Views
35 Pages

9 June 2023

Gesture recognition is a mechanism by which a system recognizes an expressive and purposeful action made by a user’s body. Hand-gesture recognition (HGR) is a staple piece of gesture-recognition literature and has been keenly researched over th...

  • Article
  • Open Access
606 Views
27 Pages

Aerokinesis: An IoT-Based Vision-Driven Gesture Control System for Quadcopter Navigation Using Deep Learning and ROS2

  • Sergei Kondratev,
  • Yulia Dyrchenkova,
  • Georgiy Nikitin,
  • Leonid Voskov,
  • Vladimir Pikalov and
  • Victor Meshcheryakov

This paper presents Aerokinesis, an IoT-based software–hardware system for intuitive gesture-driven control of quadcopter unmanned aerial vehicles (UAVs), developed within the Robot Operating System 2 (ROS2) framework. The proposed system addre...

  • Article
  • Open Access
12 Citations
4,220 Views
19 Pages

29 November 2022

This research intends to understand whether users would adopt the interactive interface of hand gesture recognition for XRSPACE MANOVA in the virtual-reality environment. Different from the traditional joystick control and external sensors, XRSPACE M...

  • Article
  • Open Access
4 Citations
4,414 Views
25 Pages

21 October 2021

Assistive technologies (ATs) often have a high-dimensionality of possible movements (e.g., assistive robot with several degrees of freedom or a computer), but the users have to control them with low-dimensionality sensors and interfaces (e.g., switch...

  • Article
  • Open Access
1 Citations
1,332 Views
19 Pages

2 October 2025

Unlike traditional control systems that rely on physical input devices, facial gesture-based interaction offers a contactless and intuitive method for operating autonomous systems. Recent advances in computer vision and deep learning have enabled the...

  • Proceeding Paper
  • Open Access
1 Citations
3,103 Views
5 Pages

This paper details the development of an e-textile gesture controller using screen-printed electrodes to measure Electromyography (EMG); the electrical signals produced in a muscle during its use. The final e-textile consists of 7 fabric electrodes a...

  • Article
  • Open Access
1 Citations
3,758 Views
22 Pages

Enhancing Drone Navigation and Control: Gesture-Based Piloting, Obstacle Avoidance, and 3D Trajectory Mapping

  • Ben Taylor,
  • Mathew Allen,
  • Preston Henson,
  • Xu Gao,
  • Haroon Malik and
  • Pingping Zhu

30 June 2025

Autonomous drone navigation presents challenges for users unfamiliar with manual flight controls, increasing the risk of collisions. This research addresses this issue by developing a multifunctional drone control system that integrates hand gesture...

  • Article
  • Open Access
3,952 Views
26 Pages

10 October 2025

This paper outlines the process of developing a low-cost system for home appliance control via real-time hand gesture classification using Computer Vision and a custom lightweight machine learning model. This system strives to enable those with speec...

  • Feature Paper
  • Article
  • Open Access
2 Citations
1,314 Views
23 Pages

9 September 2025

Many gesture recognition systems with innovative interfaces have emerged for smart home control. However, these systems tend to be energy-intensive, bulky, and expensive. There is also a lack of real-time demonstrations of gesture recognition and sub...

  • Article
  • Open Access
1,479 Views
18 Pages

12 September 2024

The body tracking systems on the current market offer a wide range of options for tracking the movements of objects, people, or extremities. The precision of this technology is often limited and determines its field of application. This work aimed to...

  • Article
  • Open Access
23 Citations
6,300 Views
18 Pages

Accurate and real-time gesture recognition is required for the autonomous operation of prosthetic hand devices. This study employs a convolutional neural network-enhanced channel attention (CNN-ECA) model to provide a unique approach for surface elec...

  • Article
  • Open Access
52 Citations
11,834 Views
25 Pages

8 January 2015

Vision-based hand gesture interactions are natural and intuitive when interacting with computers, since we naturally exploit gestures to communicate with other people. However, it is agreed that users suffer from discomfort and fatigue when using ges...

  • Article
  • Open Access
1,117 Views
21 Pages

28 August 2025

Generating realistic and contextually appropriate gestures is crucial for creating engaging embodied conversational agents. Although speech is the primary input for gesture generation, adding controls like gesture velocity, hand height, and emotion i...

  • Article
  • Open Access
1 Citations
363 Views
19 Pages

Bio-Adaptive Robot Control: Integrating Biometric Feedback and Gesture-Based Interfaces for Intuitive Human–Robot Interaction (HRI)

  • Antonio Di Tecco,
  • Daniele Leonardis,
  • Edoardo Ragusa,
  • Antonio Frisoli and
  • Claudio Loconsole

17 February 2026

AI-driven assistance can help the user perform complex teleoperated tasks, introduce autonomous patterns, or adapt the workbench to objects of interest. On the other hand, the level of assistance should be responsive to the user’s response and...

  • Article
  • Open Access
51 Citations
15,991 Views
16 Pages

4 May 2012

An ultimate goal for Ubiquitous Computing is to enable people to interact with the surrounding electrical devices using their habitual body gestures as they communicate with each other. The feasibility of such an idea is demonstrated through a wearab...

  • Article
  • Open Access
28 Citations
9,472 Views
18 Pages

Authorized Traffic Controller Hand Gesture Recognition for Situation-Aware Autonomous Driving

  • Ashutosh Mishra,
  • Jinhyuk Kim,
  • Jaekwang Cha,
  • Dohyun Kim and
  • Shiho Kim

27 November 2021

An authorized traffic controller (ATC) has the highest priority for direct road traffic. In some irregular situations, the ATC supersedes other traffic control. Human drivers indigenously understand such situations and tend to follow the ATC; however...

  • Article
  • Open Access
7 Citations
3,861 Views
18 Pages

An Investigation of Hand Gestures for Controlling Video Games in a Rehabilitation Exergame System

  • Radhiatul Husna,
  • Komang Candra Brata,
  • Irin Tri Anggraini,
  • Nobuo Funabiki,
  • Alfiandi Aulia Rahmadani and
  • Chih-Peng Fan

15 January 2025

Musculoskeletal disorders (MSDs) can significantly impact individuals’ quality of life (QoL), often requiring effective rehabilitation strategies to promote recovery. However, traditional rehabilitation methods can be expensive and may lack eng...

  • Article
  • Open Access
27 Citations
10,983 Views
16 Pages

Finger-Gesture Controlled Wheelchair with Enabling IoT

  • Muhammad Sheikh Sadi,
  • Mohammed Alotaibi,
  • Md. Repon Islam,
  • Md. Saiful Islam,
  • Tareq Alhmiedat and
  • Zaid Bassfar

11 November 2022

Modern wheelchairs, with advanced and robotic technologies, could not reach the life of millions of disabled people due to their high costs, technical limitations, and safety issues. This paper proposes a gesture-controlled smart wheelchair system wi...

  • Article
  • Open Access
2 Citations
4,251 Views
15 Pages

25 February 2025

In this study, we present a gesture-controlled robotic arm system for small assembly lines. Robotic arms are extensively used in industrial applications; however, they typically require special treatment and qualified personnel to set up and operate...

  • Article
  • Open Access
2 Citations
3,858 Views
19 Pages

Remote Control Device to Drive the Arm Gestures of an Assistant Humanoid Robot

  • Elena Rubies,
  • Ricard Bitriá,
  • Eduard Clotet and
  • Jordi Palacín

9 October 2023

This work presents a remote control device designed to drive the arm gestures of an assistant humanoid mobile robot. The remote control is a master device with two passive arms configured to replicate the four degrees of freedom of each arm of the or...

  • Article
  • Open Access
5 Citations
5,143 Views
18 Pages

A Gesture-Controlled Rehabilitation Robot to Improve Engagement and Quantify Movement Performance

  • Ava D. Segal,
  • Mark C. Lesak,
  • Anne K. Silverman and
  • Andrew J. Petruska

31 July 2020

Rehabilitation requires repetitive and coordinated movements for effective treatment, which are contingent on patient compliance and motivation. However, the monotony, intensity, and expense of most therapy routines do not promote engagement. Gesture...

  • Article
  • Open Access
54 Citations
8,723 Views
15 Pages

Industrial Robot Control by Means of Gestures and Voice Commands in Off-Line and On-Line Mode

  • Wojciech Kaczmarek,
  • Jarosław Panasiuk,
  • Szymon Borys and
  • Patryk Banach

7 November 2020

The paper presents the possibility of using the Kinect v2 module to control an industrial robot by means of gestures and voice commands. It describes the elements of creating software for off-line and on-line robot control. The application for the Ki...

  • Article
  • Open Access
157 Views
36 Pages

8 March 2026

Predefined, user-independent gesture sets do not account for individual differences in movement patterns and physical limitations. This study presents a personalized wrist–forearm static gesture recognition system for human–computer inter...

  • Article
  • Open Access
47 Citations
11,474 Views
17 Pages

8 April 2020

Dynamic hand gesture recognition is one of the most significant tools for human–computer interaction. In order to improve the accuracy of the dynamic hand gesture recognition, in this paper, a two-layer Bidirectional Recurrent Neural Network fo...

  • Article
  • Open Access
963 Views
19 Pages

GECO: A Real-Time Computer Vision-Assisted Gesture Controller for Advanced IoT Home System

  • Murilo C. Lopes,
  • Paula A. Silva,
  • Ludwing Marenco,
  • Evandro C. Vilas Boas,
  • João G. A. de Carvalho,
  • Cristiane A. Ferreira,
  • André L. O. Carvalho,
  • Cristiani V. R. Guimarães,
  • Guilherme P. Aquino and
  • Felipe A. P. de Figueiredo

21 December 2025

This paper introduces GECO, a real-time, computer vision-assisted gesture controller for IoT-based smart home systems. The platform uses a markerless MediaPipe interface that combines gesture-driven navigation and command execution, enabling intuitiv...

  • Proceeding Paper
  • Open Access
324 Views
5 Pages

Gesture-Controlled Bionic Hand for Safe Handling of Biomedical Industrial Chemicals

  • Sudarsun Gopinath,
  • Glen Nitish,
  • Daniel Ford,
  • Thiyam Deepa Beeta and
  • Shelishiyah Raymond

7 November 2025

In pharmaceutical and biomedical industries, manual handling of dangerous chemicals is a leading cause of hazardous exposure to chemicals, toxic burning, and chemical contamination. To counteract these risks, we proposed a gesture-controlled bionic h...

  • Article
  • Open Access
16 Citations
4,003 Views
18 Pages

16 July 2024

This paper presents a gesture-controlled robotic arm system designed for agricultural harvesting, utilizing a data glove equipped with bending sensors and OptiTrack systems. The system aims to address the challenges of labor-intensive fruit harvestin...

  • Article
  • Open Access
2 Citations
1,697 Views
17 Pages

A Symmetrical Leech-Inspired Soft Crawling Robot Based on Gesture Control

  • Jiabiao Li,
  • Ruiheng Liu,
  • Tianyu Zhang and
  • Jianbin Liu

This paper presents a novel soft crawling robot controlled by gesture recognition, aimed at enhancing the operability and adaptability of soft robots through natural human–computer interactions. The Leap Motion sensor is employed to capture han...

  • Article
  • Open Access
3 Citations
5,510 Views
35 Pages

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

  • Alexandre Clément,
  • Luciano Moreira,
  • Miriam Rosa and
  • Gilberto Bernardes

Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed th...

  • Article
  • Open Access
2,020 Views
30 Pages

Controlling Industrial Robotic Arms Using Gyroscopic and Gesture Inputs from a Smartwatch

  • Carmen-Cristiana Cazacu,
  • Mihail Hanga,
  • Florina Chiscop,
  • Dragos-Alexandru Cazacu and
  • Costel Emil Cotet

25 July 2025

This paper presents a novel interface that leverages a smartwatch for controlling industrial robotic arms. By harnessing the gyroscope and advanced gesture recognition capabilities of the smartwatch, our solution facilitates intuitive, real-time mani...

  • Brief Report
  • Open Access
7 Citations
4,358 Views
13 Pages

Analysis of the Leap Motion Controller Workspace for HRI Gesture Applications

  • Michal Tölgyessy,
  • Martin Dekan,
  • Jozef Rodina and
  • František Duchoň

5 January 2023

The Leap Motion Controller is a sensor for precise hand tracking; it is a device used for human interaction with computer systems via gestures. The study presented in this paper evaluates its workspace in real-world conditions. An exact replica of a...

  • Article
  • Open Access
1,727 Views
26 Pages

27 July 2025

Manual assembly remains essential in modern manufacturing, yet the increasing complexity of customised production imposes significant cognitive burdens and error rates on workers. Existing Spatial Augmented Reality (SAR) systems often operate passive...

  • Article
  • Open Access
1 Citations
1,755 Views
15 Pages

24 July 2025

The increasing integration of 3D technologies and machine learning is fundamentally reshaping mineral sciences and cultural heritage, establishing the foundation for an emerging “Mineralogy 4.0” framework. However, public engagement with...

  • Article
  • Open Access
6 Citations
4,374 Views
23 Pages

Using Gesture Recognition for AGV Control: Preliminary Research

  • Sebastian Budzan,
  • Roman Wyżgolik,
  • Marek Kciuk,
  • Krystian Kulik,
  • Radosław Masłowski,
  • Wojciech Ptasiński,
  • Oskar Szkurłat,
  • Mateusz Szwedka and
  • Łukasz Woźniak

14 March 2023

In this paper, we present our investigation of the 2D Hand Gesture Recognition (HGR) which may be suitable for the control of the Automated Guided Vehicle (AGV). In real conditions, we deal with, among others, a complex background, changing lighting...

  • Article
  • Open Access
8 Citations
4,634 Views
17 Pages

The continuous advancement of electronic technology has led to the gradual integration of automated intelligent devices into various aspects of human life. Motion gesture-based human–computer interaction systems offer abundant information, user...

  • Article
  • Open Access
22 Citations
7,888 Views
22 Pages

Touchless, mid-air gesture-based interactions with remote devices have been investigated as alternative or complementary to interactions based on remote controls and smartphones. Related studies focus on user elicitation of a gesture vocabulary for o...

  • Article
  • Open Access
8 Citations
7,383 Views
25 Pages

Control and Guidance of Low-Cost Robots via Gesture Perception for Monitoring Activities in the Home

  • Angel D. Sempere,
  • Arturo Serna-Leon,
  • Pablo Gil,
  • Santiago Puente and
  • Fernando Torres

11 December 2015

This paper describes the development of a low-cost mini-robot that is controlled by visual gestures. The prototype allows a person with disabilities to perform visual inspections indoors and in domestic spaces. Such a device could be used as the oper...

  • Article
  • Open Access
3,020 Views
18 Pages

Assessment of Gesture Accuracy for a Multi-Electrode EMG-Sensor-Array-Based Prosthesis Control System

  • Vinod Sharma,
  • Erik Lloyd,
  • Mike Faltys,
  • Max Ortiz-Catalan and
  • Connor Glass

Background: Upper limb loss significantly impacts quality of life, and whereas myoelectric prostheses restore some function, conventional surface electromyography (sEMG) systems face challenges like poor signal quality, high cognitive burden, and sub...

  • Article
  • Open Access
242 Views
15 Pages

Objective: Pulmonary segmentectomy serves as a crucial approach for treating early-stage lung cancer. However, this procedure demands precise identification of segmental anatomy, and surgeons often need to repeatedly consult the patient’s 3D im...

  • Article
  • Open Access
8 Citations
9,189 Views
23 Pages

Inertial Sensor-Based Touch and Shake Metaphor for Expressive Control of 3D Virtual Avatars

  • Shashidhar Patil,
  • Harinadha Reddy Chintalapalli,
  • Dubeom Kim and
  • Youngho Chai

18 June 2015

In this paper, we present an inertial sensor-based touch and shake metaphor for expressive control of a 3D virtual avatar in a virtual environment. An intuitive six degrees-of-freedom wireless inertial motion sensor is used as a gesture and motion c...

  • Article
  • Open Access
11 Citations
5,538 Views
16 Pages

Autonomous Human-Vehicle Leader-Follower Control Using Deep-Learning-Driven Gesture Recognition

  • Joseph Schulte,
  • Mark Kocherovsky,
  • Nicholas Paul,
  • Mitchell Pleune and
  • Chan-Jin Chung

9 March 2022

Leader-follower autonomy (LFA) systems have so far only focused on vehicles following other vehicles. Though there have been several decades of research into this topic, there has not yet been any work on human-vehicle leader-follower systems in the...

  • Article
  • Open Access
4 Citations
2,671 Views
16 Pages

14 August 2023

This study proposes a telemanipulation framework with two wearable IMU sensors without human skeletal kinematics. First, the states (intensity and direction) of spatial hand-guiding gestures are separately estimated through the proposed state estimat...

  • Article
  • Open Access
1 Citations
2,827 Views
21 Pages

A Novel Gesture-Based Control System for Fluorescence Volumetric Data in Virtual Reality

  • Vratislav Cmiel,
  • Larisa Chmelikova,
  • Inna Zumberg and
  • Martin Kralik

13 December 2021

With the development of light microscopy, it is becoming increasingly easy to obtain detailed multicolor fluorescence volumetric data. The need for their appropriate visualization has become an integral part of fluorescence imaging. Virtual reality (...

  • Feature Paper
  • Article
  • Open Access
24 Citations
17,431 Views
26 Pages

Drone Control in AR: An Intuitive System for Single-Handed Gesture Control, Drone Tracking, and Contextualized Camera Feed Visualization in Augmented Reality

  • Konstantinos Konstantoudakis,
  • Kyriaki Christaki,
  • Dimitrios Tsiakmakis,
  • Dimitrios Sainidis,
  • Georgios Albanis,
  • Anastasios Dimou and
  • Petros Daras

10 February 2022

Traditional drone handheld remote controllers, although well-established and widely used, are not a particularly intuitive control method. At the same time, drone pilots normally watch the drone video feed on a smartphone or another small screen atta...

  • Article
  • Open Access
37 Citations
7,889 Views
14 Pages

Hand Gesture Recognition Using Single Patchable Six-Axis Inertial Measurement Unit via Recurrent Neural Networks

  • Edwin Valarezo Añazco,
  • Seung Ju Han,
  • Kangil Kim,
  • Patricio Rivera Lopez,
  • Tae-Seong Kim and
  • Sangmin Lee

17 February 2021

Recording human gestures from a wearable sensor produces valuable information to implement control gestures or in healthcare services. The wearable sensor is required to be small and easily worn. Advances in miniaturized sensor and materials research...

  • Article
  • Open Access
6 Citations
3,257 Views
28 Pages

Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control

  • Branislav Malobický,
  • Marián Hruboš,
  • Júlia Kafková,
  • Jakub Krško,
  • Mário Michálik,
  • Rastislav Pirník and
  • Pavol Kuchár

25 March 2025

This paper presents the development of a robotic workstation that integrates a collaborative robot as an assistant, leveraging advanced computer vision techniques to enhance human–robot interaction. The system employs state-of-the-art computer...

of 10