Vision-based motion estimation for structural systems has attracted significant interest in recent years. As the design of robust algorithms to accurately estimate motion still represents a challenge, a multi-step framework is proposed to deal with b...
The capability of landing on previously unvisited areas is a fundamental challenge for an unmanned aerial vehicle (UAV). In this paper, we developed a vision-based motion estimation as an aid to improve landing performance. As an alternative to the c...
Event-based vision sensors offer microsecond temporal resolution and low power consumption, making them attractive for edge robotics and simultaneous localization and mapping (SLAM). Contrast maximization (CMAX) is a widely used direct geometric fram...
Contrast maximization (CMax) is a framework that provides state-of-the-art results on several event-based computer vision tasks, such as ego-motion or optical flow estimation. However, it may suffer from a problem called event collapse, which is an u...
Estimating the relative position and velocity of micro aerial vehicles (MAVs) using visual signals is a critical issue in numerous tasks. However, traditional relative motion estimation algorithms suffer severely from non-Gaussian noise interference...
Vision-based human motion assessment requires a model to capture both temporal execution patterns and context-dependent quality criteria. This problem is particularly challenging in multi-style dance, where similar kinematic patterns may receive diff...
Motion capture systems are crucial in developing multi-quadrotor systems due to their ability to provide fast and accurate ground truth measurements for tracking and control. This paper presents the implementation details and experimental validation...
Dynamic objects present a major challenge for visual simultaneous localization and mapping (Visual SLAM), as feature measurements originating from moving regions can corrupt camera pose estimation and lead to inaccurate maps. In this paper, we propos...
As an alternative to traditional remote controller, research on vision-based hand gesture recognition is being actively conducted in the field of interaction between human and unmanned aerial vehicle (UAV). However, vision-based gesture system has a...
The vast increase in the available computational capability has allowed the application of Particle-Filter (PF)-based approaches for monocular 3D-model-based tracking. These filters depend on the computation of a likelihood function that is usually u...
Paralympic water polo requires classification systems that reflect sport-specific functional performance under ecologically valid conditions. This pilot study proposes a task-specific kinematic profiling framework for deriving objective, biomechanica...
Due to the slender geometry and low-amplitude vibrations of stayed cables, existing vision-based methods often fail to accurately identify their full-field dynamic parameters, especially the higher-order modes. This paper proposes a novel holographic...
This work describes the development of a vision-based tactile sensor system that utilizes the image-based information of the tactile sensor in conjunction with input loads at various motions to train the neural network for the estimation of tactile c...
This paper introduces the improvements in natural-frequency-based SHM by applying bio-inspired optimization methods and a vision-based monitoring system for effective damage detection. This paper proposes a natural frequency extraction method using a...
Heart rate has been measured comfortably using a camera without the skin-contact by the development of vision-based measurement. Despite the potential of the vision-based measurement, it has still presented limited ability due to the noise of illumin...
The capture of a target spacecraft by a chaser is an on-orbit docking operation that requires an accurate, reliable, and robust object recognition algorithm. Vision-based guided spacecraft relative motion during close-proximity maneuvers has been con...
Ensuring the safety and reliability of freight wagons requires continuous monitoring of couplings such as hooks and buffers, which are prone to stress, wear, and misalignments. This paper proposes a vision-based 3D monitoring system which uses an RGB...
Accurate assessment of joint kinematics is fundamental to biomechanics, rehabilitation, and sports science. Although optical motion capture (OMC) remains the laboratory reference standard for biomechanical validation, its cost, infrastructure require...
Estimating human joint angles is a crucial task in motion analysis, gesture recognition, and motion intention prediction. This paper presents a novel model-based approach for generating reliable and accurate human joint angle estimation using a dual-...
This paper proposes an adaptive Kalman filter (AKF) to improve the performance of a vision-based human machine interface (HMI) applied to a video game. The HMI identifies head gestures and decodes them into corresponding commands. Face detection and...
Real-time and drift-free state estimation is essential for the flight control of Micro Aerial Vehicles (MAVs). Due to the vibration caused by the particular flapping motion and the stringent constraints of scale, weight, and power, state estimation d...
The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomo...
This paper investigates the problem of using an unmanned aerial vehicle (UAV) to track and hover above an uncooperative target, such as an unvisited area or an object that is newly discovered. A vision-based strategy integrating the metrology and the...
The problem of vision-based fixed-wing UAV formation control under communication limitations and the presence of measurement errors was investigated. In the first part of this paper, the single UAV motion model and the process of estimating the neigh...
This work introduces a comprehensive vision-based framework for autonomous space debris removal using robotic manipulators. A real-time debris detection module is built upon the YOLOv8 architecture, ensuring reliable target localization under varying...
The assessment of physical quantity values, especially in case of sports-related activities, is critical to evaluate the performance and fitness level of athletes. In real-world applications, motion analysis tools are often employed to assess motor p...
The Smartphone Video Guidance Sensor (SVGS) is a vision-based sensor that computes the six-state position and orientation vector of a target relative to a coordinate system attached to a smartphone. This paper presents accuracy-characterization measu...
To obtain accurate position information, herein, a one-assistant method involving the fusion of extreme learning machine (ELM)/finite impulse response (FIR) filters and vision data is proposed for inertial navigation system (INS)-based human motion c...
Occupancy grid map is a popular tool for representing the surrounding environments of mobile robots/intelligent vehicles. Its applications can be dated back to the 1980s, when researchers utilized sonar or LiDAR to illustrate environments by occupanc...
The Bearing–Angle algorithm effectively improves the observability of vision-based motion estimation for moving targets by combining the dimensional information of target detection frames. However, the robustness of this algorithm will be signi...
Vision-based motion estimation is an effective means for mobile robot localization and is often used in conjunction with other sensors for navigation and path planning. This paper presents a low-overhead real-time ego-motion estimation (visual odomet...
Advances in robotic technology for hand rehabilitation, particularly soft robotic gloves, have significant potential to improve patient outcomes. While vision-based algorithms pave the way for fast and convenient hand pose estimation, most current mo...
Drone target tracking, which involves instructing drone movement to follow a moving target, encounters several challenges: (1) traditional methods need accurate state estimation of both the drone and target; (2) conventional Proportional–Deriva...
Investigating aircraft flight dynamics often requires dynamic wind tunnel testing. This paper proposes a non-contact, off-board instrumentation method using vision-based techniques. The method utilises a sequential process of Harris corner detection,...
High-quality cardiopulmonary resuscitation (CPR) aims at saving lives in time-critical emergencies, which requires correct compression rate, depth, and hand placement. However, due to the high cost and environmental constraints of sensor-equipped man...
This paper presents the first demonstration of NASA’s Smartphone Video Guidance Sensor (SVGS) as real-time position and attitude estimator for proximity and formation maneuvers. An optimal linear quadratic Gaussian controller was used, combinin...
Reliable autonomy for drones operating in GNSS-intermittent or denied environments requires both stable inter-vehicle coordination and a shared global understanding of the environment. This paper presents a unified vision-based framework in which UAV...
Rapid seismic intensity estimation supports situational awareness, emergency response, and the assessment of earthquake-induced structural risk. Instrument-based systems provide authoritative measurements, but limited deployment density and installat...
One of the important image processing technologies is visual odometry (VO) technology. VO estimates platform motion through a sequence of images. VO is of interest in the virtual reality (VR) industry as well as the automobile industry because the co...
To increase the utility of legacy, gold-standard, three-dimensional (3D) motion capture datasets for computer vision-based machine learning applications, this study proposed and validated a method to synthesise two-dimensional (2D) video image frames...
Unmanned aerial vehicles (UAVs) are vital for surveillance missions requiring the geolocation of moving ground targets, yet small, resource-constrained platforms often lack integrated, robust systems that can handle disturbances such as wind, occlusi...
Vision-based 3D sensing provides an effective approach for constructing human-centric digital twins in applications such as ergonomic assessment and human–robot collaboration. However, reconstructing reliable dynamic human digital twins from vi...
Object recognition, localization, and tracking play a role of primordial importance in computer vision applications. However, it is still an extremely difficult task, particularly in scenarios where objects are attended to using fast-moving UAVs that...
Accurate relative pose estimation between unmanned aerial vehicles (UAVs) is a key requirement for cooperative navigation, formation control, and swarm operation in GNSS-denied environments. In multi-UAV systems, monocular vision is attractive due to...
The motion capture method using sparse inertial sensors is an approach for solving the occlusion and economic problems in vision-based methods, which is suitable for virtual reality applications and works in complex environments. However, VR applicat...
Newtonian reaction to blood influx into the head at each heartbeat causes subtle head motion at the same frequency as the heartbeats. Thus, this head motion can be used to estimate the heart rate. Several studies have shown that heart rates can be me...
Vision-based pose estimation is an important application of machine vision. Currently, analytical and iterative methods are used to solve the object pose. The analytical solutions generally take less computation time. However, the analytical solution...
With the global increase in maritime activities, the frequency of maritime accidents has risen, underscoring the urgent need for faster and more efficient search and rescue (SAR) solutions. This study presents an intelligent unmanned aerial vehicle (...
This paper introduces a vision-based target recognition and positioning system for UAV mobile landing scenarios, addressing challenges such as target occlusion due to shadows and the loss of the field of view. A novel image preprocessing technique is...
Optical flow is a vision-based approach that is used for tracking the movement of objects. This robust technique can be an effective tool for determining the source of failures on slope surfaces, including the dynamic behavior of rockfall. However, o...
of 6