Search Results (47)

Stable three-dimensional hand landmark reconstruction using low-cost RGB-D sensors is important for human–computer interaction, robot teleoperation, and vision-based motion analysis. RGB-based hand landmark detectors provide stable semantic 2D landmarks, but their depth output is not a metric measurement in the physical camera coordinate system. Stereo cameras can provide metric depth, but direct landmark-level back-projection is sensitive to invalid pixels, local depth holes, boundary noise, and partial occlusion. To address these problems, this paper presents a lightweight RGB-D sensing front-end that combines MediaPipe semantic hand landmarks with ZED2 stereo depth. The proposed pipeline detects 21 semantic hand landmarks in the RGB image, obtains landmark-level metric depth from the aligned ZED2 depth map using local median sampling, reconstructs 3D landmarks by camera back-projection, and further applies exponential moving average filtering and a bone-length consistency constraint. Experiments were conducted on a self-collected SVO dataset containing 13 hand actions and 26 recorded sequences, and an additional checkerboard-based reference-distance validation was performed to evaluate the metric depth sampling and 3D back-projection component. Compared with single-pixel sampling, the $5\times 5$ local median strategy slightly increased the valid-depth ratio from 0.9731 to 0.9738 and reduced the temporal smoothness metric from 1.7163 mm to 1.6902 mm. To further justify the temporal filtering choice, an additional comparison with the 1 Euro Filter was conducted using the reconstructed win5 trajectories. The 1 Euro Filter produced stronger smoothing, reducing the temporal smoothness metric to 0.196 mm, but also reduced the path-length ratio to 0.484, indicating substantial motion attenuation. EMA0.7 was therefore retained as a more balanced setting, reducing the temporal smoothness metric to 0.826 mm while maintaining a path-length ratio of 0.803. The BL0.5 bone-length constraint reduced the bone-length standard deviation from 2.0727 mm to 1.1995 mm with limited trajectory modification. The final configuration provides a practical low-cost RGB-D front-end for stable 3D hand landmark reconstruction under controlled indoor conditions. Full article

Traditional visual Simultaneous Localization and Mapping (SLAM) systems achieve high accuracy in static environments. However, in indoor dynamic scenes with frequent object motions, the presence of moving objects severely violates the scene rigidity assumption, often leading to significant performance degradation and tracking instability. To explicitly address this challenge, this paper introduces LIG-SLAM, a resource-efficient visual SLAM solution that extends the ORB-SLAM3 architecture. By incorporating dynamic object perception and geometric constraints, the system achieves robust localization in dynamic indoor environments, while its inference efficiency is significantly enhanced through targeted optimization. Specifically, a YOLOv5-based instance segmentation network is employed to obtain pixel-level segmentation of dynamic regions. To mitigate the erroneous rejection of static feature points, epipolar geometric constraints are incorporated to improve the accuracy of dynamic feature selection. Furthermore, a RANSAC-based depth consistency check is adopted to further enhance accuracy and alleviate the effects of epipolar degeneracy. Unlike conventional semantic SLAM frameworks, the proposed system incorporates ONNX-based optimization, thereby accelerating inference and improving real-time performance. Empirical evaluations conducted on TUM dynamic datasets indicate that the developed approach surpasses ORB-SLAM3 by a substantial margin, achieving a reduction of over 90% in terms of the Absolute Trajectory Error (ATE). Compared with existing semantic SLAM approaches, it achieves improvements in both accuracy and real-time performance, particularly in challenging indoor dynamic scenarios. Full article

Dynamic wireless power transfer (DWPT) has attracted significant interest due to its ability to transfer power to moving electric vehicles. Most existing DWPT research focuses on vehicles traveling along fixed paths. However, modern warehouses increasingly employ indoor electric vehicles (IEVs), such as autonomous mobile robots, that move along non-fixed paths. Although several solutions have been proposed for large-area DWPT systems applicable to IEVs with non-fixed trajectories, these approaches are predominantly based on inductive DWPT. Such systems require a large number of densely arranged transmitting coils and expensive ferrite pads, resulting in high system cost. To the authors’ best knowledge, no published work has addressed large-area capacitive DWPT systems for IEVs moving along non-fixed paths. This paper aims to fill this research gap. The main novelty of this work is the first proposal of a capacitive DWPT system for lightweight IEVs operating along non-fixed paths. The feasibility of the proposed solution is validated through simulation studies conducted in PSIM. The simulation results demonstrate that the proposed DWPT system, employing an advanced transmitting-metal-plate activation strategy, can maintain an almost constant mutual capacitance, thereby ensuring a smooth output voltage at the receiving side for a moving IEV. Full article

An ultra-wideband (UWB) Anchor–Tag commercial sensor system used for positioning is characterized herein, against an image-processing based positioning system used as a ground truth. The UWB consists of a single anchor that measures the angle of arrival (AoA) and distance to the moving tag. The driftless camera-based positioning system requires a series of complex operations, among camera calibration, image processing and network transmission delay estimation, and time alignment with the analyzed UWB measurement system. For the UWB system, the accuracy, precision, resolution, covered area, and error-vs-distance dependence are measured on several collected trajectories, both stationary and in motion. Several filtering solutions are proposed to improve these metrics that are affected by some faulty measurements, to subsequently validate the overall performance. The condition monitoring is verified both in offline and in online processing modes, using these filtering solutions. Our approach is black-box and does not use additional information except for raw position data. The importance and feasibility of UWB systems for indoor or outdoor localization is demonstrated, as well as some caveats and possible mitigation strategies. Full article

Accurate extrinsic calibration between radar and camera sensors is essential for reliable multi-modal perception in robotics and autonomous navigation. Traditional calibration methods often rely on artificial targets such as checkerboards or corner reflectors, which can be impractical in dynamic or large-scale environments. This study presents a fully targetless calibration framework that estimates the rigid spatial transformation between radar and camera coordinate frames by aligning their observed trajectories of a moving object. The proposed method integrates You Only Look Once version 5 (YOLOv5)-based 3D object localization for the camera stream with Density-Based Spatial Clustering of Applications with Noise (DBSCAN) and Random Sample Consensus (RANSAC) filtering for sparse and noisy radar measurements. A passive temporal synchronization technique, based on Root Mean Square Error (RMSE) minimization, corrects timestamp offsets without requiring hardware triggers. Rigid transformation parameters are computed using Kabsch and Umeyama algorithms, ensuring robust alignment even under millimeter-wave (mmWave) radar sparsity and measurement bias. The framework is experimentally validated in an indoor OptiTrack-equipped laboratory using a Skydio 2 drone as the dynamic target. Results demonstrate sub-degree rotational accuracy and decimeter-level translational error (approximately 0.12–0.27 m depending on the metric), with successful generalization to unseen motion trajectories. The findings highlight the method’s applicability for real-world autonomous systems requiring practical, markerless multi-sensor calibration. Full article

Indoor air pollution, including fine particulate matter (PM_2.5), poses a severe threat to human health. Due to the diverse sources of indoor PM_2.5 and its high spatial heterogeneity in distribution, traditional single-point fixed monitoring fails to accurately reflect the actual human exposure level. In recent years, the development of high spatiotemporal resolution monitoring technologies has provided a new perspective for revealing the dynamic distribution patterns of indoor PM_2.5. This study discusses two cutting-edge monitoring strategies: (1) mobile monitoring technology based on Indoor Positioning Systems (IPS) and portable sensors, which maps 2D exposure trajectories and concentration fields by having personnel carry sensors while moving; and (2) 3D dynamic monitoring technology based on in situ Lateral Scattering LiDAR (I-LiDAR), which non-intrusively reconstructs the 3D dynamic distribution of PM_2.5 concentrations using laser arrays. This study elaborates on the principles, calibration methods, application cases, advantages, and disadvantages of the two technologies, compares their applicable scenarios, and outlines future research directions in multi-technology integration, intelligent calibration, and public health applications. It aims to provide a theoretical basis and technical reference for the accurate assessment of indoor air quality and the prevention and control of health risks. Full article

Indoor localization of fast-moving targets under asynchronous acoustic sensing is severely constrained by non-line-of-sight (NLOS) propagation and sparse anchor deployments. To overcome these limitations, we propose a trajectory reconstruction-based framework that simultaneously exploits time-of-arrival (ToA) and frequency-of-arrival (FoA) measurements. By embedding temporal continuity and motion dynamics into the localization model, we cast the problem as a constrained nonlinear least squares optimization over the entire trajectory rather than isolated snapshots. To efficiently solve this high-dimensional problem, we design an enhanced particle swarm optimization (PSO) algorithm featuring adaptive phase switching and noise-resilient updates. Simulation results under varying noise conditions show that our method achieves superior accuracy and robustness compared to conventional least squares estimators, especially for high-speed trajectories. Real-world experiments using a passive acoustic testbed further validate the effectiveness of the proposed framework, with over 90% of localization errors confined within 3 m. The method is model-driven, training-free, and scalable to asynchronous and anchor-sparse environments. Full article

This study presents the configuration design and attitude control of a moving-mass coaxial dual-rotor UAV (MMCDRUAV) for indoor applications. Compared with existing configurations, the proposed configuration avoids additional actuation mass and improves the control authority. Based on these improvements, a promising micro UAV platform with a high payload ability for agile indoor flight could be developed. Ground validation tests demonstrated its maneuverability, as provided by a moving-mass control (MMC) module requiring only the repositioning of existing components (e.g., battery packs) as movable masses. For trajectory tracking, an adaptive backstepping active disturbance rejection controller (ADRC) is proposed. The architecture integrates extended-state observers (ESOs) for disturbance estimation, parameter-adaptation laws for uncertainty compensation, and auxiliary systems to address control saturation. Lyapunov stability analysis proved the existence of uniformly ultimately bounded (UUB) closed-loop tracking errors. The results of the ground verification experiment confirmed enhanced tracking performance under real-world disturbances. Full article

Simultaneous Localization and Mapping (SLAM) is a fundamental technique in mobile robotics, enabling autonomous navigation and environmental reconstruction. However, dynamic elements in real-world scenes—such as walking pedestrians, moving vehicles, and swinging doors—often degrade SLAM performance by introducing unreliable features that cause localization errors. In this paper, we define dynamic regions as areas in the scene containing moving objects, and dynamic features as the visual features extracted from these regions that may adversely affect localization accuracy. Inspired by biological perception strategies that integrate semantic awareness and geometric cues, we propose Instance-level Point-Line SLAM (IPL-SLAM), a robust visual SLAM framework for dynamic environments. The system employs YOLOv8-based instance segmentation to detect potential dynamic regions and construct semantic priors, while simultaneously extracting point and line features using Oriented FAST (Features from Accelerated Segment Test) and Rotated BRIEF (Binary Robust Independent Elementary Features), collectively known as ORB, and Line Segment Detector (LSD) algorithms. Motion consistency checks and angular deviation analysis are applied to filter dynamic features, and pose optimization is conducted using an adaptive-weight error function. A static semantic point cloud map is further constructed to enhance scene understanding. Experimental results on the TUM RGB-D dataset demonstrate that IPL-SLAM significantly outperforms existing dynamic SLAM systems—including DS-SLAM and ORB-SLAM2—in terms of trajectory accuracy and robustness in complex indoor environments. Full article

Typical SLAM systems adhere to the assumption of environment rigidity, which limits their functionality when deployed in the dynamic indoor environments commonly encountered by household robots. Prevailing methods address this issue by employing semantic information for the identification and processing of dynamic objects in scenes. However, extracting reliable semantic information remains challenging due to the presence of motion blur. In this paper, a novel visual SLAM algorithm is proposed in which various approaches are integrated to obtain more reliable semantic information, consequently reducing the impact of motion blur on visual SLAM systems. Specifically, to accurately distinguish moving objects and static objects, we introduce a missed segmentation compensation mechanism into our SLAM system for predicting and restoring semantic information, and depth and semantic information is then leveraged to generate masks of dynamic objects. Additionally, to refine keypoint filtering, a probability-based algorithm for dynamic feature detection and elimination is incorporated into our SLAM system. Evaluation experiments using the TUM and Bonn RGB-D datasets demonstrated that our SLAM system achieves lower absolute trajectory error (ATE) than existing systems in different dynamic indoor environments, particularly those with large view angle variations. Our system can be applied to enhance the autonomous navigation and scene understanding capabilities of domestic robots. Full article

Online path planning for UAVs that are following a moving target is a critical component in applications that demand a soft landing over the target. In highly dynamic situations with accelerating targets, the classical potential field (PF) method, which considers only the relative positions and/or velocities, cannot provide precision tracking and landing. Therefore, this work presents an improved acceleration-based potential field (ABPF) path planning method. This approach incorporates the relative accelerations of the UAV and the target in constructing an attractive field. By controlling the acceleration, the ABPF produces smoother trajectories and avoids sudden changes in the UAV’s motion. The proposed approach was implemented in different simulated scenarios with variable acceleration paths (i.e., circular, infinite, and helical). The simulation demonstrated the superiority of the proposed approach over the traditional PF. Moreover, similar path scenarios were experimentally evaluated using a quadrotor UAV in an indoor Vicon positioning system. To provide reliable estimations of the acceleration for the suggested method, a non-linear complementary filter was used to fuse information from the drone’s accelerometer and the Vicon system. The improved PF method was compared to the traditional PF method for each scenario. The results demonstrated a 50% improvement in the position, velocity, and acceleration accuracy across all scenarios. Furthermore, the ABPF responded faster to merging with the target path, with rising times of 1.5, 1.6, and 1.3 s for the circular, infinite, and helical trajectories, respectively. Full article

Underground mining involves numerous risks, such as collapses, gas leaks, and explosions, posing significant threats to worker safety. In this work, we develop an indoor localization system that uses Bluetooth for coarse positioning and ultrasonic arrays for precision calibration. This system is particularly useful for automated mining operations in underground environments where satellite positioning signals are unavailable. The indoor localization system consists of ultrasonic receiver arrays and an improved multi-transmitter-multi-receiver algorithm, enabling accurate localization within the mining environment. Geometric Dilution of Precision (GDOP) analysis is incorporated to optimize the network layout, and an inertial navigation module is integrated to track the posture of moving objects, enabling precise trajectory determination over large areas, such as coal mines. In the experiment, three traditional methods were compared, and the proposed tracking approach demonstrated a positioning accuracy within 10 cm, reducing error by 20% compared to conventional techniques. This high-precision indoor localization method proves beneficial for underground mining applications. Full article

Understanding the feeding behavior of Portunidae crabs with different baits can improve bait selection and is crucial for improving the effectiveness of crab fishing gear. This study, conducted in indoor experimental tanks, used trajectory tracking software and two types of natural baits (mackerel (Scomber australasicus) and squid (Uroteuthis chinensis)) to understand the behavior of Portunus sanguinolentus and Charybdis natator. Spatial distribution results showed that P. sanguinolentus was frequently present in the starting area (S1) and bait area (S3) in the control and treatment groups. However, C. natator was frequently present and concentrated in the S1 area compared to the middle areas S2 and S3, and only in the mackerel treatments were they observed to move to the S3 areas. The spatial distribution results indicate that P. sanguinolentus shows a stronger willingness to explore its surroundings, while C. natator is generally in a stationary, wait-and-see state. The swimming speeds of P. sanguinolentus and C. natator showed different trends. P. sanguinolentus showed continuous movement with no fixed speed when no bait was present in the control groups. However, when treated with mackerel and squid, the average swimming speed of P. sanguinolentus was faster (>5 cm/s) in the first 10 min and showed a more stable movement speed when searching for the baits. C. natator showed a stationary or low movement speed when no bait was present in the control groups. However, when C. natator perceived the presence of the baits in the treatment groups, their movement speed increased in the first 10 min. In addition, there was no significant difference between male and female crabs of P. sanguinolentus and C. natator in movement speed in the control and treatment groups. Compared to C. natator, P. sanguinolentus might be more sensitive to natural baits, as shown by its movement from S1 to S3. The results indicate that the species of Portunidae crabs show different bait selections. Natural baits (mackerel and squid) are recommended for catching P. sanguinolentus in crab fisheries. Full article

Against the backdrop of rapidly advancing Artificial Intelligence of Things (AIOT) and sensing technologies, there is a growing demand for indoor location-based services (LBSs). This paper proposes a through-the-wall localization and tracking (TWPT) system based on an improved ultra-wideband (IR-UWB) radar to achieve more accurate localization of indoor moving targets. The TWPT system overcomes the limitations of traditional localization methods, such as multipath effects and environmental interference, using the high penetration and high accuracy of IR-UWB radar based on multi-sensor fusion technology. In the study, an improved Kalman filter (KF) algorithm is used for clutter reduction, while the CLEAN algorithm, combined with a compensation mechanism, is utilized to increase the target detection probability. Finally, a three-point localization estimation algorithm based on multi-IR-UWB radar is applied for the precise position and trajectory estimation of the target. Experimental validation indicates the TWPT system achieves a high positioning accuracy of 96.91%, with a root mean square error (RMSE) of 0.082 m and a Maximum Position Error (MPE) of 0.259 m. This study provides a highly accurate and precise solution for indoor TWPT based on IR-UWB radar. Full article

In recent years, with the widespread application of indoor inspection robots, high-precision, robust environmental perception has become essential for robotic mapping. Addressing the issues of visual–inertial estimation inaccuracies due to redundant pose degrees of freedom and accelerometer drift during the planar motion of mobile robots in indoor environments, we propose a visual SLAM perception method that integrates wheel odometry information. First, the robot’s body pose is parameterized in SE(2) and the corresponding camera pose is parameterized in SE(3). On this basis, we derive the visual constraint residuals and their Jacobian matrices for reprojection observations using the camera projection model. We employ the concept of pre-integration to derive pose-constraint residuals and their Jacobian matrices and utilize marginalization theory to derive the relative pose residuals and their Jacobians for loop closure constraints. This approach solves the nonlinear optimization problem to obtain the optimal pose and landmark points of the ground-moving robot. A comparison with the ORBSLAM3 algorithm reveals that, in the recorded indoor environment datasets, the proposed algorithm demonstrates significantly higher perception accuracy, with root mean square error (RMSE) improvements of 89.2% in translation and 98.5% in rotation for absolute trajectory error (ATE). The overall trajectory localization accuracy ranges between 5 and 17 cm, validating the effectiveness of the proposed algorithm. These findings can be applied to preliminary mapping for the autonomous navigation of indoor mobile robots and serve as a basis for path planning based on the mapping results. Full article