Next Article in Journal
Reinforcement Learning-Driven Autonomous Path Planning for Unmanned Surface Vehicles: Current Status, Challenges, and Future Prospects
Previous Article in Journal
Chasing Ghosts: A Simulation-to-Real Olfactory Navigation Stack with Optional Vision Augmentation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

RTS-SLAM: A Trajectory Consistency-Driven Multi-Constraint Dynamic Feature-Rejection Method for Visual SLAM in Dynamic Environments

by
Huailiang Wang
,
Qiming Hu
,
Beicheng Li
,
Yuhao Geng
,
Chao Su
,
Shibo Zhu
,
Enhui Zheng
* and
Weimin Chen
School of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou 310018, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(9), 2846; https://doi.org/10.3390/s26092846
Submission received: 4 February 2026 / Revised: 17 April 2026 / Accepted: 29 April 2026 / Published: 2 May 2026
(This article belongs to the Section Navigation and Positioning)

Abstract

Simultaneous Localization and Mapping (SLAM) is a fundamental methodology that underpins autonomous navigation in robotic systems. Conventional approaches perform well in static environments but rely on the assumption of environmental rigidity, which leads to significant accuracy degradation in dynamic environments. To address this challenge, this study presents RTS-SLAM, a real-time semantic visual SLAM system designed for dynamic environments. Based on the ORB-SLAM2 framework, a multi-layer, constraint-driven dynamic feature-rejection strategy is introduced. The proposed approach first removes dynamic features by combining semantic information with geometric constraints. Subsequently, residual dynamic points are eliminated via trajectory-consistency constraint analysis, thereby effectively improving localization accuracy. Furthermore, a dense mapping strategy featuring global sparsification and critical region refinement is proposed. By reducing redundancy in the dense point cloud, the method decreases memory usage while preserving important object geometries. Experimental evaluations on the TUM RGB-D and Bonn datasets indicate that RTS-SLAM reduces the average absolute trajectory error by more than 95% compared with ORB-SLAM2 in dynamic environments. Meanwhile, the system maintains real-time performance and achieves high localization accuracy in dynamic environments.

1. Introduction

Within the framework of machine perception, SLAM technology serves as the essential mechanism for facilitating self-location and environmental modeling without pre-existing maps. It relies on the dynamic processing of onboard sensor inputs to derive a robot’s instantaneous pose while simultaneously populating an evolving map of its surroundings. The proliferation of autonomous navigation and immersive computing (AR/VR) has extended SLAM applications far beyond their traditional constraints [1,2,3]. Consequently, these frameworks are increasingly required to maintain robust performance in unpredictable, real-world landscapes characterized by high dynamics and a lack of structured geometry, rather than mere controlled settings. This shift imposes heightened demands on the adaptability and environmental understanding capabilities of SLAM algorithms. Standard visual SLAM frameworks, such as PTAM [4], DSO [5], VINS-Mono [6], and ORB-SLAM3 [7], can achieve accurate trajectory tracking and spatial mapping under the static-scene assumption. However, in scenarios characterized by high dynamics, these systems typically experience a substantial decline in operational effectiveness. Taking the widely used ORB-SLAM2  [8] as an example, when moving objects are present in the scene, its frontend association and backend refinement modules are vulnerable to dynamic features, resulting in significant motion drift, inconsistent map construction, and instability in system tracking.
To optimize the efficacy of visual SLAM frameworks for moving scenes, researchers have introduced various improvement strategies. Early approaches primarily relied on geometric constraints for dynamic feature identification. For instance, DynaSLAM [9] utilized multi-view geometric consistency to distinguish dynamic from static regions, while DS-SLAM [10] combined semantic masks and motion consistency checks for classification. With the advances of deep learning, semantic-based approaches have gained prominence. Ref. [11] applies instance segmentation to detect moving targets like “people” and “vehicles”, then filters out the corresponding feature data. However, while geometry-based methods do not rely on semantic priors and semantic-based approaches leverage semantic information, both suffer from the misclassification of static points as dynamic in scenarios with severe occlusion or significant depth noise. In recent years, hybrid approaches integrating geometric and semantic information have garnered significant attention. Examples include SG-SLAM [12] and YPR-SLAM [13], which rely on geometric constraints supplemented by object detection to counteract dynamic object interference. Despite these advances, existing methods exhibit notable limitations. On the one hand, for objects moving along epipolar lines or lacking semantic cues, their apparent motion closely resembles that of static backgrounds, rendering geometric or semantic discrimination ineffective and leading to missed detections. On the other hand, most approaches fail to adequately analyze the temporal consistency of feature point motion, making it difficult to effectively remove residual dynamic features. Furthermore, in terms of mapping, sparse maps offer higher efficiency but lack geometric information, while dense point cloud maps provide comprehensive information at the cost of substantial memory overhead.
In this study, we propose RTS-SLAM, a visual-semantic SLAM architecture capable of real-time operation in dynamic environments. Building upon the ORB-SLAM2 framework, the proposed strategy employs a hierarchical, constraint-driven approach to filter moving feature points. This approach first integrates semantic prior knowledge with epipolar geometry to achieve coarse-grained dynamic feature removal. Subsequently, by introducing trajectory consistency constraints and analyzing the coherence between feature point 3D motion and camera pose transformations, it removes residual dynamic points, significantly improving the system’s localization accuracy in dynamic environments. Concurrently, a mapping strategy that incorporates global sparsification and critical-region refinement is proposed. This approach substantially reduces point cloud memory consumption while preserving the geometric structure and details of key static regions, thereby enabling low-redundancy and accurate dense map generation in dynamic environments.
This work primarily contributes the following:
(1)
Relying on the ORB-SLAM2 architecture, we have designed RTS-SLAM, a real-time RGB-D visual SLAM framework. This system effectively identifies and eliminates interfering features in dynamic environments by integrating multiple constraints: semantic, geometric, and trajectory consistency. Experiments demonstrate that, compared to existing methods, RTS-SLAM yields superior localization precision and operational reliability in dynamic scenes, while simultaneously constructing a structurally coherent dense point cloud map in real time.
(2)
The core of this strategy lies in a multi-layer constraint-driven refinement process for dynamic feature elimination. First, it integrates semantic priors from object detection with inter-frame epipolar geometry constraints to perform coarse-grained removal of dynamic features. Subsequently, trajectory consistency constraints are incorporated. By analyzing the consistency between the 3D motion of detected points across consecutive keyframes and camera pose transformations, this approach enables precise removal of residual dynamic points. This strategy effectively eliminates dynamic features while preserving static ones, thereby providing more reliable data for subsequent stages of localization and mapping.
(3)
A mapping strategy combining global sparsification with local refinement of critical regions is proposed. This approach first performs global sparsification of point clouds to substantially reduce memory consumption of point cloud maps. Concurrently, to prevent loss of key structural features (such as object contours), locally enhanced and geometrically refined static critical regions are identified based on semantic information. Experiments demonstrate that the proposed methodology effectively preserves the high fidelity of key scene structures while substantially reducing memory consumption, thereby attaining an optimal equilibrium between processing velocity and mapping structural clarity.
The rest of this article is organized as follows. Section 2 reviews relevant work. Methodological details of the system are provided in Section 3. Experimental results are analyzed and discussed in detail within Section 4. Section 5 concludes the paper and presents potential avenues for future work.

2. Related Works

In the field of visual SLAM, addressing the interference of moving objects with system stability has become a significant challenge. Conventional visual SLAM frameworks generally rely on the static-environment assumption. However, in dynamic scenarios, moving objects introduce incorrect feature matches, severely affecting both localization accuracy and operational stability. Based on different strategies for handling dynamic features, existing approaches can be divided into three main categories: geometric constraint methods, semantic-informed models, and fusion-based strategies that combine both.
Geometric strategies primarily rely on multi-view consistency or motion-based verification for the identification and rejection of feature points produced by moving objects. Such approaches typically rest upon the fundamental assumption that violates the prescribed geometric constraints dynamically. In pure vision systems, the fundamental matrix is frequently calculated via the RANSAC-coupled seven-point algorithm [14]. Kundu et al. [15] identified dynamic elements by establishing geometric constraints derived from the fundamental matrix. Points are categorized as dynamic in cases where the geometric deviation from their associated epipolar trajectory surpasses a pre-established tolerance. Wang [16] proposed a technique for detecting moving objects by employing analytical mathematical models and geometric constraints. This approach first performs a preliminary assessment of an object’s motion through deep clustering and feature statistics, then introduces inter-frame disparity constraints to further validate its motion state. Additionally, ref. [17] enhanced dynamic semantic features in RGB-D point clouds by utilizing optical flow residuals, thereby achieving motion-static segmentation. Ref. [18] proposes an online removal strategy independent of semantic priors, directly filtering dynamic points using geometric motion features. However, such methods often fail to effectively distinguish in complex, dynamic scenes featuring slow-moving objects, severe occlusions, or sparse textures, and computational efficiency frequently falls short of real-time requirements.
The core concept of semantic information methods lies in utilizing deep learning models to acquire pixel-level semantic priors, actively identifying dynamic regions within images, and eliminating all feature points within these areas. This approach circumvents interference from dynamic features at the data source. For instance, the study in [19] proposed a graph-optimization SLAM framework combining YOLOv5 and Wi-Fi fingerprint sequence matching to improve the reliability of loop closure detection and reduce false loop detection in large-scale environments. DS-SLAM [10] integrates the SegNet [20] semantic segmentation network with optical flow techniques. It eliminates dynamic features via pixel-level moving-object detection and motion-consistency verification, thereby constructing a dense octree semantic map better suited for navigation tasks. Dynamic-DSO [21] employs Mask R-CNN [22] for semantic segmentation, deeply embedding semantic information into a direct SLAM framework to enhance system stability in dynamic environments. Detect-SLAM [23] distinguishes moving and stationary objects in keyframes via object detection, combining motion probability matching with the Randomized Consistency Sampling (RANSAC) algorithm to identify moving targets and eliminate mismatches. By removing feature points from dynamic objects and assigning unique IDs to each, it achieves dense mapping of the target objects. Similarly, Dynamic-SLAM [24] adopts the approach of removing all interest points within detected bounding boxes to suppress disturbances caused by dynamic objects. However, purely semantic dynamic exclusion methods suffer from three inherent limitations. Firstly, their performance is highly dependent on neural network models, creating a significant hurdle to reconciling computational efficiency with segmentation accuracy. Secondly, dynamic recognition capabilities are constrained by predefined semantic categories, resulting in insufficient generalization ability for unknown dynamic targets beyond the training set. Furthermore, in regions where static and dynamic elements coexist, the absence of geometric constraints often leads to the erroneous rejection of static features that should be retained.
Over the past several years, the trajectory of dynamic SLAM studies has evolved from relying on isolated information sources to developing hybrid frameworks that combine semantic and geometric constraints, significantly enhancing localization accuracy and operational efficiency in dynamic environments. Within this trend, multiple fusion strategies have been proposed. For instance, Chang et al. [11] combined YOLACT instance segmentation with optical flow compensation to establish a two-stage dynamic point filtering mechanism, though it remains limited under complex motion conditions. YOLO-SLAM [25] employs YOLOv3 [26] to detect potential moving targets, utilizing RANSAC to eliminate feature points within dynamic regions. OVD-SLAM  [27] further integrates YOLOv5 semantic segmentation, optical flow, and depth information. By distinguishing foreground from background and averaging multi-frame reprojection errors, it restores static points on moving object surfaces, thereby adapting to non-rigid motion and low-dynamic scenes. Zhu et al. [28] proposes an improved YOLOv9S-based SLAM framework integrated with ORB-SLAM2, where enhanced object detection, epipolar geometry constraints, and depth separation strategies are employed to remove dynamic features. DIO-SLAM [29] employs YOLACT instance segmentation, dynamically classifying rigid masks using optical flow residuals and consistency criteria, while compensating for misdetections by leveraging temporal frame propagation techniques. While effective under typical dynamic conditions, these hybrid approaches still encounter constraints when faced with sophisticated movement patterns. Specifically, techniques utilizing optical flow consistency often struggle to identify non-rigid motion or objects moving along epipolar lines, which may lead to detection failures and the erroneous removal of static points.
To mitigate the detrimental impact of environmental dynamics on SLAM reliability, we introduce a hierarchical framework driven by multiple constraints to eliminate dynamic feature points. Initially, the proposed strategy incorporates semantic information alongside geometric constraints to perform preliminary removal of dynamic features. Subsequently, trajectory consistency constraints are introduced for refined filtering, enabling accurate detection and removal of potential dynamic outliers. The proposed strategy significantly improves the precision of feature removal while enhancing overall system efficiency.

3. System Overview

This chapter provides an overview of the RTS-SLAM system structure, which is divided into five components. First, it outlines the overall architecture of the system along with its basic operational sequence. Second, the target identification module is introduced, which provides semantic feature inputs to the system. Subsequently, the dynamic feature classification criteria based on epipolar geometry constraints are described. Third, a refinement strategy for dynamic feature rejection based on trajectory consistency constraints is presented. Finally, the dense map construction method used in the system is detailed.

3.1. System Framework

Derived from ORB-SLAM2 [8], the RTS-SLAM framework augments the standard execution threads—tracking, local mapping, and loop detection—by integrating two parallel processing units for target recognition and dense mapping. By leveraging a multi-threaded parallel architecture, the framework preserves precise self-localization capabilities while significantly enhancing operational efficiency. The holistic design layout of this platform is visualized in Figure 1. Once initialized, the system maintains synchronized ingestion of both color frames and depth maps sourced via the RGB-D camera. The tracking thread executes ORB feature extraction on the incoming image frames, providing the fundamental input for the real-time localization algorithm. Subsequently, the system integrates semantic priors provided by the object detection thread to perform preliminary motion classification on the feature points. Utilizing epipolar line geometry constraints, it completes an initial round of coarse-motion feature rejection based on semantic and geometric fusion. Building upon this, trajectory consistency constraints are incorporated. By analyzing whether the three-dimensional motion trajectories of feature points across consecutive key frames align with camera pose transformations, the system achieves refined rejection of residual motion features. Within the dense mapping thread, we employ a mapping strategy combining global sparsification with local refinement in critical regions. This approach significantly reduces point cloud storage redundancy through global sparsification while enhancing local point density and refining geometric structures in structurally critical static areas. Ultimately, the system generates dense point cloud representations in dynamic settings, thereby balancing global coherence with high-fidelity local attributes.

3.2. Object Detection

Dynamic environments pose significant interference to visual SLAM systems. To address this, the system incorporates a lightweight object detection module. This module leverages the NCNN architecture, which is specifically tailored for mobile deployment to facilitate efficient neural network inference. Developed entirely in native C++ without external library dependencies, its highly parallelized architecture ensures real-time operational efficiency on resource-constrained platforms.
In model selection, the system employs the lightweight Single Shot MultiBox Detector (SSD) [30] architecture. This framework achieves both object localization and classification through a single forward pass, with relatively straightforward post-processing, thereby significantly reducing computational latency. To further optimize efficiency, the SSD backbone utilizes the lightweight MobileNetV3 [31]. This network employs separable convolutions and neural architecture search techniques to substantially reduce parameter count and computational overhead while maintaining detection accuracy. The complete model leverages prior knowledge acquired from the Pascal VOC [32] corpus, facilitating the robust identification of prevalent non-static entities, including human figures and various automobiles.
Contrastive to the computationally intensive semantic segmentation networks utilized in [9,10,11,33], the SSD detector integrated into our framework generates solely bounding boxes and category labels. This strategic simplification bypasses the pixel-level mask generation process, markedly curtailing processing delays. Consequently, as the cornerstone of mobile robot state estimation, the SLAM system’s real-time responsiveness becomes a critical prerequisite for the successful implementation of high-level missions.

3.3. Epipolar Constraints

In dynamic visual SLAM systems, accurate identification of static references within dynamic environments is essential to mitigate estimation drift and achieve high pose accuracy. While deep learning–based object detection methods provide semantic prior information for identifying potential moving objects such as pedestrians and vehicles, semantic information alone cannot determine their actual motion state at the observation moment. For instance, seated pedestrians or stationary vehicles detected as ‘people’ or ‘vehicles’ may contain feature points that remain static, contributing to camera motion estimation. Indiscriminately discarding all feature points associated with such semantic categories would not only discard valuable static observations but also compromise system stability in environments with many stationary structures. To further determine feature point motion states based on semantic prior knowledge, this paper introduces epipolar geometry constraints for preliminary dynamic feature screening between adjacent frames. Initially, the system establishes ORB feature correspondences across consecutive frames using a pyramidal iterative Lucas–Kanade (LK) optical flow scheme, while filtering out unreliable matches in peripheral image regions. Based on these correspondences, the inter-frame fundamental matrix is estimated from stable matches using the RANSAC-based seven-point method. By leveraging the geometric constraints defined by this fundamental matrix, the distance between each feature point and its corresponding epipolar line is computed. If this value remains below a preset threshold, the point is classified as static and retained; otherwise, it is flagged as dynamic and subsequently eliminated.
As illustrated in Figure 2, the pinhole camera model characterizes the geometric correspondence between the same spatial point P across adjacent image frames. C 1 and C 2 denote the optical centers of the cameras, respectively. The spatial point P is mapped to feature points P 1 and P 2 , respectively, within the preceding and current frame-relative camera coordinate systems. The plane defined by C 1 , C 2 , and P is designated as the epipolar plane; its intersections with the image planes of the two frames yield the epipolar lines L 1 and L 2 (illustrated by red dashed segments), while P and P denote the reprojected coordinates of the shifted map point. Feature points P 1 and P 2 are expressed in homogeneous coordinates as follows:
P 1 = x 1 y 1 1 , P 2 = x 2 y 2 1 .
where x and y constitute the pixel coordinates of the feature point. The fundamental matrix F is then utilized to determine the epipolar line L 2 within the current frame:
L 2 = F P 1 = F x 1 y 1 1 = X Y Z .
where X, Y, and Z constitute the elements of the line vector. Based on the principles in [15], the epipolar constraint is defined by
P 2 T F P 1 = P 2 T L 2 = 0 .
For feature point P 2 , the distance D to its corresponding epipolar line is given by
D = P 2 T F P 1 X 2 + Y 2 .
From the Formula (4), ideally, feature point P 2 falls precisely onto the epipolar line L 2 in the current frame; consequently, the calculated distance D should be equivalent to zero. In practical operating scenarios, however, due to interference from diverse noise sources, feature points frequently deviate from the theoretical epipolar line, in which case the value of D exceeds zero while remaining within the allowable tolerance margin. As shown in Figure 2a, the movement of point P to P causes the spatial deviation of the projected point P 4 to exceed the allowable tolerance margin, leading to its categorization as a dynamic feature and its immediate removal. Nevertheless, relying solely on the geometric properties of the polar line is generally insufficient to address all dynamic scenarios. In Figure 2b, geometric degeneration occurs when processing dynamic points moving along the polar line: if spatial point P undergoes radial translation along the linear extension of C 1 P , upon attaining position P , its corresponding projection P 3 within the polar plane remains situated on epipolar line L 2 , leading to a null displacement D when calculated via Formula (4). This leads to the point being misclassified as static. Therefore, this paper introduces a strategy for eliminating trajectory consistency constraints. By analyzing the consistency between the 3D motion paths of observations and camera pose updates, this constraint effectively identifies dynamic points moving along the polar line, thereby achieving a more refined elimination of residual dynamic features.
Figure 2. Epipolar geometry constraints. (a) The general case of dynamic features subject to epipolar geometric constraints. (b) The degenerate scenario where dynamic features undergo collinear motion relative to the epipolar line direction.
Figure 2. Epipolar geometry constraints. (a) The general case of dynamic features subject to epipolar geometric constraints. (b) The degenerate scenario where dynamic features undergo collinear motion relative to the epipolar line direction.
Sensors 26 02846 g002

3.4. Trajectory Consistency Constraint Rejection Strategy

To address the limitations of geometric constraints and semantic detection in removing dynamic feature points, trajectory consistency constraints analyze the 3D motion patterns of features across successive frames. The fundamental principle relies on the spatial alignment between feature displacement and camera ego-motion. While the apparent motion of stationary landmarks follows the camera motion, descriptors from moving objects exhibit significant motion inconsistencies. Therefore, by evaluating the alignment between feature trajectories and camera motion, dynamic and static elements can be effectively differentiated. In practical implementation, matched keypoints from consecutive frames are first transformed into the 3D camera coordinate system using depth information. Subsequently, the spatial displacement of each feature point across two frames and the ego-motion displacement of the camera are computed. By comparing these two displacement magnitudes, the motion state of each point can be determined. If the difference between the feature displacement and camera motion exceeds a predefined threshold, the point is classified as dynamic and removed; otherwise, it is retained as static.
In the proposed methodology, suppose that N pairs of correlated feature points are identified between two consecutive frames, which can be formally represented as
( p t 1 i , p t i ) , i = 1 , 2 , , N .
Let p t 1 i = [ x t 1 i , y t 1 i ] T and p t i = [ x t i , y t i ] T denote the image-plane coordinates of the i-th feature across consecutive frames. For the purpose of mapping these pixel locations into the camera coordinate system, they are reformulated into a homogeneous coordinate form
P t 1 i = x t 1 i y t 1 i 1 , P t i = x t i y t i 1 .
By leveraging the information from the depth map, the depth values associated with these two frames are represented as
D t 1 i 1 x t 1 i , y t 1 i , D t i x t i , y t i .
Through the camera’s intrinsic matrix:
K = f x 0 c x 0 f y c y 0 0 1 .
The variables f x and f y correspond to the orthogonal focal lengths, with ( c x , c y ) marking the principal point where the optical axis aligns with the image plane’s center. Utilizing these intrinsic parameters, feature points are back-projected into the 3D camera coordinate space as follows:
P t 1 i = D t 1 i K 1 P t i = ( x t 1 i c x ) D t 1 i f x ( y t 1 i c y ) D t 1 i f y D t 1 i , P t i = D t i K 1 P t i = ( x t i c x ) D t i f x ( y t i c y ) D t i f y D t i .
Subsequently, the geometric displacement d p c of each feature point in 3D space is evaluated across the sequential observations.
d p c i = P t i P t 1 i .
The translation component t is extracted directly from the camera’s estimated pose transition matrix T t , t 1 = R t 0 1 , where the magnitude of this vector represents the camera’s own motion displacement d c a m :
d c a m = t t , t 1 .
In static scenes, this displacement is primarily caused by the camera’s own motion, and its magnitude should satisfy:
d p c i d c a m .
Given that feature points exhibit significant variations in their projected scale on the imaging plane at different depths, their sensitivity to pixel changes varies across their three-dimensional displacements. Applying a uniform fixed threshold directly may lead to misclassification of minute displacements of dynamic points within close-range scenes as static points, or cause failure to correctly identify a close-range dynamic point due to its displacement exceeding the threshold without triggering detection. Therefore, to achieve discrimination that better aligns with true geometric relationships, trajectory consistency constraints must incorporate depth information of feature points. This study introduces a depth-dependent tolerance threshold σ into the trajectory consistency constraint to adjust the acceptable displacement range at different depths.
σ = α + β · min ( d t 1 i , d t i ) .
In this formulation (13), α denotes the baseline tolerance, primarily employed to compensate for camera intrinsic residuals, pixel quantization noise, and minor stochastic fluctuations during feature extraction. β is a scaling factor reflecting the influence of depth, designed to balance the heteroscedasticity of depth measurement uncertainty that intensifies with increasing distance. Although D i and d i both originate from the same depth map and encapsulate depth information, they fulfill distinct roles: D i serves as a scale factor for 3D back-projection in coordinate transformation, whereas d i acts as a depth scalar to modulate the trajectory consistency threshold during motion identification.
Potential dynamic outliers are isolated by assessing the absolute deviation between feature displacement and the camera’s ego-motion relative to the threshold σ .
Δ d i = | d p c i d c a m | , S t a t u s = Dynamic , if Δ d i > σ . Static , if Δ d i σ .
The tactical approach to rejecting dynamic features is detailed in Algorithm 1. This method first performs preliminary screening of feature points based on extreme line constraints to obtain candidate static features. Subsequently, it combines depth information and introduces trajectory-consistency constraints to conduct secondary, refined elimination of the remaining dynamic features.
Algorithm 1 Dynamic Feature Rejection Strategy
Input: 
Previous frame’s feature points, P 1 ; Current frame’s feature points, P 2 ; Previous frame’s static feature points, P 1 s t a ; Current frame’s static feature points, P 2 s t a ; Previous frame, F 1 ; Current frame, F 2 ; Previous depth map, D 1 ; Current depth map, D 2 ; Camera intrinsic matrix, K; Dynamic object culling threshold, ξ ; tolerance threshold, σ ; Number of feature points threshold, N t h ;
Output: 
Set of identified non-static points in the current frame, S d y n a m i c ;
  1:
  P 2 = EstimateOpticalFlow ( F 1 , F 2 ) ;
  2:
 Filter out potential moving features located near image boundaries;
  3:
 for each matched pair P 1 s t a , P 2 s t a whithin P 1 , P 2  do
  4:
    if Point P 1 is situated outside semantic dynamic regions then
  5:
      Append P 1 , P 2 to P 1 s t a , P 2 s t a
  6:
    end if
  7:
    Feature ++
  8:
 end for
  9:
 if Feature > N t h  then
10:
   Compute Fundamental Matrix F via RANSAC on { P 1 s t a , P 2 s t a } ;
11:
else if Feature N t h and DynamicFlag is active then
12:
   Compute Fundamental Matrix F via RANSAC on { P 1 , P 2 } ;
13:
end if
14:
for each matched pair p 1 , p 2 in P 1 , P 2  do
15:
   if Distance to epipolar line d e p i ( p 1 , p 2 , F ) > ξ  then
16:
     Append P 2 to S d y n a m i c ;
17:
   else if Valid depth values exist in both D 1 and D 2 then
18:
     Recover 3D spatial coordinates P 1 and P 2 using D and K;
19:
     Calculate individual point displacement: d p c = P 2 P 1 ;
20:
     Extract camera ego-motion displacement from pose: d c a m = t ;
21:
     if Displacement discrepancy | d p c d c a m | > σ  then
22:
        Record p 2 into the dynamic feature set S d y n a m i c ;
23:
     end if
24:
   end if
25:
end for

3.5. Dense Mapping

Within the traditional ORB-SLAM2 [8] framework, maps are primarily constructed based on sparse feature points. While this approach ensures stable pose tracking, it struggles to accurately capture the fine-grained geometric structure of real-world scenes. These limitations are notably intensified in dynamic scenarios, where the limited descriptive power of sparse data, coupled with its susceptibility to disturbances stemming from mobile entities, significantly impairs the integrity and utility of the generated mapping output. To address these deficiencies, RTS-SLAM maintains sparse mapping for efficient pose estimation while concurrently integrating depth information to construct dense point clouds. This strategy substantially bolsters the system’s capability for comprehensive geometric representation of the environment.
In large-scale SLAM scenarios, dense mapping significantly increases the number of points in the global point cloud. This imposes a dual challenge: it extends the duration of the dense mapping phase, thereby reducing the execution speed of the overall SLAM system, and introduces substantial memory requirements. Such high memory demands create a risk of memory overflow, which consequently compromises system stability. Typically, research in this field prioritizes the detailed representation of salient objects within dense point clouds, while assigning lower importance to background elements such as walls and tabletops.
Based on the aforementioned scenarios and requirements, RTS-SLAM proposes a dense-mapping strategy that integrates global sparsification and key-region refinement. As described in Algorithm 2. Global sparsification refers to applying voxel grid filtering to the depth point cloud of the keyframe. This process downsamples the point cloud by retaining representative points within each voxel cell.
The mathematical formulation of voxel grid filtering is given as follows. The original point cloud generated from the depth map D k of the keyframe F k is defined as:
P k = p i = ( x i , y i , z i ) T i = 1 , 2 , , N .
where N denotes the number of points in the original point cloud. Given the voxel resolution r v , the 3D space is partitioned into a set of cubic voxels with side length r v , where each voxel corresponds to a cubic region in the Euclidean space.For each point p i = ( x i , y i , z i ) T , its corresponding voxel index is defined as
v i = x i r v , y i r v , z i r v , v i Z 3 .
where · denotes the floor operation, and v i represents the discrete voxel grid coordinate. All points sharing the same voxel index v are grouped into a voxel cell, defined as
V v = p i P k v i = v .
For each non-empty voxel (i.e., | V v | > 0 ), the representative point is computed as the centroid of all points within the voxel:
p ¯ v = 1 | V v | p i V v p i .
Thus, the downsampled point cloud after voxel grid filtering can be expressed as
P k s = p ¯ v V v .
where | V v | denotes the number of points contained in voxel v, and P k s represents the downsampled point cloud after voxel grid filtering. The computational complexity of voxel grid filtering is approximately linear with respect to the number of input points, as each point is assigned to a voxel once, and centroid computation is performed only over occupied voxels.
The remaining points are subsequently transformed into the world coordinate system and integrated into the global point cloud map.
The key region refinement method is based on global downsampling. By utilizing image information and object detection results from several common frames closest to the keyframe, only the point clouds of the detected static key objects are transformed into the world coordinate system and saved as the global point cloud map, thereby enhancing the details of the target objects in the dense map.
Algorithm 2 Global Sparsification and Key-Region Refinement
Input: 
Keyframe F k ; Neighboring frames F i ; Depth maps D k , D i ; Camera intrinsics matrix K; Camera poses T w c k , T w c i ; Voxel resolution r v ; Temporal window size N w ;
Output: 
Updated global dense map P
  1:
 Generate depth point cloud P k from D k using K
  2:
 Apply voxel grid filtering with resolution r v to obtain sparse point cloud P k s
  3:
 Transform P k s into world coordinates using T w c k
  4:
 Insert filtered points into global map P
  5:
 Detect object bounding boxes B k in keyframe F k
  6:
 for each neighboring frame F i  do
  7:
    if  | i k | N w  then
  8:
      Identify corresponding object regions in frame F i
  9:
      Extract depth points from D i within these regions
10:
     Remove dynamic points using multi-constraint filtering
11:
     Transform remaining points to world coordinates via T w c i
12:
     Merge refined points into P
13:
   end if
14:
end for
15:
return  P
Figure 3 illustrates the key region refinement method. In this example, a book on the desk is defined as the “key object”, with its target region localized by a 2D bounding box generated by the detection network. The image on the right represents the keyframe, where the overlaying points constitute the point cloud in the camera coordinate system, obtained by downsampling the keyframe’s depth map; the red points specifically denote the point cloud of the book. The multiple images on the left are frames preceding the keyframe, with the red points in each frame representing the book’s point cloud derived from the corresponding pixels in their respective camera coordinate systems. By integrating point clouds from both the left and right frames into the global map, the geometric completeness of the target object in the dense map is enhanced.

4. Experimental Results

This section experimentally evaluates and analyses the proposed RTS-SLAM system across four dimensions. Initial quantitative evaluations focus on tracking precision, utilizing the TUM RGB-D [34] and Bonn [35] datasets as benchmarks. Subsequently, the performance advantages of our integrated fusion mechanism are verified via ablation experiments. Following this, the mean processing durations are compared across relevant algorithms to appraise the real-time viability of the system. Furthermore, the intuitive quality and structural integrity of the generated dense maps are showcased through visual reconstructions. To ensure statistical reliability and minimize stochastic errors, 20 independent trials were conducted for each data sequence. The final performance metrics were derived by calculating the trimmed mean, specifically by discarding the extreme outliers (maximum and minimum values). All computational tasks were performed on a workstation running Ubuntu 20.04, powered by an Intel i5-13400F CPU, an NVIDIA GeForce RTX 5060 GPU, and 16 GB of memory.

4.1. Performance Evaluation on TUM RGB-D Dataset

The Technical University of Munich’s Computer Vision Group provides the TUM RGB-D dataset [34], which functions as a comprehensive and authoritative benchmark for the validation of diverse SLAM methodologies. By providing synchronized color and depth streams from RGB-D sensors, the dataset encompasses diverse indoor environments and introduces significant dynamic challenges, such as pedestrian motion and manual gestures. To verify the effectiveness of RTS-SLAM in complex settings, five representative sequences were adopted for empirical study: fr3_walking_xyz, fr3_walking_rpy, fr3_walking_half, fr3_walking_static, and fr3_sitting_static. The initial four sequences represent high-dynamic scenarios characterized by intense human activity and frequent occlusions. Conversely, the final sequence features low-dynamic elements, serving to evaluate the system’s steady-state performance and adaptability in near-static surroundings.
To rigorously quantify positioning precision, two standard evaluation metrics were utilized: Absolute Trajectory Error (ATE) and Relative Pose Error (RPE). ATE assesses global consistency by determining the translational deviation between estimated and ground-truth trajectories. In contrast, RPE is partitioned into RTE (Relative Translational Error) and RRE (Relative Rotational Error) to evaluate local drift between sequential frames. System accuracy was further validated through four statistical metrics: RMSE, mean, median, and S.D. To verify the effectiveness of RTS-SLAM, we benchmarked it against the original ORB-SLAM2 across five dynamic sequences, as detailed in Table 1, Table 2 and Table 3.
As shown in Table 1, Table 2 and Table 3, RTS-SLAM exhibits substantial enhancements over ORB-SLAM2 across all evaluation metrics within highly dynamic environments. The maximum enhancements in RMSE, Mean, Median, and S.D. reached 98.19%, 98.21%, 98.14%, and 98.13%, respectively. In low-dynamic sequences, RTS-SLAM also demonstrates outstanding performance, with improvements of 32.44%, 33.26%, 34.59%, and 31.41%, respectively, across the aforementioned metrics. The absolute trajectory error (ATE) comparisons between ORB-SLAM2 and RTS-SLAM for the five evaluated sequences are further visualized in Figure 4 and Figure 5. The ground-truth trajectories are depicted by grey dashed lines, while the estimated poses are traced by blue curves. The red regions highlight the positional discrepancies. Under identical dynamic constraints, ORB-SLAM2 suffers from substantial trajectory estimation inaccuracies. Conversely, RTS-SLAM yields estimated paths that more closely match the ground-truth data. Such outcomes confirm the superior positioning performance of the proposed framework within highly dynamic environments.
To achieve a comprehensive appraisal of RTS-SLAM, we conduct a performance comparison against several leading frameworks. The evaluation involves referencing established methods including ORB-SLAM3 [7], SG-SLAM [12], RDS-SLAM [36], and COEB-SLAM [37]. Regarding the performance results illustrated in Table 4. Specifically, for the fr3_sitting_static sequence, the environment can be considered weakly dynamic or near-static due to minimal human pose variations. Under such conditions, methods relying on semantic segmentation, such as DS-SLAM, can reliably preserve static regions while suppressing unstable observations caused by minor human movements, which leads to slightly better localization accuracy. For the fr3_walking_xyz sequence, YOLO-SLAM achieves slightly better performance due to its object detection module, which can directly identify dominant dynamic objects such as humans and reduce their influence on pose estimation. Since the dynamic elements in this sequence mainly belong to detectable semantic categories, the object-level filtering mechanism becomes particularly effective. In contrast, sequences such as fr3_walking_static, fr3_walking_rpy, and fr3_walking_half contain more complex motion patterns and irregular dynamic disturbances. In such cases, semantic detection alone may fail to capture all dynamic elements. RTS-SLAM addresses this challenge through a multi-constraint dynamic feature rejection strategy, which integrates semantic cues, geometric constraints, and trajectory consistency analysis to remove feature points that violate global motion consistency. By filtering unreliable observations caused by dynamic objects while preserving reliable static features, RTS-SLAM maintains stable pose estimation and achieves more robust localization performance in highly dynamic environments.
To further clarify the differences between the proposed method and existing dynamic SLAM approaches, Table 5 summarizes the main technical characteristics of several representative methods, including the utilization of semantic information, geometric constraints, motion consistency, and their strategies for handling dynamic objects.

4.2. Performance Evaluation on Bonn RGB-D Dataset

Originating from the University of Bonn in 2019, the Bonn RGB-D dataset [35] provides 24 RGB-D sequences characterized by significant dynamic disturbances. This benchmark is frequently utilized for assessing how visual SLAM frameworks operate within intricate, non-static settings. To test the generalization and efficacy of our method in dynamic contexts, we selected nine representative sequences from this dataset for experimentation. These encompass diverse motion patterns, such as multiple individuals moving freely within an indoor setting in the “crowd” sequence, a person relocating an object in “moving no box”, the continuous camera tracking of a slow-moving individual in “person tracking”, and complex synchronous dynamic patterns of multiple individuals repeatedly jumping in unison and in the same direction in “synchronous”. Given its more intense and varied dynamic activity relative to the TUM RGB-D dataset, the Bonn dataset presents a more rigorous challenge for SLAM systems.
Regarding the performance metrics illustrated in Table 6, RTS-SLAM shows a slight deficit compared to SG-SLAM in the “moving no box1” sequence. This performance gap stems from the continuous presence of moving objects, such as boxes being transported, which frequently cause transient occlusions and swift modifications to the local structure of the scene. While RTS-SLAM emphasizes long-term consistency, SG-SLAM utilizes the frame-by-frame integration of semantic and geometric data for dynamic suppression, allowing for a more immediate response to such rapid environmental transitions. In both “synchronous” sequences, RTS-SLAM demonstrated inferior localization accuracy compared to YOLO-SLAM. This disparity is mainly due to the tightly integrated framework of YOLO-SLAM, which combines geometric priors with object recognition. By utilizing depth disparity alongside the RANSAC technique to isolate non-static elements, YOLO-SLAM successfully mitigates the pose drift triggered by coordinated movements. Conversely, the trajectory consistency constraints employed by RTS-SLAM are prone to misclassifying highly synchronized dynamic point clouds as static background, thereby introducing estimation errors. Nevertheless, in view of the comprehensive outcomes presented in Table 6, the proposed framework consistently achieves superior results throughout the majority of test sequences. This highlights its capacity for reliable localization within varied dynamic surroundings.

4.3. Ablation Experiment

To analyze the effectiveness of the unified framework incorporating geometric, semantic, and trajectory consistency constraints within dynamic environments, this paper conducted a series of ablation experiments. These experiments compared the effectiveness of algorithms relying solely on semantic information, solely on geometric information, and on the integrated approach. Specifically, RTS-SLAM (S) relies exclusively on semantic information for dynamic feature removal. RTS-SLAM (G) relies exclusively on polar line geometric constraints to identify dynamic points. RTS-SLAM (S+G) integrates semantic information with geometric constraints to facilitate the identification and removal of dynamic outliers. RTS-SLAM (S+G+T) implements a comprehensive dynamic feature rejection strategy by integrating semantic detection, polar line geometry constraints, and trajectory consistency constraints. A detailed performance comparison across different modules is showcased in Table 7.
Figure 6 provides a comparative analysis of feature point extraction and dynamic content removal results across distinct combinations of constraints. Figure 6a shows the feature points extracted by ORB-SLAM2, revealing that it has scarcely processed dynamic regions (such as pedestrians), retaining a significant number of dynamic feature points. Figure 6b presents results using semantic information alone. While feature points within human regions are effectively removed, some erroneous retention persists in dynamically active areas with insignificant semantic content (e.g., edges of rapidly moving objects). Figure 6c demonstrates results using only polar line geometry constraints. This approach erroneously removed some feature points in static regions (e.g., tabletop and monitor edges) while failing to fully identify and filter certain dynamic targets (e.g., walking pedestrians). By contrast, the strategy in Figure 6d, which fuses semantic information with polar line geometry constraints, achieves a more balanced outcome: effectively removing dynamic feature points while preserving key features in the static background. Furthermore, Figure 6e illustrates the comprehensive framework incorporating trajectory consistency constraints. Building upon the fusion of semantic and geometric data, this strategy further validates the feature points by evaluating their motion coherence across consecutive frames. This effectively suppresses residual dynamic interference, resulting in a more stable and refined final feature distribution. The quantitative results presented in Table 7, coupled with the qualitative findings from Figure 6, further validate the efficacy of the proposed multi-constraint fusion approach.

4.4. Time Analysis

To evaluate the operational feasibility of RTS-SLAM, we assessed its computational overhead by measuring the mean execution time per frame. The results were then benchmarked against current state-of-the-art SLAM solutions to verify their real-time capabilities. A summary of the real-time performance metrics is presented in Table 8, the baseline ORB-SLAM2 system achieved the shortest frame processing time due to its omission of semantic processing modules. Systems employing pixel-level semantic segmentation (such as DS-SLAM and Dyna-SLAM), while enabling finer dynamic object segmentation, introduced significant processing latency owing to their higher computational complexity, rendering them unsuitable for stringent real-time requirements. YOLO-SLAM, based on the YOLO object detection algorithm, offers advantages in detection accuracy. However, its operational speed is constrained by the algorithmic architecture and hardware limitations, posing challenges for real-time performance. In contrast, RTS-SLAM achieves an average frame processing time of merely 23.8 ms, maintaining high real-time responsiveness while realizing superior processing efficiency.

4.5. RTS-SLAM Dense Mapping Experiment

The dense reconstruction capabilities of RTS-SLAM in highly dynamic scenarios were extensively verified through a series of experiments on the TUM RGB-D dataset. Figure 7 illustrates the point cloud reconstruction performance comparison of the proposed mapping strategy at different processing stages. In the baseline configuration lacking dynamic handling (Figure 7a), potential moving objects within the scene introduce a significant volume of mismatched point clouds during motion. This results in pronounced ghosting and structural distortion in the reconstruction, which significantly undermines the structural fidelity and overall consistency of the resulting dense map. Upon implementing dynamic point cloud removal (Figure 7b), anomalous point clouds generated by potential moving objects are effectively filtered out. The geometric contours of static scene structures become markedly clearer, fundamentally improving the reconstruction quality. Further integrating global sparsification and critical region refinement (Figure 7c) enables the system to dynamically adjust point cloud density globally and locally based on semantic target distribution and depth information, while retaining key object details and optimizing resource utilization. As illustrated in Figure 7c, high-density point clouds are concentrated in critical target areas (such as the monitor, keyboard, and books on the desk), while sparse distribution is maintained in other regions, preserving essential structure while avoiding redundancy. Experimental statistics indicate that the dense point cloud in Figure 7b comprises 1,569,892 points, whereas Figure 7c contains only 307,200 points. This represents an approximately 80.4% reduction in total point cloud volume, significantly lowering demands on memory and computational resources. Since each point requires memory to store its spatial coordinates and associated attributes, the overall memory consumption is approximately proportional to the number of stored points. Therefore, reducing redundant points directly decreases the memory footprint of the dense map. To further evaluate the efficiency of the proposed dense mapping strategy, Table 9 presents a comparison of point cloud size, reduction rate, memory consumption, and mapping time under different strategies. Furthermore, many operations in dense mapping, such as neighborhood search, point fusion, and map updates, have computational costs that depend on the size of the point cloud. By reducing the point cloud size while preserving important regions, the proposed strategy can effectively reduce the computational overhead of the mapping process.

5. Conclusions

To tackle the challenges of complex dynamic settings, this research introduces RTS-SLAM, a real-time semantic visual SLAM framework. Built upon the ORB-SLAM2 architecture, the system implements a hierarchical dynamic feature suppression strategy: it first fuses semantic priors with epipolar geometry constraints for coarse-grained suppression, followed by trajectory consistency constraints to remove residual dynamic noise across consecutive frames. This methodology effectively mitigates interference from moving entities in camera ego-motion estimation, significantly improving positioning stability and metric accuracy in highly dynamic scenarios. Furthermore, during the dense-mapping phase, RTS-SLAM employs global sparsification and localized critical-region refinement. By prioritizing the geometric fidelity of salient objects while substantially reducing point cloud redundancy, the system reduces memory overhead and facilitates dense map construction for large-scale scenes.
Further refinements are required for the proposed system in future research. At the algorithmic level, efforts will focus on enhancing the generalization capability of semantic models and optimizing the spatial density of the constructed maps. At the hardware level, the integration of active sensing modalities, such as LiDAR, will be explored to compensate for the inherent limitations of pure vision solutions in depth estimation within unstructured environments.

Author Contributions

Conceptualization, H.W. and E.Z.; methodology, H.W. and Q.H.; software, H.W. and Q.H.; validation, E.Z. and W.C.; formal analysis, H.W. and Y.G.; investigation, S.Z. and C.S.; resources, H.W. and E.Z.; data curation, B.L.; writing—original draft preparation, H.W. and C.S.; writing—review and editing, H.W.; visualization, Y.G.; supervision, W.C.; project administration, E.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Saleem, H.; Malekian, R.; Munir, H. Neural network-based recent research developments in SLAM for autonomous ground vehicles: A review. IEEE Sens. J. 2023, 23, 13829–13858. [Google Scholar] [CrossRef]
  2. Wang, X.; Fan, X.; Shi, P.; Ni, J.; Zhou, Z. An overview of key SLAM technologies for underwater scenes. Remote Sens. 2023, 15, 2496. [Google Scholar] [CrossRef]
  3. Wen, S.; Tao, S.; Liu, X.; Babiarz, A.; Yu, F.R. CD-SLAM: A real-time stereo visual–inertial SLAM for complex dynamic environments with semantic and geometric information. IEEE Trans. Instrum. Meas. 2024, 73, 2517808. [Google Scholar] [CrossRef]
  4. Klein, G.; Murray, D. Parallel tracking and mapping for small AR workspaces. In 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality; IEEE: Piscataway, NJ, USA, 2007; pp. 225–234. [Google Scholar]
  5. Engel, J.; Koltun, V.; Cremers, D. Direct sparse odometry. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 40, 611–625. [Google Scholar] [CrossRef]
  6. Qin, T.; Li, P.; Shen, S. Vins-mono: A robust and versatile monocular visual-inertial state estimator. IEEE Trans. Robot. 2018, 34, 1004–1020. [Google Scholar] [CrossRef]
  7. Campos, C.; Elvira, R.; Rodríguez, J.J.G.; Montiel, J.M.M.; Tardós, J.D. Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam. IEEE Trans. Robot. 2021, 37, 1874–1890. [Google Scholar] [CrossRef]
  8. Mur-Artal, R.; Tardós, J.D. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras. IEEE Trans. Robot. 2017, 33, 1255–1262. [Google Scholar] [CrossRef]
  9. Bescos, B.; Fácil, J.M.; Civera, J.; Neira, J. DynaSLAM: Tracking, mapping, and inpainting in dynamic scenes. IEEE Robot. Autom. Lett. 2018, 3, 4076–4083. [Google Scholar] [CrossRef]
  10. Yu, C.; Liu, Z.; Liu, X.-J.; Xie, F.; Yang, Y.; Wei, Q.; Fei, Q. DS-SLAM: A semantic visual SLAM towards dynamic environments. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE: Piscataway, NJ, USA, 2018; pp. 1168–1174. [Google Scholar]
  11. Chang, J.; Dong, N.; Li, D. A real-time dynamic object segmentation framework for SLAM system in dynamic scenes. IEEE Trans. Instrum. Meas. 2021, 70, 2513709. [Google Scholar] [CrossRef]
  12. Cheng, S.; Sun, C.; Zhang, S.; Zhang, D. SG-SLAM: A real-time RGB-D visual SLAM toward dynamic scenes with semantic and geometric information. IEEE Trans. Instrum. Meas. 2022, 72, 7501012. [Google Scholar] [CrossRef]
  13. Kan, X.; Shi, G.; Yang, X.; Hu, X. YPR-SLAM: A SLAM system combining object detection and geometric constraints for dynamic scenes. Sensors 2024, 24, 6576. [Google Scholar] [CrossRef]
  14. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381–395. [Google Scholar] [CrossRef]
  15. Kundu, A.; Krishna, K.M.; Sivaswamy, J. Moving object detection by multi-view geometric techniques from a single camera mounted robot. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems; IEEE: Piscataway, NJ, USA, 2009; pp. 4306–4312. [Google Scholar]
  16. Wang, R.; Wan, W.; Wang, Y.; Di, K. A new RGB-D SLAM method with moving object detection for dynamic indoor scenes. Remote Sens. 2019, 11, 1143. [Google Scholar] [CrossRef]
  17. Sun, Y.; Liu, M.; Meng, M.Q.-H. Motion removal for reliable RGB-D SLAM in dynamic environments. Robot. Auton. Syst. 2018, 108, 115–128. [Google Scholar] [CrossRef]
  18. Zhang, T.; Zhang, H.; Li, Y.; Nakamura, Y.; Zhang, L. Flowfusion: Dynamic dense rgb-d slam based on optical flow. In 2020 IEEE International Conference on Robotics and Automation (ICRA); IEEE: Piscataway, NJ, USA, 2020; pp. 7322–7328. [Google Scholar]
  19. Shoukat, M.U.; Yan, L.; Deng, D.; Imtiaz, M.; Safdar, M.; Nawaz, S.A. Cognitive robotics: Deep learning approaches for trajectory and motion control in complex environment. Adv. Eng. Inform. 2024, 60, 102370. [Google Scholar] [CrossRef]
  20. Badrinarayanan, V.; Kendall, A.; Cipolla, R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 2481–2495. [Google Scholar] [CrossRef]
  21. Sheng, C.; Pan, S.; Gao, W.; Tan, Y.; Zhao, T. Dynamic-DSO: Direct sparse odometry using objects semantic information for dynamic environments. Appl. Sci. 2020, 10, 1467. [Google Scholar] [CrossRef]
  22. He, K.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask r-cnn. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22–29 October 2017; pp. 2961–2969. [Google Scholar]
  23. Zhong, F.; Wang, S.; Zhang, Z.; Wang, Y. Detect-SLAM: Making object detection and SLAM mutually beneficial. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV); IEEE: Piscataway, NJ, USA, 2018; pp. 1001–1010. [Google Scholar]
  24. Xiao, L.; Wang, J.; Qiu, X.; Rong, Z.; Zou, X. Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment. Robot. Auton. Syst. 2019, 117, 1–16. [Google Scholar] [CrossRef]
  25. Wu, W.; Guo, L.; Gao, H.; You, Z.; Liu, Y.; Chen, Z. YOLO-SLAM: A semantic SLAM system towards dynamic environment with geometric constraint. Neural Comput. Appl. 2022, 34, 6011–6026. [Google Scholar] [CrossRef]
  26. Redmon, J.; Farhadi, A. Yolov3: An incremental improvement. arXiv 2018, arXiv:1804.02767. [Google Scholar] [CrossRef]
  27. He, J.; Li, M.; Wang, Y.; Wang, H. OVD-SLAM: An online visual SLAM for dynamic environments. IEEE Sens. J. 2023, 23, 13210–13219. [Google Scholar] [CrossRef]
  28. Zhu, Q.; Zhao, Y.; Zhang, H.; Chen, W. A dynamic SLAM algorithm based on improved YOLOv9S. Appl. Soft Comput. 2025, 184, 113700. [Google Scholar] [CrossRef]
  29. He, L.; Li, S.; Qiu, J.; Zhang, C. DIO-SLAM: A dynamic RGB-D slam method combining instance segmentation and optical flow. Sensors 2024, 24, 5929. [Google Scholar] [CrossRef]
  30. Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.-Y.; Berg, A.C. Ssd: Single shot multibox detector. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2016; pp. 21–37. [Google Scholar]
  31. Howard, A.; Sandler, M.; Chu, G.; Chen, L.-C.; Chen, B.; Tan, M.; Wang, W.; Zhu, Y.; Pang, R.; Vasudevan, V. Searching for mobilenetv3. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: Piscataway, NJ, USA, 2019; pp. 1314–1324. [Google Scholar]
  32. Everingham, M.; Van Gool, L.; Williams, C.K.I.; Winn, J.; Zisserman, A. The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 2010, 88, 303–338. [Google Scholar] [CrossRef]
  33. Hu, Q.; Wang, S.; Chen, N.; Li, W.; Yuan, J.; Zheng, E.; Wang, G.; Chen, W. SGDO-SLAM: A Semantic RGB-D SLAM System with Coarse-to-Fine Dynamic Rejection and Static Weighted Optimization. Sensors 2025, 25, 3734. [Google Scholar] [CrossRef] [PubMed]
  34. Sturm, J.; Engelhard, N.; Endres, F.; Burgard, W.; Cremers, D. A benchmark for the evaluation of RGB-D SLAM systems. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE: Piscataway, NJ, USA, 2012; pp. 573–580. [Google Scholar]
  35. Palazzolo, E.; Behley, J.; Lottes, P.; Giguere, P.; Stachniss, C. ReFusion: 3D reconstruction in dynamic environments for RGB-D cameras exploiting residuals. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE: Piscataway, NJ, USA, 2019; pp. 7855–7862. [Google Scholar]
  36. Liu, Y.; Miura, J. RDS-SLAM: Real-time dynamic SLAM using semantic segmentation methods. IEEE Access 2021, 9, 23772–23785. [Google Scholar] [CrossRef]
  37. Min, F.; Wu, Z.; Li, D.; Wang, G.; Liu, N. COEB-SLAM: A robust VSLAM in dynamic environments combined object detection, epipolar geometry constraint, and blur filtering. IEEE Sens. J. 2023, 23, 26279–26291. [Google Scholar] [CrossRef]
Figure 1. Structural layout of the RTS-SLAM framework. The portions marked in blue represent the legacy ORB-SLAM2 scheme, while the crimson sections emphasize the modular expansions introduced in this work.
Figure 1. Structural layout of the RTS-SLAM framework. The portions marked in blue represent the legacy ORB-SLAM2 scheme, while the crimson sections emphasize the modular expansions introduced in this work.
Sensors 26 02846 g001
Figure 3. Schematic diagram of the key-region refinement process for targeted objects.
Figure 3. Schematic diagram of the key-region refinement process for targeted objects.
Sensors 26 02846 g003
Figure 4. ATE assessment for RTS-SLAM and ORB-SLAM2 evaluating five distinct data sequences: (a) fr3_walking_xyz. (b) fr3_walking_rpy. (c) fr3_walking_halfsphere.
Figure 4. ATE assessment for RTS-SLAM and ORB-SLAM2 evaluating five distinct data sequences: (a) fr3_walking_xyz. (b) fr3_walking_rpy. (c) fr3_walking_halfsphere.
Sensors 26 02846 g004
Figure 5. ATE results for RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark sequences: (a) fr3_walking_xyz. (b) fr3_walking_rpy. (c) fr3_walking_halfsphere.
Figure 5. ATE results for RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark sequences: (a) fr3_walking_xyz. (b) fr3_walking_rpy. (c) fr3_walking_halfsphere.
Sensors 26 02846 g005
Figure 6. Visualization of dynamic feature rejection performance across different modules. (a) ORB-SLAM2. (b) RTS-SLAM (S). (c) RTS-SLAM (G). (d) RTS-SLAM (S+G). (e) RTS-SLAM (S+G+T).
Figure 6. Visualization of dynamic feature rejection performance across different modules. (a) ORB-SLAM2. (b) RTS-SLAM (S). (c) RTS-SLAM (G). (d) RTS-SLAM (S+G). (e) RTS-SLAM (S+G+T).
Sensors 26 02846 g006
Figure 7. Comparison of dense mapping results. (a) Dense map without dynamic object removal. (b) Dense map after removing dynamic objects. (c) Dense map generated using the proposed global sparsification and key-region refinement strategy.
Figure 7. Comparison of dense mapping results. (a) Dense map without dynamic object removal. (b) Dense map after removing dynamic objects. (c) Dense map generated using the proposed global sparsification and key-region refinement strategy.
Sensors 26 02846 g007
Table 1. ATE performance of RTS-SLAM versus ORB-SLAM2 on TUM RGB-D sequences (unit: m).
Table 1. ATE performance of RTS-SLAM versus ORB-SLAM2 on TUM RGB-D sequences (unit: m).
SequencesORB-SLAM2RTS-SLAM (Ours)Improvements
RMSEMeanMedianS.D.RMSEMeanMedianS.D.RMSE (%)Mean (%)Median (%)S.D. (%)
fr3_walking_xyz0.88820.77040.64200.44200.01610.01380.01190.008398.1998.2198.1498.13
fr3_walking_static0.34550.31460.26060.14280.00690.00610.00550.003398.0098.0697.9097.68
fr3_walking_rpy0.64350.54980.53030.33440.02540.01990.01560.015896.0596.3897.0695.26
fr3_walking_half0.35310.30900.29540.17100.02450.02080.01710.012993.0693.2594.2092.48
fr3_sitting_static0.01010.00940.00900.00560.00680.00630.00590.003832.4433.2634.5931.41
Table 2. Relative translational error (RPE) metrics for the proposed RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark (unit: m/s).
Table 2. Relative translational error (RPE) metrics for the proposed RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark (unit: m/s).
SequencesORB-SLAM2RTS-SLAM (Ours)Improvements
RMSEMeanMedianS.D.RMSEMeanMedianS.D.RMSE (%)Mean (%)Median (%)S.D. (%)
fr3_walking_xyz0.34080.28010.24950.23400.01270.01050.00880.007296.2796.2596.4696.94
fr3_walking_static0.24680.09470.06350.11220.00750.00640.00560.003996.9593.2291.1596.49
fr3_walking_rpy0.36360.22610.15870.16430.02090.01530.01200.014294.2693.2392.4691.37
fr3_walking_half0.22460.16890.12600.14800.01650.01290.00980.010392.6692.3992.2593.02
fr3_sitting_static0.01490.01330.01080.00970.00830.00700.00590.004544.0447.0445.1553.75
Table 3. Relative rotational error (RPE) metrics for the proposed RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark (unit: °/s).
Table 3. Relative rotational error (RPE) metrics for the proposed RTS-SLAM versus ORB-SLAM2 across the TUM RGB-D benchmark (unit: °/s).
SequencesORB-SLAM2RTS-SLAM (Ours)Improvements
RMSEMeanMedianS.D.RMSEMeanMedianS.D.RMSE (%)Mean (%)Median (%)S.D. (%)
fr3_walking_xyz7.01595.21334.41864.04870.46640.39880.32960.241893.3592.3592.5494.03
fr3_walking_static3.62741.66890.55333.48360.22630.20530.19240.095393.7687.7065.2397.26
fr3_walking_rpy6.81024.90952.02114.06180.96300.70400.49950.657185.8685.6675.2983.82
fr3_walking_half7.02274.24851.75176.59150.78180.66610.55660.409288.8784.3268.2393.79
fr3_sitting_static0.38300.31500.31890.22140.27500.23990.22350.134528.2023.8529.9339.28
Table 4. ATE performance of the proposed RTS-SLAM compared with other dynamic SLAM algorithms on the TUM RGB-D benchmark (unit: m).
Table 4. ATE performance of the proposed RTS-SLAM compared with other dynamic SLAM algorithms on the TUM RGB-D benchmark (unit: m).
Seq.ORB-SLAM3DS-SLAMSG-SLAMCOEB-SLAMRDS-SLAMYOLO-SLAMDynaSLAMRTS-SLAM (Ours)
RMSES.D.RMSES.D.RMSES.D.RMSES.D.RMSES.D.RMSES.D.RMSES.D.RMSES.D.
fr3_w_xyz0.70120.30180.02470.01610.01800.00940.01820.00940.05710.02290.01460.00700.01560.00790.01610.0083
fr3_w_static0.42180.22460.00810.00670.00810.00360.00740.00320.02060.01200.00730.00350.00790.00430.00690.0033
fr3_w_rpy0.86560.45260.44420.23500.03410.02130.03420.02310.16040.08740.21640.10010.03250.01940.02540.0158
fr3_w_half0.62800.29260.03030.02830.03130.01940.03030.01580.08070.04540.02830.01380.02610.01230.02450.0129
fr3_s_static0.00900.00430.00650.00330.00720.00320.00740.00360.00840.00430.00660.00330.00670.00280.00680.0038
Mean0.52510.25510.10270.05780.01970.01140.01950.01100.06540.03440.05460.02550.01770.00930.01590.0088
Note: Bold values indicate the best performance in each sequence among all compared methods.
Table 5. Comparison of representative dynamic SLAM methods in terms of dynamic feature handling strategies.
Table 5. Comparison of representative dynamic SLAM methods in terms of dynamic feature handling strategies.
MethodSemanticGeometricMotion ConsistencyDynamic Object Handling Strategy
ORB-SLAM3NoYesYesAssumes a static environment and does not explicitly handle dynamic objects
DS-SLAMYes (semantic segmentation)YesNoRemoves feature points on detected dynamic objects using semantic masks
SG-SLAMYesYesYesCombines semantic segmentation and geometric constraints to filter dynamic points
COEB-SLAMYes (object-level)YesNoUses object-level constraints and bounding boxes to suppress dynamic regions
RDS-SLAMYesYesNoIntegrates semantic information with depth-based geometric consistency to suppress dynamic features
YOLO-SLAMYes (object detection)YesYesCombines object detection with geometric verification to filter dynamic features
DynaSLAMYes (Mask R-CNN)YesNoSegments dynamic objects and removes associated feature points
RTS-SLAM (Ours)YesYesYesMulti-constraint dynamic feature rejection using semantic cues, geometric constraints, and trajectory consistency
Note: Bold values indicate the proposed method (RTS-SLAM (Ours)) for clearer visual comparison with other methods.
Table 6. ATE assessment of the proposed RTS-SLAM versus contemporary state-of-the-art algorithms using the Bonn benchmark (unit: m).
Table 6. ATE assessment of the proposed RTS-SLAM versus contemporary state-of-the-art algorithms using the Bonn benchmark (unit: m).
Seq.ORB-SLAM2YOLO-SLAMSG-SLAMRTS-SLAM (Ours)
RMSES.D.RMSES.D.RMSES.D.RMSES.D.
crowd10.86320.62840.033-0.02340.01430.02020.0113
crowd21.35731.20710.423-0.05840.04060.02460.0143
crowd31.07721.00700.069-0.03190.02190.03080.0181
moving_no_box10.11740.09350.027-0.01920.00810.02110.0122
moving_no_box20.11420.09730.035-0.02990.00300.02670.0104
person_tracking10.79590.70900.157-0.04000.01390.03820.0115
person_tracking21.06790.95900.037-0.03760.01540.02510.0131
synchronous11.14110.98840.014-0.32290.18240.08230.0564
synchronous21.40691.32010.007-0.01640.01260.01380.0088
Note: Bold values indicate the best performance in each sequence among all compared methods.
Table 7. ATE assessment for distinct system modules evaluated on the TUM RGB-D benchmark (unit: m).
Table 7. ATE assessment for distinct system modules evaluated on the TUM RGB-D benchmark (unit: m).
Seq.SGS+GS+G+T
RMSES.D.RMSES.D.RMSES.D.RMSES.D.
fr3_w_xyz0.01810.00970.02160.00990.01700.00890.01610.0083
fr3_w_static0.00940.00530.01020.00540.00770.00360.00690.0038
fr3_w_rpy0.03590.02250.23500.14850.03100.01900.02540.0158
fr3_w_half0.07630.05780.04000.02550.03060.01760.02450.0129
fr3_s_static0.00830.00420.00990.00460.00790.00390.00680.0038
Runtime (ms)21.318.522.623.8
Note: Bold values indicate the best performance in each sequence among all ablation settings.
Table 8. Real-time performance evaluation.
Table 8. Real-time performance evaluation.
SystemsAverage Processing Time per Frame (ms)Hardware Platform
YOLO-SLAM696.09Intel Core i5-4288U CPU
ORB-SLAM216.4Intel Core i5-13400F CPU, NVIDIA GeForce RTX 5060 GPU
SG-SLAM39.8Intel Core i5-13400F CPU, NVIDIA GeForce RTX 5060 GPU
COEB-SLAM48.7Intel Core i5-13400F CPU, NVIDIA GeForce RTX 5060 GPU
RTS-SLAM (ours)23.8Intel Core i5-13400F CPU, NVIDIA GeForce RTX 5060 GPU
Table 9. Quantitative comparison of dense mapping efficiency under different strategies.
Table 9. Quantitative comparison of dense mapping efficiency under different strategies.
MethodPointsReduction (%)Memory (MB)Mapping Time (ms)
Original Dense Map1,569,89212041.0
Voxel Grid Filter520,00066.94020.8
RTS-SLAM (Ours)307,20080.42418.7
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, H.; Hu, Q.; Li, B.; Geng, Y.; Su, C.; Zhu, S.; Zheng, E.; Chen, W. RTS-SLAM: A Trajectory Consistency-Driven Multi-Constraint Dynamic Feature-Rejection Method for Visual SLAM in Dynamic Environments. Sensors 2026, 26, 2846. https://doi.org/10.3390/s26092846

AMA Style

Wang H, Hu Q, Li B, Geng Y, Su C, Zhu S, Zheng E, Chen W. RTS-SLAM: A Trajectory Consistency-Driven Multi-Constraint Dynamic Feature-Rejection Method for Visual SLAM in Dynamic Environments. Sensors. 2026; 26(9):2846. https://doi.org/10.3390/s26092846

Chicago/Turabian Style

Wang, Huailiang, Qiming Hu, Beicheng Li, Yuhao Geng, Chao Su, Shibo Zhu, Enhui Zheng, and Weimin Chen. 2026. "RTS-SLAM: A Trajectory Consistency-Driven Multi-Constraint Dynamic Feature-Rejection Method for Visual SLAM in Dynamic Environments" Sensors 26, no. 9: 2846. https://doi.org/10.3390/s26092846

APA Style

Wang, H., Hu, Q., Li, B., Geng, Y., Su, C., Zhu, S., Zheng, E., & Chen, W. (2026). RTS-SLAM: A Trajectory Consistency-Driven Multi-Constraint Dynamic Feature-Rejection Method for Visual SLAM in Dynamic Environments. Sensors, 26(9), 2846. https://doi.org/10.3390/s26092846

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop