1. Introduction
Autonomous underwater vehicles (AUVs) and remotely operated vehicles (ROVs) are widely used in subsea inspection, marine surveying, intervention, and object search tasks such as unexploded ordnance (UXO) localization [
1,
2]. These tasks require simultaneous localization and mapping (SLAM) to estimate robot motion and build metrically consistent maps of the surrounding environment [
3,
4]. However, underwater visual perception differs from terrestrial imaging because of light attenuation, wavelength-dependent color shift, scattering, caustics, and reflections [
5,
6]. Commodity active RGB-D sensors are also often limited underwater due to attenuation, scattering, and refraction [
7]. Therefore, many underwater SLAM systems still rely on monocular or vision-dominant inputs, which are affected by scale ambiguity, scale drift, and underwater appearance changes [
3,
4]. Forward-looking sonar (FLS) provides acoustic range measurements that do not depend on visual texture and are related to physical distance [
8,
9]. This makes sonar useful for providing metric constraints when monocular vision lacks absolute scale [
10,
11]. However, raw FLS observations are sparse, ambiguous, and noisy. Limited angular resolution, elevation ambiguity, multipath reflections, and reverberation can produce incorrect or duplicated returns, especially around reflective objects, metallic targets, and confined environments such as pools or tanks [
11,
12]. Thus, raw sonar measurements cannot be directly treated as dense and unambiguous geometric observations. In this work, we use sonar to provide sparse metric cues for visual geometry regularization.
Recently, 3D Gaussian Splatting (3DGS) has provided explicit scene representations for efficient differentiable rendering [
13]. Its rendering efficiency has further motivated Gaussian-based SLAM systems for dense tracking and mapping [
14,
15]. Applying 3DGS SLAM underwater remains challenging because Gaussian mapping depends on geometric initialization. Depth errors affect where Gaussian primitives are inserted, how their spatial scales are initialized, and how later optimization proceeds. Although monocular depth foundation models can provide dense depth predictions [
16,
17,
18], underwater images may differ from their training data because of color shift, caustics, reflections, low-texture surfaces, and underwater-specific object appearances. These depth errors can lead to inaccurate Gaussian placement and scale initialization during incremental reconstruction. For underwater scenes, 3DGS-based methods have incorporated underwater image formation models, attenuation–backscatter modeling, or uncertainty-aware visual geometry into reconstruction and SLAM [
6,
7,
19,
20]. Sonar-aware Gaussian methods have also shown that acoustic measurements can be useful for underwater reconstruction and sonar view synthesis [
21,
22,
23].
However, existing underwater 3DGS SLAM systems mainly rely on visual inputs, where geometric priors are usually obtained from monocular depth estimation, visual tracking, or tracking-derived uncertainty. In contrast, sonar–Gaussian methods mainly focus on reconstruction or acoustic rendering rather than visual SLAM. How to use sparse and noisy sonar measurements as metric constraints for 3DGS SLAM remains insufficiently explored.
To address this problem, we propose SonarReg-GS SLAM, an object-aware visual–acoustic underwater 3D Gaussian Splatting SLAM framework with sparse sonar-guided depth regularization. The key idea is to use sonar as a sparse metric regulator for monocular depth rather than directly inserting raw sonar measurements into the Gaussian optimizer. Given an RGB image, we first extract object masks using open-vocabulary segmentation models [
24]. These masks are not used for dense semantic mapping. Instead, they provide weak spatial priors to constrain acoustic range extraction. Inspired by object-level opti-acoustic range association [
11], sampled mask rays are matched to corresponding sonar beams, where thresholded dominant echo responses are selected as sparse sonar anchors after target-class filtering, near-contour sampling, bearing-to-beam gating, and valid-pair checking.
The extracted sonar anchors provide sparse range constraints with physical scale, while monocular depth provides dense structural information. We use these anchors to estimate and regularize the scale of monocular depth, producing dense metric depth priors for Gaussian initialization and tracking. Our system reconstructs the entire scene as a dense Gaussian map while using object masks to enhance detected object regions during optimization. Specifically, the object-aware loss keeps the standard full-image photometric and depth supervision and assigns higher weights to pixels inside the detected object masks. In this way, the system still reconstructs the full scene while improving local geometry and appearance in object regions.
In contrast to existing visual–acoustic SLAM systems that typically use sonar observations as sparse landmarks, range factors, or pose constraints, SonarReg-GS SLAM converts filtered, object-conditioned FLS returns into sparse metric depth anchors for monocular depth regularization. Compared with monocular 3DGS-SLAM methods, SonarReg-GS SLAM retains the same objective of camera tracking and dense full-scene Gaussian mapping but introduces external acoustic range cues to regularize the monocular depth prior before it is used in the subsequent SLAM pipeline. The resulting sonar-regularized depth is used for dense tracking, Gaussian initialization, and depth supervision during mapping. Unlike sonar-guided Gaussian reconstruction or novel view synthesis methods, SonarReg-GS SLAM focuses on RGB–FLS tracking and dense Gaussian mapping, with sonar serving as an external geometric prior rather than as a dense scene representation or acoustic rendering signal.
We evaluate the proposed SonarReg-GS SLAM on two public RGB–sonar underwater datasets: an object-centric UXO dataset [
12] and a pool-based OPTI dataset [
11]. Compared with representative classical SLAM and 3DGS SLAM baselines, our method shows improved tracking accuracy and mapping quality, indicating that the introduced sonar modality contributes useful metric constraints for underwater Gaussian Splatting SLAM.
The main contributions of this work are summarized as follows:
We present SonarReg-GS SLAM, an underwater visual–acoustic 3D Gaussian Splatting SLAM framework that integrates synchronized RGB and forward-looking sonar inputs for tracking and dense full-scene Gaussian mapping.
We introduce a sparse sonar-guided depth regularization mechanism that uses filtered FLS range anchors to generate metric depth priors for Gaussian initialization and tracking.
We design an object-aware RGB mask loss that increases photometric supervision in detected object regions without restricting the system to object-only mapping.
The remainder of this paper is organized as follows.
Section 2 reviews related work on underwater visual–acoustic SLAM, Gaussian Splatting-based SLAM, and sonar-guided reconstruction.
Section 3 introduces the preliminaries of 3D Gaussian Splatting and forward-looking sonar imaging geometry.
Section 4 presents the proposed SonarReg-GS SLAM framework, including sonar-guided depth regularization, dense tracking, and Gaussian mapping with object-aware supervision.
Section 5 describes the experimental setup and presents the quantitative comparisons, qualitative results, ablation studies, and robustness analyses.
Section 6 discusses the limitations of the proposed method and possible directions for future work. Finally,
Section 7 concludes the paper.
4. Method
4.1. Overview
Given a sequence of RGB frames and synchronized FLS images captured in underwater environments, our framework estimates the camera trajectory while reconstructing the scene as a dense 3D Gaussian map. Building on the 3DGS and FLS imaging formulations introduced in
Section 3, our method constructs a sonar-regularized depth prior and integrates it into dense tracking and Gaussian mapping. Since monocular depth estimators provide dense structural cues but usually lack a reliable metric scale in underwater scenes, we use FLS measurements as sparse metric anchors to regularize monocular depth.
Specifically, Grounded-SAM object masks are used as object-level spatial priors for acoustic association. We sample near-side contour pixels from the detected object masks, associate their horizontal visual bearings with corresponding FLS azimuth beams, and extract reliable echo ranges as sparse range anchors. These anchors are used to estimate an object-conditioned scale factor for each valid object mask in a selected keyframe and construct a sonar-regularized depth prior (
) within the corresponding object-mask region (
Section 4.2).
The corrected depth prior is incorporated into dense tracking through inverse-depth regularization in dense bundle adjustment (
Section 4.3). For mapping, we follow the common Gaussian map optimization pipeline and introduce an object-aware RGB mask loss to strengthen supervision inside detected object regions without changing the dense full-scene mapping objective (
Section 4.4).
4.2. Sonar-Guided Depth Regularization
We use FLS measurements as sparse metric constraints for regularization of monocular depth in selected keyframes. For clarity, we describe the procedure for one selected keyframe and omit the keyframe index unless necessary. Given an RGB image (I) and a synchronized FLS image (S), the module constructs a sonar-regularized depth prior ().
Object-mask prior and near-side contour sampling. Given an RGB image (I), Grounded-SAM extracts target object masks according to the target prompt. If multiple target masks are detected, we process each mask independently to avoid mixing acoustic anchors from objects at different ranges. For clarity, we describe the following procedure for one object mask and denote it as . The mask serves as an object-level spatial prior for acoustic association rather than as a dense semantic map.
We obtain an initial dense monocular depth map (
) using the Metric3D V2 depth estimator [
18]. Although
provides dense structural cues, its metric scale can be unreliable in underwater scenes. Therefore, we use
mainly to select candidate acoustic queries and use FLS measurements to provide metric-scale constraints.
Specifically, we first extract a boundary band (
B) from
and compute a near-side depth threshold (
) from the depth values on the boundary. The near-side contour samples are selected as
where
is the
-th percentile of
. This contour-biased sampling is motivated by the fact that FLS echoes are often dominated by the closest visible or strongly reflective surface of the object.
Opti-acoustic association and range-anchor extraction. We compute the horizontal visual bearing for each sampled mask-contour coordinate (
) from the camera intrinsics:
where
and
denote the horizontal focal length and principal point of the RGB camera intrinsic matrix, respectively.
Since the camera and FLS are mounted in a co-located and approximately aligned configuration, we use
to query the corresponding azimuth beam in the FLS image. For more general camera–sonar rigs, this association would require explicit extrinsic calibration. Along this associated beam, we apply a Constant False-Alarm Rate (CFAR)-based detector to extract a statistically significant echo response and use its range as the acoustic anchor. The CFAR estimates an adaptive threshold from neighboring reference cells, making it suitable for sonar images with spatially varying reverberation [
36,
37].
Under the co-located and approximately aligned sensor setup, we use the extracted FLS range as an approximate metric anchor to correct the scale of the monocular depth in the corresponding object region.
Candidate anchors are further filtered by local consistency in the bearing-range space, since valid object echoes usually form a locally smooth contour in the FLS image. The retained valid range-anchor set is denoted as
Here, denotes the FLS range extracted from the azimuth beam associated with .
Scale estimation and regularized depth prior. Under the approximately co-located and aligned camera–FLS setup, we use the monocular depth values at the associated contour samples as approximate range proxies for scale estimation.
For this object mask, we estimate a scale factor by comparing the retained FLS ranges with the monocular depth values at the corresponding sampled coordinates:
Here,
is computed over all valid anchor pairs (
), and
is a small constant for numerical stability.
The corrected depth prior is obtained by applying this scale inside the detected object-mask region:
When multiple target masks are present, the same procedure is applied independently to each mask to avoid mixing anchors from objects at different ranges. For keyframes without sufficient reliable anchors, the system falls back to the original monocular depth prior. The resulting prior for keyframe k is denoted as when used in the tracking and mapping modules.
It should be noted that the proposed sonar regularization does not directly impose a global trajectory-scale constraint. Instead, it provides local metric depth anchors in object-mask regions, which are mainly used to improve Gaussian initialization and depth supervision for mapping and are also incorporated as regularized depth priors during dense tracking.
4.3. Dense Tracking with Sonar-Regularized Depth Prior
Underwater image sequences often contain weak texture, reduced contrast, and medium-induced appearance changes, which make sparse feature matching unstable. We therefore adopt a dense tracking architecture inspired by DROID-SLAM [
38]. The tracker estimates dense pixel-wise correspondences between covisible frames and refines them recurrently, providing stronger constraints for pose estimation than sparse keypoints.
As shown in
Figure 1, the tracking module follows a feature extraction–optical flow–recurrent refinement–dense optimization pipeline. Specifically, a Convolutional Gated Recurrent Unit (ConvGRU) is used for correspondence refinement, and a Dense Bundle Adjustment (DBA) layer is used for joint pose and inverse-depth optimization. The tracking problem is formulated on an active covisibility graph (
, where
V denotes the selected keyframes and
denotes the pairwise frame connections used for optimization). For each connected keyframe pair, dense image features are first extracted and used by the optical-flow update module to estimate pixel-wise correspondences across frames. The ConvGRU [
38] recurrently refines these correspondences and predicts their confidence weights. The refined correspondences are then passed to the DBA layer, which jointly optimizes keyframe poses and inverse-depth maps.
Let
denote the camera-to-world pose of keyframe
i, and let
denote the optimized inverse-depth map. We incorporate the sonar-regularized depth prior into DBA as an inverse-depth regularization term:
Here, denotes the set of pixels used for dense tracking, and and are camera projection and back-projection operators, respectively.
The first term minimizes the dense reprojection residual induced by the recurrently refined correspondences. denotes the Mahalanobis distance, where represents the confidence weights predicted by the optical-flow update module. The second term regularizes the optimized inverse depth using the sonar-regularized keyframe depth prior (). Here, denotes the depth-supervision coefficient of the DROID-SLAM-based dense bundle adjustment backend, and is a validity weight that disables the regularization where the prior is invalid or unreliable.
In contrast with directly using the initial monocular depth (), the prior () contains object-region scale correction from reliable FLS range anchors. In this way, acoustic measurements influence tracking indirectly through the regularized depth prior rather than being introduced as explicit sonar reprojection or point-matching residuals in the pose optimization. This design preserves the dense visual tracking formulation while introducing sparse metric-scale information from FLS measurements.
4.4. Gaussian Mapping with Object-Aware Mask Supervision
After the tracking module estimates the pose of a newly inserted keyframe, its RGB image (I), sonar-regularized depth prior (), and camera pose are forwarded to the mapping module. The mapping module maintains a full-scene 3D Gaussian map and updates it incrementally as new keyframes are processed.
Following common Gaussian-SLAM practice, the depth prior is used as proxy geometry to initialize or expand Gaussian primitives in newly observed regions, while the map parameters are refined by differentiable RGB and depth rendering.
For each selected keyframe, we render an RGB image () and a metric depth map () from the current Gaussian map at the corresponding camera pose. The observed RGB image (I) provides full-image photometric supervision, while the sonar-regularized depth prior () constrains the rendered depth. Therefore, the mapping objective is first defined over the full image to preserve dense full-scene reconstruction.
The RGB reconstruction loss combines photometric and structural similarity terms:
which provides full-image appearance supervision for Gaussian color, opacity, and geometric optimization. The depth consistency loss constrains the rendered depth using the sonar-regularized depth prior:
Underwater target objects often occupy limited image regions and can be weakly constrained by global photometric losses, especially under low contrast, turbidity, and background clutter. To strengthen the reconstruction of detected target objects without changing the full-scene mapping objective, we introduce an object-aware RGB mask loss that provides additional photometric supervision inside the object-mask regions, defined as
where ⊙ denotes element-wise multiplication and
is a small constant for numerical stability.
This term is not a semantic segmentation loss and does not restrict mapping to the object region. Instead, it adds region-level photometric supervision inside the detected object mask, improving the reconstruction of target objects while preserving the dense full-scene Gaussian mapping objective.
We also use a perceptual loss to improve perceptual consistency:
In addition, an isotropic scale regularization term (
) is applied to penalize large-scale differences among the three axes of each Gaussian primitive, preventing excessively elongated or flattened Gaussians during map optimization. The final mapping objective is written as follows:
where the scalar weights balance the contribution of each term. The RGB, perceptual, and isotropic regularization terms follow common Gaussian mapping practice, while
and
incorporate the proposed sonar-regularized depth prior and object-aware supervision.
5. Experiments
5.1. Experimental Setup
Datasets. We evaluate the proposed SonarReg-GS SLAM on two public underwater RGB–sonar datasets collected in real-world sensing setups: the UXO dataset [
12] and the OPTI dataset [
11]. Both datasets provide synchronized optical and acoustic observations, making them suitable for evaluating whether sparse sonar measurements can serve as metric constraints for underwater monocular GS-SLAM.
The UXO dataset [
12] is an acoustic–optical dataset collected for underwater unexploded ordnance perception. The data were captured in a controlled test basin using an ARIS Explorer 3000 imaging sonar (Sound Metrics Corporation, Bellevue, WA, USA) and a HERO8 Black camera (GoPro, Inc., San Mateo, CA, USA) mounted on a pan-tilt unit attached to a gantry crane. The dataset contains multiple UXO-like targets, including a 100 lb general purpose bomb, a phosphor bomb, a mortar bomb, and a test cylinder. It provides raw and polar-transformed sonar frames, matched camera frames, calibration parameters, target information, and sensor metadata. These sequences contain metallic objects, strong acoustic reflections, low-texture regions, and underwater appearance variations, which make them challenging for purely visual SLAM and suitable for evaluating sonar-guided metric regularization. In the experimental results, we use the original recording-oriented sequence names to identify the evaluated UXO sequences. Specifically, “100lbs_bomb” denotes a selected recording of the 100 lb general-purpose bomb. “15cm_mortar” denotes a selected mortar sequence with a propellant charge case and tail fins. “20 lbs” denotes a selected recording of a deformed phosphor bomb. “100lbs_bomb_floor” denotes a recording of the 100 lb bomb placed on the basin floor, and “test_cylinder” denotes a selected recording of the reference cylinder. These names are used consistently in the quantitative tables and qualitative figures.
The OPTI dataset [
11] is an underwater opti-acoustic semantic SLAM dataset collected with a monocular camera, multibeam sonar, an IMU, a DVL, and a pressure sensor. It contains indoor and outdoor underwater sequences with challenging acoustic and lighting conditions. The dataset provides reference trajectories obtained from a low-cost Hybrid Long/Inverted Ultra-Short Baseline (iLBL-USBL) acoustic beacon system, enabling quantitative evaluation of trajectory accuracy. We use three OPTI sequences, denoted as Run1, Run2, and Run3, to evaluate the robustness of different SLAM systems under real underwater opti-acoustic sensing conditions.
Reference Trajectories. For the OPTI dataset, we directly use the provided reference trajectories for localization evaluation. For the UXO dataset, ready-to-use per-frame camera-trajectory ground truth is not provided in the format required by our SLAM evaluation pipeline. Therefore, we reconstruct reference camera trajectories using COLMAP 3.10-dev [
39]. Following common practice in underwater SLAM evaluation [
7,
40], these SfM-reconstructed trajectories are used as pseudo reference trajectories for quantitative comparison.
Baselines. We compare SonarReg-GS SLAM with representative classical and Gaussian-based SLAM methods, including ORB-SLAM3 [
27], MonoGS [
14], and Splat-SLAM [
31]. ORB-SLAM3 is included as a classical feature-based SLAM baseline. MonoGS and Splat-SLAM are selected as representative monocular Gaussian splatting SLAM systems. For ORB-SLAM3 and MonoGS, we evaluate both depth-free and depth-enabled variants when applicable. The depth-free setting uses only monocular RGB input, while the depth-enabled setting incorporates estimated monocular depth priors. For depth-enabled variants, we use the same monocular depth estimator [
18] as the initial depth source, without sonar-based scale regularization. Splat-SLAM is evaluated under its default depth-prior setting, since it relies on monocular depth priors in its standard pipeline. Our method further uses sonar-derived metric cues to regularize the depth scale during tracking and Gaussian mapping.
Existing underwater visual–acoustic SLAM systems, such as Opti-Acoustic Semantic SLAM [
11] and SVIn2 [
4], are considered as related work rather than direct quantitative baselines because their sensing assumptions and output representations are different from ours. These systems rely on additional sensors such as IMU, DVL, and pressure/depth sensors, which provide motion, scale, or depth constraints beyond the RGB-FLS setting considered in this work. Moreover, they mainly produce trajectory or landmark estimates, whereas ours targets dense full-scene Gaussian mapping with rendering-based evaluation.
Metrics. We report the Absolute Trajectory Error (ATE) RMSE to evaluate tracking accuracy. Before computing the error, each estimated trajectory is aligned with the reference trajectory using Sim(3) Umeyama alignment. This metric evaluates trajectory consistency after global similarity alignment. Since our sonar-guided depth regularization is applied locally within object-mask regions, the Sim(3)-aligned ATE is used to assess tracking robustness rather than to independently verify global scale accuracy. The metric-scale effect of sonar anchors is instead reflected through the object-region depth regularization process and the rendering-based mapping results. For mapping quality, we evaluate the rendered images using PSNR, SSIM [
41], and LPIPS [
42]. PSNR reflects pixel-wise reconstruction fidelity; a higher value indicates better rendering quality. SSIM measures structural consistency between the rendered and reference images, with larger values corresponding to better structural similarity. LPIPS evaluates perceptual discrepancy in a learned feature space; a lower score indicates higher perceptual similarity.
Implementation Details. All experiments are conducted on a workstation with an Intel Core i9-14900KF CPU, 32 GB RAM, and an NVIDIA RTX 4090 GPU. The system runs Ubuntu 22.04 LTS, and the implementation uses Python 3.10.18, PyTorch 2.1.0, and CUDA 11.8. All compared methods are evaluated under the same hardware environment.
5.2. Visualization of Sonar-Guided Depth Regularization
Before presenting quantitative tracking and mapping results, we first visualize the proposed sonar-guided depth regularization process. Since dense ground-truth depth is unavailable in the evaluated datasets, this visualization is intended to illustrate the RGB–sonar association and depth-scale correction process rather than to evaluate depth accuracy.
Figure 2 shows representative examples from the UXO dataset. The RGB images provide object masks and near-side contour samples, which define the visual support for acoustic association. For these sampled pixels, the corresponding FLS azimuth beams are queried to extract valid range anchors after echo filtering and local consistency checking. The extracted anchors are then used to estimate an object-region scale factor and construct the sonar-regularized depth prior.
Compared with the initial monocular depth (), the sonar-regularized depth prior () shows structured scale adjustment in the detected object regions. This indicates that sonar measurements are not directly inserted as dense geometry; instead, they are used as sparse metric constraints to regularize monocular depth before tracking and Gaussian mapping.
Because dense ground-truth depth is unavailable, this visualization does not establish that is directly more accurate than . Instead, is treated as a sonar-constrained depth prior for the downstream SLAM pipeline. Its practical effectiveness in improving tracking and Gaussian mapping is evaluated quantitatively in the subsequent experiments and further verified through the ablation study.
5.3. Tracking Results
Table 1 reports the tracking accuracy on the UXO dataset; representative trajectories are visualized in
Figure 3a–c. Our method achieves the lowest average ATE RMSE of 0.1015 m, outperforming ORB-SLAM3, MonoGS, and Splat-SLAM. Compared with the Gaussian-based SLAM baseline, Splat-SLAM, our method reduces the average ATE by 21.7%. Moreover, our method ranks first or second on all five sequences, showing more consistent tracking performance across different UXO objects and scene layouts.
It is worth noting that directly introducing monocular depth does not consistently improve tracking. For example, MonoGS with depth obtains a higher average ATE than its depth-free variant. This suggests that monocular depth priors in underwater scenes can still suffer from scale errors and scene-dependent bias. In contrast, our sonar-guided regularization provides an additional depth prior for dense tracking using sparse but metrically grounded FLS range anchors.
Table 2 reports the tracking accuracy on the OPTI dataset; a representative trajectory is visualized in
Figure 3d. ORB-SLAM3 fails on all sequences under both depth-free and depth-enabled settings, indicating that OPTI poses significant challenges to traditional feature-based visual SLAM. Among the successfully tracked methods, our method achieves the lowest average ATE RMSE of 0.4640 m, reducing the average error by 18.4% compared with Splat-SLAM and by 49.1% compared with MonoGS without depth.
Similarly, directly incorporating monocular depth does not improve MonoGS on this dataset. MonoGS with depth obtains a higher average ATE than its depth-free variant, suggesting that monocular depth priors can introduce scale bias and scene-dependent errors in underwater environments. Our method does not obtain the best result on every individual OPTI sequence, but it achieves the lowest average ATE, suggesting that sonar-guided depth regularization provides useful constraints for overall tracking performance.
5.4. Mapping Results
Table 3 reports the quantitative rendering results on the UXO dataset, while
Figure 4 provides the corresponding qualitative comparisons. Our method achieves the best average PSNR of 29.61 dB and the lowest average LPIPS of 0.173. Specifically, our method obtains the best PSNR and LPIPS on all five sequences, indicating improved photometric fidelity and perceptual rendering quality. Compared with MonoGS with depth, our method improves the average PSNR by 1.56 dB and reduces LPIPS by 52.3%.
Although our method does not achieve the highest average SSIM, it maintains competitive structural similarity while substantially improving PSNR and LPIPS. This result suggests that the sonar-regularized depth prior provides useful supervision for Gaussian mapping, especially in terms of photometric fidelity and perceptual quality.
Table 4 reports the quantitative rendering results on the OPTI dataset, while
Figure 5 provides the corresponding qualitative comparisons. Our method achieves the best average PSNR of 28.63 dB and the lowest average LPIPS of 0.303 while obtaining a comparable average SSIM. In particular, our method improves the average PSNR from 20.91 dB to 28.63 dB compared with MonoGS without depth and reduces the average LPIPS from 0.450 to 0.303. Compared with Splat-SLAM, our method improves the average PSNR by 10.03 dB and reduces LPIPS by 52.9%.
These rendering results suggest that sonar-regularized depth supervision improves Gaussian mapping quality, especially in terms of PSNR and LPIPS. Although MonoGS without depth achieves a slightly higher SSIM on some individual runs, our method consistently obtains the best PSNR and LPIPS on all three sequences, suggesting better photometric fidelity and perceptual rendering quality.
5.5. Robustness Analysis
Robustness to Object-Mask Perturbations. We evaluate the robustness of the proposed association strategy to two common types of segmentation error: mask-boundary variation and spatial localization error. The experiments are conducted on the 100lbs_bomb sequence. For mask-boundary variations, the detected masks are eroded or dilated by 5 and 10 pixels. For localization errors, the entire masks are shifted horizontally or vertically by and pixels. For each spatial-shift setting, the results from the two opposite directions along the same axis are averaged. Only the mask input is perturbed, while all other system components and parameters remain unchanged.
As shown in
Table 5, the proposed method remains stable under the tested perturbations. Across all perturbed settings, the ATE RMSE ranges from 0.0614 m to 0.0700 m, the PSNR from 30.25 dB to 30.84 dB, the SSIM from 0.881 to 0.891, and the LPIPS from 0.115 to 0.126. These results are comparable to those obtained with the original mask, which achieves an ATE RMSE of 0.0624 m, a PSNR of 30.95 dB, an SSIM of 0.886, and an LPIPS of 0.121.
Among the tested localization perturbations, horizontal shifts produce the largest increase in ATE RMSE. This observation is consistent with the association mechanism because horizontal displacement directly changes the visual bearing used to query the corresponding FLS beam. Nevertheless, even under a horizontal shift of pixels, the method achieves an ATE RMSE of 0.0700 m and a PSNR of 30.40 dB without tracking failure. The observed stability is consistent with the use of near-side contour sampling, bearing-to-beam gating, echo-response filtering, local consistency checking, valid-pair verification, and median-based scale estimation, which reduce the influence of moderate mask inaccuracies.
Overall, the results indicate that the proposed association strategy tolerates moderate mask-boundary and localization errors without substantial degradation in tracking or rendering performance.
Robustness to Camera–Sonar Alignment Errors. Robustness evaluation is important for the practical deployment of robotic perception and SLAM systems [
43,
44].
In our setup, the camera and FLS are mounted in a co-located and approximately aligned configuration, allowing the horizontal visual bearing to be directly used for querying of the corresponding FLS azimuth beam. We therefore evaluate the sensitivity of SonarReg-GS SLAM to residual yaw misalignment between the two sensors.
Specifically, synthetic yaw offsets of , , and are introduced into the bearing-to-beam association, while all other components and parameters remain unchanged. Results for positive and negative offsets with the same magnitude are averaged.
As shown in
Table 6, the proposed method shows limited performance variation under the tested perturbations. The ATE RMSE remains within the range of 0.0631–0.0681 m, and PSNR values fall within the range of 30.46–30.66 dB. The SSIM remains at 0.883, while the LPIPS ranges from 0.120 to 0.122. Even at an absolute yaw offset of
, the method achieves an ATE RMSE of 0.0665 m and a PSNR of 30.66 dB.
These results indicate reasonable robustness to residual yaw misalignment under the approximately aligned sensor configuration.
Parameter Sensitivity. We conduct one-factor-at-a-time experiments on the 100lbs_bomb sequence for the mask-loss weight, sonar intensity threshold, and RGB–FLS association beam window.
The sonar intensity threshold filters weak echo responses: a candidate range anchor is retained only when the strongest sampled echo response is no lower than the threshold, whose default value is 0.15. For the association sensitivity analysis, the beam window specifies the number of adjacent FLS beams searched on each side of the beam predicted from the visual bearing. The maximum response within this window is used for range extraction, and the default value of 0 denotes nearest-beam association.
Each parameter is varied independently while all other settings remain unchanged. The main setting serves as the common reference point for the three parameter sweeps.
As shown in
Table 7, the method remains stable over the tested parameter ranges. Varying the mask-loss weight results in an ATE RMSE of 0.0623–0.0697 m and a PSNR of 30.34–30.95 dB. Changing the sonar intensity threshold yields an ATE RMSE of 0.0624–0.0714 m and a PSNR of 30.40–30.95 dB. Similarly, varying the association beam window from 0 to 5 produces an ATE RMSE of 0.0624–0.0648 m and a PSNR of 30.53–30.95 dB. Overall, the tracking and rendering metrics show limited variation over the tested parameter ranges. This indicates that the proposed method has limited sensitivity to moderate variations in the evaluated parameters. The default settings used in the main experiments provide a practical balance between object-region supervision, acoustic-anchor reliability, and anchor availability rather than optimizing a single evaluation metric.
5.6. Ablation Study
We conduct an ablation study on the 100lbs_bomb sequence to evaluate the effects of the sonar-guided depth-scale correction and the object-aware mask loss. As shown in
Table 8, removing the depth-scale correction increases the ATE RMSE from 0.0624 m to 0.0642 m and decreases the PSNR from 30.95 dB to 29.45 dB. This result suggests that FLS range anchors provide useful scale cues for monocular depth regularization, especially in terms of improving rendering quality in this sequence.
Removing the object-aware mask loss also degrades rendering quality, reducing PSNR from 30.95 dB to 30.28 dB and slightly worsening SSIM and LPIPS. This suggests that the proposed mask loss strengthens photometric supervision inside detected object regions and helps preserve target appearance without changing the full-scene mapping objective. Overall, the full model achieves the best results on this ablation sequence, supporting the complementary effects of sonar-guided depth regularization and object-aware mask supervision.