Efficient and Spatially Aware 3D Gaussian Splatting for Compact Large-Scale Scene Reconstruction
Abstract
1. Introduction
- We propose a novel large-scale scene reconstruction method based on 3DGS, which can achieve better rendering quality than state-of-the-art methods.
- We present a balanced data partitioning strategy to evenly manage memory consumption and training time across blocks, and modify the densification scheme to enhance the details of faraway objects in the scene.
- We optimize the Gaussian pruning step and introduce the depth regularization to improve the geometric details of the scene.
2. Related Work
2.1. Novel View Synthesis
2.2. Large Scene Reconstruction
3. Our Method
3.1. Preliminary
3.2. Balanced Data Partitioning
3.3. Spatially Aware Density Control
3.4. Gaussian Pruning
3.5. Training Procedure
4. Experiments
4.1. Experimental Setup
4.2. Results Analysis
4.3. Ablation Study
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| 3DGS | 3D Gaussian Splatting |
| NVS | Novel View Synthesis |
| GPU | Graphics Processing Unit |
| VRAM | Video Random Access Memory |
| MLP | Multi-layer Perception |
References
- Yang, Z.; Chai, Y.; Anguelov, D.; Zhou, Y.; Sun, P.; Erhan, D.; Rafferty, S.; Kretzschmar, H. Surfelgan: Synthesizing realistic sensor data for autonomous driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 11118–11127. [Google Scholar]
- Ost, J.; Mannan, F.; Thuerey, N.; Knodt, J.; Heide, F. Neural scene graphs for dynamic scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 19–25 June 2021; pp. 2856–2865. [Google Scholar]
- Yan, Y.; Lin, H.; Zhou, C.; Wang, W.; Sun, H.; Zhan, K.; Lang, X.; Zhou, X.; Peng, S. Street gaussians: Modeling dynamic urban scenes with gaussian splatting. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 156–173. [Google Scholar]
- Zhou, X.; Lin, Z.; Shan, X.; Wang, Y.; Sun, D.; Yang, M.H. Drivinggaussian: Composite gaussian splatting for surrounding dynamic autonomous driving scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 17–18 June 2024; pp. 21634–21643. [Google Scholar]
- Jiang, Y.; Yu, C.; Xie, T.; Li, X.; Feng, Y.; Wang, H.; Li, M.; Lau, H.; Gao, F.; Yang, Y.; et al. Vr-gs: A physical dynamics-aware interactive gaussian splatting system in virtual reality. In ACM SIGGRAPH 2024 Conference Papers; ACM: New York, NY, USA, 2024; pp. 1–11. [Google Scholar]
- Bozcan, I.; Kayacan, E. Au-air: A multi-modal unmanned aerial vehicle dataset for low altitude traffic surveillance. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May–31 August 2020; pp. 8504–8510. [Google Scholar]
- Turki, H.; Ramanan, D.; Satyanarayanan, M. Mega-NERF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 12922–12931. [Google Scholar]
- Mi, Z.; Xu, D. Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields. In Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda, 1–5 May 2023. [Google Scholar]
- Tancik, M.; Casser, V.; Yan, X.; Pradhan, S.; Mildenhall, B.; Srinivasan, P.P.; Barron, J.T.; Kretzschmar, H. Block-nerf: Scalable large scene neural view synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022; pp. 8248–8258. [Google Scholar]
- Martin-Brualla, R.; Radwan, N.; Sajjadi, M.S.M.; Barron, J.T.; Dosovitskiy, A.; Duckworth, D. NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 19–25 June 2021. [Google Scholar]
- Mildenhall, B.; Srinivasan, P.P.; Tancik, M.; Barron, J.T.; Ramamoorthi, R.; Ng, R. Nerf: Representing scenes as neural radiance fields for view synthesis. Commun. ACM 2021, 65, 99–106. [Google Scholar] [CrossRef] [Scilit]
- Kerbl, B.; Kopanas, G.; Leimkühler, T.; Drettakis, G. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph. 2023, 42, 139:1–139:15. [Google Scholar] [CrossRef] [Scilit]
- Lin, J.; Li, Z.; Tang, X.; Liu, J.; Liu, S.; Liu, J.; Lu, Y.; Wu, X.; Xu, S.; Yan, Y.; et al. VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 17–18 June 2024. [Google Scholar]
- Chen, Y.; Lee, G.H. DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus. arXiv 2024, arXiv:2400.00000. [Google Scholar]
- Liu, Y.; Luo, C.; Fan, L.; Wang, N.; Peng, J.; Zhang, Z. Citygaussian: Real-time high-quality large-scale scene rendering with gaussians. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 265–282. [Google Scholar]
- Fan, J.; Li, W.; Han, Y.; Tang, Y. Momentum-GS: Momentum Gaussian Self-Distillation for High-Quality Large Scene Reconstruction. arXiv 2024, arXiv:2412.04887. [Google Scholar]
- Fridovich-Keil, S.; Yu, A.; Tancik, M.; Chen, Q.; Recht, B.; Kanazawa, A. Plenoxels: Radiance Fields without Neural Networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022. [Google Scholar]
- Müller, T.; Evans, A.; Schied, C.; Keller, A. Instant neural graphics primitives with a multiresolution hash encoding. ACM Trans. Graph. 2022, 41, 1–15. [Google Scholar] [CrossRef] [Scilit]
- Yariv, L.; Hedman, P.; Reiser, C.; Verbin, D.; Srinivasan, P.P.; Szeliski, R.; Barron, J.T.; Mildenhall, B. Bakedsdf: Meshing neural sdfs for real-time view synthesis. In ACM SIGGRAPH 2023 Conference Proceedings; ACM: New York, NY, USA, 2023; pp. 1–9. [Google Scholar]
- Sun, C.; Sun, M.; Chen, H.-T. Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022; pp. 5459–5469. [Google Scholar]
- Reiser, C.; Peng, S.; Liao, Y.; Geiger, A. Kilonerf: Speeding up neural radiance fields with thousands of tiny mlps. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 11–17 October 2021; pp. 14335–14345. [Google Scholar]
- Yu, Z.; Chen, A.; Huang, B.; Sattler, T.; Geiger, A. Mip-splatting: Alias-free 3d gaussian splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024; pp. 19447–19456. [Google Scholar]
- Lu, T.; Yu, M.; Xu, L.; Xiangli, Y.; Wang, L.; Lin, D.; Dai, B. Scaffold-gs: Structured 3d gaussians for view-adaptive rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 17–18 June 2024; pp. 20654–20664. [Google Scholar]
- Navaneet, K.L.; Meibodi, K.P.; Koohpayegani, S.A.; Pirsiavash, H. CompGS: Smaller and Faster Gaussian Splatting with Vector Quantization. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024. [Google Scholar]
- Fan, Z.; Wang, K.; Wen, K.; Zhu, Z.; Xu, D.; Wang, Z. LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS. arXiv 2023, arXiv:2311.17245. [Google Scholar]
- Girish, S.; Gupta, K.; Shrivastava, A. Eagles: Efficient accelerated 3d gaussians with lightweight encodings. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 54–71. [Google Scholar]
- Lee, J.C.; Rho, D.; Sun, X.; Ko, J.H.; Park, E. Compact 3D Gaussian Representation for Radiance Field. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 16–22 June 2024; pp. 21719–21728. [Google Scholar]
- Fan, L.; Yang, Y.; Li, M.; Li, H.; Zhang, Z. Trim 3D Gaussian Splatting for Accurate Geometry Representation. arXiv 2024, arXiv:2406.07499. [Google Scholar] [CrossRef] [Scilit]
- Rematas, K.; Liu, A.; Srinivasan, P.P.; Barron, J.T.; Tagliasacchi, A.; Funkhouser, T.; Ferrari, V. Urban radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022; pp. 12932–12942. [Google Scholar]
- Xu, L.; Xiangli, Y.; Peng, S.; Pan, X.; Zhao, N.; Theobalt, C.; Dai, B.; Lin, D. Grid-guided neural radiance fields for large urban scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 18–22 June 2023; pp. 8296–8306. [Google Scholar]
- Kerbl, B.; Meuleman, A.; Kopanas, G.; Wimmer, M.; Lanvin, A.; Drettakis, G. A hierarchical 3d gaussian representation for real-time rendering of very large datasets. ACM Trans. Graph. (TOG) 2024, 43, 1–15. [Google Scholar] [CrossRef] [Scilit]
- Schönberger, J.L.; Frahm, J.-M. Structure-from-Motion Revisited. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016. [Google Scholar]
- Yang, L.; Kang, B.; Huang, Z.; Zhao, Z.; Xu, X.; Feng, J.; Zhao, H. Depth anything v2. Adv. Neural Inf. Process. Syst. 2025, 37, 21875–21911. [Google Scholar]
- Ye, Z.; Li, W.; Liu, S.; Qiao, P.; Dou, Y. Absgs: Recovering fine details in 3d gaussian splatting. In Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, VIC, Australia, 28 October–1 November 2024; pp. 1053–1061. [Google Scholar]
- Chen, Y.; Gu, C.; Jiang, J.; Zhu, X.; Zhang, L. Periodic vibration gaussian: Dynamic urban scene reconstruction and real-time rendering. arXiv 2023, arXiv:2311.18561. [Google Scholar]
- Zhang, Z.; Hu, W.; Lao, Y.; He, T.; Zhao, H. Pixel-gs: Density control with pixel-aware gradient for 3d gaussian splatting. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 326–342. [Google Scholar]
- Lin, L.; Liu, Y.; Hu, Y.; Yan, X.; Xie, K.; Huang, H. Capturing, Reconstructing, and Simulating: The UrbanScene3D Dataset. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2022; pp. 93–109. [Google Scholar]
- Li, Y.; Jiang, L.; Xu, L.; Xiangli, Y.; Wang, Z.; Lin, D.; Dai, B. Matrixcity: A large-scale city dataset for city-scale neural rendering and beyond. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 2–6 October 2023; pp. 3205–3215. [Google Scholar]
- Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhang, R.; Isola, P.; Efros, A.A.; Shechtman, E.; Wang, O. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 586–595. [Google Scholar]






| Method | Building | Rubble | Residence | Sci-Art | MatrixCity | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PSNR ↑ | SSIM ↑ | LPIPS ↓ | PSNR ↑ | SSIM ↑ | LPIPS ↓ | PSNR ↑ | SSIM ↑ | LPIPS ↓ | PSNR ↑ | SSIM ↑ | LPIPS ↓ | PSNR ↑ | SSIM ↑ | LPIPS ↓ | |
| Mega-NeRF [7] | 20.93 | 0.547 | 0.504 | 24.06 | 0.553 | 0.516 | 22.08 | 0.628 | 0.489 | 25.60 | 0.770 | 0.390 | - | - | - |
| Switch-NeRF [8] | 21.54 | 0.579 | 0.474 | 24.31 | 0.562 | 0.496 | 22.57 | 0.654 | 0.457 | 26.52 | 0.795 | 0.360 | - | - | - |
| 3D-GS [12] | 20.46 | 0.720 | 0.305 | 25.47 | 0.777 | 0.277 | 21.44 | 0.791 | 0.236 | 21.05 | 0.830 | 0.242 | 23.67 | 0.735 | 0.384 |
| VastGaussian † [13] | 21.80 | 0.728 | 0.225 | 25.20 | 0.742 | 0.264 | 21.01 | 0.699 | 0.261 | 22.64 | 0.761 | 0.261 | 28.33 | 0.835 | 0.220 |
| CityGaussian [15] | 21.55 | 0.778 | 0.246 | 25.77 | 0.813 | 0.228 | 22.00 | 0.813 | 0.211 | 21.39 | 0.837 | 0.230 | 27.46 | 0.865 | 0.204 |
| DOGS [14] | 22.73 | 0.759 | 0.204 | 25.78 | 0.765 | 0.257 | 21.94 | 0.740 | 0.244 | 24.42 | 0.804 | 0.219 | 28.58 | 0.847 | 0.219 |
| Momentum-GS [16] | 23.23 | 0.815 | 0.194 | 25.93 | 0.827 | 0.201 | 22.21 | 0.818 | 0.197 | 23.02 | 0.856 | 0.205 | 28.01 | 0.880 | 0.179 |
| Ours | 25.51 | 0.834 | 0.174 | 27.22 | 0.814 | 0.178 | 23.43 | 0.820 | 0.169 | 24.74 | 0.842 | 0.170 | 28.42 | 0.849 | 0.174 |
| Scenes | Building | Rubble | Residence | Sci-Art | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Times ↓ | Points | Mem ↓ | Times ↓ | Points | Mem ↓ | Times ↓ | Points | Mem ↓ | Times ↓ | Points | Mem ↓ | |
| Mega-NeRF [7] | 19:49 | - | 5.84 | 30:48 | - | 5.88 | 27:20 | - | 5.99 | 27:39 | - | 5.97 |
| Switch-NeRF [8] | 24:46 | - | 5.84 | 38.30 | - | 5.87 | 35:11 | - | 5.94 | 34:34 | - | 5.92 |
| 3D-GS [12] | 21:37 | 7.99 | 4.62 | 18:40 | 3.85 | 2.18 | 23:13 | 5.35 | 3.23 | 21:33 | 2.31 | 1.61 |
| DOGS [14] | 03:51 | 6.89 | 3.39 | 02:25 | 4.74 | 2.54 | 04:33 | 7.64 | 6.11 | 04:23 | 5.67 | 3.53 |
| Momentum-GS [16] | 03:32 | 8.33 | 2.45 | 02:49 | 5.09 | 1.50 | 04:11 | 6.79 | 2.00 | 03:45 | 3.30 | 0.97 |
| Ours | 00:52 | 6.49 | 1.51 | 00:43 | 4.85 | 1.23 | 01:23 | 7.54 | 1.87 | 01:21 | 5.51 | 1.34 |
| Scenes | Building | Rubble | ||||
|---|---|---|---|---|---|---|
| PSNR ↑ | SSIM ↑ | LPIPS ↓ | PSNR ↑ | SSIM ↑ | LPIPS ↓ | |
| w.o. BP | 21.74 | 0.732 | 0.223 | 24.72 | 0.745 | 0.237 |
| w.o. SD | 23.08 | 0.770 | 0.194 | 25.43 | 0.761 | 0.201 |
| w.o. DR | 25.31 | 0.816 | 0.186 | 26.81 | 0.792 | 0.182 |
| full model | 25.51 | 0.834 | 0.174 | 27.22 | 0.814 | 0.178 |
| PSNR ↑ | SSIM ↑ | LPIPS ↓ | |
|---|---|---|---|
| Fixed High (1.0) | 23.71 | 0.783 | 0.207 |
| Fixed Low (0.01) | 25.30 | 0.812 | 0.191 |
| Decay | 25.51 | 0.834 | 0.174 |
| PSNR ↑ | SSIM ↑ | LPIPS ↓ | Times ↓ | Points | Mem ↓ | |
|---|---|---|---|---|---|---|
| 0 | 25.42 | 0.827 | 0.180 | 01:19 | 7.71 | 1.78 |
| 0.1 | 25.48 | 0.830 | 0.173 | 01:10 | 7.09 | 1.64 |
| 0.2 | 25.51 | 0.834 | 0.174 | 00:58 | 6.49 | 1.51 |
| 0.3 | 25.21 | 0.813 | 0.191 | 00:52 | 5.92 | 1.37 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Luo, H.; Tu, Z.; He, J.; Yuan, J. Efficient and Spatially Aware 3D Gaussian Splatting for Compact Large-Scale Scene Reconstruction. Appl. Sci. 2026, 16, 965. https://doi.org/10.3390/app16020965
Luo H, Tu Z, He J, Yuan J. Efficient and Spatially Aware 3D Gaussian Splatting for Compact Large-Scale Scene Reconstruction. Applied Sciences. 2026; 16(2):965. https://doi.org/10.3390/app16020965
Chicago/Turabian StyleLuo, Hao, Zhituo Tu, Jialei He, and Jie Yuan. 2026. "Efficient and Spatially Aware 3D Gaussian Splatting for Compact Large-Scale Scene Reconstruction" Applied Sciences 16, no. 2: 965. https://doi.org/10.3390/app16020965
APA StyleLuo, H., Tu, Z., He, J., & Yuan, J. (2026). Efficient and Spatially Aware 3D Gaussian Splatting for Compact Large-Scale Scene Reconstruction. Applied Sciences, 16(2), 965. https://doi.org/10.3390/app16020965

