Optimization of Manifold Learning Using Differential Geometry for 3D Reconstruction in Computer Vision
Abstract
1. Introduction
- Motivation and Problem Statement
- Contributions of the research
- To suggest an optimal manifold learning model (OML-DGF) that learns differential geometric features for structurally consistent low-dimensional embeddings.
- To introduce a curvature-sensitive embedding approach through augmenting LLE with second-order derivatives from the local tangent spaces.
- To build Riemannian metric-based neighborhood graphs by geodesic approximations to provide correct spatial connectivity.
- To develop a curvature-regularized objective function for better geometric coherence in embedding.
- To illustrate the efficacy of the proposed technique on the ModelNet40 data set, with a maximum of 17% enhancement in reconstruction precision over conventional approaches, with real-time scaling to applications of 3D vision.
2. Related Works
- Research Gaps
3. Problem Formulation
4. Optimization of Manifold Learning Using Differential Geometry Framework
4.1. Dataset Description: ModelNet40
4.2. Preprocessing Techniques
4.3. Curvature-Weighted Embedding Development
Pseudocode-1: Curvature-Weighted Embedding Optimization Algorithm in OML-DGF Framework |
# Input: X: High-dimensional input point cloud; k: Number of neighbors; κ: Curvature values for each point; G: Riemannian neighborhood graph with geodesic distances; α: Curvature regularization weight; T: Number of optimization iterations; η: Learning rate # Output: Y: Optimized low-dimensional embedding # Step 1: Compute curvature-aware LLE weights C = Z.T @ Z # Step 2: Initialize low-dimensional embedding Y (e.g., via PCA) # Step 3: Optimize embedding with gradient descent : # Geodesic preservation term # Curvature-weighted LLE reconstruction term # Update embedding return Y |
4.4. Embedding Space Optimization
4.5. 3D Reconstruction from Optimized Embeddings
Pseudocode-2: Geometry-Aware 3D Reconstruction from Optimized Embeddings |
Learning rate Reconstructed high-dimensional point cloud # Step 1: Initialize reconstructed point cloud # Step 2: Iterative reconstruction with loss minimization # Local reconstruction error with curvature sensitivity # Global geodesic structure consistency # Update reconstructed points |
5. Results and Discussion
5.1. Reconstruction Accuracy Improvement (%)
5.2. Structural Preservation/Fidelity Score
5.3. Geodesic Distance Preservation Error
5.4. Curvature Distortion Penalty
5.5. Computational Scalability (Efficiency Metric)
- Qualitative Visualization and Analysis of 3D Reconstruction
6. Conclusions
Funding
Data Availability Statement
Conflicts of Interest
References
- Zhou, L.; Wu, G.; Zuo, Y.; Chen, X.; Hu, H. A comprehensive review of vision-based 3d reconstruction methods. Sensors 2024, 24, 2314. [Google Scholar] [CrossRef]
- Meilă, M.; Zhang, H. Manifold learning: What, how, and why. Annu. Rev. Stat. Its Appl. 2024, 11, 393–417. [Google Scholar] [CrossRef]
- Fei, Y.; Liu, Y.; Jia, C.; Li, Z.; Wei, X.; Chen, M. A survey of geometric optimization for deep learning: From Euclidean space to Riemannian manifold. ACM Comput. Surv. 2025, 57, 1–37. [Google Scholar] [CrossRef]
- Chowdhury, S.H.; Sany, M.R.; Ahamed, M.H.; Das, S.K.; Badal, F.R.; Das, P.; Tasneem, Z.; Hasan, M.M.; Islam, M.R.; Ali, M.F.; et al. A State-of-the-Art Computer Vision Adopting Non-Euclidean Deep-Learning Models. Int. J. Intell. Syst. 2023, 2023, 8674641. [Google Scholar] [CrossRef]
- Song, W.; Zhang, X.; Yang, G.; Chen, Y.; Wang, L.; Xu, H. A Study on Dimensionality Reduction and Parameters for Hyperspectral Imagery Based on Manifold Learning. Sensors 2024, 24, 2089. [Google Scholar] [CrossRef]
- Fu, J.; Zhao, D. MPAD: A New Dimension-Reduction Method for Preserving Nearest Neighbors in High-Dimensional Vector Search. arXiv 2025, arXiv:2504.16335. [Google Scholar]
- Ahmed, E.; Mahasneh, M. Efficient Extraction of Patterns in High-Dimensional Data through Tensor Decomposition Techniques. PatternIQ Min. 2025, 2, 108–118. [Google Scholar] [CrossRef]
- Gujjar, J.P.; Ambreen, L.; Hiremani, V.; Devadas, R.M. Interactive dashboard and 3D visualization using t-SNE dimensionality reduction technique. In Interactive and Dynamic Dashboard; CRC Press: Boca Raton, FL, USA, 2024; pp. 119–134. [Google Scholar]
- Amiri, Z.; Heidari, A.; Navimipour, N.J.; Esmaeilpour, M.; Yazdani, Y. The deep learning applications in IoT-based bio-and medical informatics: A systematic literature review. Neural Comput. Appl. 2024, 36, 5757–5797. [Google Scholar] [CrossRef]
- Beaudett, B.; Liang, S.; Srivastava, A. Investigating Image Manifolds of 3D Objects: Learning, Shape Analysis, and Comparisons. arXiv 2025, arXiv:2503.06773. [Google Scholar]
- Sanborn, S.; Mathe, J.; Papillon, M.; Buracas, D.; Lillemark, H.J.; Shewmake, C.; Bertics, A.; Pennec, X.; Miolane, N. Beyond euclid: An illustrated guide to modern machine learning with geometric, topological, and algebraic structures. arXiv 2024, arXiv:2407.09468. [Google Scholar] [CrossRef]
- Hekmatnejad, M.; Hoxha, B.; Deshmukh, J.V.; Yang, Y.; Fainekos, G. Formalizing and evaluating requirements of perception systems for automated vehicles using spatio-temporal perception logic. Int. J. Robot. Res. 2024, 43, 203–238. [Google Scholar] [CrossRef]
- Yin, Y.; Lyu, J.; Wang, Y.; Liu, H.; Wang, H.; Chen, B. Towards robust probabilistic modeling on SO (3) via rotation laplace distribution. IEEE Trans. Pattern Anal. Mach. Intell. 2025, 47, 3469–3486. [Google Scholar] [CrossRef]
- Vyas, B.; Rajendran, R.M. Generative adversarial networks for anomaly detection in medical images. Int. J. Multidiscip. Innov. Res. Methodol. 2023, 2, 52–58. [Google Scholar]
- Ren, S.; Hou, J.; Chen, X.; He, Y.; Wang, W. Geoudf: Surface reconstruction from 3d point clouds via geometry-guided distance representation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 1–6 October 2023; pp. 14214–14224. [Google Scholar]
- Qi, Z.; Dong, R.; Fan, G.; Ge, Z.; Zhang, X.; Ma, K.; Yi, L. Contrast with reconstruct: Contrastive 3d representation learning guided by generative pretraining. In Proceedings of the International Conference on Machine Learning, Honolulu, HI, USA, 23–29 July 2023; PMLR: Cambridge MA, USA, 2023; pp. 28223–28243. [Google Scholar]
- Anvekar, T.; Bazazian, D. Gpr-net: Geometric prototypical network for point cloud few-shot learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023; pp. 4179–4188. [Google Scholar]
- Guo, Z.; Zhang, R.; Qiu, L.; Li, X.; Heng, P.A. Joint-mae: 2d-3d joint masked autoencoders for 3d point cloud pre-training. arXiv 2023, arXiv:2302.14007. [Google Scholar]
- Ye, C.; Zhu, H.; Zhang, B.; Chen, T. A closer look at few-shot 3d point cloud classification. Int. J. Comput. Vis. 2023, 131, 772–795. [Google Scholar] [CrossRef]
- Robinett, R.A.; Orecchia, L.; Riesenfeld, S.J. Manifold learning and optimization using tangent space proxies. arXiv 2025, arXiv:2501.12678. [Google Scholar]
- Psenka, M.; Pai, D.; Raman, V.; Sastry, S.; Ma, Y. Representation learning via manifold flattening and reconstruction. J. Mach. Learn. Res. 2024, 25, 1–47. [Google Scholar]
- ModelNet40—Princeton 3D Object Dataset. Available online: https://www.kaggle.com/datasets/balraj98/modelnet40-princeton-3d-object-dataset/data (accessed on 30 May 2025).
Aspect | Description |
---|---|
Current Challenge | Traditional manifold learning techniques (e.g., Isomap, LLE, t-SNE) inadequately preserve the intrinsic geometric and topological structure of 3D data. |
Cause of the Problem | These methods operate under Euclidean assumptions, neglecting differential geometric properties such as curvature, tangent spaces, and geodesic distances. |
Effect of the Problem | Leads to distortion in local and global structures, resulting in inaccurate 3D reconstructions and reduced reliability in real-world applications. |
Research Gap | Lack of a unified framework that combines manifold learning with differential geometry to retain structural fidelity in low-dimensional embeddings. |
Core Problem Statement | How can manifold learning be optimized using differential geometry to preserve curvature and geodesic structure, thereby improving accuracy in 3D reconstruction? |
Traditional Manifold Learning Methods | Proposed OML-DGF Framework |
---|---|
Operate under Euclidean space assumptions | Utilize Riemannian metric-based neighborhood graphs |
Ignore intrinsic curvature and geodesics | Preserve curvature using second-order derivatives |
Distort local and global structure during embedding | Maintain geometric coherence and topological structure |
Use fixed or generic neighborhood construction | Build geodesic-aware neighborhood connections |
Optimize with structure-agnostic loss functions | Introduce curvature-regularized objective functions |
Attribute | Description |
---|---|
Dataset Name | ModelNet40 |
Type | 3D CAD models (mesh and point cloud representations) |
Number of Categories | 40 (e.g., chair, table, airplane, lamp, car) |
Total Samples | 12,311 models |
Training Samples | 9843 models |
Testing Samples | 2468 models |
Data Format | 3D mesh (.off), converted to point clouds |
Input Dimensionality | High-dimensional spatial coordinates (typically 1024–2048 points × 3 coordinates) |
Preprocessing | Normalization, uniform sampling, PCA-based dimensionality reduction |
Common Use | 3D reconstruction, shape classification, and unsupervised manifold learning |
Input | Preprocessing Technique Applied | Pre-Processed Output |
---|---|---|
Raw 3D point cloud | Normalization (centering and scaling) | Normalized point cloud centered at the origin and scaled to unit sphere |
Full point cloud with a variable number of points | Uniform sampling (e.g., Farthest Point Sampling) | Point cloud with fixed number of points (e.g., 1024 per object) |
Normalized, sampled point cloud | PCA-based alignment and projection | Point cloud aligned along principal axes and decorrelated |
Aligned point cloud | Riemannian neighborhood graph construction | Graph structure with geodesic edge weights and local topology |
Local neighborhoods | Curvature estimation using second-order surface fitting | Estimated scalar curvature values for each point |
Variable | Description |
---|---|
Original high-dimensional 3D point cloud. | |
Low dimensional point cloud embedding, where | |
Reconstructed 3D point cloud from the embedding. | |
Embedding function that maps . | |
Inverse mapping function . | |
Curvature weighted reconstruction weights from neighbor to point . | |
Neighborhood of point in the original high-dimensional space. | |
Curvature at original and reconstructed point | |
Geodesic distance between and in the original space. | |
Euclidean distance between reconstructed points and . | |
Regularization weight for the curvature distortion penalty. | |
Trade-off coefficient for the geodesic preservation term in total loss. |
Dataset Size (Points) | Runtime (Seconds) |
---|---|
1000 | 12.4 |
5000 | 48.6 |
10,000 | 105.3 |
20,000 | 215.7 |
Method | Reconstruction Error ↓ | Geodesic Preservation Score ↑ | Curvature Consistency ↑ | Runtime (s) ↓ |
---|---|---|---|---|
OML-DGF | 0.0125 | 0.947 | 0.905 | 105.3 |
LLE | 0.0267 | 0.861 | 0.712 | 43.2 |
Isomap | 0.0213 | 0.902 | 0.754 | 68.9 |
t-SNE | 0.0301 | 0.873 | 0.695 | 112.6 |
PCA | 0.0442 | 0.712 | 0.604 | 18.4 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, Y. Optimization of Manifold Learning Using Differential Geometry for 3D Reconstruction in Computer Vision. Mathematics 2025, 13, 2771. https://doi.org/10.3390/math13172771
Wang Y. Optimization of Manifold Learning Using Differential Geometry for 3D Reconstruction in Computer Vision. Mathematics. 2025; 13(17):2771. https://doi.org/10.3390/math13172771
Chicago/Turabian StyleWang, Yawen. 2025. "Optimization of Manifold Learning Using Differential Geometry for 3D Reconstruction in Computer Vision" Mathematics 13, no. 17: 2771. https://doi.org/10.3390/math13172771
APA StyleWang, Y. (2025). Optimization of Manifold Learning Using Differential Geometry for 3D Reconstruction in Computer Vision. Mathematics, 13(17), 2771. https://doi.org/10.3390/math13172771