Close-Range 3D Hyperspectral Measurement System with a Physics-Guided Spectral Correction Model
Highlights
- A close-range 3D hyperspectral measurement framework was developed by integrating a structured-light 3D module with a hyperspectral imaging module, achieving sub-40-μm sphere-fitting RMS residuals and an effective spectral resolution of 7 nm.
- A physics-guided spectral correction model (3D-LFSC) was proposed for geometrically complex surfaces, improving spectral consistency by more than 10% compared with existing correction methods.
- The proposed framework improves the reliability of reflectance-related spectral measurements on geometrically complex surfaces, where conventional white-board calibration and Lambertian-based correction are often inadequate.
- The corrected 3D hyperspectral point clouds support downstream optical sensing tasks, such as color consistency analysis on facial surfaces, and show potential for close-range spectral assessment of biological samples.
Abstract
1. Introduction
2. System Design and Methods
2.1. Optical Design of the System
2.2. Generation of 3D Point Clouds
2.3. Generation of 3D Hyperspectral Point Clouds
2.4. Limitations of Explicit BRDF-Based Reflectance Modeling
2.5. 3D-LFSC Model
3. Results
3.1. System Characterization
3.2. Model Performance
3.3. Color Detection via Corrected 3D Hyperspectral Point Clouds
4. Discussion and Conclusions
Supplementary Materials
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Bhargava, A.; Sachdeva, A.; Sharma, K.; Alsharif, M.H.; Uthansakul, P.; Uthansakul, M. Hyperspectral imaging and its applications: A review. Heliyon 2024, 10, e33208. [Google Scholar] [CrossRef]
- DC-MSSFF Net: Dule-channel multi-scale spatial-spectral feature fusion network for cholangiocarcinoma pathology high-resolution hyperspectral image segmentation. Comput. Methods Programs Biomed. 2025, 269, 108905. [CrossRef] [PubMed]
- Lim, S.L.; Sreevalsan-Nair, J.; Daya Sagar, B.S. Multispectral data mining: A focus on remote sensing satellite images. WIREs Data Min. Knowl. Discov. 2024, 14, e1522. [Google Scholar] [CrossRef]
- Bai, X.; Wang, J.; Chen, R.; Kang, Y.; Ding, Y.; Lv, Z.; Ding, D.; Feng, H. Research progress of inland river water quality monitoring technology based on unmanned aerial vehicle hyperspectral imaging technology. Environ. Res. 2024, 257, 119254. [Google Scholar] [CrossRef]
- Alanazi, A.; Wahab, N.H.A.; Al-Rimy, B.A.S. Hyperspectral Imaging for Remote Sensing and Agriculture: A Comparative Study of Transformer-based Models. In Proceedings of the 2024 IEEE 14th Symposium on Computer Applications & Industrial Electronics (ISCAIE); IEEE: New York, NY, USA, 2024; pp. 129–136. [Google Scholar]
- Yoon, J. Hyperspectral Imaging for Clinical Applications. BioChip J. 2022, 16, 1–12. [Google Scholar] [CrossRef]
- Tian, C.; Chen, Y.; Liu, Y.; Wang, X.; Lv, Q.; Li, Y.; Deng, J.; Liu, Y.; Li, W. Accurate classification of glomerular diseases by hyperspectral imaging and transformer. Comput. Methods Programs Biomed. 2024, 254, 108285. [Google Scholar] [CrossRef]
- Huang, H.-Y.; Nguyen, H.-T.; Lin, T.-L.; Saenprasarn, P.; Liu, P.-H.; Wang, H.-C. Identification of Skin Lesions by Snapshot Hyperspectral Imaging. Cancers 2024, 16, 217. [Google Scholar] [CrossRef]
- Courtenay, L.A.; Barbero-García, I.; Martínez-Lastras, S.; Del Pozo, S.; Corral, M.; González-Aguilera, D. Using computational learning for non-melanoma skin cancer and actinic keratosis near-infrared hyperspectral signature classification. Photodiagnosis Photodyn. Ther. 2024, 49, 104269. [Google Scholar] [CrossRef] [PubMed]
- Lu, B.; Dao, P.D.; Liu, J.; He, Y.; Shang, J. Recent Advances of Hyperspectral Imaging Technology and Applications in Agriculture. Remote Sens. 2020, 12, 2659. [Google Scholar] [CrossRef]
- Liang, J.; Wang, Y.; Shi, Y.; Huang, X.; Li, Z.; Zhang, X.; Zou, X.; Shi, J. Non-destructive discrimination of homochromatic foreign materials in cut tobacco based on VIS-NIR hyperspectral imaging. J. Sci. Food Agric. 2023, 103, 4545–4552. [Google Scholar] [CrossRef]
- Kuswidiyanto, L.W.; Noh, H.-H.; Han, X. Plant Disease Diagnosis Using Deep Learning Based on Aerial Hyperspectral Images: A Review. Remote Sens. 2022, 14, 6031. [Google Scholar] [CrossRef]
- Khan, A.; Vibhute, A.D.; Mali, S.; Patil, C.H. A systematic review on hyperspectral imaging technology with a machine and deep learning methodology for agricultural applications. Ecol. Inform. 2022, 69, 101678. [Google Scholar] [CrossRef]
- Ye, W.; Xu, W.; Yan, T.; Yan, J.; Gao, P.; Zhang, C. Application of Near-Infrared Spectroscopy and Hyperspectral Imaging Combined with Machine Learning Algorithms for Quality Inspection of Grape: A Review. Foods 2023, 12, 132. [Google Scholar] [CrossRef]
- Ma, J.; Sun, D.-W.; Pu, H.; Cheng, J.-H.; Wei, Q. Advanced Techniques for Hyperspectral Imaging in the Food Industry: Principles and Recent Applications. Annu. Rev. Food Sci. Technol. 2019, 10, 197–220. [Google Scholar] [CrossRef]
- Kabir, M.A.; Lee, I.; Singh, C.B.; Mishra, G.; Panda, B.K.; Lee, S.-H. Detection of Mycotoxins in Cereal Grains and Nuts Using Machine Learning Integrated Hyperspectral Imaging: A Review. Toxins 2025, 17, 219. [Google Scholar] [CrossRef]
- Chen, S.-Y.; Hsu, S.-H.; Ko, C.-Y.; Hsu, K.-H. Real-time defect and freshness inspection on chicken eggs using hyperspectral imaging. Food Control 2023, 150, 109716. [Google Scholar] [CrossRef]
- Foix, S.; Alenya, G.; Torras, C. Lock-in Time-of-Flight (ToF) Cameras: A Survey. IEEE Sens. J. 2011, 11, 1917–1926. [Google Scholar] [CrossRef]
- Lazaros, N.; Sirakoulis, G.C.; Gasteratos, A. Review of Stereo Vision Algorithms: From Software to Hardware. Int. J. Optomechatronics 2008, 2, 435–462. [Google Scholar] [CrossRef]
- Engel, T. 3D optical measurement techniques. Meas. Sci. Technol. 2022, 34, 032002. [Google Scholar] [CrossRef]
- Zhang, S. High-speed 3D shape measurement with structured light methods: A review. Opt. Lasers Eng. 2018, 106, 119–131. [Google Scholar] [CrossRef]
- Luo, J.; Forsberg, E.; He, S. 5D-fusion imaging for surface shape, polarization, and hyperspectral measurement. Appl. Opt. 2022, 61, 7776–7785. [Google Scholar] [CrossRef]
- Luo, J.; Li, S.; Forsberg, E.; He, S. 4D surface shape measurement system with high spectral resolution and great depth accuracy. Opt. Express 2021, 29, 13048–13070. [Google Scholar] [CrossRef]
- Qi, H.; Lyu, N.; Yu, H.; Zheng, D.; Han, J. 4-D multiframe co-encoded spectral imaging system. Opt. Lasers Eng. 2023, 169, 107697. [Google Scholar] [CrossRef]
- Shin, S.; Choi, S.; Heide, F.; Baek, S.-H. Dispersed Structured Light for Hyperspectral 3D Imaging. In Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Seattle, WA, USA, 2024; pp. 24997–25006. [Google Scholar]
- Xu, Y.; Giljum, A.; Kelly, K.F. A hyperspectral projector for simultaneous 3D spatial and hyperspectral imaging via structured illumination. Opt. Express 2020, 28, 29740–29755. [Google Scholar] [CrossRef]
- Luo, J.; Lin, Z.; Xing, Y.; Forsberg, E.; Wu, C.; Zhu, X.; Guo, T.; Wang, G.; Bian, B.; Wu, D.; et al. Portable 4D Snapshot Hyperspectral Imager for Fastspectral and Surface Morphology Measurements. Prog. Electromagn. Res. 2022, 173, 25–36. [Google Scholar] [CrossRef]
- Li, J.; Zheng, Y.; Liu, L.; Li, B. 4D line-scan hyperspectral imaging. Opt. Express 2021, 29, 34835–34849. [Google Scholar] [CrossRef]
- Heist, S.; Zhang, C.; Reichwald, K.; Kühmstedt, P.; Notni, G.; Tünnermann, A. 5D hyperspectral imaging: Fast and accurate measurement of surface shape and spectral characteristics using structured light. Opt. Express 2018, 26, 23366–23379. [Google Scholar] [CrossRef]
- Li, J.; Liu, L.; Li, B. 4D Vis-SWIR line-scan hyperspectral imaging. Opt. Express 2024, 32, 44624–44642. [Google Scholar] [CrossRef]
- Luo, J.; Forsberg, E.; Fu, S.; Xing, Y.; Liao, J.; Jiang, J.; Zheng, Y.; He, S. 4D dual-mode staring hyperspectral-depth imager for simultaneous spectral sensing and surface shape measurement. Opt. Express 2022, 30, 24804–24821. [Google Scholar] [CrossRef] [PubMed]
- Thirgood, C.; Mendez, O.; Ling, E.; Storey, J.; Hadfield, S. HyperGS: Hyperspectral 3D Gaussian Splatting. arXiv 2024, arXiv:2412.12849. [Google Scholar] [CrossRef]
- Li, C.; Monno, Y.; Okutomi, M. Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New Orleans, LA, USA, 2022; pp. 19738–19747. [Google Scholar]
- Mishra, P.; Polder, G.; Gowen, A.; Rutledge, D.N.; Roger, J.-M. Utilising variable sorting for normalisation to correct illumination effects in close-range spectral images of potato plants. Biosyst. Eng. 2020, 197, 318–323. [Google Scholar] [CrossRef]
- Hu, P.; Huang, H.; Chen, Y.; Qi, J.; Li, W.; Jiang, C.; Wu, H.; Tian, W.; Hyyppä, J. Analyzing the Angle Effect of Leaf Reflectance Measured by Indoor Hyperspectral Light Detection and Ranging (LiDAR). Remote Sens. 2020, 12, 919. [Google Scholar] [CrossRef]
- Zhang, L.; Jin, J.; Wang, L.; Huang, P.; Ma, D. A 3D white referencing method for soybean leaves based on fusion of hyperspectral images and 3D point clouds. Precis. Agric. 2020, 21, 1173–1186. [Google Scholar] [CrossRef]
- Xie, P.; Du, R.; Ma, Z.; Cen, H. Generating 3D Multispectral Point Clouds of Plants with Fusion of Snapshot Spectral and RGB-D Images. Plant Phenomics 2023, 5, 0040. [Google Scholar] [CrossRef]
- Xie, P.; Ma, Z.; Du, R.; Yang, X.; Jiang, Y.; Cen, H. An unmanned ground vehicle phenotyping-based method to generate three-dimensional multispectral point clouds for deciphering spatial heterogeneity in plant traits. Mol. Plant 2024, 17, 1624–1638. [Google Scholar] [CrossRef] [PubMed]
- Zuo, C.; Feng, S.; Huang, L.; Tao, T.; Yin, W.; Chen, Q. Phase shifting algorithms for fringe projection profilometry: A review. Opt. Lasers Eng. 2018, 109, 23–59. [Google Scholar] [CrossRef]
- Zhang, Q.; Su, X.; Xiang, L.; Sun, X. 3-D shape measurement based on complementary Gray-code light. Opt. Lasers Eng. 2012, 50, 574–579. [Google Scholar] [CrossRef]
- Feng, S.; Zuo, C.; Zhang, L.; Tao, T.; Hu, Y.; Yin, W.; Qian, J.; Chen, Q. Calibration of fringe projection profilometry: A comparative review. Opt. Lasers Eng. 2021, 143, 106622. [Google Scholar] [CrossRef]
- Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334. [Google Scholar] [CrossRef]
- Guarnera, D.; Guarnera, G.C.; Ghosh, A.; Denk, C.; Glencross, M. BRDF Representation and Acquisition. Comput. Graph. Forum 2016, 35, 625–650. [Google Scholar] [CrossRef]
- Cook, R.L.; Torrance, K.E. A Reflectance Model for Computer Graphics. ACM Trans. Graph. 1982, 1, 7–24. [Google Scholar] [CrossRef]
- Szeliski, R. Computer Vision: Algorithms and Applications; Texts in Computer Science; Springer International Publishing: Cham, Switzerland, 2022; ISBN 978-3-030-34371-2. [Google Scholar]
- Weidner, V.R.; Hsia, J.J. Reflection properties of pressed polytetrafluoroethylene powder. J. Opt. Soc. Am. 1981, 71, 856–861. [Google Scholar] [CrossRef]
- Springsteen, A. Standards for the measurement of diffuse reflectance—An overview of available materials and measurement laboratories. Anal. Chim. Acta 1999, 380, 379–390. [Google Scholar] [CrossRef]
- Wu, Z.; Zuo, C.; Guo, W.; Tao, T.; Zhang, Q. High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light. Opt. Express 2019, 27, 1283–1297. [Google Scholar] [CrossRef]
- Liu, Y.; Zhang, Q.; Liu, Y.; Yu, X.; Hou, Y.; Chen, W. High-speed 3D shape measurement using a rotary mechanical projector. Opt. Express 2021, 29, 7885–7903. [Google Scholar] [CrossRef] [PubMed]
- Wan, W.; Liu, Z.; Yu, Z.; Wang, J.; Yu, X. Design of a binocular multispectral stereo imaging system and its application in plant phenotyping. Plant Phenomics 2025, 7, 100105. [Google Scholar] [CrossRef]
- Gevaux, L. Three-dimensional maps of human skin properties on full face with shadows using 3-D hyperspectral imaging. J. Biomed. Opt. 2019, 24, 066002. [Google Scholar] [CrossRef]
- Arnall, D.B.; Raun, W.R.; Solie, J.B.; Stone, M.L.; Johnson, G.V.; Girma, K.; Freeman, K.W.; Teal, R.K.; Martin, K.L. Relationship Between Coefficient of Variation Measured by Spectral Reflectance and Plant Density at Early Growth Stages in Winter Wheat. J. Plant Nutr. 2006, 29, 1983–1997. [Google Scholar] [CrossRef]
- Centore, P. The coefficient of variation as a measure of spectrophotometric repeatability. Color Res. Appl. 2016, 41, 571–579. [Google Scholar] [CrossRef]
- Weatherall, I.L.; Coombs, B.D. Skin Color Measurements in Terms of CIELAB Color Space Values. J. Investig. Dermatol. 1992, 99, 468–473. [Google Scholar] [CrossRef]
- Pointer, M.R. A comparison of the CIE 1976 colour spaces. Color Res. Appl. 1981, 6, 108–118. [Google Scholar] [CrossRef]








| Specifications | Parameters |
|---|---|
| Effective spectral range | 430–700 nm |
| Usable spectral channels | 92 |
| Spectral resolution | 7 nm (Full Width at Half Maximum) |
| Sphere-fitting RMS residual | 36.39 μm at 530 mm, mean of 9 measurements |
| Mean radius error | 22.19 μm |
| Acquisition time | approximately 60 s |
| Working distance | 400 mm~1000 mm |
| Work | Imaging Strategy | Spectral Performance | 3D Accuracy | Method for Spectral Correction |
|---|---|---|---|---|
| Wan et al. [50] | Binocular multispectral imaging | 20 nm, 10 channels | 0.89 mm at 1036 mm | White-board calibration |
| Qi et al. [24] | 4D multi-frame co-encoded spectral imaging | 420–660 nm; average SAM = 4.28 | 0.1 mm | Not specifically considered |
| Gevaux et al. [51] | 3D facial hyperspectral imaging with LCTF | 10 nm, 31 channels | ~0.4 mm | Geometrical calibration; limited performance on some facial regions |
| Luo et al. [27] | Portable 4D snapshot hyperspectral imaging | 10 nm | 55.7 μm | White-board calibration |
| This work | Structured-light 3D & HSI fusion | 7 nm, 92 channels | 36.39 μm sphere-fitting RMS residual at 530 mm | 3D-LFSC geometry-aware correction |
| Spatial Position Set | Score (NeREF) | Score (3D-LFSC) | Score (White-Board) |
|---|---|---|---|
| 1 | 11.07 | 8.81 | 18.05 |
| 2 | 11.76 | 9.71 | 16.86 |
| 3 | 11.65 | 11.06 | 14.29 |
| 4 | 10.87 | 9.59 | 17.39 |
| 5 | 13.08 | 10.52 | 19.09 |
| 6 | 11.19 | 9.65 | 17.50 |
| 7 | 9.89 | 8.93 | 13.59 |
| Mean Score | 11.36 | 9.75 | 16.68 |
| 0.91 | 0.75 | 1.86 | |
| Mean Score vs. NeREF | 0.00% | 14.14% | −46.88% |
| vs. NeREF | 0.00% | 17.43% | −105.28% |
| Spatial Position Set | Score (NeREF) | Score (3D-LFSC) | Score (White-Board) |
|---|---|---|---|
| 1 | 10.22 | 7.78 | 17.79 |
| 2 | 8.84 | 7.01 | 18.86 |
| 3 | 12.06 | 10.52 | 18.63 |
| 4 | 8.68 | 8.84 | 17.78 |
| 5 | 8.57 | 9.02 | 17.45 |
| Mean Score | 9.67 | 8.64 | 18.10 |
| 1.34 | 1.19 | 0.55 | |
| Mean Score vs. NeREF | 0.00% | 10.74% | −87.10% |
| vs. NeREF | 0.00% | 10.72% | 59.13% |
| Sample | 3D-LFSC Model | White-Board Calibration | ||||||
|---|---|---|---|---|---|---|---|---|
| L* | a* | b* | L* | a* | b* | |||
| 1 | 66.498 | 19.935 | 30.013 | 0.149 | 70.975 | 21.381 | 32.232 | 2.779 |
| 2 | 66.916 | 19.998 | 30.126 | 0.340 | 70.392 | 21.144 | 31.800 | 2.038 |
| 3 | 66.924 | 20.263 | 30.479 | 0.594 | 71.539 | 21.517 | 32.027 | 3.250 |
| 4 | 66.414 | 20.084 | 29.809 | 0.290 | 64.161 | 19.654 | 29.359 | 4.818 |
| 5 | 66.208 | 19.962 | 29.751 | 0.486 | 65.585 | 19.970 | 29.979 | 3.236 |
| Sample | Human Face 1 | Human Face 2 | Between Face 1 and Face 2 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| L* | a* | b* | L* | a* | b* | ||||
| 1 | 58.185 | 15.058 | 24.013 | 0.290 | 58.317 | 11.541 | 30.313 | 0.137 | 7.068 |
| 2 | 58.569 | 14.873 | 24.036 | 0.166 | 58.429 | 11.314 | 30.211 | 0.163 | 6.753 |
| 3 | 58.514 | 14.82 | 24.252 | 0.202 | 58.442 | 11.565 | 30.148 | 0.128 | 6.771 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Liu, Z.; Wan, W.; Yu, Z.; Jiang, Z.; Yu, X.; Zhang, Y.; Luo, S.; Guo, Y.; Chen, K. Close-Range 3D Hyperspectral Measurement System with a Physics-Guided Spectral Correction Model. Sensors 2026, 26, 3396. https://doi.org/10.3390/s26113396
Liu Z, Wan W, Yu Z, Jiang Z, Yu X, Zhang Y, Luo S, Guo Y, Chen K. Close-Range 3D Hyperspectral Measurement System with a Physics-Guided Spectral Correction Model. Sensors. 2026; 26(11):3396. https://doi.org/10.3390/s26113396
Chicago/Turabian StyleLiu, Zhiyuan, Wenxiu Wan, Ziru Yu, Zhiqie Jiang, Xiangyang Yu, Youliang Zhang, Shengkang Luo, Yuchen Guo, and Ke Chen. 2026. "Close-Range 3D Hyperspectral Measurement System with a Physics-Guided Spectral Correction Model" Sensors 26, no. 11: 3396. https://doi.org/10.3390/s26113396
APA StyleLiu, Z., Wan, W., Yu, Z., Jiang, Z., Yu, X., Zhang, Y., Luo, S., Guo, Y., & Chen, K. (2026). Close-Range 3D Hyperspectral Measurement System with a Physics-Guided Spectral Correction Model. Sensors, 26(11), 3396. https://doi.org/10.3390/s26113396

