Non-Line-of-Sight Imaging via Sparse Bayesian Learning Deconvolution
Abstract
1. Introduction
- Bayesian sparsity-driven transient enhancement: SBL selectively suppresses noise while preserving physically consistent multipath photon returns, effectively restoring informative temporal structures;
- Hardware-free compatibility with existing LCT pipelines: The proposed module is lightweight and geometry-agnostic, allowing direct integration without acquisition or system modifications;
- Improved reconstruction fidelity under photon-starved conditions: Enhanced transients provide more reliable input for light-cone propagation, yielding clearer boundaries, finer spatial details, and stronger robustness to IRF distortions;
- Validated effectiveness on both simulated and real measurements: Results confirm that transient quality is a critical bottleneck in practical NLOS imaging, and addressing it promotes scalable and reliable real-world deployment.
2. Light-Cone Transform Algorithm
2.1. Non-Line-of-Sight Imaging Problem
2.2. Light Cone Transform (LCT) Algorithm
3. Sparse Bayesian Learning in NLOS
3.1. Sparse Bayesian Learning
3.2. Enhanced LCT Reconstruction via SBL Preprocessing
3.3. Overall Processing Workflow
4. Results and Discussion
4.1. Simulation Results
4.1.1. Signal-Domain Comparison of SBL, RL and Tikhonov
4.1.2. Non-Line-of-Sight Reconstruction Results
4.2. Experiment Results
4.3. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Velten, A.; Willwacher, T.; Gupta, O.; Bawendi, M.; Freeman, W.T.; Raskar, R. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun. 2012, 3, 745. [Google Scholar] [CrossRef]
- O’Toole, M.; Lindell, D.B.; Wetzstein, G. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 2018, 555, 338–341. [Google Scholar] [CrossRef] [PubMed]
- Velten, A.; Wu, D.; Jarabo, A.; Masia, B.; Barsi, C.; Joshi, C.; Lawson, E.; Bawendi, M.; Gutierrez, D.; Raskar, R. Femto-photography: Capturing and visualizing the propagation of light. ACM Trans. Graph. 2013, 32, 44. [Google Scholar] [CrossRef]
- Heide, F.; Xiao, L.; Heidrich, W.; Hullin, M.B. Diffuse mirrors: 3d reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors. In Proceedings of the CVPR, Columbus, OH, USA, 23–28 June 2014; pp. 3222–3229. [Google Scholar]
- Laurenzis, M.; Velten, A. Nonline-of-sight laser gated viewing of scattered photons. Opt. Eng. 2014, 53, 023102. [Google Scholar] [CrossRef]
- Buttafava, M.; Zeman, J.; Tosi, A.; Eliceiri, K.; Velten, A. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 2015, 23, 20933–20946. [Google Scholar] [CrossRef] [PubMed]
- Gariepy, G.; Krstajic, N.; Henderson, R.; Li, C.; Thomson, R.R.; Buller, G.S.; Heshmat, B.; Raskar, R.; Leach, J.; Faccio, D. Single-photon sensitive light-in-flight imaging. Nat. Commun. 2015, 6, 6021. [Google Scholar] [CrossRef] [PubMed]
- O’Toole, M.; Heide, F.; Lindell, D.B.; Zang, K.; Diamond, S.; Wetzstein, G. Reconstructing transient images from single-photon sensors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 1539–1547. [Google Scholar]
- Li, T.; Luo, Y.; Zhao, K. Weak non-line-of-sight target echoes extraction without accumulation. Opt. Express 2023, 31, 36209–36218. [Google Scholar] [CrossRef] [PubMed]
- Feng, Y.; Cui, X.; Meng, Y. Non-line-of-sight imaging at infrared wavelengths using a superconducting nanowire single-photon detector. Opt. Express 2023, 31, 42240–42254. [Google Scholar] [CrossRef] [PubMed]
- Yang, W.; Zhang, C.; Jiang, W.; Zhang, Z.; Sun, B. None-line-of-sight imaging enhanced with spatial multiplexing. Opt. Express 2022, 30, 5855–5867. [Google Scholar] [CrossRef] [PubMed]
- Li, Z.; Liu, X.; Wang, J.; Shi, Z.; Qiu, L.; Fu, X. Fast non-line-of-sight imaging based on first photon event stamping. Opt. Lett. 2022, 47, 1928–1931. [Google Scholar] [CrossRef] [PubMed]
- Lindell, D.B.; Wetzstein, G.; O’Toole, M. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Trans. Graph. 2019, 38, 1–13. [Google Scholar] [CrossRef]
- Liu, X.; Guillén, I.; La Manna, M. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 2019, 572, 620–623. [Google Scholar] [CrossRef] [PubMed]
- Liu, X.; Wang, J.; Xiao, L.; Shi, Z.; Fu, X.; Qiu, L. Non-line-of-sight imaging with arbitrary illumination and detection pattern. Nat. Commun. 2023, 14, 3230. [Google Scholar] [CrossRef] [PubMed]
- Young, S.I.; Lindell, D.B.; Girod, B.; Taubman, D.; Wetzstein, G. Non-line-of-sight surface reconstruction using the directional light-cone transform. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual, 14–19 June 2020; pp. 1407–1416. [Google Scholar]
- Jin, C.; Hu, X.; Cao, X.; Zhang, Z.J.; Zhao, Y. Richardson–Lucy deconvolution of time histograms for high-resolution non-line-of-sight imaging based on a back-projection method. Opt. Lett. 2018, 43, 5885–5888. [Google Scholar] [CrossRef] [PubMed]
- Liu, X.; Wang, J.; Li, Z.; Shi, Z.; Fu, X.; Qiu, L. Non-line-of-sight reconstruction with signal–object collaborative regularization. Light. Sci. Appl. 2021, 10, 198. [Google Scholar] [CrossRef] [PubMed]
- Ding, R.; Ye, J.; Gao, Q.; Xu, F.; Duan, Y. Curvature regularization for non-line-of-sight imaging from under-sampled data. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 8474–8485. [Google Scholar] [CrossRef] [PubMed]
- Xu, W.; Chen, S.; Wang, D.; Tian, Y.; Zhang, N.; Hao, W.; Su, X. Feature enhanced non-line-of-sight imaging using graph model in latent space. Opt. Laser Technol. 2025, 181, 111538. [Google Scholar] [CrossRef]
- Xu, W.; Chen, S.; Tian, Y.; Wang, D.; Su, X. Fast non-line-of-sight imaging based on product-convolution expansions. Opt. Lett. 2022, 47, 4680–4683. [Google Scholar] [CrossRef] [PubMed]
- Li, Y.; Zhang, Y.; Ye, J.; Xu, F.; Xiong, Z. Deep non-line-of-sight imaging from under-scanning measurements. Adv. Neural Inf. Process. Syst. 2023, 36, 59095–59106. [Google Scholar]
- Ye, J.; Sun, Y.; Li, W.; Zeng, J.W.; Hong, Y.; Li, Z.P.; Huang, X.; Xue, X.; Yuan, X.; Xu, F.; et al. Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation. Nat. Comput. Sci. 2024, 4, 920–927. [Google Scholar] [CrossRef] [PubMed]








| Method | Time/Pixel (s) |
|---|---|
| SBL (windowed, ) | 0.016231 |
| RL (Richardson–Lucy) | 0.009528 |
| TK (Tikhonov inverse filtering) | 0.000398 |
| Method | Peak Location | Shift | FWHM | BG_STD | SNR (dB) | SSIM |
|---|---|---|---|---|---|---|
| GT | 1184 | 0 | 1.86 | 0.0000 | 313.07 | 1.0000 |
| Raw | 1192 | 8 | 31.22 | 0.0004 | 67.34 | 0.9564 |
| SBL | 1189 | 5 | 1.27 | 0.0001 | 105.40 | 0.9323 |
| RL | 1200 | 16 | 5.25 | 0.0001 | 78.99 | 0.9537 |
| TK | 1198 | 14 | 4.75 | 0.0009 | 61.20 | 0.9363 |
| Target | Algorithm | SSIM | PSNR (dB) | STD |
|---|---|---|---|---|
| E | SBL-LCT | 0.2005 | 11.2058 | 0.2146 |
| LCT | 0.1472 | 10.6974 | 0.2300 | |
| f-k | 0.1750 | 10.7851 | 0.2388 | |
| F | SBL-LCT | 0.1471 | 10.6429 | 0.1771 |
| LCT | 0.1040 | 10.0420 | 0.2384 | |
| f-k | 0.1334 | 10.3214 | 0.2620 |
| Hardware | Setup |
|---|---|
| Laser source | PicoQuant LDH-D-C-850 (PicoQuant GmbH, Berlin, Germany) |
| Pulse width: 500 ps (FWHM) | |
| Repetition rate: 2.5 MHz (experimental setting) | |
| Average power: 0.1 mW@1 MHz | |
| SPAD | EXCELITAS SPCM-AQRH-16-FC (Excelitas Technologies Corp., Vaudreuil-Dorion, QC, Canada) |
| Photon detection efficiency: 45%@850 nm | |
| Dark count rate: <25 cps | |
| Dead time: 22 ns | |
| TCSPC module | PicoQuant PicoHarp 300 (PicoQuant GmbH, Berlin, Germany) |
| Selected temporal resolution: 16 ps |
| Target | Algorithm | STD | Entropy |
|---|---|---|---|
| CH | SBL-LCT | 0.215 | 7.43 |
| LCT | 0.221 | 7.54 | |
| f-k | 0.188 | 7.18 | |
| HS | SBL-LCT | 0.205 | 7.31 |
| LCT | 0.196 | 7.29 | |
| f-k | 0.188 | 6.84 | |
| C + tilted H | SBL-LCT | 0.230 | 7.45 |
| LCT | 0.231 | 7.51 | |
| f-k | 0.226 | 7.35 | |
| UCAS | SBL-LCT | 0.234 | 7.46 |
| LCT | 0.263 | 7.75 | |
| f-k | 0.254 | 7.69 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Tian, Y.; Xu, W.; Wang, D.; Zhang, N.; Chen, S.; Gao, P.; Su, X.; Hao, W. Non-Line-of-Sight Imaging via Sparse Bayesian Learning Deconvolution. Photonics 2026, 13, 53. https://doi.org/10.3390/photonics13010053
Tian Y, Xu W, Wang D, Zhang N, Chen S, Gao P, Su X, Hao W. Non-Line-of-Sight Imaging via Sparse Bayesian Learning Deconvolution. Photonics. 2026; 13(1):53. https://doi.org/10.3390/photonics13010053
Chicago/Turabian StyleTian, Yuyuan, Weihao Xu, Dingjie Wang, Ning Zhang, Songmao Chen, Peng Gao, Xiuqin Su, and Wei Hao. 2026. "Non-Line-of-Sight Imaging via Sparse Bayesian Learning Deconvolution" Photonics 13, no. 1: 53. https://doi.org/10.3390/photonics13010053
APA StyleTian, Y., Xu, W., Wang, D., Zhang, N., Chen, S., Gao, P., Su, X., & Hao, W. (2026). Non-Line-of-Sight Imaging via Sparse Bayesian Learning Deconvolution. Photonics, 13(1), 53. https://doi.org/10.3390/photonics13010053

