Finite-Aperture Limits for Yaw Estimation in Confocal Non-Line-of-Sight Imaging
Abstract
1. Introduction
2. Materials and Methods
2.1. Geometric Criterion from Transient Support and Switch-Line Visibility
2.1.1. Target and Wall Geometry
2.1.2. Transient Support and Switch-Line Criterion
2.1.3. Loss of Support-Bound Information on a Finite Wall
2.1.4. Closed-Form Transient Model Used for the Simulations
2.2. Fisher Analysis of Yaw Sensitivity
3. Results
3.1. Finite-Wall Ambiguity and Reconstruction Behaviour
3.2. Experimental Validation of the Transient Model
3.3. Fisher Information as a Continuous Measure of Yaw Observability
3.3.1. Extracting Information from the Wall
3.3.2. Wall Fisher Information as a Continuous Visibility Indicator
4. Discussion and Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| NLOS | Non-line-of-sight |
| FI | Fisher Information |
References
- Adelson, E.H.; Wang, J.Y.A. Single Lens Stereo with a Plenoptic Camera. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 99–106. [Google Scholar] [CrossRef]
- Levoy, M.; Hanrahan, P. Light Field Rendering. In Proceedings of SIGGRAPH 1996; ACM: New York, NY, USA, 1996; pp. 31–42. [Google Scholar] [CrossRef]
- Gortler, S.J.; Grzeszczuk, R.; Szeliski, R.; Cohen, M.F. The Lumigraph. In Proceedings of SIGGRAPH 1996; ACM: New York, NY, USA, 1996; pp. 43–54. [Google Scholar] [CrossRef]
- Ng, R.; Levoy, M.; Brédif, M.; Duval, G.; Horowitz, M.; Hanrahan, P. Light Field Photography with a Hand-Held Plenoptic Camera; Stanford University Computer Science Technical Report CTSR 2005-02; Stanford University: Stanford, CA, USA, 2005. [Google Scholar]
- Massaro, G.; Giannella, D.; Scagliola, A.; Di Lena, F.; Scarcelli, G.; Garuccio, A.; Pepe, F.V.; D’Angelo, M. Light-field microscopy with correlated beams for high-resolution volumetric imaging. Sci. Rep. 2022, 12, 16823. [Google Scholar] [CrossRef] [PubMed]
- Massaro, G.; Mos, P.; Vasiukov, S.; Di Lena, F.; Scattarella, F.; Pepe, F.V.; Ulku, A.; Giannella, D.; Charbon, E.; Bruschini, C.; et al. Correlated-photon imaging at 10 volumetric images per second. Sci. Rep. 2023, 13, 12813. [Google Scholar] [CrossRef]
- Massaro, G.; Pepe, F.V.; D’Angelo, M. Refocusing Algorithm for Correlation Plenoptic Imaging. Sensors 2022, 22, 6665. [Google Scholar] [CrossRef] [PubMed]
- Di Lena, F.; Massaro, G.; Lupo, A.; Schiavon, M.; D’Angelo, M.; Garuccio, A.; Pepe, F.V. Correlation Plenoptic Imaging: An Overview. Appl. Sci. 2018, 8, 1958. [Google Scholar] [CrossRef]
- Pepe, F.V.; Di Lena, F.; Garuccio, A.; Scarcelli, G.; D’Angelo, M. Diffraction-Limited Plenoptic Imaging with Correlated Light. Phys. Rev. Lett. 2017, 119, 243602. [Google Scholar] [CrossRef]
- Maeda, T.; Satat, G.; Swedish, T.B.; Sinha, L.; Raskar, R. Recent Advances in Imaging Around Corners. arXiv 2019, arXiv:1910.05613. [Google Scholar] [CrossRef]
- Geng, R.; Hu, Y.; Chen, Y. Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes. APSIPA Trans. Signal Inf. Process. 2022, 11, e26. [Google Scholar] [CrossRef]
- Xin, J.; Du, D.; Deng, R. Progress and Prospect of Non-Line-of-Sight Imaging (Invited). Infrared Laser Eng. 2022, 51, 1–26. [Google Scholar] [CrossRef]
- Katz, O.; Small, E.; Silberberg, Y. Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nat. Photonics 2012, 6, 549–553. [Google Scholar] [CrossRef]
- Katz, O.; Heidmann, P.; Fink, M.; Gigan, S. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photonics 2014, 8, 784–790. [Google Scholar] [CrossRef]
- Batarseh, M.; Sukhov, S.; Shen, Z.; Gemar, H.; Rezvani, R.; Dogariu, A. Passive sensing around the corner using spatial coherence. Nat. Commun. 2018, 9, 3629. [Google Scholar] [CrossRef] [PubMed]
- Beckus, A.; Tamasan, A.; Atia, G.K. Multi-Modal Non-Line-of-Sight Passive Imaging. IEEE Trans. Image Process. 2019, 28, 3372–3382. [Google Scholar] [CrossRef] [PubMed]
- Boger-Lombard, J.; Katz, O. Passive optical time-of-flight for non line-of-sight localization. Nat. Commun. 2019, 10, 3343. [Google Scholar] [CrossRef] [PubMed]
- Jarabo, A.; Masia, B.; Marco, J.; Gutierrez, D. Recent Advances in Transient Imaging: A Computer Graphics and Vision Perspective. Vis. Inform. 2017, 1, 65–79. [Google Scholar] [CrossRef]
- Kirmani, A.; Hutchison, T.; Davis, J.; Raskar, R. Looking Around the Corner using Transient Imaging. In Proceedings of ICCV; IEEE: Kyoto, Japan, 2009; pp. 159–166. [Google Scholar] [CrossRef]
- Velten, A.; Willwacher, T.; Gupta, O.; Veeraraghavan, A.; Bawendi, M.G.; Raskar, R. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun. 2012, 3, 745. [Google Scholar] [CrossRef]
- Buttafava, M.; Zeman, J.; Tosi, A.; Eliceiri, K.; Velten, A. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 2015, 23, 20997–21011. [Google Scholar] [CrossRef]
- O’Toole, M.; Lindell, D.B.; Wetzstein, G. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 2018, 555, 338–341. [Google Scholar] [CrossRef]
- Liu, X.; Guillén, I.; La Manna, M.; Nam, J.H.; Reza, S.A.; Le, T.H.; Jarabo, A.; Gutiérrez, D.; Velten, A. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 2019, 572, 620–623. [Google Scholar] [CrossRef]
- Laurenzis, M.; Velten, A. Non-line-of-sight laser gated viewing of scattered photons. Opt. Eng. 2014, 53, 023102. [Google Scholar] [CrossRef]
- Arellano, V.; Gutierrez, D.; Jarabo, A. Fast back-projection for non-line of sight reconstruction. Opt. Express 2017, 25, 11574–11583. [Google Scholar] [CrossRef]
- Jungerman, S.; Ingle, A.; Li, Y.; Gupta, M. 3D Scene Inference from Transient Histograms. In Computer Vision—ECCV 2022; Springer: Cham, Switzerland, 2022; pp. 401–417. [Google Scholar] [CrossRef]
- Lindell, D.B.; Wetzstein, G.; O’Toole, M. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Trans. Graph. 2019, 38, 116. [Google Scholar] [CrossRef]
- Nam, J.H.; Brandt, E.; Bauer, S.; Liu, X.; Renna, M.; Tosi, A.; Sifakis, E.; Velten, A. Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second. Nat. Commun. 2021, 12, 6526. [Google Scholar] [CrossRef]
- Zhang, W.; Guo, E.; Zhu, S.; Huang, C.; Chen, L.; Liu, L.; Bai, L.; Lam, E.Y.; Han, J. Real-time scan-free non-line-of-sight imaging. APL Photonics 2024, 9, 126101. [Google Scholar] [CrossRef]
- Pediredla, A.K.; Buttafava, M.; Tosi, A.; Cossairt, O.; Veeraraghavan, A. Reconstructing Rooms Using Photon Echoes: A Plane Based Model and Reconstruction Algorithm for Looking Around the Corner. In Proceedings of the IEEE International Conference on Computational Photography (ICCP); IEEE: Evanston, IL, USA, 2017; pp. 1–12. [Google Scholar] [CrossRef]
- Heide, F.; O’Toole, M.; Zang, K.; Lindell, D.B.; Diamond, S.; Wetzstein, G. Non-line-of-sight Imaging with Partial Occluders and Surface Normals. ACM Trans. Graph. 2019, 38, 22. [Google Scholar] [CrossRef]
- Young, S.I.; Lindell, D.B.; Girod, B.; Taubman, D.; Wetzstein, G. Non-Line-of-Sight Surface Reconstruction Using the Directional Light-Cone Transform. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Seattle, WA, USA, 2020; pp. 1404–1413. [Google Scholar] [CrossRef]
- Mu, F.; Mo, S.; Peng, J.; Liu, X.; Nam, J.H.; Raghavan, S.; Velten, A.; Li, Y. Physics to the Rescue: Deep Non-Line-of-Sight Reconstruction for High-Speed Imaging. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 47, 6146–6158. [Google Scholar] [CrossRef]
- Liu, X.; Wang, J.; Xiao, L.; Shi, Z.; Fu, X.; Qiu, L. Non-line-of-sight Imaging with Arbitrary Illumination and Detection Pattern. Nat. Commun. 2023, 14, 3230. [Google Scholar] [CrossRef] [PubMed]
- Grau Chopite, J.; Hullin, M.B.; Wand, M.; Iseringhausen, J. Deep Non-Line-of-Sight Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Seattle, WA, USA, 2020; pp. 957–966. [Google Scholar] [CrossRef]
- Wang, J.; Liu, X.; Xiao, L.; Shi, Z.; Qiu, L.; Fu, X. Non-Line-of-Sight Imaging with Signal Superresolution Network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Vancouver, BC, Canada, 2023; pp. 17420–17429. [Google Scholar] [CrossRef]
- Cui, X.; Yue, H.; Li, S.; Yin, X.; Hou, Y.; Meng, Y.; Zou, K.; Hu, X.; Yang, J. Virtual Scanning: Unsupervised Non-Line-of-Sight Imaging from Irregularly Undersampled Transients. In Advances in Neural Information Processing Systems 37 (NeurIPS 2024); Neural Information Processing Systems Foundation: Vancouver, BC, Canada, 2024. [Google Scholar] [CrossRef]
- Cho, I.; Shim, H.; Kim, S.J. Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging. In Computer Vision—ECCV 2024; Springer: Cham, Switzerland, 2024; pp. 72–89. [Google Scholar] [CrossRef]
- Liu, X.; Bauer, S.; Velten, A. Analysis of Feature Visibility in Non-Line-of-Sight Measurements. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Long Beach, CA, USA, 2019; pp. 10140–10148. [Google Scholar] [CrossRef]
- Tanaka, K.; Mukaigawa, Y.; Kadambi, A. Polarized Non-Line-of-Sight Imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Seattle, WA, USA, 2020; pp. 2133–2142. [Google Scholar] [CrossRef]
- Liu, H.; Wang, P.; He, X.; Chen, M.; Liu, M.; Xu, Z.; Jiang, X.; Peng, X.; Xu, M. PI-NLOS: Polarized infrared non-line-of-sight imaging. Opt. Express 2023, 31, 44113–44126. [Google Scholar] [CrossRef] [PubMed]
- Pueyo-Ciutad, O.; Marco, J.; Schertzer, S.; Christnacher, F.; Laurenzis, M.; Gutierrez, D.; Redo-Sanchez, A. Time-Gated Polarization for Active Non-Line-of-Sight Imaging. In SIGGRAPH Asia 2024 Conference Papers; Association for Computing Machinery: New York, NY, USA, 2024. [Google Scholar] [CrossRef]
- Tsai, C.-Y.; Kutulakos, K.N.; Narasimhan, S.G.; Sankaranarayanan, A.C. The Geometry of First-Returning Photons for Non-Line-of-Sight Imaging. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Honolulu, HI, USA, 2017; pp. 2336–2344. [Google Scholar] [CrossRef]
- Xin, S.; Nousias, S.; Kutulakos, K.N.; Sankaranarayanan, A.C.; Narasimhan, S.G.; Gkioulekas, I. A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Long Beach, CA, USA, 2019; pp. 6800–6809. [Google Scholar] [CrossRef]
- Tsai, C.-Y.; Sankaranarayanan, A.C.; Gkioulekas, I. Beyond Volumetric Albedo—A Surface Optimization Framework for Non-Line-of-Sight Imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Long Beach, CA, USA, 2019; pp. 1545–1555. [Google Scholar] [CrossRef]
- Rapp, J.; Saunders, C.; Tachella, J.; Murray-Bruce, J.; Altmann, Y.; Tourneret, J.-Y.; McLaughlin, S.; Dawson, R.M.A.; Wong, F.N.C.; Goyal, V.K. Seeing around corners with edge-resolved transient imaging. Nat. Commun. 2020, 11, 5929. [Google Scholar] [CrossRef]
- Klein, P.P. On the Ellipsoid and Plane Intersection Equation. Appl. Math. 2012, 3, 1634–1640. [Google Scholar] [CrossRef]
- Chandrupatla, T.R.; Osler, T.J. The Perimeter of an Ellipse. Math. Sci. 2010, 35, 122–131. [Google Scholar]







| Category | Quantity | Value |
|---|---|---|
| Target geometry | Target type | USAF-style paper chart |
| Target yaw | ||
| Target size | ||
| Target distance | ||
| Horizontal anchor | ||
| Relay wall | Wall area | |
| Sampling grid | ||
| Spatial step | ||
| Spatial extent | – | |
| Time grid | Number of temporal samples | 300 |
| Temporal bin width | ||
| Temporal window | – |
| Component | Manufacturer and Location |
|---|---|
| Pulsed fiber laser, KATANA, | NKT Photonics A/S, Birkerød, Denmark |
| Single-pixel SPAD detector, PDM Series | Micro Photon Devices, Bolzano, Italy |
| Fiber collimator, C40FC-A | Thorlabs Inc., Newton, NJ, USA |
| Two-axis galvo scanning system | Thorlabs Inc., Newton, NJ, USA |
| Scanner-control electronics | National Instruments Corp., Austin, TX, USA |
| TCSPC module, Time Tagger | Swabian Instruments GmbH, Stuttgart, Germany |
| Category | Quantity | Value |
|---|---|---|
| Target | Target type | isotropic planar patch |
| Target distance from wall | ||
| Target size | ||
| Relay wall | Wall area | |
| Sampling grid | ||
| Spatial step | ||
| Time sampling and response | Temporal window | – |
| Temporal samples | ||
| Temporal bin width | ||
| Gaussian broadening | ||
| Yaw sampling | Angular range | |
| Number of angular samples | 401 | |
| Angular step | ||
| Transient parameters | Background per wall-time bin | |
| Integrated background | ||
| Mean integrated signal | ||
| Mean integrated SNR |
| Category | Quantity | Value |
|---|---|---|
| Target | Target type | Diffusive sphere |
| Target radius | ||
| Target distance from relay wall | ||
| Relay wall | Wall area | |
| Sampling grid | ||
| Spatial step | ||
| Acquisition | Temporal bin width | |
| Temporal samples | 1000 | |
| Integration time per point | ||
| Laser repetition rate |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Romanelli, R.; Livi, L.F.; Pepe, F.V.; Sorelli, G.; Mauri, E.; D’Angelo, M.; Proietti, M. Finite-Aperture Limits for Yaw Estimation in Confocal Non-Line-of-Sight Imaging. J. Imaging 2026, 12, 248. https://doi.org/10.3390/jimaging12060248
Romanelli R, Livi LF, Pepe FV, Sorelli G, Mauri E, D’Angelo M, Proietti M. Finite-Aperture Limits for Yaw Estimation in Confocal Non-Line-of-Sight Imaging. Journal of Imaging. 2026; 12(6):248. https://doi.org/10.3390/jimaging12060248
Chicago/Turabian StyleRomanelli, Riccardo, Lorenzo Francesco Livi, Francesco V. Pepe, Giacomo Sorelli, Enea Mauri, Milena D’Angelo, and Massimiliano Proietti. 2026. "Finite-Aperture Limits for Yaw Estimation in Confocal Non-Line-of-Sight Imaging" Journal of Imaging 12, no. 6: 248. https://doi.org/10.3390/jimaging12060248
APA StyleRomanelli, R., Livi, L. F., Pepe, F. V., Sorelli, G., Mauri, E., D’Angelo, M., & Proietti, M. (2026). Finite-Aperture Limits for Yaw Estimation in Confocal Non-Line-of-Sight Imaging. Journal of Imaging, 12(6), 248. https://doi.org/10.3390/jimaging12060248

