Learning to See Around Corners: A Deep Unfolding Framework for Terahertz Radar Non-Line-of-Sight 3D Imaging
Abstract
1. Introduction
2. Model and Methodology
2.1. NLOS THz Radar Imaging Model
2.2. Assumptions
- When THz waves illuminate a rough surface (roughness on the order of the wavelength), the scattering process typically includes both specular and diffuse components. To simplify the modeling of NLOS propagation paths and the subsequent multipath analysis, this study focuses on the dominant specular reflection component. We therefore assume that all reflections from surfaces are effectively specular, providing a tractable basis for signal path reconstruction.
- The properties of the reflective surface (e.g., material, geometry, roughness) introduce inherent signal attenuation and multipath effects, which influence final image quality. Under the constraints of THz radar transmitting power, our experimental setup for NLOS imaging is configured with a single reflective surface. In this configuration, the most significant multipath effects stem from multiple reflections and beam broadening due to the radar’s wide beamwidth. Furthermore, we assume that the targets of interest are situated within the NLOS-visible region and are sufficiently illuminated by the reflected beam from this single surface.
- Since this paper focuses exclusively on the development of the NLOS THz radar 3D imaging algorithm, we assume that the distance between the target and the radar array is known a priori, which is used to preprocess the raw echo data and extract only the signal components corresponding to the true hidden targets, eliminating environmental clutter and target ghosts. The detailed echo extraction process is not discussed in this work.
2.3. Iterative Shrinkage/Thresholding Frameworks
2.3.1. ISTA
2.3.2. FISTA
2.4. Network Mapping of FISTA
2.4.1. Initialization
2.4.2. Gradient Descent Module
2.4.3. Proximal Mapping Module
2.4.4. Momentum Module
2.4.5. Hyperparameter Regularization
2.4.6. Loss Function
2.4.7. Training Strategy and Dataset
2.4.8. NLOS 3D Imaging Implementation
| Algorithm 1 NLOS FISTA-Net for 3D THz radar imaging |
|
3. Experiments and Results
3.1. Experiment Setup
3.2. Experiment Results and Discussion
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
| NLOS | Non-Line-of-Sight |
| LOS | Line-of-Sight |
| TWR | Through-Wall Radar |
| LAC | Looking Around Corner |
| SAR | Synthetic Aperture Radar |
| RMA | Range Migration Algorithm |
| CS | Compressed sensing |
| THz | Terahertz |
| DL | Deep learning |
| FMCW | Frequency-Modulated Continuous Wave |
| BRDF | Bidirectional Reflectance Distribution Function |
| RCMC | Range Cell Migration Correction |
| FFT | Fast Fourier transform |
| CAWGN | Complex-valued additive white Gaussian noise |
| ISTA | Iterative Shrinkage/Thresholding Algorithm |
| LASSO | Least Absolute Shrinkage and Selection Operator |
| FISTA | Fast Iterative Shrinkage/Thresholding Algorithm |
| MSE | Mean Square Error |
| DNN | Deep Neural Network |
| ENT | Entropy |
| IC | Image Contrast |
References
- Yang, J.Y. Development laws and macro trends analysis of radar technology. J. Radars 2012, 1, 19–27. [Google Scholar] [CrossRef]
- Ding, C.B.; Qiu, X.L.; Wu, Y.R. Concept, system, and method of holographic synthetic aperture radar. J. Radars 2020, 9, 399–408. [Google Scholar] [CrossRef]
- Ding, C.B.; Qiu, X.L.; Xu, F.; Liang, X.D.; Jiao, Z.K.; Zhang, F.B. Synthetic aperture radar three-dimensional imaging—From TomoSAR and array InSAR to microwave vision. J. Radars 2019, 8, 693–709. [Google Scholar] [CrossRef]
- Kong, L.J.; Guo, S.S.; Chen, J.H.; Wu, P.L.; Cui, G.L. Overview and prospects of multipath exploitation radar target detection technology. J. Radars 2024, 13, 23–45. [Google Scholar] [CrossRef]
- Smith, G.E.; Mobasseri, B.G. Multipath exploitation for radar target classification. In Proceedings of the 2012 IEEE Radar Conference, Atlanta, GA, USA, 7–11 May 2012; pp. 623–628. [Google Scholar]
- Raskar, R.; Davis, J. 5d Time-Light Transport Matrix: What Can We Reason About Scene Properties? 2008. Available online: https://dspace.mit.edu/handle/1721.1/67888 (accessed on 23 January 2026).
- Kirmani, A.; Hutchison, T.; Davis, J.; Raskar, R. Looking around the corner using transient imaging. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 29 September–2 October 2009; pp. 159–166. [Google Scholar]
- Velten, A.; Willwacher, T.; Gupta, O.; Veeraraghavan, A.; Bawendi, G.M.; Raskar, R. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun. 2012, 3, 745. [Google Scholar] [CrossRef]
- Katz, O.; Heidmann, P.; Fink, M.; Gigan, S. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photonics 2014, 8, 784–790. [Google Scholar] [CrossRef]
- Yedidia, A.B.; Baradad, M.; Thrmpoulidis, C.; Freeman, T.W.; Wornell, W.G. Using unknown occluders to recover hidden scenes. In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 12223–12231. [Google Scholar]
- Liu, X.T.; Wang, J.Y.; Li, Z.P.; Shi, Z.Q.; Fu, X.; Qiu, L.Y. Non-line-of-sight reconstruction with signal-object collaborative regularization. Light Sci. Appl. 2021, 10, 198. [Google Scholar] [CrossRef]
- Pauli, M.; Göttel, B.; Scherr, S.; Bhutani, A.; Ayhan, S.; Winkler, W. Miniaturized millimeter-wave radar sensor for high-accuracy applications. IEEE Trans. Microw. Theory Tech. 2017, 65, 1707–1715. [Google Scholar] [CrossRef]
- Wang, X.; Xu, L.H.; Sun, H.B.; Xin, J.M.; Zheng, N.N. On-road vehicle detection and tracking using MMW radar and monovision fusion. IEEE Trans. Intell. Transp. Syst. 2016, 17, 2075–2084. [Google Scholar] [CrossRef]
- Guo, S.S.; Zhao, Q.S.; Cui, G.L.; Li, S.L.; Kong, L.J.; Yang, X.B. Behind corner targets location using small aperture millimeter wave radar in nlos urban environment. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 460–470. [Google Scholar] [CrossRef]
- Chen, J.H.; Zhang, Y.; Guo, S.S.; Cui, G.L.; Wu, P.L.; Jia, C. Joint estimation of nlos building layout and targets via sparsity driven approach. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5114513. [Google Scholar] [CrossRef]
- Wei, S.J.; Wei, J.S.; Liu, X.Y.; Wang, M.; Liu, S.; Fan, F. Nonlineof-sight 3-D imaging using millimeter-wave radar. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5106518. [Google Scholar] [CrossRef]
- Lin, Y.Q.; Qiu, X.L.; Peng, L.X.; Li, H.; Ding, C.B. Non-line-of-sight target relocation by multipath model in SAR 3D urban area imaging. J. Radars 2024, 13, 777–790. [Google Scholar] [CrossRef]
- Wen, Y.B.; Wei, S.J.; Wei, J.S.; Liang, J.D.; Zhang, X.L. Non-line-of-sight imaging of hidden moving target using millimeter-wave inverse synthetic aperture radar. In Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17–22 July 2022; pp. 555–558. [Google Scholar]
- Tan, X.H.; Yang, Z.J.; Li, D.; Liu, H.Q.; Liao, G.S.; Wu, Y. An efficient range-Doppler domain ISAR imaging approach for rapidly spinning targets. IEEE Trans. Geosci. Remote Sens. 2020, 58, 2670–2681. [Google Scholar] [CrossRef]
- Xing, M.D.; Ma, P.H.; Lou, Y.S.; Sun, G.C.; Lin, H. Review of fast back projection algorithms in synthetic aperture radar. J. Radars 2024, 13, 1–22. [Google Scholar] [CrossRef]
- Donoho, D.L. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 1289–1306. [Google Scholar] [CrossRef]
- Cetin, M.; Karl, W.C. Feature-enhanced synthetic aperture radar image formation based on nonquadratic regularization. IEEE Trans. Image Process. 2001, 10, 623–631. [Google Scholar] [CrossRef] [PubMed]
- Álvarez, Y.; Rodriguez-vaqueiro, Y.; Gonzalezvaldes, B.; Rappaport, C.M.; Las-Heras, F.; Martínez-Lorenzo, J.Á. Three-dimensional compressed sensing-based millimeter-wave imaging. IEEE Trans. Antennas Propag. 2015, 63, 5868–5873. [Google Scholar] [CrossRef]
- Baraniuk, R.; Steeghs, P. Compressive radar imaging. In Proceedings of the 2007 IEEE Radar Conference, Waltham, MA, USA, 17–20 April 2007; pp. 128–133. [Google Scholar]
- Wei, S.J.; Zhang, X.L.; Shi, J.; Gao, X. Sparse reconstruction for SAR imaging based on compressed sensing. Prog. Electromagn. Res. 2010, 109, 63–81. [Google Scholar] [CrossRef]
- Liu, X.Y.; Wei, S.J.; Wei, J.S.; Shi, J.; Zhang, X.L.; Li, Y.J. Non-line-of-sight millimeter-wave radar 3-D sparse reconstruct via MSSTV method. In Proceedings of the 2022 IEEE 9th International Symposium on Microwave, Antenna, Propagation and EMC Technologies for Wireless Communications (MAPE), Chengdu, China, 26–29 August 2022; pp. 424–427. [Google Scholar]
- Cai, X.; Wei, S.J.; Wen, Y.B.; Hu, J.B.; Wang, M.; Shi, J.; Cui, G.L. Precise reconstruction method for hidden targets based on non-line-of-sight radar 3D imaging. J. Radars 2024, 13, 791–806. [Google Scholar] [CrossRef]
- Cai, X.; Wei, S.J.; Wen, Y.B.; Wang, M.; Shi, J.; Zhang, X.L. Bayesian-based 3-D MMW radar imaging of non-line-of-sight environments. In Proceedings of the 2023 Cross Strait Radio Science and Wireless Technology Conference (CSRSWTC), Guilin, China, 10–13 November 2023; pp. 1–3. [Google Scholar]
- Wen, Y.B.; Wei, S.J.; Cai, X.; Wang, M.; Shi, J.; Zhang, X.L. NMTCS: Non-line-of-sight sparse reconstruct for hidden motion targets. In Proceedings of the 2023 Cross Strait Radio Science and Wireless Technology Conference (CSRSWTC), Guilin, China, 10–13 November 2023; pp. 1–3. [Google Scholar]
- Wen, Y.B.; Wei, S.J.; Cai, X.; Shen, R.; Wang, M.; Shi, J. CMTI: Non-line- of-sight radar imaging for non-cooperative corner motion target. IEEE Trans. Veh. Technol. 2025, 74, 179–190. [Google Scholar] [CrossRef]
- Wen, Y.B.; Wei, S.J.; Cai, X.; Hu, Y.F.; Wang, M.; Cui, G.L. Non-line-of-sight sparse aperture ISAR imaging via a novel detail-aware regularization. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5220218. [Google Scholar] [CrossRef]
- Gregor, K.; Yann, L.C. Learning fast approximations of sparse coding. In Proceedings of the 27th International Conference on International Conference on Machine Learning, Haifa, Israel, 21–24 June 2010; pp. 399–406. [Google Scholar]
- Liu, R.S.; Zhang, Y.X.; Cheng, S.C.; Luo, Z.X.; Fan, X. A deep framework assembling principled modules for CS-MRI: Unrolling perspective, convergence behaviors, and practical modelin. IEEE Trans. Med. Imaging 2020, 39, 4150–4163. [Google Scholar] [CrossRef]
- Wang, M.; Wei, S.J.; Shen, R.; Zhou, Z.C.; Shi, J.; Zhang, X.L. 3D SAR imaging method based on learned sparse prior. J. Radars 2023, 12, 36–52. [Google Scholar] [CrossRef]
- Wang, M.; Wei, S.J.; Liang, J.D.; Zeng, X.L.; Wang, C.; Shi, J. RMIST-Net: Joint range migration and sparse reconstruction network for 3-D mmW imaging. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5205117. [Google Scholar] [CrossRef]
- Wang, M.; Wei, S.J.; Zhou, Z.C.; Shi, J.; Zhang, X.L.; Guo, Y.X. CTV-Net: Complex-valued TV-driven network with nested topology for 3-D SAR imaging. IEEE Trans. Neural Netw. Learn. Syst. 2024, 35, 5588–5602. [Google Scholar] [CrossRef] [PubMed]
- Wang, M.; Wei, S.J.; Shi, J.; Wu, Y.; Qu, Q.Z.; Zhou, Y.Y. CSR-Net: A novel complex-valued network for fast and precise 3-D microwave sparse reconstruction. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 4476–4492. [Google Scholar] [CrossRef]
- Zhang, H.; Wei, S.J.; Min, R.; Cai, X.; Li, S.Q.; Li, J. Adaptive FMCW Radar Interference Suppression via Coupled Range-Doppler Unsupervised Sparse Learning and Reconstruction. IEEE Trans. Microw. Theory Tech. 2025, 73, 9442–9458. [Google Scholar] [CrossRef]
- Wei, S.J.; Zhang, H.; Zeng, X.F.; Zhou, Z.C.; Shi, J.; Zhang, X.L. CARNet: An effective method for SAR image interference suppression. Int. J. Appl. Earth Obs. Geoinf. 2022, 114, 103019. [Google Scholar] [CrossRef]
- Han, S.; Bertling, K.; Dean, P.; Keeley, J.; Burnett, A.D.; Lim, Y.L.; Khanna, S.P.; Valavanis, A.; Linfield, E.H.; Davies, A.G.; et al. Laser Feedback Interferometry as a Tool for Analysis of Granular Materials at Terahertz Frequencies: Towards Imaging and Identification of Plastic Explosives. Sensors 2016, 16, 352. [Google Scholar] [CrossRef]
- Silvestri, C.; Rakić, A.D.; Indjin, D.; Khalatpour, A.; Jirauschek, C.; Demic, A.; Ikonic, Z.; Dean, P.; Vuković, N.; Radovanović, J.; et al. Quantum cascade laser roadmap. arXiv 2026, arXiv:2602.17042. [Google Scholar] [CrossRef]
- Wang, Y.Z.; Li, L.J.; Gong, K. Narrowband experimental study on millimeter-wave indoor propagation. In Proceedings of the 1998 International Conference on Communication Technology, Beijing, China, 22–24 October 1998. [Google Scholar]
- Elad, M. Why simple shrinkage is still relevant for redundant representations? IEEE Trans. Inf. Theory 2006, 52, 5559–5569. [Google Scholar] [CrossRef]
- Bioucas-Dias, J.M.; Figueiredo, M.A.T. A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration. IEEE Trans. Image Process. 2007, 16, 2992–3004. [Google Scholar] [CrossRef] [PubMed]
- Beck, A.; Teboulle, M. A fast iterative shrinkage thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2009, 2, 183–202. [Google Scholar] [CrossRef]
- Xiang, J.X.; Dong, Y.G.; Yang, Y.J. FISTA-Net: Learning a fast iterative shrinkage thresholding network for inverse problems in imaging. IEEE Trans. Med. Imaging 2021, 40, 1329–1339. [Google Scholar] [CrossRef]
- Wang, M.; Wei, S.J.; Liang, J.D.; Liu, S.; Shi, J.; Zhang, X.L. Lightweight FISTA-inspired sparse reconstruction network for mmW 3-D holography. IEEE Trans. Geosci. Remote Sens. 2021, 60, 5211620. [Google Scholar] [CrossRef]
- Zhou, Y.L.; Zhong, Y.; Wei, Z.; Yin, T.T.; Chen, X.D. An improved deep learning scheme for solving 2-D and 3-D inverse scattering problem. IEEE Trans. Antennas Propag. 2021, 69, 2853–2863. [Google Scholar] [CrossRef]








| Parameters | Values |
|---|---|
| Center Frequency (GHz) | 121 |
| Chirp Constant (MHz/s) | 31.746 |
| Bandwidth (GHz) | 10 |
| Pulse Width (s) | 315 |
| Pulse Repeat Frequency (Hz) | 33.3 |
| x-axis Synthetic Aperture Length (mm) | 200 |
| x-axis Antenna Element Spacing (mm) | 0.598 |
| z-axis Synthetic Aperture Length (mm) | 200 |
| z-axis Antenna Element Spacing (mm) | 1 |
| Targets | SR | RMA | FISTA | FISTA-Net | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ENT | IC | Times (s) | ENT | IC | Times (s) | ENT | IC | Times (s) | ||
| Letter “E” | 1 | 11.848 | 5.860 | 0.252 | 10.807 | 7.456 | 3.539 | 10.477 | 8.096 | 0.010 |
| 0.7 | 12.657 | 4.361 | 0.253 | 11.323 | 6.698 | 3.573 | 10.391 | 8.426 | 0.011 | |
| 0.5 | 13.149 | 3.240 | 0.242 | 11.691 | 5.942 | 3.551 | 10.284 | 8.893 | 0.011 | |
| 0.3 | 13.543 | 2.191 | 0.231 | 11.963 | 5.231 | 3.414 | 10.050 | 10.148 | 0.011 | |
| Scissors | 1 | 12.870 | 4.498 | 0.264 | 11.095 | 8.345 | 3.875 | 10.882 | 9.002 | 0.010 |
| 0.7 | 13.324 | 3.254 | 0.269 | 11.344 | 7.797 | 3.986 | 10.919 | 9.125 | 0.011 | |
| 0.5 | 13.579 | 2.452 | 0.256 | 11.389 | 7.673 | 3.864 | 10.889 | 9.440 | 0.011 | |
| 0.3 | 13.792 | 1.719 | 0.232 | 11.245 | 8.039 | 3.863 | 10.891 | 9.912 | 0.011 | |
| Resolution chart | 1 | 12.798 | 2.486 | 0.416 | 12.596 | 2.666 | 5.516 | 12.546 | 2.841 | 0.015 |
| 0.7 | 13.386 | 1.963 | 0.379 | 13.067 | 2.312 | 5.286 | 12.639 | 2.831 | 0.011 | |
| 0.5 | 13.639 | 1.626 | 0.345 | 13.311 | 2.031 | 5.365 | 12.735 | 2.825 | 0.013 | |
| 0.3 | 13.811 | 1.347 | 0.351 | 13.437 | 1.822 | 5.363 | 12.857 | 2.821 | 0.011 | |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Chen, K.; Wei, S.; Wang, M.; Chen, J.; Han, B.; Li, J.; Liu, Z.; Zhang, X.; Liao, Y.; Gao, P.; et al. Learning to See Around Corners: A Deep Unfolding Framework for Terahertz Radar Non-Line-of-Sight 3D Imaging. Photonics 2026, 13, 440. https://doi.org/10.3390/photonics13050440
Chen K, Wei S, Wang M, Chen J, Han B, Li J, Liu Z, Zhang X, Liao Y, Gao P, et al. Learning to See Around Corners: A Deep Unfolding Framework for Terahertz Radar Non-Line-of-Sight 3D Imaging. Photonics. 2026; 13(5):440. https://doi.org/10.3390/photonics13050440
Chicago/Turabian StyleChen, Kun, Shunjun Wei, Mou Wang, Juran Chen, Bingyu Han, Jin Li, Zhe Liu, Xiaoling Zhang, Yi Liao, Pengcheng Gao, and et al. 2026. "Learning to See Around Corners: A Deep Unfolding Framework for Terahertz Radar Non-Line-of-Sight 3D Imaging" Photonics 13, no. 5: 440. https://doi.org/10.3390/photonics13050440
APA StyleChen, K., Wei, S., Wang, M., Chen, J., Han, B., Li, J., Liu, Z., Zhang, X., Liao, Y., Gao, P., & Mi, X. (2026). Learning to See Around Corners: A Deep Unfolding Framework for Terahertz Radar Non-Line-of-Sight 3D Imaging. Photonics, 13(5), 440. https://doi.org/10.3390/photonics13050440

