Towards Next-Generation Smart Seed Phenomics: A Review and Roadmap for Metasurface-Based Hyperspectral Imaging and a Light-Field Platform for 3D Reconstruction
Abstract
1. Introduction
1.1. Challenges and Technological Gaps in High-Throughput Seed Phenomics
1.2. Light-Field and Metasurface Imaging: Emerging Technologies for 3D and Spectral Seed Phenotyping
1.3. Scope and Contributions
2. Technical Foundations: From Light-Field Imaging to Metasurface Arrays
2.1. Principles of Light-Field Imaging and Metasurface Optics
2.2. Dispersion Engineering of Metasurfaces and Hyperspectral Imaging Mechanisms
3. Design and Optimization of Light-Field Modulation by Metasurface Lens Arrays
3.1. Architecture for Metasurface-Based Light-Field Manipulation
- Multidimensional light-field design: This requires leveraging dispersion theory, aberration analysis, and related optical design principles to guide the design and optimization of metalenses [57]. A comprehensive library of nanostructured pillar units is established, along with a complete dispersion phase model. Inverse-design methods are then employed to jointly optimize the metasurface lens array and hyperspectral performance [58].
- Fabrication of large-aperture metasurface arrays: The design specifications necessitate advanced fabrication processes capable of producing large-aperture metalens arrays [59]. While DUV steppers offer high resolution for subwavelength structures, their exposure field is typically limited. Fabricating a large-aperture metalens array exceeding this field requires reticle stitching. Technical challenges here include controlling stitching errors at the nanometer scale; slight misalignments at exposure boundaries introduce phase discontinuities, leading to scattering and ghost images that degrade the reconstruction quality of the light field. Furthermore, the high cost of DUV photomasks and the low throughput associated with multi-shot exposures pose a barrier to cost-sensitive agricultural applications. Optimization of fabrication workflows and post-fabrication characterization of large-aperture samples are critical to ensure performance consistency. To address the cost constraints, NIL is viewed as a promising alternative for mass production. However, for high-aspect-ratio metasurface pillars, demolding defects (where nanopillars fracture or adhere to the mold) significantly reduce yield. A critical barrier in large-area NIL is maintaining the uniformity of the residual layer thickness across the entire wafer. Variations in RLT alter the effective height of the meta-atoms, causing phase errors that result in chromatic aberration, which is particularly detrimental for hyperspectral reconstruction accuracy. Despite these hurdles, recent progress has been made. Rho’s group recently demonstrated a “roll-to-plate” printing protocol capable of fabricating centimeter-scale RGB achromatic metalenses, significantly lowering the unit cost for mass deployment [60].
- Multidimensional light-field reconstruction: Accurate reconstruction requires knowledge of the point-spread function (PSF) of the metasurface array. Using broadband spectral characteristics, deconvolution and end-to-end neural network models are developed to reconstruct hyperspectral images [61]. This reconstruction framework is possibly applied to seed phenotyping experiments, ultimately enabling the creation of a 3D hyperspectral imaging database for seeds.
3.2. High-Efficiency Inverse Design of Metasurfaces
4. Computational Reconstruction and Information Decoupling Algorithms
4.1. Three-Dimensional Light-Field Analysis and Reconstruction from Metalens Arrays
4.1.1. Spatial and Angular Resolution
4.1.2. Disparity Map Accuracy
4.1.3. Three-Dimensional Light-Field Reconstruction Algorithm
4.2. Light-Field Depth Estimation Methods
4.2.1. Geometric Methods
4.2.2. Deep Learning Methods
4.3. Physics-Guided Neural Networks for Dispersive Spectral Decoupling
- Adjoint-based optimization for dispersion linearization: By employing adjoint optimization, the metasurface’s nanostructure parameters, such as pillar height and diameter, are iteratively tuned together with the axial dispersion profile. This compensates for higher-order chromatic nonlinearity, producing numerically solvable dispersive images suitable for hyperspectral reconstruction.
- Physics-informed neural networks: Traditional data-driven deep learning models (e.g., U-Net) are often treated as “black boxes” in hyperspectral reconstruction, lacking explicit physical constraints on metasurface dispersion. This limits generalization in complex imaging scenarios. To overcome this, the axial dispersion transfer function of the metasurface, defined as the wavelength-dependent point-spread function, , can be embedded within a neural network framework to construct a physics-informed inverse-convolution spectral network, achieving longitudinal-dispersion spectral decoupling.
4.3.1. End-to-End Co-Design Optimization Framework
4.3.2. Physics-Informed Attention and Generative Learning
4.4. Hyperspectral Reconstruction Algorithm
5. Roadmap to Implement 3D–Hyperspectral Metalens-Array Light-Field Camera
5.1. Coupling Mechanisms Between Metasurface Dispersion and Light-Field Imaging
5.2. Multidimensional Light-Field–Spectral Coupling–Decoupling and Reconstruction Theory
5.3. Implementation Pathways and Challenges for Seed Phenomics
5.3.1. Key Technology Map, Challenges, and Future Perspectives
5.3.2. Validation Framework for Seed Phenotyping
6. Conclusions and Perspectives
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Shiferaw, B.; Prasanna, B.M.; Hellin, J.; Bänziger, M. Crops that feed the world 6. Past successes and future challenges to the role played by maize in global food security. Food Secur. 2011, 3, 307–327. [Google Scholar] [CrossRef]
- Erenstein, O.; Jaleta, M.; Sonder, K.; Mottaleb, K.; Prasanna, B.M. Global maize production, consumption and trade: Trends and R&D implications. Food Secur. 2022, 14, 1295–1319. [Google Scholar] [CrossRef]
- Jin, B.; Qi, H.; Jia, L.; Tang, Q.; Gao, L.; Li, Z.; Zhao, G. Determination of viability and vigor of naturally-aged rice seeds using hyperspectral imaging with machine learning. Infrared Phys. Technol. 2022, 122, 104097. [Google Scholar] [CrossRef]
- Qi, H.; Huang, Z.; Sun, Z.; Tang, Q.; Zhao, G.; Zhu, X.; Zhang, C. Rice seed vigor detection based on near-infrared hyperspectral imaging and deep transfer learning. Front. Plant Sci. 2023, 14, 1283921. [Google Scholar] [CrossRef]
- Wang, X.; Zhu, M.; Li, J.; Yang, Y.; Xie, H.; Duan, Y.; Cao, N.; Kan, R.; Yu, Y. Evaluation and Development Trends of Optical Detection Technology for Seed Vigor. Spectroscopy 2025. [Google Scholar] [CrossRef]
- Gao, T.; Chandran, A.K.N.; Paul, P.; Walia, H.; Yu, H. HyperSeed: An End-to-End Method to Process Hyperspectral Images of Seeds. Sensors 2021, 21, 8184. [Google Scholar] [CrossRef] [PubMed]
- Yang, W.; Feng, H.; Zhang, X.; Zhang, J.; Doonan, J.H.; Batchelor, W.D.; Xiong, L.; Yan, J. Crop Phenomics and High-Throughput Phenotyping: Past Decades, Current Challenges, and Future Perspectives. Mol. Plant 2020, 13, 187–214. [Google Scholar] [CrossRef]
- ElMasry, G.; Mandour, N.; Al-Rejaie, S.; Belin, E.; Rousseau, D. Recent Applications of Multispectral Imaging in Seed Phenotyping and Quality Monitoring—An Overview. Sensors 2019, 19, 1090. [Google Scholar] [CrossRef]
- Klasen, D.; Fischbach, A.; Sydoruk, V.; Kochs, J.; Bühler, J.; Koller, R.; Huber, G. Seed-to-plant-tracking: Automated phenotyping of seeds and corresponding plants of Arabidopsis. Front. Plant Sci. 2025, 16, 1539424. [Google Scholar] [CrossRef]
- Zhang, M.; Song, J.; Jia, H.; Zhang, X.; Yang, W.; Wang, Y.; Wang, H. Prediction of Vigor of Naturally Aged Seeds from Xishuangbanna Cucumber (Cucumis sativus L. var. xishuangbannanesis) Using Hyperspectral Imaging. Agriculture 2025, 15, 1043. [Google Scholar] [CrossRef]
- Danilevicz, M.F.; Bayer, P.E.; Nestor, B.J.; Bennamoun, M.; Edwards, D. Resources for image-based high-throughput phenotyping in crops and data sharing challenges. Plant Physiol. 2021, 187, 699–715. [Google Scholar] [CrossRef]
- Berry, J.C.; Fahlgren, N.; Pokorny, A.A.; Bart, R.S.; Veley, K.M. An automated, high-throughput method for standardizing image color profiles to improve image-based plant phenotyping. PeerJ 2018, 6, e5727. [Google Scholar] [CrossRef]
- Reuzeau, C.; Pen, J.; Frankard, V.; de Wolf, J.; Peerbolte, R.; Broekaert, W.; van Camp, W. TraitMill: A Discovery Engine for Identifying Yield-enhancement Genes in Cereals. Plant Gene Trait. 2010, 1, 1–6. [Google Scholar] [CrossRef]
- Guo, Q.; Wu, F.; Pang, S.; Zhao, X.; Chen, L.; Liu, J.; Xue, B.; Xu, G.; Li, L.; Jing, H.; et al. Crop 3D—A LiDAR based platform for 3D high-throughput crop phenotyping. Sci. China Life Sci. 2018, 61, 328–339. [Google Scholar] [CrossRef]
- Wu, D.; Guo, Z.; Ye, J.; Feng, H.; Liu, J.; Chen, G.; Zheng, J.; Yan, D.; Yang, X.; Xiong, X.; et al. Combining high-throughput micro-CT-RGB phenotyping and genome-wide association study to dissect the genetic architecture of tiller growth in rice. J. Exp. Bot. 2019, 70, 545–561. [Google Scholar] [CrossRef] [PubMed]
- Qian, Y.; Cao, P.; Yin, W.; Dai, F.; Hu, F.; Yan, Z. Calculation method of surface shape feature of rice seed based on point cloud. Comput. Electron. Agric. 2017, 142, 416–423. [Google Scholar] [CrossRef]
- Yang, J.; Zhao, Q.; Song, Q.; Zhu, M.; Liu, S.; Yu, Y.; Wang, H. Co-optimized tunable-focus light field imaging system for 3D seed phenotyping: From optical design to computational reconstruction. Optica Open 2025, preprint. [Google Scholar] [CrossRef]
- Xiong, Z.; Liu, S.; Tan, J.; Huang, Z.; Li, X.; Zhuang, G.; Fang, Z.; Chen, T.; Zhang, L. Combining Hyperspectral Techniques and Genome-Wide Association Studies to Predict Peanut Seed Vigor and Explore Associated Genetic Loci. Int. J. Mol. Sci. 2024, 25, 8414. [Google Scholar] [CrossRef]
- Yan, H.; Zhang, Z.; Lv, Y.; Nie, Y. Integrated multispectral imaging, germination phenotype, and transcriptomic analysis provide insights into seed vigor responsive mechanisms in quinoa under artificial accelerated aging. Front. Plant Sci. 2024, 15, 1435154. [Google Scholar] [CrossRef]
- Li, Y.; Li, P.; Zheng, X.; Liu, H.; Zhao, Y.; Sun, X.; Liu, W.; Zhou, S. Design of a Novel Microlens Array and Imaging System for Light Fields. Micromachines 2024, 15, 1166. [Google Scholar] [CrossRef] [PubMed]
- Pan, W.; Umana-Membreno, G.A.; Akhavan, N.D.; Tan, H.H.; Neshev, D.; Wesemann, L.; Leslie, P.; Driggers, R.; Faraone, L. Design and Simulation of Metalens Arrays for Enhanced MWIR Imaging Array Performance. J. Electron. Mater. 2025, 54, 8304–8314. [Google Scholar] [CrossRef]
- Fan, Z.-B.; Qiu, H.-Y.; Zhang, H.-L.; Pang, X.-N.; Zhou, L.-D.; Liu, L.; Ren, H.; Wang, Q.-H.; Dong, J.-W. A broadband achromatic metalens array for integral imaging in the visible. Light Sci. Appl. 2019, 8, 67. [Google Scholar] [CrossRef]
- World’s First Hyper-Spectral Color Imaging by a Metalens Camera Without Chromatic Aberration. Available online: https://group.ntt/en/newsrelease/2022/10/24/221024a.html (accessed on 24 October 2022).
- Dhanya, V.G.; Subeesh, A.; Susmita, C.; Amaresh; Saji, S.J.; Dilsha, C.; Keerthi, C.; Nunavath, A.; Singh, A.N.; Kumar, S. High throughput phenotyping using hyperspectral imaging for seed quality assurance coupled with machine learning methods: Principles and way forward. Plant Physiol. Rep. 2024, 29, 749–768. [Google Scholar] [CrossRef]
- Wang, R.-F.; Qu, H.-R.; Su, W.-H. From sensors to insights: Technological trends in image-based high-throughput plant phenotyping. Smart Agric. Technol. 2025, 12, 101257. [Google Scholar] [CrossRef]
- Hu, X.; Xu, W.; Fan, Q.; Yue, T.; Yan, F.; Lu, Y.; Xu, T. Metasurface-based computational imaging: A review. Adv. Photonics 2024, 6, 014002. [Google Scholar] [CrossRef]
- Hu, X.; Li, Z.; Miao, L.; Fang, F.; Jiang, Z.; Zhang, X. Measurement Technologies of Light Field Camera: An Overview. Sensors 2023, 23, 6812. [Google Scholar] [CrossRef]
- Lin, B.; Tian, Y.; Zhang, Y.; Zhu, Z.; Wang, D. Deep learning methods for high-resolution microscale light field image reconstruction: A survey. Front. Bioeng. Biotechnol. 2024, 12, 1500270. [Google Scholar] [CrossRef]
- Ghamisi, P.; Yokoya, N.; Li, J.; Liao, W.; Liu, S.; Plaza, J.; Rasti, B.; Plaza, A. Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art. IEEE Geosci. Remote Sens. Mag. 2018, 5, 37–78. [Google Scholar] [CrossRef]
- Liu, Y.; Pu, H.; Sun, D.-W. Hyperspectral imaging technique for evaluating food quality and safety during various processes: A review of recent applications. Trends Food Sci. Technol. 2017, 69, 25–35. [Google Scholar] [CrossRef]
- Levoy, M.; Ng, R.; Adams, A.; Footer, M.; Horowitz, M. Light Field Microscopy. In Acm Siggraph 2006 Papers; ACM: New York, NY, USA, 2006; pp. 924–934. [Google Scholar]
- Broxton, M.; Grosenick, L.; Yang, S.; Cohen, N.; Andalman, A.; Deisseroth, K.; Levoy, M. Wave optics theory and 3-D deconvolution for the light field microscope. Opt. Express 2013, 21, 25418–25439. [Google Scholar] [CrossRef]
- Zhang, Z.; Bai, L.; Cong, L.; Yu, P.; Zhang, T.; Shi, W.; Li, F.; Du, J.; Wang, K. Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy. Nat. Biotechnol. 2021, 39, 74–83. [Google Scholar] [CrossRef]
- Khorasaninejad, M.; Capasso, F. Metalenses: Versatile multifunctional photonic components. Science 2017, 358, eaam8100. [Google Scholar] [CrossRef]
- Berry, M.V. Quantal phase factors accompanying adiabatic changes. Proc. R. Soc. London. Ser. A Math. Phys. Sci. 1984, 392, 45–57. [Google Scholar] [CrossRef]
- Hu, Y.; Jiang, Y.; Zhang, Y.; Yang, X.; Ou, X.; Li, L.; Kong, X.; Liu, X.; Qiu, C.-W.; Duan, H. Asymptotic dispersion engineering for ultra-broadband meta-optics. Nat. Commun. 2023, 14, 6649. [Google Scholar] [CrossRef] [PubMed]
- Li, S.-H.; Sun, C.; Tang, P.-Y.; Liao, J.-H.; Hsieh, Y.-H.; Fung, B.-H.; Fang, Y.-H.; Kuo, W.-H.; Wu, M.-H.; Chang, H.-C.; et al. Augmented reality system based on the integration of polarization-independent metalens and micro-LEDs. Opt. Express 2024, 32, 11463–11473. [Google Scholar] [CrossRef]
- Lin, R.J.; Su, V.-C.; Wang, S.; Chen, M.K.; Chung, T.L.; Chen, Y.H.; Kuo, H.Y.; Chen, J.-W.; Chen, J.; Huang, Y.-T.; et al. Achromatic metalens array for full-colour light-field imaging. Nat. Nanotechnol. 2019, 14, 227–231. [Google Scholar] [CrossRef] [PubMed]
- Fan, Q.; Xu, W.; Hu, X.; Zhu, W.; Yue, T.; Zhang, C.; Yan, F.; Chen, L.; Lezec, H.J.; Lu, Y.; et al. Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field. Nat. Commun. 2022, 13, 2130. [Google Scholar] [CrossRef] [PubMed]
- Zaidi, A.; Rubin, N.A.; Meretska, M.L.; Li, L.W.; Dorrah, A.H.; Park, J.-S.; Capasso, F. Metasurface-enabled single-shot and complete Mueller matrix imaging. Nat. Photonics 2024, 18, 704–712. [Google Scholar] [CrossRef]
- Zhao, Z.; Liu, X.; Ji, Y.; Zhang, Y.; Chen, Y.; Luo, Z.; Song, Y.; Geng, Z.; Tanaka, T.; Qi, F.; et al. Meta-lens digital image correlation. Opto-Electronic Adv. 2025, 8, 250014-1–250014-12. [Google Scholar] [CrossRef]
- Song, Y.; Yuan, J.; Chen, Q.; Liu, X.; Zhou, Y.; Cheng, J.; Xiao, S.; Chen, M.K.; Geng, Z. Three-dimensional varifocal meta-device for augmented reality display. PhotoniX 2025, 6, 6. [Google Scholar] [CrossRef]
- Zhou, Y.; Chen, Z.; Cheng, J.; Zhang, Q.; Geng, Z.; Wu, Z.; Chen, M.K. High-Resolution 3D Imaging with Tunable Point Cloud Projection Based on Meta-Device. Laser Photonics Rev. 2025, e01327. [Google Scholar] [CrossRef]
- Fröch, J.E.; Colburn, S.; Brady, D.J.; Heide, F.; Veeraraghavan, A.; Majumdar, A. Computational imaging with meta-optics. Optica 2025, 12, 774. [Google Scholar] [CrossRef]
- Wang, P.; Mohammad, N.; Menon, R. Chromatic-aberration-corrected diffractive lenses for ultra-broadband focusing. Sci. Rep. 2016, 6, 21545. [Google Scholar] [CrossRef]
- Yu, H.; Xie, Z.; Li, C.; Li, C.; de SMenezes, L.; Maier, S.A.; Ren, H. Dispersion Engineering of Metalenses. Appl. Phys. Lett. 2023, 123, 240503. [Google Scholar] [CrossRef]
- He, Y.; Chen, M.K.; Huang, M.; Zhang, Y.; Liu, X.; Luo, Z.; Yao, C.; Li, H.; Zeng, F.; Geng, Z.; et al. Dispersive Meta-lens Thermometry for High-temperature Measurements. Nat. Commun. 2025, 16, 10090. [Google Scholar] [CrossRef]
- Tan, S.; Yang, F.; Boominathan, V.; Veeraraghavan, A.; Naik, G.V. 3D Imaging Using Extreme Dispersion in Optical Metasurfaces. Acs Photonics 2021, 8, 1421–1429. [Google Scholar] [CrossRef]
- Liu, Y.; Li, W.-D.; Xin, K.-Y.; Chen, Z.-M.; Chen, Z.-Y.; Chen, R.; Chen, X.-D.; Zhao, F.-L.; Zheng, W.-S.; Dong, J.-W. Ultra-wide FOV meta-camera with transformer-neural-network color imaging methodology. Adv. Photonics 2024, 6, 056001. [Google Scholar] [CrossRef]
- Hua, X.; Wang, Y.; Wang, S.; Zou, X.; Zhou, Y.; Li, L.; Yan, F.; Cao, X.; Xiao, S.; Tsai, D.P.; et al. Ultra-compact snapshot spectral light-field imaging. Nat. Commun. 2022, 13, 2732. [Google Scholar] [CrossRef] [PubMed]
- Roques-Carmes, C.; Wang, K.; Yang, Y.; Majumdar, A.; Lin, Z. Computational Metaoptics for Imaging. arXiv 2024. [Google Scholar] [CrossRef]
- Chen, W.T.; Park, J.-S.; Marchioni, J.; Millay, S.; Yousef, K.M.A.; Capasso, F. Dispersion-engineered metasurfaces reaching broadband 90% relative diffraction efficiency. Nat. Commun. 2023, 14, 2544. [Google Scholar] [CrossRef]
- Sun, J.; Wei, K.; Eboli, T.; Wang, C.; Zheng, C.; Zhou, Z.; Majumdar, A.; Heidrich, W.; Heide, F. Collaborative On-Sensor Array Cameras. ACM Trans. Graph. 2025, 44, 55. [Google Scholar] [CrossRef]
- Yang, J.; Cui, K.; Huang, Y.; Zhang, W.; Feng, X.; Liu, F. Angle-Insensitive Spectral Imaging Based on Topology-Optimized Plasmonic Metasurfaces. Laser Photonics Rev. 2024, 18, 2400255. [Google Scholar] [CrossRef]
- Bao, Y.; Li, B. Single-shot simultaneous intensity, phase and polarization imaging with metasurface. Natl. Sci. Rev. 2025, 12, nwae418. [Google Scholar] [CrossRef]
- Zeng, Y.; Zhong, H.; Long, Z.; Cao, H.; Jin, X. From performance to structure: A comprehensive survey of advanced metasurface design for next-generation imaging. npj Nanophotonics 2025, 2, 39. [Google Scholar] [CrossRef]
- Li, Z.; Pestourie, R.; Lin, Z.; Johnson, S.G.; Capasso, F. Empowering Metasurfaces with Inverse Design: Principles and Applications. ACS Photonics 2022, 9, 2178–2192. [Google Scholar] [CrossRef]
- Quan, D.; Liu, X.; Tang, Y.; Liu, H.; Min, S.; Li, G.; Srivastava, A.K.; Cheng, X. Dielectric Metalens by Multilayer Nanoimprint Lithography and Solution Phase Epitaxy. Adv. Eng. Mater. 2023, 25, 2201824. [Google Scholar] [CrossRef]
- Moon, S.-W.; Kim, Y.; Yoon, G.; Rho, J. Recent Progress on Ultrathin Metalenses for Flat Optics. iScience 2020, 23, 101877. [Google Scholar] [CrossRef]
- Choi, M.; Kim, J.; Moon, S.; Shin, K.; Nam, S.-W.; Park, Y.; Kang, D.; Jeon, G.; Lee, K.-I.; Yoon, D.H.; et al. Roll-to-plate printable RGB achromatic metalens for wide-field-of-view holographic near-eye displays. Nat. Mater. 2025, 24, 535–543. [Google Scholar] [CrossRef] [PubMed]
- Pestourie, R.; Pérez-Arancibia, C.; Lin, Z.; Shin, W.; Capasso, F.; Johnson, S.G. Inverse design of large-area metasurfaces. Opt. Express 2018, 26, 33732–33747. [Google Scholar] [CrossRef]
- Li, Z.; Pestourie, R.; Park, J.-S.; Huang, Y.-W.; Johnson, S.G.; Capasso, F. Inverse design enables large-scale high-performance meta-optics reshaping virtual reality. Nat. Commun. 2022, 13, 2409. [Google Scholar] [CrossRef]
- Gao, R.-Q.; Song, Q.; Liu, H.; Gao, J.-B.; Wang, X.-Y.; Bayanheshig; Li, C.; Ding, G.; Gong, Y.; Chen, X.-H.; et al. Design of near-Infrared reconfigurable metalens on Silicon-On-Insulator (SOI) platform with Fabry–Perrot phase shifter. Opt. Commun. 2019, 446, 56–63. [Google Scholar] [CrossRef]
- Ng, R.; Levoy, M.; Brédif, M.; Duval, G.; Horowitz, M.; Hanrahan, P. Light Field Photography with a Hand-Held Plenoptic Camera. Ph.D. Thesis, Stanford University, Stanford, CA, USA, 2005. [Google Scholar]
- Levoy, M. Light Fields and Computational Imaging. Computer 2006, 39, 46–55. [Google Scholar] [CrossRef]
- Jin, D.; Zhang, S.; Huo, X.; Zhang, W.; Yang, F. A Two-Step Calibration Method for Unfocused Light Field Camera Based on Projection Model Analysis. arXiv 2021. [Google Scholar] [CrossRef]
- Wanner, S.; Goldluecke, B. Variational Light Field Analysis for Disparity Estimation and Super-Resolution. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 36, 606–619. [Google Scholar] [CrossRef] [PubMed]
- Zhang, S.; Sheng, H.; Li, C.; Zhang, J.; Xiong, Z. Robust depth estimation for light field via spinning parallelogram operator. Comput. Vis. Image Underst. 2016, 145, 148–159. [Google Scholar] [CrossRef]
- Sabater, N.; Seifi, M.; Drazic, V.; Sandri, G.; Pérez, P. Accurate Disparity Estimation for Plenoptic Images. In Proceedings of the European Conference on Computer Vision, Zurich, Switzerland, 6 September 2014; Springer International Publishing: Cham, Switzerland; pp. 548–560. [Google Scholar]
- Wang, T.-C.; Efros, A.A.; Ramamoorthi, R. Occlusion-Aware Depth Estimation Using Light-Field Cameras. In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 7–13 December 2015; pp. 3487–3495. [Google Scholar]
- Shin, C.; Jeon, H.-G.; Yoon, Y.; Kweon, I.S.; Kim, S.J. EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 19–21 June 2018; pp. 4748–4757. [Google Scholar]
- Du, Y.; Zhang, Q.; Hua, D.; Hou, J.; Wang, B.; Zhu, S.; Zhang, Y.; Fang, Y. EANet: Depth Estimation Based on EPI of Light Field. BioMed Res. Int. 2021, 2021, 8293151. [Google Scholar] [CrossRef]
- Chen, J.; Zhang, S.; Lin, Y. Attention-based Multi-Level Fusion Network for Light Field Depth Estimation. Proc. AAAI Conf. Artif. Intell. 2021, 35, 1009–1017. [Google Scholar] [CrossRef]
- Lin, L.; Li, Q.; Gao, B.; Yan, Y.; Zhou, W.; Kuruoglu, E.E. Unsupervised learning of light field depth estimation with spatial and angular consistencies. Neurocomputing 2022, 501, 113–122. [Google Scholar] [CrossRef]
- Zhang, Q.; Yu, Z.; Liu, X.; Wang, C.; Zheng, Z. End-to-end joint optimization of metasurface and image processing for compact snapshot hyperspectral imaging. Opt. Commun. 2023, 530, 129154. [Google Scholar] [CrossRef]
- Yu, Z.; Zhang, Q.; Tao, X.; Li, Y.; Tao, C.; Wu, F.; Wang, C.; Zheng, Z. High-performance full-color imaging system based on end-to-end joint optimization of computer-generated holography and metalens. Opt. Express 2022, 30, 40871–40883. [Google Scholar] [CrossRef]
- Hu, S.; Shi, R.; Wang, B.; Wei, Y.; Qi, B.; Zhou, P. Full-Color Imaging System Based on the Joint Integration of a Metalens and Neural Network. Nanomaterials 2024, 14, 715. [Google Scholar] [CrossRef]
- Cai, Y.; Lin, J.; Lin, Z.; Wang, H.; Zhang, Y.; Pfister, H.; Timofte, R.; Van Gool, L. MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), New Orleans, LA, USA, 18–24 June 2022; pp. 744–754. [Google Scholar]
- Hu, X.; Cai, Y.; Lin, J.; Wang, H.; Yuan, X.; Zhang, Y.; Timofte, R.; Van Gool, L. HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 17521–17530. [Google Scholar]
- Chung, H.; Kim, J.; Mccann, M.T.; Klasky, M.L.; Ye, J.C. Diffusion Posterior Sampling for General Noisy Inverse Problems. arXiv 2024. [Google Scholar] [CrossRef]
- Attal, B.; Huang, J.-B.; Richardt, C.; Zollhöfer, M.; Kopf, J.; O’TOole, M.; Kim, C. HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 17–24 June 2023; pp. 16610–16620. [Google Scholar]
- Zhang, F.; Bao, H.; Pu, M.; Guo, Y.; Kang, T.; Li, X.; He, Q.; Xu, M.; Ma, X.; Luo, X. Dispersion-engineered spin photonics based on folded-path metasurfaces. Light Sci. Appl. 2025, 14, 198. [Google Scholar] [CrossRef]
- Tsilipakos, O.; Koschny, T. Multiresonant metasurfaces for arbitrarily broad bandwidth pulse chirping and dispersion compensation. Phys. Rev. B 2023, 107, 165408. [Google Scholar] [CrossRef]
- Chen, Y.; Gui, X.; Zeng, J.; Zhao, X.-L.; He, W. Combining Low-Rank and Deep Plug-and-Play Priors for Snapshot Compressive Imaging. IEEE Trans. Neural Netw. Learn. Syst. 2023, 35, 16396–16408. [Google Scholar] [CrossRef] [PubMed]
- Hu, J.; Yang, W. Metalens array miniaturized microscope for large-field-of-view imaging. Opt. Commun. 2023, 555, 130231. [Google Scholar] [CrossRef]
- Nussbaum, P.; Völkel, R.; Herzig, H.P.; Eisner, M.; Haselbeck, S. Design, fabrication and testing of microlens arrays for sensors and microsystems. Pure Appl. Opt. J. Eur. Opt. Soc. Part A 1997, 6, 617–636. [Google Scholar] [CrossRef]
- Dansereau, D.G.; Pizarro, O.; Williams, S.B. Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras. In Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA, 23–28 June 2013; pp. 1027–1034. [Google Scholar]
- Bian, L.; Wang, Z.; Zhang, Y.; Li, L.; Zhang, Y.; Yang, C.; Fang, W.; Zhao, J.; Zhu, C.; Meng, Q.; et al. A broadband hyperspectral image sensor with high spatio-temporal resolution. Nature 2024, 635, 73–81. [Google Scholar] [CrossRef]
- Horie, Y.; Arbabi, A.; Arbabi, E.; Kamali, S.M.; Faraon, A. Wide bandwidth and high resolution planar filter array based on DBR-metasurface-DBR structures. Opt. Express 2016, 24, 11677–11682. [Google Scholar] [CrossRef]
- Wagadarikar, A.; John, R.; Willett, R.; Brady, D. Single disperser design for coded aperture snapshot spectral imaging. Appl. Opt. 2008, 47, B44–B51. [Google Scholar] [CrossRef] [PubMed]
- Gehm, M.E.; John, R.; Brady, D.J.; Willett, R.M.; Schulz, T.J. Single-shot compressive spectral imaging with a dual-disperser architecture. Opt. Express 2007, 15, 14013–14027. [Google Scholar] [CrossRef] [PubMed]
- Faraji-Dana, M.; Arbabi, E.; Arbabi, A.; Kamali, S.M.; Kwon, H.; Faraon, A. Compact folded metasurface spectrometer. Nat. Commun. 2018, 9, 4196. [Google Scholar] [CrossRef]
- Han, X.-H.; Wang, J.; Jiang, H. Recent Advancements in Hyperspectral Image Reconstruction from a Compressive Measurement. Sensors 2025, 25, 3286. [Google Scholar] [CrossRef]
- Bewley, J.D.; Bradford, K.; Hilhorst, H. Seeds: Physiology of Development, Germination and Dormancy; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2012. [Google Scholar]
- Yang, Z.; Albrow-Owen, T.; Cai, W.; Hasan, T. Miniaturization of Optical Spectrometers. Science 2021, 371, 0722. [Google Scholar] [CrossRef] [PubMed]
- Li, Q.; Liang, M.; Liu, S.; Liu, J.; Chen, S.; Wen, S.; Luo, H. Phase reconstruction via metasurface-integrated quantum analog operation. Opto-Electronic Adv. 2025, 8, 240239-1–240239-9. [Google Scholar] [CrossRef]























| Technology Direction | Main Advantages | Technical Challenges | Future Trends |
|---|---|---|---|
| Metasurfaces for Hyperspectral Imaging | • Single-shot acquisition: Complete spectral data without mechanical scanning | • Broadband efficiency: Maintaining high transmission across visible–NIR spectrum | • New dielectric materials for enhanced efficiency |
| • System miniaturization: Replaces complex spectroscopic systems | • Spectral cross-talk: Interwavelength interference elimination | • Physics-informed neural networks | |
| • Controllable dispersion: Precise wavelength manipulation via nanostructures | • Manufacturing precision: Nanoscale fabrication tolerances affecting spectral response | • Nanoimprinting for mass production | |
| • High design freedom: Inverse design for optimal spectral encoding | • Calibration complexity: Accurate PSF wavelength dependence characterization | • Integrated optoelectronic computing | |
| • Computational imaging fusion: Co-optimization with deep learning algorithms | • Computational demand: High-dimensional data reconstruction requirements | • Transition from lab to industrial applications | |
| Metasurface Arrays for 3D Reconstruction | • Multi-view synchronization: Simultaneous capture from different perspectives | • Viewpoint consistency: Performance uniformity across array elements | • Large-scale uniform array fabrication |
| • Depth information extraction: Accurate 3D reconstruction via parallax calculation | • Spatial resolution limitation: Resolution limited by microlens array size | • Advanced depth estimation algorithms | |
| • Motion capture: Dynamic scene capture correlated in single shot | • Depth accuracy: Reconstruction precision constrained by baseline and resolution | • Wide-field metasurface design | |
| • Occlusion recovery: Occlusion potentially reconstructed from angular data | • Data reconstruction: Complex algorithm for image alignment and reconstruction | • Real-time processing architectures | |
| Metasurface Arrays for 3D–Hyperspectral Fusion | capture | • 5D coupling decoupling: Extreme complexity in spatial–spectral–angular separation | • Multiphysics-informed machine learning |
| • Hardware-algorithm co-design: End-to-end joint optimization | • System modeling difficulty: Accurate multiphysics coupling models | • Advanced tensor decomposition methods | |
| • Complementary information enhancement: Mutual constraints improve reconstruction | • Data explosion: Massive 5D data storage, transmission, and processing | • Heterogeneous integration technologies | |
| • Single-exposure completeness: Full high-dimensional data cube without scanning | • Manufacturing limits: Large-scale high-uniformity metasurface array fabrication | • Edge computing for real-time applications | |
| • Compact multifunctionality: Multiple traditional systems in single device | • Computational requirements: Real-time processing needs powerful hardware | • Next-generation computational photography |
| Category | Metric (Reviewer Requested) | Refractive MLA [86,87] | Meta-Array [88,89] | CASSI [90,91] | Metasurface [22,92] |
|---|---|---|---|---|---|
| 1. Dispersion Mechanisms | Axial Dispersion Sensitivity (∂f/∂λ) | ~0.005 μm/nm | Negligible (Achromatic/Corrected) | N/A | Non-Uniformly Coupled |
| ~0.005 pixels/nm | N/A (Spatial Multiplexing) | ~0.5–2 pixels/nm | Low/Parasitic (Radial Blur if Uncorrected) | ||
| 2. Optics and Efficiency | Chromatic Aberration Control Range | Broadband (430–780 nm) | Discrete Bands | Broadband (430–780 nm Material Limited) | Broadband (400–1700 nm) |
| Monochromatic Efficiency | Very High (>95%) | High (~60–80%) | High (~80–90%) | High (~70–90%) | |
| Broadband Imaging Efficiency | High (>90%) | Medium (~40–60%) | Medium (~50%, Mask Blocking) | High (~70%) | |
| Throughput (NA) | 0.2–0.5 | Medium (NA~0.3) | Low–Medium (NA Limited by F-Number) | High (NA up to 0.8–0.9) | |
| 3. Physical Specs | Thickness/Volume | Bulky (TTL > 50 mm) | Ultra-Compact (TTL < 500 μm) | Bulky System (TTL > 100 mm) | Ultra-Compact (TTL < 1 mm) |
| System Integration (Component Count) | Low (Lens Group + MLA + Sensor) | High (CMOS Integration) | Low (Obj + Mask + Relay + Prism + Sensor) | High (Monolithic Integration) | |
| 4. Imaging Specs | Spectral Resolution | Low (~20–50 nm) | Medium (~10–20 nm) | Medium–High (<10 nm) | High (~1–5 nm) |
| Spatial Resolution | Low (Trade-off: Spatial/Spectral) | Medium (Sub-Sampled) | Medium (Mask Resolution Limited) | High (Full Sensor Pixel Count) | |
| Depth Res/DOF | High/Refocusable (Light-Field Capability) | Low (Fixed Focus) | Low/Fixed (Planar Imaging) | High/Tunable (Point-Spread Function Engineering) | |
| Signal-to-Noise Ratio (SNR) | High (>40 dB) | Medium (~30 dB) | Medium (20–30 dB, Shot Noise) | Medium (25–35 dB) | |
| 5. Algorithm and Data | Calibration Burden | Geometric (Microlens Center Alignment) | Light (Filter Response Matrix) | Heavy (Full 3D PSF Scanning) | Light (1D z-λ Curve Fitting) |
| Reconstruction Runtime | Fast (Linear Processing, <5 s) | Real-time (Demosaicing, ms) | Slow (Iterative/DL, mins to hours) | Real-Time (~100 ms) | |
| Dataset/Training Req. | None | Low (For Demosaicing) | High (Model-Based/ DL-Based Reconstruction) | High (96 Channels, Training Augmentation/Transfer Learning) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yang, J.; Zhao, Q.; Liu, S.; Guo, J.; Guan, F.; Wang, S.; Hu, Q.; Liu, Q.; Song, Q.; Zhu, M.; et al. Towards Next-Generation Smart Seed Phenomics: A Review and Roadmap for Metasurface-Based Hyperspectral Imaging and a Light-Field Platform for 3D Reconstruction. Photonics 2026, 13, 61. https://doi.org/10.3390/photonics13010061
Yang J, Zhao Q, Liu S, Guo J, Guan F, Wang S, Hu Q, Liu Q, Song Q, Zhu M, et al. Towards Next-Generation Smart Seed Phenomics: A Review and Roadmap for Metasurface-Based Hyperspectral Imaging and a Light-Field Platform for 3D Reconstruction. Photonics. 2026; 13(1):61. https://doi.org/10.3390/photonics13010061
Chicago/Turabian StyleYang, Jingrui, Qinglei Zhao, Shuai Liu, Jing Guo, Fengwei Guan, Shuxin Wang, Qinglong Hu, Qiang Liu, Qi Song, Mingdong Zhu, and et al. 2026. "Towards Next-Generation Smart Seed Phenomics: A Review and Roadmap for Metasurface-Based Hyperspectral Imaging and a Light-Field Platform for 3D Reconstruction" Photonics 13, no. 1: 61. https://doi.org/10.3390/photonics13010061
APA StyleYang, J., Zhao, Q., Liu, S., Guo, J., Guan, F., Wang, S., Hu, Q., Liu, Q., Song, Q., Zhu, M., & Li, C. (2026). Towards Next-Generation Smart Seed Phenomics: A Review and Roadmap for Metasurface-Based Hyperspectral Imaging and a Light-Field Platform for 3D Reconstruction. Photonics, 13(1), 61. https://doi.org/10.3390/photonics13010061

