Development of a 2D Image-Based Rice Panicle-Level Yield Prediction Framework Using Image-Based Reconstruction Technique
Abstract
1. Introduction
2. Materials and Methods
2.1. 2D & 3D Modeling Method of Crops
2.2. 2D Image-Based Rice Yield Prediction Framework
2.2.1. Data Module
2.2.2. Rice Panicle and 2D Surface Area Estimation Module
2.2.3. Unit Correction and Verification Module
2.2.4. Rice Panicle Weight Prediction Module
3. Results
3.1. Grain Detection Performance
3.2. Performance of Pixel-to-Physical Scale Calibration
3.3. Shape Metrics Based Grain Panicle-Level Grain Weight Reconstruction
4. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Food and Agriculture Organization of the United Nations (FAO). FAO Rice Information; FAO: Rome, Italy, 2002; Volume 3, Available online: https://www.fao.org/4/y4347e/y4347e01.htm (accessed on 22 January 2026).
- Shi, Y.; Guo, Y.; Wang, Y.; Li, M.; Li, K.; Liu, X.; Fang, C.; Luo, J. Metabolomic analysis reveals nutritional diversity among three staple crops and three fruits. Foods 2022, 11, 550. [Google Scholar] [CrossRef]
- Korea Rural Economic Institute (KREI). World Grain Market Outlook and Current Status. Available online: https://repository.krei.re.kr (accessed on 22 January 2026).
- Food and Agriculture Organization of the United Nations (FAO). Cereal Supply and Demand Brief: World Food Situation; FAO: Rome, Italy, 2025; Available online: https://www.fao.org/worldfoodsituation/csdb/en (accessed on 23 January 2026).
- Jabed, M.A.; Murad, M.A.A. Crop yield prediction in agriculture: A comprehensive review of machine learning and deep learning approaches, with insights for future research and sustainability. Heliyon 2024, 10, e40836. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Zhong, D.; Chen, X.; Niu, Z.; Cao, Q. Impact of climate change on rice growth and yield in China: Analysis based on climate year type. Geogr. Sustain. 2024, 5, 548–560. [Google Scholar] [CrossRef]
- Yu, J.; Du, T.; Zhang, P.; Ma, Z.; Chen, X.; Cao, J.; Li, H.; Li, T.; Zhu, Y.; Xu, F. Impacts of high temperatures on the growth and development of rice and measures for heat tolerance regulation: A review. Agronomy 2024, 14, 2811. [Google Scholar] [CrossRef]
- Hu, T.; Zhang, X.; Khanal, S.; Wilson, R.; Leng, G.; Toman, E.M.; Wang, X.; Li, Y.; Zhao, K. Climate change impacts on crop yields: A review of empirical findings, statistical crop models, and machine learning methods. Environ. Model. Softw. 2024, 179, 106119. [Google Scholar] [CrossRef]
- Bai, S.; Hong, J.; Li, L.; Su, S.; Li, Z.; Wang, W.; Zhang, F.; Liang, W.; Zhang, D. Dissection of the genetic basis of rice panicle architecture using a genome-wide association study. Rice 2021, 14, 77. [Google Scholar] [CrossRef]
- Whan, A.P.; Smith, A.B.; Cavanagh, C.R.; Ral, J.-P.F.; Shaw, L.M.; Howitt, C.A.; Bischof, L. GrainScan: A low cost, fast method for grain size and colour measurements. Plant Methods 2014, 10, 23. [Google Scholar] [CrossRef] [PubMed]
- Yin, C.; Zhu, Y.; Li, X.; Lin, Y. Molecular and genetic aspects of grain number determination in rice (Oryza sativa L.). Int. J. Mol. Sci. 2021, 22, 728. [Google Scholar] [CrossRef]
- Sim, J.; Cho, J.; Lee, K.; Lee, Y. AI-Based Paddy Rice Yield Prediction Using Satellite Images, Meteorological Data, and Digital Elevation Model: Case Study of South Korea, 2000–2023. Korean J. Remote Sens. 2024, 40, 1195–1208. [Google Scholar] [CrossRef]
- Zhao, S.; Gu, J.; Zhao, Y.; Hassan, M.; Li, Y.; Ding, W. A method for estimating spikelet number per panicle: Integrating image analysis and a 5-point calibration model. Sci. Descr. 2015, 5, 16241. [Google Scholar] [CrossRef]
- Akhtar, M.S.; Zafar, Z.; Nawaz, R.; Fraz, M.M. Unlocking plant secrets: A systematic review of 3D imaging in plant phenotyping techniques. Comput. Electron. Agric. 2024, 222, 109033. [Google Scholar] [CrossRef]
- Gong, L.; Lin, K.; Wang, T.; Liu, C.; Yuan, Z.; Zhang, D.; Hong, J. Image-based on-panicle rice [Oryza sativa L.] grain counting with a prior edge wavelet correction model. Agronomy 2018, 8, 91. [Google Scholar] [CrossRef]
- Tang, R. Mathematical Methods for Camera Self-Calibration in Photogrammetry and Computer Vision. Ph.D. Thesis, University of Stuttgart, Stuttgart, Germany, 2013. [Google Scholar]
- Forero, M.G.; Murcia, H.F.; Méndez, D.; Betancourt-Lozano, J. LiDAR platform for acquisition of 3D plant phenotyping database. Plants 2022, 11, 2199. [Google Scholar] [CrossRef]
- Yang, X.; Lu, X.; Xie, P.; Guo, Z.; Fang, H.; Fu, H.; Hu, X.; Sun, Z.; Cen, H. PanicleNeRF: Low-cost, high-precision in-field phenotyping of rice panicles with smartphone. Plant Phenomics 2024, 6, 0279. [Google Scholar] [CrossRef]
- An, N.; Welch, S.M.; Markelz, R.C.; Baker, R.L.; Palmer, C.M.; Ta, J.; Maloof, J.N.; Weinig, C. Quantifying time-series of leaf morphology using 2D and 3D photogrammetry methods for high-throughput plant phenotyping. Comput. Electron. Agric. 2017, 135, 222–232. [Google Scholar] [CrossRef]
- Fahlgren, N.; Gehan, M.A.; Baxter, I. Lights, camera, action: High-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 2015, 24, 93–99. [Google Scholar] [CrossRef]
- Grundland, M.; Dodgson, N.A. Decolorize: Fast, contrast enhancing, color to grayscale conversion. Pattern Recognit. 2007, 40, 2891–2896. [Google Scholar] [CrossRef]
- Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
- Rosenfeld, A.; Pfaltz, J.L. Sequential operations in digital picture processing. J. ACM (JACM) 1966, 13, 471–494. [Google Scholar] [CrossRef]
- Li, L.; Zhang, Q.; Huang, D. A review of imaging techniques for plant phenotyping. Sensors 2014, 14, 20078–20111. [Google Scholar] [CrossRef]
- Walsh, J.J.; Mangina, E.; Negrão, S. Advancements in imaging sensors and AI for plant stress detection: A systematic literature review. Plant Phenomics 2024, 6, 0153. [Google Scholar] [CrossRef]
- Tanabata, T.; Shibaya, T.; Hori, K.; Ebana, K.; Yano, M. SmartGrain: High-throughput phenotyping software for measuring seed shape through image analysis. Plant Physiol. 2012, 160, 1871–1880. [Google Scholar] [CrossRef] [PubMed]
- Zu, Q.; Liu, T.; Zhu, W.; Pan, Y.; Wang, J.; Song, X.; Yu, J.; Dang, S.; Yu, X.; Zhang, Z. Automated seed counting using image processing and deep learning. Front. Plant Sci. 2025, 16, 1659781. [Google Scholar] [CrossRef] [PubMed]
- Singh, A.; Ganapathysubramanian, B.; Singh, A.K.; Sarkar, S. Machine learning for high-throughput stress phenotyping in plants. Trends Plant Sci. 2016, 21, 110–124. [Google Scholar] [CrossRef]
- Itakura, K.; Hosoi, F. Automatic leaf segmentation for estimating leaf area and leaf inclination angle in 3D plant images. Sensors 2018, 18, 3576. [Google Scholar] [CrossRef] [PubMed]
- Rose, J.C.; Paulus, S.; Kuhlmann, H. Accuracy analysis of a multi-view stereo approach for phenotyping of tomato plants at the organ level. Sensors 2015, 15, 9651–9665. [Google Scholar] [CrossRef]
- Mach, J.; Svatý, Z.; Šoupa, O.; Nouzovský, L.; Halecký, M. Implementation of an SfM-MVS-based photogrammetry approach for detailed 3D reconstruction of plants. Plant Methods 2025, 21, 127. [Google Scholar] [CrossRef]
- Lin, Y. LiDAR: An important tool for next-generation phenotyping technology of high potential for plant phenomics? Comput. Electron. Agric. 2015, 119, 61–73. [Google Scholar] [CrossRef]
- Gao, K.; Gao, Y.; He, H.; Lu, D.; Xu, L.; Li, J. Nerf: Neural radiance field in 3d vision, a comprehensive review. arXiv 2022, arXiv:2210.00379. [Google Scholar]
- Araus, J.L.; Cairns, J.E. Field high-throughput phenotyping: The new crop breeding frontier. Trends Plant Sci. 2014, 19, 52–61. [Google Scholar] [CrossRef]
- Munjal, R.; Benıwal, J.; Dhundwal, A.; Goyal, A.; Kumarı, A.; Behl, R.K. Accelerating crop breeding in the 21st century: A comprehensive review of next generation phenotyping techniques and strategies. Ekin J. Crop Breed. Genet. 2023, 9, 160–171. [Google Scholar]
- Jegham, N.; Koh, C.Y.; Abdelatti, M.; Hendawi, A. Yolo evolution: A comprehensive benchmark and architectural review of yolov12, yolo11, and their previous versions. arXiv 2024, arXiv:2411.00201. [Google Scholar]
- Zhao, S.; Zheng, H.; Chi, M.; Chai, X.; Liu, Y. Rapid yield prediction in paddy fields based on 2D image modelling of rice panicles. Comput. Electron. Agric. 2019, 162, 759–766. [Google Scholar] [CrossRef]
- Tian, Y.; Ye, Q.; Doermann, D. Yolov12: Attention-centric real-time object detectors. arXiv 2025, arXiv:2502.12524. [Google Scholar]
- Yang, D.; Yang, H.; Liu, D.; Wang, X. Research on automatic 3D reconstruction of plant phenotype based on Multi-View images. Comput. Electron. Agric. 2024, 220, 108866. [Google Scholar] [CrossRef]
- Ultralytics. YOLO12: Attention-Centric Object Detection. Available online: https://docs.ultralytics.com/ko/models/yolo12/ (accessed on 20 February 2026).
- Su, Y.; Xiao, L.-T. 3D visualization and volume-based quantification of rice chalkiness in vivo by using high resolution micro-CT. Rice 2020, 13, 69. [Google Scholar] [CrossRef] [PubMed]
- Ren, S.; He, K.; Girshick, R.; Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems 28; MIT Press: Cambridge, MA, USA, 2015. [Google Scholar]
- Zhang, H.; Chang, H.; Ma, B.; Shan, S.; Chen, X. Cascade RetinaNet: Maintaining consistency for single-stage object detection. arXiv 2019, arXiv:1907.06881. [Google Scholar]
- Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.-Y.; Berg, A.C. Ssd: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands, 11–14 October 2016; pp. 21–37. [Google Scholar]
- Li, G.; Zhang, J.; Yang, C.; Song, Y.; Zheng, C.; Wang, S.; Liu, Z.; Ding, Y. Optimal yield-related attributes of irrigated rice for high yield potential based on path analysis and stability analysis. Crop J. 2014, 2, 235–243. [Google Scholar] [CrossRef]
- Yuqi, P.; Penghui, J.; Manchun, L.; Dengshuai, C. Temporal Variation Analysis of Rice Yield in the Jiangsu Province, China: Application of Decision Support System for Agrotechnology Transfer Model. Glob. J. Agric. Innov. Res. Dev. 2022, 9, 81–99. [Google Scholar] [CrossRef]
- van Dijk, A.D.J.; Kootstra, G.; Kruijer, W.; de Ridder, D. Machine learning in plant science and plant breeding. iScience 2021, 24, 101890. [Google Scholar] [CrossRef]




| Analysis Category | 2D Image-Based Modeling | 3D Reconstruction-Based Modeling |
|---|---|---|
| Core Algorithms | Otsu, CCA, YOLO, CNN | SfM, MVS, Point Cloud, NeRF |
| Data Processing | Planar image analysis | Multi-view 3D reconstruction |
| Extracted Features | Area, Length, Grain count | Volume, Area, Spatial distribution |
| Computational Cost | Low | High |
| Limitations | Occlusion, stem loss | High cost, Complex pipeline |
| Model | Precision | Recall | mAP@50 | F1-Score | Training Time (min) |
|---|---|---|---|---|---|
| YOLOv5 | 0.615 | 0.636 | 0.649 | 0.625 | 250 min |
| YOLOv8 | 0.904 | 0.866 | 0.926 | 0.901 | 314 min |
| YOLOv10 | 0.886 | 0.854 | 0.933 | 0.87 | 432 min |
| YOLOv12 | 0.886 | 0.921 | 0.927 | 0.903 | 476 min |
| Model | Precision | Recall | mAP@50 | F1-Score | Training Time (min) |
|---|---|---|---|---|---|
| Faster-R-CNN | 0.749 | 0.560 | 0.454 | 0.641 | 1151 min |
| RetinaNet | 0.952 | 0.700 | 0.696 | 0.807 | 1013 min |
| SSD | 0.163 | 0.120 | 0.029 | 0.138 | 281 min |
| YOLOv12 | 0.886 | 0.921 | 0.927 | 0.903 | 476 min |
| Model | MAE (Counts) | RMSE (Counts) | MAPE (%) | |
|---|---|---|---|---|
| YOLOv12 | 0.95 | 4.68 | 6.24 | 3.56 |
| Cultivar | MAE (cm2) | RMSE (cm2) | MAPE (%) | |
|---|---|---|---|---|
| Huaidao | 0.99 | 0.24 | 0.20 | 1.00 |
| Sidao | 0.99 | 0.37 | 0.27 | 1.41 |
| Suxiu | 0.98 | 0.52 | 0.33 | 5.10 |
| Jingjing | 0.99 | 0.54 | 0.43 | 2.20 |
| Cultivar | p-Value of Independent Variables | ||
|---|---|---|---|
| Length | Area | Count | |
| Huaidao | 0.041 | ||
| Sidao | 0.30 | ||
| Suxiu | 0.10 | ||
| Jingjing | 0.23 | 0.15 | |
| Cultivar | RMSE (g) | MAE (g) | MAPE (%) | |
|---|---|---|---|---|
| Huaidao | 0.89 | 0.26 | 0.20 | 6.45 |
| Sidao | 0.97 | 0.16 | 0.12 | 3.79 |
| Suxiu | 0.96 | 0.16 | 0.11 | 1.15 |
| Jingjing | 0.92 | 0.24 | 0.19 | 7.34 |
| Cultivar | p-Value of Independent Variables | |
|---|---|---|
| Length | Count | |
| Huaidao | ||
| Cultivar | RMSE (g) | MAE (g) | MAPE (%) | |
|---|---|---|---|---|
| Huaidao | 0.84 | 0.32 | 0.24 | 7.80 |
| Cultivar | p-Value of Independent Variables | |
|---|---|---|
| Area | Count | |
| Sidao | ||
| Suxiu | ||
| Jingjing | 0.098 | |
| Cultivar | RMSE (g) | MAE (g) | MAPE (%) | |
|---|---|---|---|---|
| Sidao | 0.96 | 0.17 | 0.13 | 3.82 |
| Suxiu | 0.96 | 0.16 | 0.11 | 4.70 |
| Jingjing | 0.92 | 0.24 | 0.19 | 7.20 |
| Cultivar | p-Value of Independent Variables |
|---|---|
| Area | |
| Jingjing |
| Cultivar | RMSE (g) | MAE (g) | MAPE (%) | |
|---|---|---|---|---|
| Jingjing | 0.92 | 0.24 | 0.19 | 7.39 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Kim, D.; Lim, H.; Kim, S. Development of a 2D Image-Based Rice Panicle-Level Yield Prediction Framework Using Image-Based Reconstruction Technique. Agronomy 2026, 16, 896. https://doi.org/10.3390/agronomy16090896
Kim D, Lim H, Kim S. Development of a 2D Image-Based Rice Panicle-Level Yield Prediction Framework Using Image-Based Reconstruction Technique. Agronomy. 2026; 16(9):896. https://doi.org/10.3390/agronomy16090896
Chicago/Turabian StyleKim, Daehong, Hyeongjun Lim, and Sojung Kim. 2026. "Development of a 2D Image-Based Rice Panicle-Level Yield Prediction Framework Using Image-Based Reconstruction Technique" Agronomy 16, no. 9: 896. https://doi.org/10.3390/agronomy16090896
APA StyleKim, D., Lim, H., & Kim, S. (2026). Development of a 2D Image-Based Rice Panicle-Level Yield Prediction Framework Using Image-Based Reconstruction Technique. Agronomy, 16(9), 896. https://doi.org/10.3390/agronomy16090896

