Frame-Based vs. Event-Based Optical Turbulence Strength Estimation: A Comparative and Hybrid Approach
Abstract
1. Introduction
1.1. Background
1.2. Motivation
- Effect of frame rate: Frame-based estimation methods are well studied, but the impact of camera frame rate on estimation accuracy has not been systematically quantified. Most prior imaging studies have employed video at standard rates (~25–30 Hz); modern high-speed cameras can reach hundreds of hertz, raising the question of how much improvement in capturing turbulence dynamics higher frame rates can provide. It is unclear how much benefit is gained beyond 30 FPS, especially under different turbulence conditions, since this has not yet been rigorously evaluated in the literature. For instance, at 180 FPS each frame is separated by only ~5.6 ms, allowing the capture of faster intensity fluctuations than the ~33 ms frame interval at 30 FPS.
- Event performance in weak turbulence: Event cameras naturally produce fewer events when scene changes are small. In conditions of weak turbulence (i.e., very small wavefront distortions), the paucity of events may degrade the reliability of event-based turbulence metrics. If the medium-induced image changes are subtle, an event sensor could output very sparse data, potentially leading to noisy or biased estimates. This limitation has not been thoroughly investigated, as prior event-based studies have largely focused on relatively strong turbulence scenarios or qualitative imagery improvements. In extreme cases of a very stable atmosphere, an event camera may register virtually no events for many seconds, yielding insufficient data to estimate turbulence.
- Lack of comparative studies: To date, no comprehensive study has compared frame-only versus event-only approaches for turbulence strength estimation under the same conditions, using a consistent ground truth. The literature contains only isolated demonstrations. For example, event-driven image reconstruction experiments [8] and recent neural network-based turbulence removal using events [11] but a side-by-side performance evaluation of the two sensing modalities (using identical data sets and reference measurements) is missing. Furthermore, a systematic examination of a hybrid strategy that combines frame and event data has not been published in a field setting.
- Need for hybrid inference: Intuitively, combining frame-based and event-based inputs could offer the best of both worlds: the frame camera provides a stable reference image and captures slower or low-amplitude distortions, while the event camera contributes sensitivity to fast, transient features of turbulence. Especially under moderate-to-strong turbulence, an intelligent fusion of these modalities might significantly improve the robustness and accuracy of estimates. Investigating a simple fusion approach is an important step, as it can provide insight into the potential gains of multi-sensor turbulence monitoring and inform the design of more sophisticated fusion strategies. For example, when turbulence is weak the frame-based method can provide a baseline estimate while the event sensor yields little information, whereas in stronger turbulence the event features can capture rapid fluctuations that complement the frame-based measurements. A fused model could thus maintain high accuracy across a broader range of conditions than either modality alone.
1.3. Objectives
- Frame Rate Analysis: Quantify the effect of frame rate on the accuracy of turbulence estimation by testing a high-speed CMOS camera at 180 FPS and down-sampling the recorded data to equivalent 90 FPS and 30 FPS streams.
- Modal Comparison: Compare the performance of event-based versus frame-based estimation across multiple atmospheric turbulence regimes (ranging from weak to strong turbulence).
- Hybrid Fusion Feasibility: Assess the feasibility and benefits of a simple hybrid inference model that combines event camera data with frame camera outputs to improve turbulence strength prediction accuracy.
2. Experimental Setup
2.1. Overview of Setup
2.2. Data Acquisition
2.3. Data Processing
3. Methods of Turbulence Estimation
3.1. Event-Based Prediction
3.2. CMOS-Based Prediction
3.3. Hybrid Inference
3.4. Model Training and Evaluation
3.4.1. Training Procedure
3.4.2. Evaluation Metrics
3.4.3. Metric Selection Justification
4. Results
4.1. Effect of Frame Rate on CMOS Model Performance (ΔT = 5 s)
4.2. Weak vs. Strong Turbulence Error Distributions (Frame-Rate Effect)
4.3. Comparison of Event-Only, Frame-Only, and Hybrid Models
4.4. Performance Across Turbulence Regimes
- Weak turbulence: In mild conditions, the frame-based CMOS models outperform the event-based and hybrid models. The 90 FPS CMOS model achieves the lowest mean error (~33% MARE), with the 180 FPS CMOS slightly higher (~34% MARE). Their performance is statistically indistinguishable (p > 0.05). The event-only model, however, suffers from very large errors in weak turbulence (mean MARE ~62%, median ~42%). The hybrid model at 90 FPS, which fuses these event signals with frames, fares better than event-alone but still has a higher error (~39% mean MARE) than the pure frame models. Notably, a hybrid model with only 30 FPS input performs worst of all (mean ~75% MARE), indicating that under slow, small turbulence distortions, the addition of event data cannot compensate for extremely low frame rates. In essence, when turbulence is weak, conventional frame-based estimation is sufficient and most accurate—the extra information from events is largely unnecessary and may introduce noise.
- Moderate turbulence: In intermediate conditions, all methods perform more comparably, though some advantages emerge. The CMOS model still benefits from high frame rate—at 180 FPS it achieves ~24.5% mean MARE, which is slightly better than the hybrid 90 FPS model (~26.7% MARE) and clearly better than the event-only model (~31.7% MARE). The 90 FPS frame-only model is also quite strong (~26.9% mean MARE), essentially matching the hybrid. These results suggest that in moderate turbulence, a high-frame-rate conventional camera can nearly match the hybrid’s accuracy on average. Nonetheless, the hybrid (and event) models show an edge in capturing variability: for example, the hybrid 90 FPS has a slightly lower median error (~21% vs. ~25% for CMOS), hinting that it more consistently estimates turbulence without severe outliers. Meanwhile, the hybrid 30 FPS version sees its error drop to ~30% mean MARE—a substantial improvement over its ~75% in weak turbulence—now approaching the event-only performance. This indicates that the event-based data become increasingly useful as turbulence intensifies, elevating even a low-FPS hybrid to respectable accuracy in moderate conditions.
- Strong turbulence: Under severe turbulence, the hybrid and event-based approaches decisively outperform the frame-only approach. The hybrid model with 90 FPS frames attains a mean MARE of only ~19.6%—by far the lowest in this regime—with median error ~17.8%, indicating very robust performance even at the upper end of turbulence strength. The event-only model is the next best, ~26.7% mean MARE, outperforming all purely frame-based results. Meanwhile, the best CMOS-only model (180 FPS) has a mean MARE ~30.0%, and the gap widens further at lower frame rates (34.3% at 90 FPS; 44.4% at 30 FPS). In other words, the hybrid model (90 FPS + events) reduces error by ~35% relative to the high-speed CMOS-only model in strong turbulence, a remarkable gain achieved despite using half the frame rate. Even the hybrid with 30 FPS frames yields ~22% mean MARE, beating the 180 FPS CMOS camera by a significant margin. These statistics confirm that when turbulence is strong, the fusion of event-based information with images is dramatically more effective than relying on frame data alone. The event camera’s ability to capture rapid, high-frequency wavefront tilts and intensity scintillations provides the hybrid model with an insight that a finite-frame-rate imager lacks [11]. Thus, for high turbulence, the hybrid approach is not only preferable—it is necessary to achieve low error and high correlation with true .
4.5. Error Distributions by Model Type and Turbulence Level
5. Discussion
5.1. Sensor-Specific Insights
5.2. Frame Rate Tradeoffs
5.3. Hybrid Inference Feasibility
5.4. Limitations
5.5. Implications for Deployment
6. Conclusions
7. Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A. Detailed Model Performance
| Turbulence Regime | Metric | CMOS 30 FPS | CMOS 90 FPS | CMOS 180 FPS | Event (ΔT = 5) | Hybrid 30 FPS | Hybrid 90 FPS |
|---|---|---|---|---|---|---|---|
| Weak | Median | 31.13 | 24.31 | 23.77 | 42.56 | 61.16 | 27.53 |
| Mean | 35.85 | 33.18 | 34.44 | 62.05 | 75.51 | 39.69 | |
| STD | 30.54 | 35.62 | 37.66 | 59.37 | 62.60 | 41.05 | |
| Moderate | Median | 43.42 | 25.44 | 21.64 | 25.05 | 23.21 | 21.07 |
| Mean | 65.80 | 26.92 | 24.53 | 31.67 | 30.05 | 26.74 | |
| STD | 62.14 | 19.09 | 19.87 | 27.50 | 28.14 | 24.39 | |
| Strong | Median | 46.73 | 35.78 | 30.39 | 24.68 | 20.36 | 17.77 |
| Mean | 44.44 | 34.32 | 29.97 | 26.67 | 22.13 | 19.63 | |
| STD | 17.87 | 16.18 | 16.02 | 17.28 | 14.73 | 13.39 |
References
- Hegde, R.; Anand, N.; Satheesh, S.K.; Moorthy, K.K. Modeling the atmospheric refractive index structure parameter using macrometeorological observations. Appl. Opt. 2024, 63, E10–E17. [Google Scholar] [CrossRef]
- Tatarski, V.I. Wave Propagation in a Turbulent Medium; Courier Dover Publications: Garden City, NY, USA, 2016. [Google Scholar]
- Roddier, F. Adaptive Optics in Astronomy; Cambridge University Press: Cambridge, UK, 1999. [Google Scholar]
- Hill, R.J. Algorithms for obtaining atmospheric surface-layer fluxes from scintillation measurements. J. Atmos. Ocean. Technol. 1997, 14, 456–467. [Google Scholar] [CrossRef]
- Zamek, S.; Yitzhaky, Y. Turbulence strength estimation from an arbitrary set of atmospherically degraded images. J. Opt. Soc. Am. A 2006, 23, 3106–3113. [Google Scholar] [CrossRef]
- Potvin, G. Relationship between turbulent image variance and average image gradient. J. Opt. Soc. Am. A 2024, 41, B32–B39. [Google Scholar] [CrossRef] [PubMed]
- Roggemann, M.C.; Welsh, B.M. Imaging Through Turbulence; CRC Press: Boca Raton, FL, USA, 2018. [Google Scholar]
- Boehrer, N.; Nieuwenhuizen, R.; Dijk, J. Using event cameras for imaging through atmospheric turbulence. In Proceedings of the COAT-2019—Workshop (Communications and Observations Through Atmospheric Turbulence: Characterization and Mitigation), Châtillon, France, 2–3 December 2019. [Google Scholar]
- Rebecq, H.; Ranftl, R.; Koltun, V.; Scaramuzza, D. High speed and high dynamic range video with an event camera. IEEE Trans. Pattern Anal. Mach. Intell. 2019, 43, 1964–1980. [Google Scholar] [CrossRef]
- Gallego, G.; Delbrück, T.; Orchard, G.; Bartolozzi, C.; Taba, B.; Censi, A.; Leutenegger, S.; Davison, A.J.; Conradt, J.; Daniilidis, K.; et al. Event-based vision: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 44, 154–180. [Google Scholar] [CrossRef] [PubMed]
- Liu, Y.; Teng, M.; Xia, Y.; Duan, P.; Shi, B. EvTurb: Event Camera Guided Turbulence Removal. arXiv 2025, arXiv:2508.10582. [Google Scholar] [CrossRef]
- Rebecq, H.; Ranftl, R.; Koltun, V.; Scaramuzza, D. Events-to-video: Bringing modern computer vision to event cameras. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 3857–3866. [Google Scholar]
- Atrey, P.K.; Hossain, M.A.; El Saddik, A.; Kankanhalli, M.S. Multimodal fusion for multimedia analysis: A survey. Multimed. Syst. 2010, 16, 345–379. [Google Scholar] [CrossRef]
- Saha, R.K.; Salcin, E.; Kim, J.; Smith, J.; Jayasuriya, S. Turbulence strength Cn2 estimation from video using physics-based deep learning. Opt. Express 2022, 30, 40854–40870. [Google Scholar] [CrossRef] [PubMed]
- Mizrahi, D.; Brisk, D.; Mordechai, Y.; Maor, O. Event-Based Camera Modeling for Atmospheric Turbulence Prediction. Sensors 2025, 25, 7276. [Google Scholar] [CrossRef]
- Polnau, E.; Vorontsov, M.A. Atmospheric turbulence characterization using a neuromorphic camera-based imaging sensor. J. Opt. 2021, 23, 125608. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
- Mizrahi, D.; Laufer, I.; Zuckerman, I. Real-World Spatial Synchronization of Event-CMOS Cameras through Deep Learning: A Novel CNN-DGCNN Approach. Sensors 2024, 24, 4050. [Google Scholar] [CrossRef]
- Duan, H.; Guo, C.; Ou, Y. Fusing Events and Frames with Coordinate Attention Gated Recurrent Unit for Monocular Depth Estimation. Sensors 2024, 24, 7752. [Google Scholar] [CrossRef]
- Apicella, A.; Isgrò, F.; Prevete, R. Don’t push the button! exploring data leakage risks in machine learning and transfer learning. Artif. Intell. Rev. 2025, 58, 339. [Google Scholar] [CrossRef]
- Nikou, M.K.; Ehsani, M.R. Turbulence models application on CFD simulation of hydrodynamics, heat and mass transfer in a structured packing. Int. Commun. Heat Mass Transf. 2008, 35, 1211–1219. [Google Scholar] [CrossRef]
- Azimi, H.; Shabanlou, S.; Kardar, S. Turbulent flow in the vicinity of side weirs in subcritical conditions. Math. Model. Comput. Simul. 2018, 10, 784–797. [Google Scholar] [CrossRef]
- Edwards, A.W. RA Fischer, Statistical Methods for Research Workers, (1925). In Landmark Writings in Western Mathematics 1640–1940; Elsevier Science: Amsterdam, The Netherlands, 2005; pp. 856–870. [Google Scholar]
- Tukey, J.W. Comparing Individual Means in the Analysis of Variance. Biometrics 1949, 5, 99–114. [Google Scholar] [CrossRef] [PubMed]
- Boehrer, N.; Nieuwenhuizen, R.P.; Dijk, J. Turbulence mitigation in imagery including moving objects from a static event camera. Opt. Eng. 2021, 60, 053101. [Google Scholar] [CrossRef]
- Chakravarthi, B.; Verma, A.A.; Daniilidis, K.; Fermuller, C.; Yang, Y. Recent event camera innovations: A survey. In Proceedings of the European Conference on Computer Vision, Milan, Italy, 29 September–4 October 2024; Springer Nature: Cham, Switzerland, 2024; pp. 342–376. [Google Scholar]
- Bi, C.; Qing, C.; Wu, P.; Jin, X.; Liu, Q.; Qian, X.; Zhu, W.; Weng, N. Optical turbulence profile in marine environment with artificial neural network model. Remote Sens. 2022, 14, 2267. [Google Scholar] [CrossRef]
- Qu, T.; Zhang, Y.; Wu, J.; Wu, Z. Vortex Beam Transmission Compensation in Atmospheric Turbulence Using CycleGAN. Photonics 2023, 10, 1182. [Google Scholar] [CrossRef]
- Zhang, X.; Mao, Z.; Chimitt, N.; Chan, S.H. Imaging through the atmosphere using turbulence mitigation transformer. IEEE Trans. Comput. Imaging 2024, 10, 115–128. [Google Scholar] [CrossRef]
- Hoffmire, M.A.; Hardie, R.C.; Rucci, M.A.; Van Hook, R.; Karch, B.K. Deep learning for anisoplanatic optical turbulence mitigation in long-range imaging. Opt. Eng. 2021, 60, 033103. [Google Scholar] [CrossRef]
- Kryjak, T. Event-based vision on fpgas-a survey. In Proceedings of the 27th Euromicro Conference on Digital System Design (DSD), Paris, France, 28–30 August 2024; IEEE: Piscataway, NJ, USA, 2024; pp. 541–550. [Google Scholar]
- Shankaranarayanan, H.; Yadav, S.S.; Adithya Krishna, A.; Vikram, P.; Mehendale, M. HOMI: Ultra-Fast EdgeAI platform for Event Cameras. arXiv 2025, arXiv:2508.12637. [Google Scholar]
- Yasarla, R.; Patel, V.M. Learning to restore images degraded by atmospheric turbulence using uncertainty. In Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA, 19–22 September 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1694–1698. [Google Scholar]
- Wang, Z.; Ng, Y.; van Goor, P.; Mahony, R. Event camera calibration of per-pixel biased contrast threshold. arXiv 2020, arXiv:2012.09378. [Google Scholar] [CrossRef]







| # | Feature (Name) | Formula | Category | Intuition for Turbulence Estimation |
|---|---|---|---|---|
| 1 | Total Events | Temporal | More turbulence more brightness changes larger | |
| 2 | Positive Event Ratio | Polarity | Deviation from 0.5 indicates bias in intensity changes | |
| 3 | Negative Event Ratio | Polarity | Complement to (2) | |
| 4 | Max Spatial Span X | Spatial | horizontal image wander range | |
| 5 | Max Spatial Span Y | Spatial | Vertical wander range; strongly linked to [16] | |
| 6 | Mean Spatial Span X | ) | Spatial | Average horizontal displacement after offset removal |
| 7 | Mean Spatial Span Y | ) | Spatial | Average vertical displacement after offset removal |
| 8 | STD Spatial Span X | Spatial | Robust spread of x; large under strong turbulence. | |
| 9 | STD Spatial Span Y | Spatial | Robust spread of y; large under strong turbulence. | |
| 10 | Event Rate (MEvt/s) | Temporal | Normalizes count by window length T (T measured in µsec) | |
| 11 | XY Correlation | Spatial | Detects diagonal shear in displacements | |
| 12 | XT Correlation | Temporal | Horizontal drift trend vs. time | |
| 13 | YT Correlation | Temporal | Vertical drift trend vs. time | |
| 14 | Spatial Event Density | Spatial | Distinguishes dense scintillation from sparse wander | |
| 15 | Spatial Entropy (32-bin) | Spatial | Uniform scatter (high entropy) ⇔ strong turbulence | |
| 16 | Inter-Event Mean | Temporal | Shorter mean gap = faster fluctuations | |
| 17 | Inter-Event STD | Temporal | Variability of event timing | |
| 18 | Inter-Event Median | Temporal | Robust central gap measure | |
| 19 | Spatial Dispersion | Spatial | Net 2D jitter; analogous RMS spot size |
| Turbulence Regime | Event (ΔT = 5) | CMOS (180 FPS) | Hybrid (90 FPS) |
|---|---|---|---|
| Weak | 42.56/62.05 | 23.77/34.44 | 27.53/39.69 |
| Moderate | 25.05/31.67 | 21.64/24.53 | 21.07/26.74 |
| Strong | 24.68/26.67 | 30.39/29.97 | 17.77/19.63 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Mizrahi, D.; Brisk, D.; Mordechai, Y.; Maor, O. Frame-Based vs. Event-Based Optical Turbulence Strength Estimation: A Comparative and Hybrid Approach. Atmosphere 2026, 17, 24. https://doi.org/10.3390/atmos17010024
Mizrahi D, Brisk D, Mordechai Y, Maor O. Frame-Based vs. Event-Based Optical Turbulence Strength Estimation: A Comparative and Hybrid Approach. Atmosphere. 2026; 17(1):24. https://doi.org/10.3390/atmos17010024
Chicago/Turabian StyleMizrahi, Dor, Daniel Brisk, Yogev Mordechai, and Or Maor. 2026. "Frame-Based vs. Event-Based Optical Turbulence Strength Estimation: A Comparative and Hybrid Approach" Atmosphere 17, no. 1: 24. https://doi.org/10.3390/atmos17010024
APA StyleMizrahi, D., Brisk, D., Mordechai, Y., & Maor, O. (2026). Frame-Based vs. Event-Based Optical Turbulence Strength Estimation: A Comparative and Hybrid Approach. Atmosphere, 17(1), 24. https://doi.org/10.3390/atmos17010024

