On Solar Filament Detection Techniques: From Manual to Intelligent
Abstract
1. Introduction
2. Historical Evolution of Solar Filament Detection Techniques
2.1. Manual and Semi-Automated Methods (1990s–2002)
2.2. Image Processing and Early Machine Learning (2003–2010)
2.3. Deep Learning Era (2011–Present)
3. Performance Comparison of Key Technical Approaches
3.1. Traditional Image Processing Methods
3.2. Classical Machine Learning Approaches
3.3. Deep Learning Architectures
3.4. Cross-Paradigm Performance Analysis
3.5. Critical Perspectives: Paradigm Conflicts and Epistemic Gaps
3.5.1. The Semantic Gap: Pixel Precision vs. Physical Reality
3.5.2. Metric Misalignment: Geometric Accuracy vs. Prognostic Value
3.5.3. Fragmentation in Benchmarking and Reproducibility
- The Role of Standardization:Addressing this fragmentation is critical. The introduction of standardized datasets, such as MAGFILO v1.0 [53], represents a pivotal step forward. By providing a consistent benchmark for fair algorithm comparison, MAGFILO v1.0 addresses the critical gap in reproducibility, allowing for rigorous assessment of different architectures on a level playing field. However, until such benchmarks are universally adopted, the community risks a “Tower of Babel” scenario where results are incomparable across different research groups.
3.5.4. The “Instrumental Overfitting” Crisis
3.5.5. Technological Monoculture and the “Black Box” Barrier
4. Application-Oriented Challenges and Advances
4.1. Cross-Instrument Generalization
4.2. Real-Time Processing and Computational Efficiency
4.3. Integration with Space Weather Forecasting
4.4. Handling Data Quality Variability
4.5. Operational Deployment Considerations
4.6. Summary and Outlook
5. Future Research Directions
5.1. Standardized Datasets and Benchmarking
5.2. Towards Trustworthy and Edge-Deployable AI Systems
- Technological Pathway: Research should move beyond simple architecture scaling (e.g., Flat U-Net [43]) to advanced model compression techniques such as network quantization (reducing precision from 32-bit float to 8-bit integer) and knowledge distillation (training lightweight “student” models to mimic heavy “teacher” networks). This would facilitate “smart telemetry,” where spacecraft downlink only metadata or event-triggered image cutouts of active filaments, significantly optimizing data budgets.
- Critical Insight: Future architectures could incorporate a “physics loss” function () alongside standard segmentation loss. For instance, imposing constraints based on magnetic connectivity or enforcing topological continuity can penalize the model for predicting physically impossible fragmented structures. This ensures that the detected filaments are not just visually similar to the ground truth but are consistent with underlying MHD principles.
- Visual Explainability (XAI): Techniques such as attention mechanisms [41,61], provide critical insights by visualizing which image regions drive the model’s decisions. Future work should advance from simple attention maps to sophisticated feature attribution methods (e.g., Integrated Gradients) that can verify whether the model is focusing on physical filament structures or irrelevant background artifacts.
- Uncertainty Quantification (UQ): Beyond knowing where the model looks, operators need to know how confident it is. Integrating Bayesian Neural Networks or Monte Carlo Dropout allows systems to generate probability heatmaps. By distinguishing between aleatoric uncertainty (data noise) and epistemic uncertainty (model ignorance), these systems provide forecasters with actionable risk assessments—flagging low-confidence detections for human review while automating high-confidence cases.
5.3. Multi-Modal Data Integration
5.4. Advanced Tracking and Eruption Prediction
5.5. Generalized and Adaptive Detection
5.6. Integration with Operational Forecasting
5.7. Physical Parameter Extraction
- Integrated Parameter Extraction: Multi-task networks can jointly predict filament masks, spine coordinates, chirality classification, and kinematic properties in a single forward pass. This approach not only improves computational efficiency but also enables the network to learn shared representations that mutually benefit segmentation and parameter estimation tasks.
- Metrics for Physical Consistency: Establishing evaluation protocols beyond standard segmentation metrics—such as tilt angle error relative to manual measurements, chirality agreement rates, and velocity field consistency—will incentivize the development of scientifically meaningful detection systems.
- Large-Scale Statistical Applications: Automated parameter extraction pipelines enable comprehensive statistical studies of filament properties across solar cycles, facilitating investigations into hemispheric asymmetry patterns, poleward migration trends, and the identification of pre-eruptive signatures critical for space weather forecasting [5,57].
5.8. Historical Data Utilization and Long-Term Studies
5.9. Cross-Disciplinary Opportunities: The Era of Foundation Models
- Zero-Shot Segmentation: Models such as the Segment Anything Model (SAM) have demonstrated remarkable zero-shot generalization capabilities. Future research should investigate the applicability of SAM-based architectures for solar filament detection. By utilizing prompt engineering (e.g., providing box prompts or point prompts of filaments) rather than full retraining, researchers could bypass the bottleneck of massive annotated datasets.
- Vision-Language Integration: The rise of Multi-modal Large Language Models (MLLMs) offers a novel pathway for semantic understanding. Integrating visual encoders with language models could enable systems that not only segment filaments but also generate natural language descriptions of their morphology (“sigmoid,” “barb-bearing”) or query databases using semantic prompts (“Show me all active region filaments with high chirality”), effectively bridging the gap between pixel data and scientific query.
6. Overall Synthesis and Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AAFDCC | Advanced Automated Filament Detection and Characterization Code |
| ACWE | Active Contours Without Edges |
| AI | Artificial Intelligence |
| ANN | Artificial Neural Network |
| AP | Average Precision |
| ASPP | Atrous Spatial Pyramid Pooling |
| BBSO | Big Bear Solar Observatory |
| CGAN | Conditional Generative Adversarial Network |
| CHASE | Chinese H Solar Explorer |
| CME | Coronal Mass Ejection |
| CNN | Convolutional Neural Network |
| CPU | Central Processing Unit |
| CSRT | Discriminative Correlation Filter with Channel and Spatial Reliability |
| DSC | Dice Similarity Coefficient |
| EUV | Extreme Ultraviolet |
| F1 | F1 Score |
| FAR | False Acceptance Rate |
| FDD | Filter-based Diffusion Detection |
| FDH | Full-Disk H-alpha |
| FITS | Flexible Image Transport System |
| FMT | Flare Monitoring Telescope |
| GLCM | Gray-Level Co-occurrence Matrix |
| GONG | Global Oscillation Network Group |
| GPU | Graphics Processing Unit |
| HEK | Heliophysics Event Knowledgebase |
| HIS | H Imaging Spectrograph |
| HSOS | Huairou Solar Observing Station |
| H | Hydrogen-alpha (spectral line) |
| IoU | Intersection over Union |
| IRIS | Interface Region Imaging Spectrograph |
| KSO | Kanzelhöhe Solar Observatory |
| LAPAN | Lembaga Penerbangan dan Antariksa Nasional |
| mAP | mean Average Precision |
| MCC | Matthews Correlation Coefficient |
| MD | Morphological Detection |
| MHD | Magnetohydrodynamic |
| MLLM | Multi-modal Large Language Model |
| MLSO | Mauna Loa Solar Observatory |
| MPI | Message Passing Interface |
| NMS | Non-Maximum Suppression |
| NN | Neural Network |
| NOAA | National Oceanic and Atmospheric Administration |
| OACT | Osservatorio Astrofisico di Catania |
| OpenMP | Open Multi-Processing |
| P | Precision |
| PINN | Physics-Informed Neural Network |
| R | Recall |
| ResNet | Residual Network |
| RGB | Red–Green–Blue |
| RTX | Ray Tracing Texel eXtreme (NVIDIA GPU) |
| SAM | Segment Anything Model |
| SIDE | Steerable Isotropic Differential Enhancement |
| SMART | Solar Monitor Active Region Tracker |
| SUIT | Solar Ultraviolet Imaging Telescope |
| SVM | Support Vector Machine |
| TPR | True Positive Rate |
| U-Net | U-shaped convolutional network |
| UQ | Uncertainty Quantification |
| USO | Udaipur Solar Observatory |
| XAI | Explainable Artificial Intelligence |
| YNAO | Yunnan Observatories |
| YOLO | You Only Look Once |
Appendix A. Descriptive Summary of Solar Filament Detection Studies
| Study | Methodology/Approach | Key Findings/Performance | Computational & Efficiency Aspects | Robustness Handling | Datasets & Validation |
|---|---|---|---|---|---|
| Mouradian [3] | Semi-automated digitization & synthesis of hand-drawn synoptic maps | Established long-term digital record & synthesis methods for filaments | Human-in-the-loop process; digitization enables computational analysis | Relies on expert human decision, minimizing false detections | Meudon synoptic map series (1919+). Became a benchmark dataset for validation |
| Gao et al. [32] | Thresholding & region-growing | Automated detection of filament disappearance;alerts on disappearance events | Processes 1 image/minute; suitable for near-real-time alert | Uses “4-pixel” & “40-pixel” methods to handle noise and fragmentation | Tested on BBSO full-disk H images |
| Zharkova and Schetinin [25] | Early ANN technique for filament recognition | Effective recognition on varied brightness backgrounds | Computationally light due to simple network | Handles atmospheric distortions well | Tested on Meudon Observatory H spectroheliograms |
| Zharkova and Schetinin [63] | Artificial Neural Network with linear background approximation and sliding window technique | Effectively recognizes filaments on variable brightness backgrounds; trained on one fragment | Computationally light network; faster than region-growing, slightly slower than mosaic methods | Adapts to variable intensity backgrounds; no explicit noise correction needed | Meudon Observatory H spectroheliograms; visually validated against mosaic & region-growing methods |
| Shih and Kowalski [39] | Advanced local thresholding or global thresholding; directional morphological filtering with linear structuring elements | Excellent detection of large filaments (100%); good detection of small filaments (90.4%); higher false positives than some methods | Faster than region-growing methods; suitable for parallel implementation; efficient directional filtering | Removes sunspots by brightness thresholding; robust to Gaussian and blur noise | Tested on BBSO H full-disk images; validated against manual markings |
| Fuller and Aboudarham [1] | Region growing with seed selection for detection | Very good correspondence with manual digitization | Efficient for four months of data | Image cleaning reduces defects and false detections | Tested on Meudon Observatory H spectroheliograms |
| Bernasconi et al. [15] | Automated detection, spine/barb extraction, chirality classification, and synodic tracking | 72% accuracy compared to manual chirality identification | Efficient for daily tracking over long periods | Unbiased detection reduces operator subjectivity | Tested on BBSO H images spanning multiple years |
| Fuller et al. [24] | Cleaning and region growing for filament recognition | Good agreement with manual digitization | Efficient segmentation and skeleton pruning | Corrects instrument defects and noise | Used in EGSO project for solar features |
| Qahwaji and Colak [19] | Hybrid system: adaptive intensity filtering, modified region growing, and NN verification | FAR reduced to 4% for filaments with NN verification; fast detection suitable for operational use | Fast detection (<3 s/image) suitable for operational use | Limb darkening correction and intensity filtering applied | Tested on Meudon H & Ca II K3 images; validated against synoptic maps |
| Liu et al. [13] | Multi-band H detection; local median thresholding (109 regions, di = 0.9); seed clustering; multi-wavelength classification | 89% manual event recall; 10× more detections; precise start/end times; surge/filament/network classification | 1 s/frame preprocessing; 1–3 h/day | Data quality filtering; limb-darkening correction; sunspot exclusion | FMT Hida Observatory; H center, Å, white light; 7 days (1997–2001); validated against manual event catalogs |
| Qu et al. [14] | Image processing with SVM classification | High precision in filament and spine detection | Moderate speed; suitable for real-time applications | Uses image enhancement to reduce noise and limb effects | Applied on BBSO H full-disk images |
| Zharkova and Schetinin [45] | ANN with linear/parabolic background approximation; sliding window technique | ∼82.5% accuracy with parabolic fit; outperforms linear fit and earlier mosaic/region-growing methods | Efficient once trained; faster than region-growing; suitable for processing large archives | Adapts to limb darkening and intensity variations without explicit noise correction | Tested on Meudon H spectroheliograms; compared against region-growing and mosaic methods |
| Zharkova et al. [50] | Review of filament detection methods (chain linking, region growing); introduces ANN technique with linear/parabolic background approximation | ANN achieves ∼82.5% accuracy for filaments on variable backgrounds; effective without explicit noise correction | Notes computational demands of large archives; ANN efficient once trained | ANN adapts to variable intensity backgrounds; preprocessing (e.g., shape correction) | Techniques tested on Meudon H data; compared against region-growing results |
| Shih et al. [4] | SIDE for filament enhancement, adaptive thresholding, and SVM for filament/sunspot discrimination | ∼95% detection rate for large filaments; first SVM use for sunspot removal; automated disappearance detection | Efficient processing suitable for continuous monitoring | Robust to low-contrast filaments and limb darkening via SIDE & SVM | Tested on BBSO H full-disk images; validated against manual detection |
| Qahwaji and Colak [64] | Local contrast enhancement and adaptive intensity filtering to identify filament and NN for verification | Neural network verification reduces false positives | Image processing and feature-based NN verification enables 1 s/image | Intensity filtering and local detection windows to eliminate noise | Tested on Meudon H data; compared against BASS manual annotations |
| Aboudarham et al. [65] | Integrated automatic detection with filament tracking for synoptic map synthesis | Achieved major progress towards fully automatic synoptic map generation | Aims for a fully automated processing pipeline | Image cleaning (limb fitting, intensity normalization) reduces defects | Tested on Meudon H spectroheliograms; compared with manual maps |
| Aboudarham et al. [40] | Laplacian enhancement, region growing, morphological closing; Carrington map-based tracking | ∼90% detection accuracy; enables tracking across rotations; handles filament splitting/reappearance | Fully automated pipeline; suitable for synoptic map generation and long-term tracking | Corrects limb darkening, transparency variations, and instrumental defects | Meudon H spectroheliograms; validated against manual synoptic maps |
| Atoum et al. [66] | Adaptive local thresholding (ALT) using dual-window sliding; intensity- and range-based segmentation | Lower false acceptance rate (FAR: ∼9%) compared to ALT&V (19%); produces well-defined filaments with reduced noise | Efficient sliding window processing; suitable for daily image analysis | Adaptive to local intensity variations; handles background non-uniformity via local statistics | Meudon H images; validated against manual synoptic maps; FAR used as performance metric |
| Joshi et al. [28] | Intensity and size thresholding with preprocessing (fragment grouping/foreshortening correction) | 81% detection rate across 10 events; capable of real-time eruption monitoring | ∼1 min/image processing time; suitable for real-time systems | Limb/foreshortening correction; sunspot removal; multi-observatory robustness | Tested on BBSO, MLSO, KSO, USO data; validated against manual inspection |
| Yuan et al. [20] | Polynomial luminance correction, adaptive thresholding, morphological operations, and graph-based skeleton extraction | Accuracy >96% for filament number and >99% for area; outperforms previous methods | Efficient cascading Hough transform reduces memory consumption | Robust across different observatories; removes sunspots by shape | Tested on 4 observatories (BBSO, KANZ, OACT, YNAO); validated against manual annotations |
| Andrijauskas and Gradvohl [49] | Hybrid OpenMP-MPI parallelization; two methods: FDD (diffusion filter + graph-based) and MD (morphological operators) | FDD: ∼80% pixel accuracy, 94% filament detection rate; MD: ∼58% accuracy, 66% detection rate | 326× speed-up for FDD, 54× for MD on 5-node cluster; supports high-throughput processing of large images | Diffusion filter preserves edges; handles filament continuity across MPI segments | BBSO H images; validated against manually annotated ground truth images |
| Atoum [17] | Fully automated detection and tracking with NN merging | High confidence in filament disappearance detection | Faster than previous empirical methods | Adaptive thresholding improves noise handling | Uses Heliographic Carrington coordinates for tracking |
| Bonnin et al. [56] | Co-rotational frame tracking with skeleton curve-matching | ∼90% tracking accuracy for filaments | Efficient for large datasets; ∼30 s per Carrington rotation | Stable in co-rotating frame | Applied on Meudon H spectroheliograms |
| Peng et al. [2] | Early automated methods including ANN and region growing | Moderate accuracy; ANN improves detection near solar limb | Region growing is time-consuming; ANN faster | Sensitive to background cleaning and limb proximity | Tested on limited datasets, mainly H images |
| Hao et al. [31] | Canny edge detection & morphological operators for detection; differential rotation for tracing | Quantified latitudinal migration speeds in Cycle 23; ∼85% detection accuracy | Efficient processing (∼1 s/image for detection) | Preprocessing removes limb darkening; sunspot filtering by geometry | Tested on MLSO H images; validated against manual detection |
| Riegler et al. [67] | Variational multi-label segmentation for simultaneous flare and filament detection | Accurate classification vs. expert annotations; F-score: 0.89 (filaments), 0.92 (flares) | Real-time alert potential with preprocessing steps | Image normalization, registration, and structural bandpass filter | Tested on KSO H image sequences; validated against NOAA annotations |
| Atoum and Ali [29] | Geometrical approach for spine extraction | More accurate and longer spine detection | Computationally less complex and faster | Tracks filament backbone precisely | Suitable for real-time tracking |
| Schuh et al. [54] | Comparative evaluation leveraging AAFDCC metadata to train a general Trainable Feature Recognition (TFR) module | Achieved >82.7% filament detection accuracy; confirmed reliability of AAFDCC reporting | Efficient with certain classifiers (e.g., J48, RF) for large-scale data | labeling schemes to mitigate label noise | Trained and validated on BBSO H images using AAFDCC module metadata as benchmark |
| Atoum and Ali [23] | Image processing + neural network for merging broken filaments; uses spatial & orientation features as NN inputs | 92% true-positive rate in merging fragments;reduces false merging compared to earlier empirical methods | Efficient once NN is trained; avoids constant thresholds | Adaptive to fragment distance & orientation; handles fragmentation caused by imaging artifacts | Applied on BBSO H images; validated against manual merging |
| Atoum [58] | Context-based sliding window with adaptive thresholding | Adapts window size to local intensity variability; handles both high- and low-contrast filaments | Adaptive window reduces unnecessary computation | Robust to uneven illumination and intensity variations; no fixed structuring elements | Tested on BBSO and Meudon H images |
| Hao et al. [5] | Canny edge detection for segmentation, and morphological operations for feature extraction | Generated filament “butterfly diagram” from nearly 3 solar cycles | Efficient and versatile method applied to multi-cycle data | Limb-darkening correction; sunspot exclusion | Applied to full-disk H data (primarily BBSO) |
| Ahmadzadeh et al. [30] | Mask R-CNN deep neural network framework | Competitive performance using Mask R-CNN; scalable with more data | Scalable deep learning framework | Handles false positives and negatives well | Trained on BBSO H images with HEK metadata |
| Salasa and Arymurthy [44] | Mask R-CNN deep learning for filament detection | Achieves 96% precision without intensity normalization | Fast detection at 0.42 s per image | Robust to intensity variations without normalization | Applied on LAPAN H images |
| Zhu et al. [26] | Improved U-Net with dropout layers & nearest-neighbor upsampling | Average TPR: 0.9145, DSC: 0.8944; effective for large filaments | GPU training: ∼49 min; CPU: ∼57 h; suitable for small datasets | Handles noise and artifacts; sensitive to uneven illumination | Dataset from BBSO/FDH A H images |
| Liu et al. [47] | Multiple improved U-Net variants with ASPP module; compared with CGAN | dilation-122436 achieves Jac: 0.6320, MCC: 0.7829, F1: 0.7710 on high-quality images; CGAN better for low-quality images | Improved U-Nets train faster (≈1.2h) vs. CGAN (80 h); suitable for limited data | ASPP improves high-quality image segmentation; CGAN more robust to poor image quality | Trained on 3000 pairs from HSOS & BBSO H images; validated against manual ground truth |
| Guo et al. [52] | Improved CondInst instance segmentation with ResNet-C/D/v2 backbone + Matrix NMS | Mean precision: 90.83%, recall: 83.88%, AP: 82.86%, F1: 87.22%; effectively detects fragmented filaments | Training: 30 h on 1×RTX 2080; inference: 0.458 s/image | Robust to uneven brightness, limb darkening, low contrast; generalizes across observatories | BBSO H images; 12,519 filaments; tested on SMART & HSOS data |
| Priyadarshi et al. [57] | K-means clustering for optimal RGB thresholding on hand-drawn suncharts | Effective extraction of filament parameters; revealed poleward migration and tilt sign dominance | Processing of scanned drawings is computationally light | Handles variability in hand-drawn data and discolorations | Unique dataset from Kodaikanal Solar Observatory; cross-verified with H plates |
| Wu et al. [68] | AA-UNet with axial attention for segmentation | Achieves F1-score of 0.77, robust to noise | Efficient segmentation with attention blocks | Handles uneven image quality effectively | Tested on solar image test sets |
| You and Shang [69] | Improved DeepLab V3+ deep learning model | F1-score improved by over 2% compared to original | Optimized convolutions reduce incomplete detections | Enhanced edge optimization for small filaments | Dataset from BBSO H images |
| Bandyopadhyay and Pant [70] | Active Contours Without Edges (ACWE) with preprocessing (inpainting, log transform, sharpening) and postprocessing | Max TPR: 0.9075; accuracy: 99.63%; outperforms Otsu and K-means in boundary preservation | Slower execution (∼29.8 s/image); no training required | Robust to noise; preserves boundaries; sensitive to local minima | BBSO H images; validated against manual ground truth |
| Diercke et al. [27] | Semi-supervised deep learning combining YOLOv5 and U-Net | 92% accuracy in filament segmentation | Semi-supervised learning reduces annotation cost | Generalizable to multiple H filtergrams | Applied on ChroTel, GONG, and KSO data |
| Jiang and Li [41] | Attention U2-Net; integrates attention gates into RSU blocks for enhanced feature selection | F1-score: 0.83; outperforms standard U-Net variants; effective for multi-scale filaments | Trained on an NVIDIA Quadro RTX4000 GPU; batch size of 2 over 150 epochs. (No inference time or comparative efficiency metrics reported) | Attention mechanism improves robustness to noise and complex backgrounds | CHASE/H images (2023); 600 images with labels from clustering & post-processing |
| Shang et al. [42] | Hybrid CNN-Transformer model with multi-scale residual blocks, deformable large kernel attention, and res path | F1: 91.19%, Precision: 91.50%, Recall: 90.89%; superior anti-interference to sunspots and noise | Batch size: 4; Transformer layers: 12; image size: 512×512; data augmentation used | Enhanced global feature extraction; robust to sunspots and background noise | Dataset from BBSO H images; 2700 augmented training samples |
| Zheng et al. [18] | U-Net and CSRT tracking for filament dynamics | Validated for accurate filament identification | Automated processing suitable for large data | Robust velocity inversion and spine extraction | Uses CHASE/HIS full-disk spectroscopic data |
| Zhu et al. [43] | Flat U-Net ultralightweight model for segmentation | Precision 0.93, DSC up to 0.82 with attention blocks | Highly efficient with reduced parameters | Performs well despite image quality variations | Dataset from BBSO H images |
| Seth et al. [22] | YOLOv8-obb (oriented bounding boxes); self-validation via statistical moments (entropy, skew, etc.) and Tamura texture features (GLCM). | On FITS: P = 0.788, R = 0.863, mAP@0.5 = 0.874. Entropy best differentiates plages, sunspots, filaments, off-limb. | 500 epochs, batch size 8, LR 0.01. Data augmentation: grayscale, HSV, gamma, flips. | Gamma augmentation for intensity variations; manual rescaling (×8) on real SUIT; statistical/Tamura self-validation for unlabeled data. | Mock SUIT from IRIS Mg II k (2013–2023); 217→3056 augmented JPG (train), 123 FITS (val), 92 real SUIT FITS (test). |
References
- Fuller, N.; Aboudarham, J. Automatic Detection of Solar Filaments versus Manual Digitization. In Knowledge-Based Intelligent Information and Engineering Systems; Negoita, M.G., Howlett, R.J., Jain, L.C., Eds.; Springer: Berlin/Heidelberg, Germany, 2004; Volume 3215, pp. 467–475. [Google Scholar] [CrossRef]
- Peng, P.; Ji, K.; Wang, F. A Survey of Solar Filament Detection Methods. In Proceedings of the 2013 6th International Conference on Intelligent Networks and Intelligent Systems, Shenyang, China, 1–3 November 2013; pp. 320–323. [Google Scholar] [CrossRef]
- Mouradian, Z. The New “Solar Activity Synoptic Maps” of Observatoire de Paris-Meudon. In Proceedings of the Synoptic Solar Physics; Astronomical Society of the Pacific Conference Series; Balasubramaniam, K.S., Harvey, J., Rabin, D., Eds.; Astronomical Society of the Pacific: San Francisco, CA, USA, 1998; Volume 140, p. 197. [Google Scholar]
- Qu, M. Automatic Solar Feature Detection Using Image Processing and Pattern Recognition Techniques. Ph.D. Thesis, New Jersey Institute of Technology, Newark, NJ, USA, 2006. [Google Scholar]
- Hao, Q.; Chen, P.F.; Fang, C. Automated Detection Methods for Solar Activities and an Application for Statistic Analysis of Solar Filament. Proc. Int. Astron. Union 2018, 13, 101–107. [Google Scholar] [CrossRef]
- Ahmadzadeh, A.; Kempton, D.J.; Schuh, M.A.; Angryk, R.A. Improving the Functionality of Tamura Directionality on Solar Images. In 2017 IEEE International Conference on Big Data (Big Data); IEEE: Piscataway, NJ, USA, 2017; pp. 2518–2526. [Google Scholar] [CrossRef]
- Zhao, C.; Lin, G.; Deng, Y.; Yang, X. Automatic Recognition of Sunspots in HSOS Full-Disk Solar Images. Publ. Astron. Soc. Aust. 2016, 33, e018. [Google Scholar] [CrossRef]
- Colak, T.; Qahwaji, R. Automated McIntosh-based Classification of Sunspot Groups Using MDI Images. Sol. Phys. 2008, 248, 277–296. [Google Scholar] [CrossRef]
- Zhang, J.; Lin, G.; Zeng, S.; Zheng, S.; Yang, X.; Lin, G.; Zeng, X.; Wang, H. Intelligent Recognition of Time Stamp Characters in Solar Scanned Images from Film. Adv. Astron. 2019, 2019, 6565379. [Google Scholar] [CrossRef]
- Asensio Ramos, A.; Cheung, M.C.M.; Chifu, I.; Gafeira, R. Machine Learning in Solar Physics. Living Rev. Sol. Phys. 2023, 20, 4. [Google Scholar] [CrossRef]
- Armstrong, J.A.; Fletcher, L. Fast Solar Image Classification Using Deep Learning and Its Importance for Automation in Solar Physics. Sol. Phys. 2019, 294, 80. [Google Scholar] [CrossRef]
- Kurokawa, H.; Ishiura, K.; Kimura, G.; Nakai, Y.; Kitai, R.; Funakoshi, Y.; Shinkawa, T. Observations of Solar Hα Filament Disappearances with a New Solar Flare-Monitoring-Telescope at Hida Observatory. J. Geomagn. Geoelectr. 1995, 47, 1043–1052. [Google Scholar] [CrossRef]
- Liu, Y.; Kurokawa, H.; Kitai, R.; Ueno, S.; Su, J.T. A Study on Surges: I. Automatic Detection of Dynamic Hα Dark Features from High-Cadence Full-Disk Observations. Sol. Phys. 2005, 228, 149–164. [Google Scholar] [CrossRef]
- Qu, M.; Shih, F.Y.; Jing, J.; Wang, H. Automatic Solar Filament Detection Using Image Processing Techniques. Sol. Phys. 2005, 228, 119–135. [Google Scholar] [CrossRef]
- Bernasconi, P.N.; Rust, D.M.; Hakim, D. Advanced Automated Solar Filament Detection and Characterization Code: Description, Performance, and Results. Sol. Phys. 2005, 228, 97–117. [Google Scholar] [CrossRef]
- Aschwanden, M.J. Image Processing Techniques and Feature Recognition in Solar Physics. Sol. Phys. 2010, 262, 235–275. [Google Scholar] [CrossRef]
- Atoum, I.A. The Development of Automatic and Solar Imaging Techniques for the Accurate Detection, Merging, Verification and Tracking of Solar Filaments. Ph.D. Thesis, University of Bradford, Bradford, UK, 2012. [Google Scholar]
- Zheng, Z.; Hao, Q.; Qiu, Y.; Hong, J.; Li, C.; Ding, M.D. Developing an Automated Detection, Tracking and Analysis Method for Solar Filaments Observed by CHASE via Machine Learning. arXiv 2024, arXiv:2402.14209. [Google Scholar] [CrossRef]
- Qahwaji, R.; Colak, T. Automatic Detection and Verification of Solar Features. Int. J. Imaging Syst. Technol. 2005, 15, 199–210. [Google Scholar] [CrossRef]
- Yuan, Y.; Shih, F.Y.; Jing, J.; Wang, H.; Chae, J. Automatic Solar Filament Segmentation and Characterization. Sol. Phys. 2011, 272, 101–117. [Google Scholar] [CrossRef]
- Yuan, Y. Development of Advanced Algorithms to Detect, Characterize and Forecast Solar Activities. Ph.D. Thesis, New Jersey Institute of Technology, Newark, NJ, USA, 2011. [Google Scholar]
- Seth, P.; Upendran, V.; Anand, M.; Sarkar, J.; Roy, S.; Chaki, P.; Chowdhury, P.; Ghosh, B.; Tripathi, D. SPACE-SUIT: An Artificial Intelligence Based Chromospheric Feature Extractor and Classifier for SUIT. Sol. Phys. 2025, 300, 89–114. [Google Scholar] [CrossRef]
- Atoum, I.A.; Ali, M. Adaptive Technique for Merging Broken Filaments in Hα Solar Images Using Machine Learning Techniques. Arab. J. Sci. Eng. 2017, 42, 787–792. [Google Scholar] [CrossRef]
- Fuller, N.; Aboudarham, J.; Bentley, R.D. Filament Recognition and Image Cleaning on Meudon Hα Spectroheliograms. Sol. Phys. 2005, 227, 61–73. [Google Scholar] [CrossRef]
- Zharkova, V.V.; Schetinin, V. A Neural-Network Technique for Recognition of Filaments in Solar Images. In Knowledge-Based Intelligent Information and Engineering Systems; Goos, G., Hartmanis, J., Van Leeuwen, J., Palade, V., Howlett, R.J., Jain, L., Eds.; Springer: Berlin/Heidelberg, Germany, 2003; Volume 2773, pp. 148–154. [Google Scholar] [CrossRef]
- Zhu, G.; Lin, G.; Wang, D.; Liu, S.; Yang, X. Solar Filament Recognition Based on Deep Learning. Sol. Phys. 2019, 294, 117. [Google Scholar] [CrossRef]
- Diercke, A.; Jarolim, R.; Kuckein, C.; González Manrique, S.J.; Ziener, M.; Veronig, A.M.; Denker, C.; Pötzi, W.; Podladchikova, T.; Pevtsov, A.A. A Universal Method for Solar Filament Detection from H α Obs. Using Semi-Supervised Deep Learn. Astron. Astrophys. 2024, 686, A213. [Google Scholar] [CrossRef]
- Joshi, A.D.; Srivastava, N.; Mathew, S.K. Automated Detection of Filaments and Their Disappearance Using Full-Disc Hα Images. Sol. Phys. 2010, 262, 425–436. [Google Scholar] [CrossRef]
- Atoum, I.A.; Ali, M. Automated Algorithms for Detecting Solar Filaments in H-Alpha Solar Images and Detecting Their Spines. Int. J. Astron. 2013, 2, 56–64. [Google Scholar] [CrossRef]
- Ahmadzadeh, A.; Mahajan, S.S.; Kempton, D.J.; Angryk, R.A.; Ji, S. Toward Filament Segmentation Using Deep Neural Networks. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 9–12 December 2019; pp. 4932–4941. [Google Scholar] [CrossRef]
- Hao, Q.; Fang, C.; Chen, P.F. Developing an Advanced Automated Method for Solar Filament Recognition and Its Scientific Application to a Solar Cycle of MLSO Hα Data. Sol. Phys. 2013, 286, 385–404. [Google Scholar] [CrossRef][Green Version]
- Gao, J.; Wang, H.; Zhou, M. Development of an Automatic Filament Disappearance Detection System. Sol. Phys. 2002, 205, 93–103. [Google Scholar] [CrossRef]
- González, R.C.; Woods, R.E.; Masters, B.R. Book Review: Digital Image Processing, Third Edition. J. Biomed. Opt. 2009, 14, id.029901. [Google Scholar] [CrossRef]
- Jähne, B. Digital Image Processing; Springer: Berlin/Heidelberg, Germany, 2005. [Google Scholar] [CrossRef]
- Pao, Y.h. Adaptive Pattern Recognition and Neural Networks; Addison-Wesley: Reading, MA, USA, 1989. [Google Scholar]
- Konrad, J. Multidimensional Signal, Image and Video Processing and Coding [Book Reviews]. IEEE Signal Process. Mag. 2007, 24, 160–161. [Google Scholar] [CrossRef]
- Mallat, S. A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way; Elsevier/Academic Press: Amsterdam, The Netherlands; Boston, MA, USA, 2009. [Google Scholar]
- Ripley, B.D. Pattern Recognition and Neural Networks; Cambridge University Press: Cambridge, UK, 1996. [Google Scholar]
- Shih, F.Y.; Kowalski, A.J. Automatic Extraction of Filaments in Hα Solar Images. Sol. Phys. 2003, 218, 99–122. [Google Scholar] [CrossRef]
- Aboudarham, J.; Scholl, I.; Fuller, N.; Fouesneau, M.; Galametz, M.; Gonon, F.; Maire, A.; Leroy, Y. Automatic Detection and Tracking of Filaments for a Solar Feature Database. Ann. Geophys. 2008, 26, 243–248. [Google Scholar] [CrossRef][Green Version]
- Jiang, W.; Li, Z. Automated High-Precision Recognition of Solar Filaments Based on an Improved U2-net. Universe 2024, 10, 381. [Google Scholar] [CrossRef]
- Shang, Z.; Song, M.; Li, R. Solar Filament Detection Based on an Improved Deep Learning Model. Appl. Sci. 2024, 14, 3745. [Google Scholar] [CrossRef]
- Zhu, G.; Lin, G.; Yang, X.; Zeng, C. Flat U-net: An Efficient Ultralightweight Model for Solar Filament Segmentation in Full-Disk Hα Images. Astrophys. J. 2025, 980, 176. [Google Scholar] [CrossRef]
- Salasa, R.P.; Arymurthy, A.M. Solar Filament Detection Using Mask R-CNN. In Proceedings of the 2019 International Workshop on Big Data and Information Security (IWBIS), Bali, Indonesia, 11 October 2019; pp. 67–71. [Google Scholar] [CrossRef]
- Zharkova, V.V.; Schetinin, V. Filament Recognition In Solar Images with the Neural Network Technique. Sol. Phys. 2005, 228, 137–148. [Google Scholar] [CrossRef]
- Zharkova, V.; Jain, L.C. Artificial Intelligence in Recognition and Classification of Astrophysical and Medical Images; Studies in Computational Intelligence; Springer: Berlin/Heidelberg, Germany; New York, NY, USA, 2007; Volume 46. [Google Scholar]
- Liu, D.; Song, W.; Lin, G.; Wang, H. Solar Filament Segmentation Based on Improved U-nets. Sol. Phys. 2021, 296, 176. [Google Scholar] [CrossRef]
- Benkhalil, A.; Zharkova, V.; Zharkov, S.; Ipson, S. Active Region Detection and Verification With the Solar Feature Catalogue. Sol. Phys. 2006, 235, 87–106. [Google Scholar] [CrossRef]
- Andrijauskas, F.; Gradvohl, A.L.S. Solar Filaments Detection Using Parallel Programming in Hybrid Architectures. In Proceedings of the 2012 Workshop on High-Performance Computing for Astronomy Date, Delft, The Netherlands; Association for Computing Machinery: New York, NY, USA, 2012; pp. 41–48. [Google Scholar] [CrossRef]
- Zharkova, V.; Ipson, S.; Benkhalil, A.; Zharkov, S. Feature Recognition in Solar Images. Artif. Intell. Rev. 2005, 23, 209–266. [Google Scholar] [CrossRef]
- Schuh, M.A.; Angryk, R.A. Massive labeled solar image data benchmarks for automated feature recognition. In Proceedings—2014 IEEE International Conference on Big Data, IEEE Big Data 2014; IEEE: Piscataway, NJ, USA, 2014; pp. 53–60. [Google Scholar] [CrossRef]
- Guo, X.; Yang, Y.; Feng, S.; Bai, X.; Liang, B.; Dai, W. Solar-Filament Detection and Classification Based on Deep Learning. Sol. Phys. 2022, 297, 104. [Google Scholar] [CrossRef]
- Ahmadzadeh, A.; Adhyapak, R.; Chaurasiya, K.; Nagubandi, L.A.; Aparna, V.; Martens, P.C.; Pevtsov, A.; Bertello, L.; Pevtsov, A.; Douglas, N.; et al. A Dataset of Manually Annotated Filaments from H-alpha Observations. Sci. Data 2024, 11, 1031. [Google Scholar] [CrossRef] [PubMed]
- Schuh, M.A.; Banda, J.M.; Bernasconi, P.N.; Angryk, R.A.; Martens, P.C.H. A Comparative Evaluation of Automated Solar Filament Detection. Sol. Phys. 2014, 289, 2503–2524. [Google Scholar] [CrossRef]
- Schmieder, B.; Démoulin, P.; Aulanier, G. Solar filament eruptions and their physical role in triggering coronal mass ejections. Adv. Space Res. 2013, 51, 1967. [Google Scholar] [CrossRef]
- Bonnin, X.; Aboudarham, J.; Fuller, N.; Csillaghy, A.; Bentley, R. Automation of the Filament Tracking in the Framework of the HELIO Project. Sol. Phys. 2012, 283, 49–66. [Google Scholar] [CrossRef]
- Priyadarshi, A.; Hegde, M.; Jha, B.K.; Chatterjee, S.; Mandal, S.; Chowdhury, M.; Banerjee, D. Detection of Solar Filaments Using Suncharts from Kodaikanal Solar Observatory Archive Employing a Clustering Approach. Astrophys. J. 2022, 943, 140. [Google Scholar] [CrossRef]
- Atoum, I.A. An Automatic Segmentation Algorithm for Solar Filaments in H-alpha Images Using a Context-Based Sliding Window. Int. J. Adv. Comput. Sci. Appl. 2018, 9, 286–291. [Google Scholar] [CrossRef]
- Hassija, V.; Chamola, V.; Mahapatra, A.; Singal, A.; Goel, D.; Huang, K.; Scardapane, S.; Spinelli, I.; Mahmud, M.; Hussain, A. Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence. Cogn. Comput. 2024, 16, 45–74. [Google Scholar] [CrossRef]
- Lin, G.; Zhu, G.; Yang, X.; Song, Y.; Zhang, M.; Liu, S.; Wang, X.; Su, J.; Zheng, S.; Zhang, J.; et al. A New Comprehensive Data Set of Solar Filaments of 100 Yr Interval. I. Astrophys. J. Suppl. Ser. 2020, 249, 11–30. [Google Scholar] [CrossRef]
- Longo, L.; Brcic, M.; Cabitza, F.; Choi, J.; Confalonieri, R.; Ser, J.D.; Guidotti, R.; Hayashi, Y.; Herrera, F.; Holzinger, A.; et al. Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions. Inf. Fusion 2024, 106, 102301. [Google Scholar] [CrossRef]
- Scholl, I.F.; Habbal, S.R. Automatic Detection and Classification of Coronal Holes and Filaments Based on EUV and Magnetogram Observations of the Solar Disk. Sol. Phys. 2008, 248, 425–439. [Google Scholar] [CrossRef]
- Zharkova, V.V.; Schetinin, V. A Recognition of Filaments in Solar Images with an Artificial Neural Network. In Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium, 23–25 April 2003; pp. 521–526. [Google Scholar]
- Qahwaji, R.; Colak, T. Hybrid Imaging and Neural Networks Techniques for Processing Solar Images. Int. J. Comput. Their Appl. 2006, 13, 9–16. [Google Scholar]
- Aboudarham, J.; Scholl, I.; Fuller, N.; Fouesneau, M.; Galametz, M.; Gonon, F.; Maire, A.; Leroy, Y. Automation of Meudon Synoptic Maps. In Proceedings of the the Physics of Chromospheric Plasmas; Astronomical Society of the Pacific Conference Series; Heinzel, P., Dorotovič, I., Rutten, R.J., Eds.; Astronomical Society of the Pacific: San Francisco, CA, USA, 2007; Volume 368, p. 505. [Google Scholar]
- Atoum, I.A.; Qahwaji, R.S.; Colak, T.; Ahmed, Z.H. Adaptive Thresholding Technique for Solar Filament Segmentation. Ubiquitous Comput. Commun. J. 2009, 4, 91–95. [Google Scholar]
- Riegler, G.; Pock, T.; Pötzi, W.; Veronig, A.M. Filament and Flare Detection in Hα Image Sequences. arXiv 2013, arXiv:1304.7132. [Google Scholar] [CrossRef]
- Wu, Y.N.; Liu, D.; Liu, X.C. Solar Filament Segmentation Based on AA-UNet. In Proceedings of the 2022 International Conference on Automation, Robotics and Computer Engineering (ICARCE); IEEE: Piscataway, NJ, USA, 2022; pp. 1–5. [Google Scholar] [CrossRef]
- You, J.; Shang, Z. Solar Filament Detection Based on Improved DeepLab V3+. Publ. Astron. Soc. Pac. 2022, 134, 64501. [Google Scholar] [CrossRef]
- Bandyopadhyay, S.; Pant, V. Solar Filaments Detection Using Active Contours without Edges. In Proceedings of the 6th URSI Regional Conference on Radio Science—RCRS 2024, Bhimtal, India, 22–25 October 2024. [Google Scholar] [CrossRef]


| Period | Key Developments and Representative Works |
|---|---|
| 1990s–2002 | |
| 2003–2010 | |
| 2011–Present |
| Characteristic | Traditional Image Processing | Classical Machine Learning | Deep Learning |
|---|---|---|---|
| Typical Accuracy | 72–96% | 82–95% | 90–96% |
| Processing Speed | 1–60 s/image | 1–3 s/image | 0.4–3 s/image |
| Training Requirements | None | Moderate | Substantial |
| Data Dependency | Low | Medium | High |
| Robustness to Noise | Low-Medium | Medium | High |
| Interpretability | High | Medium | Low (Improving via Attention maps/XAI) |
| Adaptability | Low | Medium | High |
| Challenge Area | Key Challenges | Recent Advances and Solutions |
|---|---|---|
| Cross-Instrument Generalization |
|
|
| Real-Time Processing |
| |
| Space Weather Integration |
| |
| Data Quality Variability |
| |
| Operational Deployment |
|
|
| Research Area | Key Objectives & Critical Insights | Priority |
|---|---|---|
| Standardized Data & Benchmarks | Critical Insight: Address dataset bias and evaluation metric limitations; shift from single-instrument optimization to cross-domain generalization
| High |
| Trustworthy & Physics-Informed AI | Critical Insight: Bridge data-driven optimization with physical understanding; develop systems that are both resource-efficient for spaceborne deployment and scientifically trustworthy through physical grounding
| High |
| Generalized & Adaptive Detection | Critical Insight: Move beyond one-size-fits-all approaches; enable robust performance across diverse observational conditions
| High |
| Multi-Modal Data Fusion | Critical Insight: Leverage complementary physical information across wavelengths; enhance detection reliability and physical understanding
| Medium |
| Advanced Tracking & Eruption Prediction | Critical Insight: Move beyond static detection to temporal understanding; enable reliable identification of pre-eruptive signatures and lifecycle evolution
| High |
| Operational Forecasting Integration | Critical Insight: Translate detection advances into actionable space weather forecasts; connect research outputs directly to operational decision-making pipelines
| High |
| Physical Parameter Extraction | Critical Insight: Transform detection from segmentation task to quantitative physical analysis; enable direct scientific insights
| High |
| Historical Data Analysis | Critical Insight: Extend temporal coverage for long-term studies; leverage century-scale datasets for solar cycle analysis
| Medium |
| Foundation Models & Cross-Disciplinary Applications | Critical Insight:
Leverage large-scale pre-trained models and multi-modal learning to overcome data scarcity; extend solar-validated methodologies to stellar observations
| Medium |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Hu, Y.; Liu, Y.; Li, H.-T.; Elmhamdi, A.; Zhu, G.; Sha, F.; Liu, Q.; Baltyuor, S.; Tang, D.; Song, T.; et al. On Solar Filament Detection Techniques: From Manual to Intelligent. Universe 2026, 12, 173. https://doi.org/10.3390/universe12060173
Hu Y, Liu Y, Li H-T, Elmhamdi A, Zhu G, Sha F, Liu Q, Baltyuor S, Tang D, Song T, et al. On Solar Filament Detection Techniques: From Manual to Intelligent. Universe. 2026; 12(6):173. https://doi.org/10.3390/universe12060173
Chicago/Turabian StyleHu, Yang, Yu Liu, Hai-Tang Li, Abouazza Elmhamdi, Gaofei Zhu, Feiyang Sha, Qiang Liu, Saleh Baltyuor, Delin Tang, Tengfei Song, and et al. 2026. "On Solar Filament Detection Techniques: From Manual to Intelligent" Universe 12, no. 6: 173. https://doi.org/10.3390/universe12060173
APA StyleHu, Y., Liu, Y., Li, H.-T., Elmhamdi, A., Zhu, G., Sha, F., Liu, Q., Baltyuor, S., Tang, D., Song, T., Zhang, H., Zhou, Q., Wang, X., & Luo, Q. (2026). On Solar Filament Detection Techniques: From Manual to Intelligent. Universe, 12(6), 173. https://doi.org/10.3390/universe12060173

