Abstract
Background/Objectives: In patients with acute ischemic stroke (AIS), the first pass effect (FPE) refers to the complete recanalization of an occluded vessel (TICI = 2C/3) with a single thrombectomy attempt. Achieving complete vessel recanalization is associated with better functional outcomes compared to lower reperfusion rates (TICI < 2B). There is no consensus on which thrombectomy technique provides the best recanalization results for AIS patients. Furthermore, there is a paucity of tools available to predict FPE prior to mechanical thrombectomy (MT). The objective of this study is to develop a radiomics model based on brain NCECT to predict which patients are more likely to achieve a FPE with thromboaspiration MT. Methods: The thrombi of 91 patients were semi-automatically segmented on NCECT. A total of 1167 radiomic features (RFs) were extracted for each patient. Some clinical data (age, gender, cardiovascular risk factors, smoking or alcohol abuse, clot density and clot laterality) were also collected. Results: A LASSO regression analysis identified nine RFs with nonzero coefficients. A logistic regression model for FPE prediction was developed with nine RFs and eight clinical variables. A total of six RFs were found to be statistically associated with FPE. The clinical variables did not demonstrate a statistically significant association with the likelihood of achieving FPE (p > 0.05). The prediction of which patients are likely to achieve FPE obtained an AUC, accuracy, sensitivity and specificity of 0.890, 0.813, 0.815 and 0.811, respectively (p < 0.05). Conclusions: Radiomics can help identify patients who are more likely to achieve FPE with thromboaspiration.
1. Introduction
Recanalization of the occluded vessel in acute ischemic stroke (AIS) patients after a mechanical thrombectomy (MT) is measured with the TICI (Thrombolysis In Cerebral Infarction) scale [1]. Classically, successful repermeabilization was defined as a thrombectomy resulting in a TICI ≥ 2B [2]. However, it has been shown that patients who achieve a recanalization TICI 2C or 3 have better clinical outcomes 3 months after thrombectomy than patients who achieve TICI 2B [3]. In patients undergoing mechanical thrombectomy, the first pass effect (FPE) is defined as the complete recanalization (TICI ≥ 2C) of an occluded vessel following a single-pass thrombectomy. It has been demonstrated that FPE is associated with improved clinical outcomes and lower mortality rates in patients with AIS [4,5]. Initially, the FPE was described for stent retriever devices. Subsequent studies evaluated the rate of FPE in patients undergoing stent retriever therapy compared to those undergoing thromboaspiration. The results were found to be similar in both groups in randomized trials [6,7]. Furthermore, an association has been observed between the molecular composition of the thrombus and the probability of achieving an FPE with MT [8,9]. Moreover, research has been conducted that demonstrates a correlation between the molecular composition of thrombi and their radiological appearance, as well as the correlation between the radiological appearance and the probability of FPE [10,11,12,13].
In the domain of diagnostic imaging, radiomics has witnessed a surge in interest in recent years. This emerging field involves the use of quantitative analysis techniques to process radiological image data that escapes human visual detection [14]. In its early days, radiomics focused primarily on oncological pathology, but more recently, there have been more publications on radiomic modeling in non-oncological pathology, including in patients with AIS [15,16,17,18]. It has been revealed that radiomic data may vary depending on the molecular composition of the thrombi causing AIS [19]. However, there is a paucity of studies on the prediction of successful repermeabilization in patients undergoing MT using radiomic data from radiological images [20,21]. No studies have been identified in which the objective is to predict FPE with thromboaspiration based on NCECT-based radiomics.
We propose a retrospective study to identify which patients are most likely to achieve an FPE with thromboaspiration using a radiomic model with features obtained from NCECT. Given the relatively rapid nature of thromboaspiration and its cost-effectiveness compared with stent retrievers in cases where an FPE is achieved [22], we believe that such information may be very important in prethrombectomy planning in patients with AIS.
2. Materials and Methods
2.1. Study Design and Ethical Approval
This retrospective observational study was conducted at the University Hospital of Santiago de Compostela, a public and tertiary-level hospital that serves as a referral center for the treatment of AIS patients, covering a population of 600,000. The study was performed in accordance with the principles of the Declaration of Helsinki of the World Medical Association and approved by the Santiago-Lugo Ethics Committee (code 2023/299).
2.2. Patient Selection
A total of 334 mechanical thrombectomies were performed at this hospital between the years 2021 and 2023. All these patients were admitted to the stroke unit of the same hospital and treated according to national society protocols by trained neurologists and neuroradiologists experienced in cerebrovascular disease. Patients presenting to the emergency department with suspected AIS underwent brain NCECT, CT perfusion and CT angiography of the supra-aortic arteries. For recanalization treatment, interventional neuroradiologists employed mechanical thrombectomy by thromboaspiration as a primary technique. The stent retriever and combined (aspiration and stent retriever) techniques were employed as second-intention techniques. The procedures were conducted by neuroradiologists with expertise in both diagnostic and interventional neuroradiology.
Data were collected retrospectively from patients who underwent mechanical thrombectomy at the University Hospital of Santiago de Compostela between 1 January 2020 and 31 May 2023. The inclusion criteria were as follows: (1) patients aged 18 years old or older; (2) brain NCECT with a slice thickness of 0.625 mm; (3) a visible thrombus on NCECT located in the distal internal carotid artery (ICA) or in the middle cerebral artery (MCA) (M1 or proximal M2 segments); (4) treatment with at least the first thrombectomy attempt performed with thromboaspiration. The exclusion criteria were as follows: (1) thrombus in another intracranial artery or patients with tandem occlusion and (2) patients for whom imaging studies were conducted in an external hospital. Intravenous tissue plasminogen activator (tPA) was administered to patients following brain NCECT, in accordance with the established clinical guidelines.
2.3. Image Acquisition
All patients enrolled in the study underwent a NCECT at our public hospital using two different CT scanners (16 rows of detectors, 120 kV) of the same make and model (Phillips Ingenuity; Amsterdam, the Netherlands) during the diagnosis process of AIS. Patients were randomly assigned to each scanner. The acquisition and reconstruction protocols were identical in both scanners. The images obtained had a slice thickness of 0.625 mm. Although reconstructions with a thickness of 1 mm were available, they were not used for analysis. The window width and center were set at 80 and 40 Hounsfield units (HU), respectively (Figure 1).
Figure 1.
Example of AIS caused by a thromboembolus in the M1 segment of the left middle cerebral artery: (a) Sagittal view; (b) coronal view.
2.4. Segmentation and Feature Extraction
The Digital Imaging and Communications in Medicine (DICOM) files of the brain NCECT were imported into 3D-Slicer version 5.2.2 (free software available at www.slicer.org) [23]. The region of interest (ROI) was defined as the visible thrombus in the ICA and/or proximal MCA (M1 and M2 segments). A 3D-semi-automatic segmentation was performed using the segment editor of 3D-Slicer [24]. The selected segmentation tool is “Level Tracing”, whereby the outline is defined by the movement of the mouse, resulting in pixels that share the same background density value as the mouse’s current background pixel. The subsequent application of the outline to the region of interest is a decision that is made by the radiologist. Segmentation was performed by a radiology resident who had received specialized training. The segmentation was validated by three neuroradiologists with expertise in neurointervention and neuroimaging (Figure 2). The RFs were also extracted in 3D-Slicer using the Radiomics module. For all ROIs, image voxel resampling to a dimension of 1 mm × 1 mm × 1 mm was performed. Smoothing with a Gaussian filter and a fixed gray bin width value of 25 was also performed to normalize the images. Wavelet-based features and kernel sizes of 3, 5 and 7 were also performed [25,26].
Figure 2.
Same patient as in Figure 1. Example of semi-automated segmentation using 3D Slicer software: (a) Sagittal view segmented; (b) 3D reconstruction of thrombus segmentation. The selected segmentation tool is “Level Tracing”.
The RFs extracted were as follows: (1) first-order features (evaluate pixel/voxel distribution); texture features such as (2) gray-level cooccurrence matrix (GLCM), (3) gray-level dependence matrix (GLDM), (4) gray-level run length matrix (GLRLM), (5) gray-level size zone matrix (GLSZM) and (6) neighboring gray-tone difference matrix (NGTDM); (7) shape features (geometric evaluation of segmented area). A total of 106,197 radiomic features were extracted from the 91 patients included in the study, with 1167 features per patient (Figure 3).
Figure 3.
Radiomics workflow: RFs are obtained from visible thrombus in NCECT. Segmentation is semi-automatic. A total of 1167 radiomic features were obtained for each patient, with the most significant ones selected using LASSO regression. Finally, a logistic regression identified six statistically significant RFs for the prediction model. The accuracy, sensitivity, specificity, ROC curve and Cohen’s Kappa index were then calculated.
The segmentation, extraction of RFs, and analysis of the results were performed using a system with an Intel CORE i7 processor (Santa Clara, CA, USA) with 16 GB RAM, 1 TB hard disk and Microsoft Windows 11 operating system (Redmond, Washington, DC, USA).
2.5. Clinical Data
This study also explored the relationship between various clinical variables and the achievement of FPE. The clinical variables analyzed included cardiovascular risk factors such as arterial hypertension, diabetes mellitus, dyslipidemia and smoking history, along with sex, age and thrombus laterality. In addition, the HU of each thrombus were collected and subjected to analysis.
2.6. Feature Selection and Statistical Analysis
The feature selection and the construction of the predictive model were carried out using Orange Data Mining Toolbox in Python (Ljubljana, Slovenia) and Statistical Package for the Social Sciences (SPSS) version 22.0 (SPSS Inc., Chicago, IL, USA) [27,28]. For the purpose of feature normalization, a Z-score normalization (with a range between 0 and 1) was applied using the tool “Continuize”, which is available in Orange. A LASSO (Least Absolute Shrinkage and Selection Operator) regression was used to select the significant RFs, with a nonzero coefficient. The RFs selected and the clinical variables were analyzed with a logistic regression, with Backward LR used as selection method. A confusion matrix, odds ratios and 95% confidence intervals were obtained. With regard to the confusion matrix, the true positive (TP) is defined as the number of FPE thrombectomies correctly identified as such. The false positive (FP) is defined as the number of non-FPE thrombectomies incorrectly identified as FPE thrombectomies. The true negative (TN) is defined as the number of non-FPE thrombectomies correctly identified as such. Finally, the false negative (FN) is defined as the number of FPE thrombectomies incorrectly identified as non-FPE thrombectomies (Table 1). The accuracy, sensitivity (Se) and specificity (Sp) of the model were calculated, where Se is the model’s ability to correctly classify patients with FPE thrombectomy and Sp is the model’s ability to correctly classify patients with non-FPE thrombectomy.
Table 1.
Representation of a confusion matrix used to visualize the performance of the prediction of FPE. Columns represent the predicted class. The rows represent the true class.
The performance of the model was evaluated using the receiver-operating characteristic (ROC) curve. The Hosmer–Lemeshow goodness-of-fit test was also calculated. Cohen’s Kappa coefficient (%) has also been calculated, which is defined for classification problems with two categories—in our case, FPE and non-FPE thrombectomies—as follows:
where and . The Kappa index is a measure that adjusts for the effect of chance and is considered a more robust index than accuracy or AUC [29].
Finally, the Radiomic Quality Score (RQS) was calculated to measure the methodology compared with other radiomics studies. RQS consists of 36 checkpoints that assess radiomic studies to promote best scientific practice [30]. The score in our study was 17 (47.22%) (Appendix A). This present study was also elaborated by the CLEAR guidelines (CheckList for EvaluAtion of Radiomics research) (Supplementary Materials Table S1) [31].
3. Results
3.1. Patient Information
A total of 279 patients with AIS underwent mechanical thrombectomy between January 2021 and May 2023. In 119 patients, the occlusion was in an artery other than the ICA/MCA, or a tandem occlusion. In 37 patients, the initial attempt at mechanical thrombectomy was conducted using the stent retriever or combined technique. In 32 cases, the precise location of the thrombus could not be determined using NCECT. Finally, 91 patients were included in the study (Figure 4).
Figure 4.
Decision tree for inclusion of patients in the study. From a total of 279 patients, 91 patients were selected after applying the inclusion and exclusion criteria.
Of the patients included, 51 achieved FPE while 40 did not. The cohort consisted of 31 male and 60 female patients. In the FPE group, 36 (70.6%) were female patients, 41 patients (80.4%) had arterial hypertension, 16 (31.4%) had diabetes, 34 (66.7%) had dyslipidemias, five (9.8%) had a history of smoking and 27 (53%) had clots located on the left side. In the non-FPE group, 24 (60%) were female patients, 30 patients (75%) had arterial hypertension, nine (22.5%) had diabetes, 22 (55%) had dyslipidemia, six (15%) had a history of smoking and 22 (55%) had clots located on the left side. The mean age was 77.74 years (standard deviation (SD) 12.13) in the FPE group and 77.70 years (SD 8.66) in the non-FPE group. The mean HU for the FPE group was 58.77 (SD 10.17) compared to 63.38 (SD 26.01) for the non-FPE group (Table 2).
Table 2.
Baseline characteristics of patients included in this study.
3.2. Features Analysis
A total of 1167 RFs were obtained from each patient. The Least Absolute Shrinkage and Selection Operator (LASSO) method (λ = 0.9) selected nine RFs with nonzero coefficients. The RFs selected were one shape feature (maximum 2D diameter for rows), six texture features (GLRLM—gray-level non-uniformity, GLRLM—gray-level non-uniformity normalized, GLRLM—run entropy, GLSZM—zone entropy, GLSZM—size zone non-uniformity normalized, GLDM—large dependence low-gray-level emphasis) and two first-order features (90th percentile, Kurtosis). However, of the non-radiomics variables collected (gender, age, arterial hypertension, diabetes, dyslipidemia, smoking, laterality of clot and HU of clot) that were included in the logistic regression analysis, none were found to be statistically significantly associated with FPE. The association of these variables with FPE was also analyzed on an individual basis. The analysis of dichotomous variables was conducted using the Chi-square test. Continuous variables were analyzed using Student’s t-test. Nevertheless, the data did not demonstrate a statistically significant association between the acquisition of FPE through thromboaspiration and any of the aforementioned factors (p-value > 0.05) (Table 2). The Backward LR selection method of the logistic regression selected 6 RFs that were statistically associated with FPE (p-value < 0.05) for the final model prediction (Table 3).
Table 3.
The LASSO regression identified nine RFs with non-zero coefficients. Logistic regression showed that six of these nine RFs were statistically associated with the likelihood of achieving FPE with thromboaspiration.
3.3. Prediction of FPE
The nine RFs selected via LASSO regression (λ = 0.9), in conjunction with the clinical variables collected, were utilized to execute the logistic regression and thereby categorize the patients into FPE and non-FPE groups. The backward selection model of the logistic regression eliminates the clinical variables and three RFs (GLRM—run entropy, GLRLM—gray-level non-uniformity and GLDM—large-dependence low-gray-level emphasis) (p-value > 0.05). The final prediction model is exclusively predicated on the following radiomic features: 90th percentile, Kurtosis, maximum 2D diameter of rows, GLSZM—size zone non-uniformity normalized, GLSZM—zone Entropy and GLRLM—gray-level non-uniformity normalized (p-value < 0.005). With these six selected RFs, the confusion matrix and ROC curve were obtained, giving an accuracy of 0.813, a Se of 0.815, a Sp of 0.811 and an AUC of 0.890 (p < 0.05) (Table 4) (Figure 5).
Table 4.
Confusion matrix obtained from logistic regression analysis using the six RFs associated with the likelihood of achieving FPE with thromboaspiration.
Figure 5.
The ROC curve was obtained with SPSS using the six RFs selected in the logistic regression. The green line represents an AUC of 0.5. The blue line shows the AUC obtained in the FPE prediction (0.890).
The Kappa coefficient result was 74.90%, indicating a substantial agreement between the prediction model and the actual observations (Table 5). For the Hosmer–Lemeshow goodness-of-fit test, the Chi-square test result was 12.002 with a p-value of 0.151. This means that there is no reason to believe that the predicted results are different from the observed results and the model can be considered acceptable (Table 6).
Table 5.
Interpretation of the Kappa index. The results of our model show substantial agreement.
Table 6.
Hosmer–Lemeshow contingency table.
4. Discussion
The objective of this study was to predict the FPE in patients with MCA/ICA stroke who were undergoing MT by thromboaspiration. This was achieved by utilizing RFs obtained from the semi-automated segmentation of the hyperdense thrombus on the NCECT. The results demonstrate that radiomic data can help to predict FPE in these patients. Six RFs were independent predictors for FPE prediction (p-value < 0.05). The accuracy of FPE prediction is 0.813 when these six RFs are employed. The clinical data obtained and the clot density were not demonstrated to be independent predictors for FPE (p-value > 0.05). The findings of this study suggest that thrombi visible on NCECT contain information associated with the efficiency of thrombus removal by thromboaspiration.
Forecasting the likelihood of achieving FPE through thromboaspiration could be crucial in selecting the most cost-effective method for arterial reperfusion. The effectiveness of different thrombectomy techniques remains a topic of debate. Both thromboaspiration and a stent retriever show similar outcomes in large vessel occlusions [32]. Many hospitals use thromboaspiration as the primary technique, reserving stent retrievers for second-line use when thromboaspiration fails or as a first-line option for distal occlusions in smaller vessels. Few studies have directly compared the cost-effectiveness of these techniques. Although a procedure that begins with thromboaspiration and subsequently requires stent retrieval is generally less cost-effective than starting with a stent retriever, higher cost-effectiveness has been observed when FPE is achieved with a single pass of thromboaspiration compared to using a stent retriever [33].
The relationship between radiomic features and successful permeabilization in AIS patients has been previously investigated. Hofmeister et al. developed a radiomic model to predict TICI > 2b with a single pass of thromboaspiration in a cohort of 47 patients [20]. The model demonstrated an accuracy of 0.851, a sensitivity of 0.50, a specificity of 0.971, a positive predictive value of 0.857 and a negative predictive value of 0.850. A Support Vector Machine (SVM) classifier was employed, and the model was based on 1485 radiomic features (first-order features, GLCM, GLDM, GLRLM, GLSZM, NGTDM and shape features), with nine selected for the final prediction model. Additionally, this study identified a correlation between radiomic features and the number of thrombectomy attempts. Despite the smaller size of their cohort, their findings suggest a correlation between radiomic data and the success of mechanical thrombectomy. In contrast to our study, which aims to predict FPE (TICI ≥ 2c), they defined successful reperfusion as TICI ≥ 2b. Hofmeister et al. [20] employed semi-automated segmentation and a SVM automatic classifier, whereas our study achieved optimal results with the logistic regression analysis. The previously mentioned study reported a radiomic quality score of 17 out of 36 (47.22%), which is equivalent to this present study’s score. Sarioglu et al. [21] conducted another similar study. They developed a prediction model for FPE in 52 patients treated primarily with stent retrievers. Their model achieved an AUC of 0.83 in predicting FPE and demonstrated that clot-based radiomics can aid in estimating the success of mechanical thrombectomy in AIS patients. They performed a manual segmentation of thrombi on non-contrast CT and validated the thrombus location using CT angiography, extracting 88 radiomic features. They identified two RFs as independent predictors of FPE and found that incorporating these features into a model based on ASPECTS and patient sex improved prediction accuracy. The findings of their study also emphasize the significance of RFs in the planning of endovascular procedures. Nevertheless, they attempted to pre-predict FPE with a stent retriever, their sample size was smaller, and the number of features they employed was also smaller than that of the present article. Furthermore, they utilized manual segmentation, which resulted in limitations in terms of the reproducibility of ROI segmentation [21].
Our study has several limitations. First, only patients with visible thrombi on NCECT were included in this study. Although the relationship between thrombus density and the likelihood of achieving FPE has been investigated, no statistically significant association was found [34]. Similarly, an analysis of thrombus density in this present article revealed no significant correlation between mean HU and FPE. For practical integration into clinical settings, it is essential that the impact of these tools on image analysis time be minimized. The segmentation of visible thrombi in NCECT is quick and straightforward, whereas including non-visible thrombi on NCECT can significantly delay analysis when localization is based on angio-CT. Future research should explore the inclusion of non-visible thrombi at NCECT by integrating additional imaging techniques for segmentation. Secondly, this is a retrospective study conducted at a single center, so it does not present an external validation cohort. Despite the fact that this study encompasses patients whose images were obtained using two different CT scanners—both scanners are of the same make and model and utilized the same acquisition and reconstruction protocol—this does not enhance the external validity of the article. In this context, we suggest that multicenter and prospective studies be conducted to broaden the current body of literature. Third, the lack of standardization in the procedures for obtaining and analyzing radiomic data remains a limitation in applying findings to other research groups. Therefore, it is crucial to provide a detailed description of the methodology used and adhere to established standards for radiomic studies, such as the Radiomics Quality Score (RQS) and CLEAR checklist. Finally, with regard to the issue of sample size, while this manuscript includes a greater number of patients than similar published studies [18,19], and while it is a retrospective study, the ideal sample size calculated for a prospective study should be 162 patients (taking into account a population of 279 mechanical thrombectomies performed in the recruitment period, with a confidence interval of 95% and a margin of error of 5%). The inclusion of additional patients was precluded by the relatively brief recruitment period of just sixteen months. Furthermore, the inclusion and exclusion criteria were meticulously designed to exclude patients with some conditions that could impede the successful acquisition of a FPE during mechanical thrombectomy (e.g., patients with tandem occlusion or distal occlusions). In this sense, despite the study’s larger sample size compared to other similar published studies, further increases in the number of patients are necessary to ensure the robustness of the findings.
Currently, the decision to perform mechanical thrombectomy using either aspiration or a stent retriever is guided by the neuroradiologist’s personal preference, the patient’s vascular anatomy and the location of the thrombus but does not usually consider the thrombus composition. Radiomics provides additional insights into the radiological appearance of the thrombus, which is closely related to its composition [35,36]. This study has shown that radiomic data can provide valuable information for predicting FPE with thromboaspiration. By integrating this information, neuroradiologists could better predict the likelihood of success of mechanical thrombectomy and select the most appropriate technique for each case, if targeted studies support these findings. This approach would transform mechanical thrombectomy into a more personalized technique.
5. Conclusions
Our study demonstrates that radiomic features can help predict the achievement of FPE with thromboaspiration, potentially improving procedural planning and allowing for a more tailored approach to mechanical thrombectomy.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm14124027/s1, Table S1: Clear CHECKLIST.
Author Contributions
Conceptualization, J.P.-Á. and A.J.M.M.; methodology, J.P.-Á. and A.J.M.M.; software, J.P.-Á.; validation, M.B.U. and M.S.B.; formal analysis, J.P.-Á.; investigation, J.P.-Á., A.J.M.M. and J.M.F.; resources R.G.-F. and M.S.B.; data curation, J.P.-Á.; writing—original draft preparation, J.P.-Á.; writing—review and editing, A.J.M.M., J.M.F., M.B.U., S.A.R., E.R.C., R.I.R., R.G.-F. and M.S.B.; visualization, J.M.P.; supervision, A.J.M.M., R.G.-F. and M.S.B.; project administration, A.J.M.M. and R.G.-F. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
This study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Santiago-Lugo (protocol code 2023/299; approved 31 May 2023).
Informed Consent Statement
Informed consent was obtained from all subjects involved in this study.
Data Availability Statement
The software utilized for segmentation and feature extraction can be made accessible via https://www.slicer.org/. Patient images and radiomic data are not published for ethical reasons.
Acknowledgments
The authors would like to acknowledge the support of the Spanish Society of Neuroradiology (SENr). In addition, we would like to acknowledge the training provided by Eva Cernadas (Centro Singular de Investigación en Tecnoloxías Intelixentes da USC [CiTIUS], Universidade de Santiago de Compostela; eva.cernadas@usc.es), Manuel Fernández Delgado (Centro Singular de Investigación en Tecnoloxías Intelixentes da USC [CiTIUS], Universidade de Santiago de Compostela; manuel.fernandez.delgado@usc.es) and Víctor González-Castro (Department of Electrical, Systems and Automation Engineering, Universidad de León; victor.gonzalez@unileon.es). The authors would also like to acknowledge the help and advice provided by Antonio López Rueda (University Hospital of Bellvitge).
Conflicts of Interest
The authors declare no conflicts of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| AIS | Acute Ischemic Stroke |
| AUC | Area Under Curve |
| DICOM | Digital Imaging and Communications in Medicine |
| FN | False Negative |
| FP | False Positive |
| FPE | First Pass Effect |
| GLCM | Gray-Level Cooccurrence Matrix |
| GLDM | Gray-Level Dependence Matrix |
| GLRLM | Gray-Level Run Length Matrix |
| GLSZM | Gray-Level Size Zone Matrix |
| HU | Hounsfield Units |
| ICA | Internal Carotid Artery |
| MT | Mechanical Thrombectomy |
| MCA | Middle Cerebral Artery |
| NCECT | Non-Contrast Enhanced Computed Tomography |
| NGTDM | Neighboring Gray-Tone Difference Matrix |
| RF | Radiomics Features |
| ROC | Receiver-Operating Characteristic |
| ROI | Region Of Interest |
| RQS | Radiomics Quality Score |
| SD | Standard Deviation |
| Se | Sensitivity |
| Sp | Specificity |
| SVM | Support Vector Machine |
| TN | True Negative |
| TP | True Positive |
| TICI | Thrombolysis In Cerebral Infarction |
| tPA | Intravenous Tissue Plasminogen Activator |
Appendix A. Radiomics Quality Score (RQS)
Table A1.
Please find below the RQS questionnaire and total score. For full details of the questionnaire, please refer to https://www.radiomics.world/rqs (accessed on 17 March 2025).
Table A1.
Please find below the RQS questionnaire and total score. For full details of the questionnaire, please refer to https://www.radiomics.world/rqs (accessed on 17 March 2025).
| Questions | Answers |
|---|---|
| Image protocol quality | Protocols well documented and public |
| Multiple segmentations | Yes |
| Phantom study | No |
| Imaging at multiple time points | No |
| Feature reduction | Either measure is implemented |
| Multivariable analysis with non-RFs | Yes |
| Detect and discuss biological correlates | Yes |
| Cut-off analyses | No |
| Discrimination statistics | Discrimination statistic and its significance |
| Calibration statistics | Calibration statistic and its significance |
| Prospective study | No |
| Validation | No validation |
| Comparison to “gold standard” | Yes |
| Potential clinical utility | Yes |
| Cost-effectiveness analysis | No |
| Open science and data | The code is open sourced |
| Total Score | 17 (47.22%) |
References
- Higashida, R.T.; Furlan, A.J.; Roberts, H.; Tomsick, T.; Connors, B.; Barr, J.; Dillon, W.; Warach, S.; Broderick, J.; Tilley, B.; et al. Technology Assessment Committee of the American Society of Interventional and Therapeutic Neuroradiology; Technology Assessment Committee of the Society of Interventional Radiology. Trial design and reporting standards for intra-arterial cerebral thrombolysis for acute ischemic stroke. Stroke 2003, 34, e109–e137, Erratum in: Stroke 2003, 34, 2774. [Google Scholar] [CrossRef] [PubMed]
- Fugate, J.E.; Klunder, A.M.; Kallmes, D.F. What is meant by “TICI”? AJNR Am. J. Neuroradiol. 2013, 34, 1792–1797. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Zaidat, O.O.; Castonguay, A.C.; Linfante, I.; Gupta, R.; Martin, C.O.; Holloway, W.E.; Mueller-Kronast, N.; English, J.D.; Dabus, G.; Malisch, T.W.; et al. First Pass Effect: A New Measure for Stroke Thrombectomy Devices. Stroke 2018, 49, 660–666. [Google Scholar] [CrossRef] [PubMed]
- Jang, K.M.; Nam, T.K.; Ko, M.J.; Choi, H.H.; Kwon, J.T.; Park, S.W.; Byun, J.S. Thrombolysis in Cerebral Infarction Grade 2C or 3 Represents a Better Outcome than 2B for Endovascular Thrombectomy in Acute Ischemic Stroke: A Network Meta-Analysis. World Neurosurg. 2020, 136, e419–e439. [Google Scholar] [CrossRef] [PubMed]
- Zheng, H.; Zhai, Y.; Cao, W.; Zhang, Q.; Bai, X.; Gao, J.; Kang, M.; Liu, Y.; Guo, Y.; Lu, G.; et al. First pass effect in patients undergoing endovascular treatment for posterior circulation acute ischemic stroke. J. Stroke Cerebrovasc. Dis. 2024, 33, 107640. [Google Scholar] [CrossRef] [PubMed]
- Ducroux, C.; Piotin, M.; Gory, B.; Labreuche, J.; Blanc, R.; Ben Maacha, M.; Lapergue, B.; Fahed, R.; ASTER Trial investigators. First pass effect with contact aspiration and stent retrievers in the Aspiration versus Stent Retriever (ASTER) trial. J. Neurointerv. Surg. 2020, 12, 386–391. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Hafeez, M.U.; Kan, P.; Srivatsan, A.; Moore, S.; Jafari, M.; DeLaGarza, C.; Hafeez, K.; Nascimento, F.A.; Srinivasan, V.M.; Burkhardt, J.-K.; et al. Comparison of First-Pass Efficacy Among Four Mechanical Thrombectomy Techniques: A Single-Center Experience. World Neurosurg. 2020, 144, e533–e540. [Google Scholar] [CrossRef]
- Delvoye, F.; Di Meglio, L.; Consoli, A.; Nomenjanahary, M.S.; Dupont, S.; Labreuche, J.; Maier, B.; Piotin, M.; Blanc, R.; Escalard, S.; et al. High thrombus platelet content is associated with a lower rate of first pass effect in stroke treated by endovascular therapy. Eur. Stroke J. 2022, 7, 376–383. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Juega, J.; Requena, M.; Piñana, C.; Rodriguez, M.; Camacho, J.; Vidal, M.; Moliné, T.; Serna, G.; Palacio-Garcia, C.; Rubiera, M.; et al. Intracranial thrombus composition is associated with occlusion location and endovascular treatment outcomes: Results from ITACAT multicenter study. J. Neurointerv. Surg. 2024, 17, 525–529. [Google Scholar] [CrossRef] [PubMed]
- Viltužnik, R.; Kaučič, A.; Blinc, A.; Vidmar, J.; Serša, I. Comparing CT and MR Properties of Artificial Thrombi According to Their Composition. Diagnostics 2023, 13, 1802. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Benson, J.C.; Fitzgerald, S.T.; Kadirvel, R.; Johnson, C.; Dai, D.; Karen, D.; Kallmes, D.F.; Brinjikji, W. Clot permeability and histopathology: Is a clot’s perviousness on CT imaging correlated with its histologic composition? J. Neurointerv. Surg. 2020, 12, 38–42. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Fitzgerald, S.T.; Wang, S.; Dai, D.; Douglas, A.; Kadirvel, R.; Gounis, M.J.; Chueh, J.; Puri, A.S.; Layton, K.F.; Thacker, I.C.; et al. Platelet-rich clots as identified by Martius Scarlet Blue staining are isodense on NCCT. J. Neurointerv. Surg. 2019, 11, 1145–1149. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- He, G.; Deng, J.; Lu, H.; Wei, L.; Zhao, Y.; Zhu, Y.; Li, Y. Thrombus enhancement sign on CT angiography is associated with the first pass effect of stent retrievers. J. Neurointerv. Surg. 2023, 15, 146–152. [Google Scholar] [CrossRef] [PubMed]
- Gillies, R.J.; Kinahan, P.E.; Hricak, H. Radiomics: Images Are More than Pictures, They Are Data. Radiology 2016, 278, 563–577. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Yue, X.; Cui, J.; Huang, S.; Liu, W.; Qi, J.; He, K.; Li, T. An interpretable radiomics-based machine learning model for predicting reverse left ventricular remodeling in STEMI patients using late gadolinium enhancement of myocardial scar. Eur. Radiol. 2025. ahead of print. [Google Scholar] [CrossRef] [PubMed]
- Zhan, Y.; Song, F.; Zhang, W.; Gong, T.; Zhao, S.; Lv, F. Prediction of benign and malignant pulmonary nodules using preoperative CT features: Using PNI-GARS as a predictor. Front. Immunol. 2024, 15, 1446511. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Porto-Álvarez, J.; Mosqueira Martínez, A.; Martínez Fernández, J.; Sanmartín López, M.; Blanco Ulla, M.; Vázquez Herrero, F.; Pumar, J.M.; Rodríguez-Yáñez, M.; Minguillón Pereiro, A.M.; Bolón Villaverde, A.; et al. How Can Radiomics Help the Clinical Management of Patients with Acute Ischemic Stroke? Appl. Sci. 2023, 13, 10061. [Google Scholar] [CrossRef]
- Manco, L.; Maffei, N.; Strolin, S.; Vichi, S.; Bottazzi, L.; Strigari, L. Basic of machine learning and deep learning in imaging for medical physicists. Phys. Med. 2021, 83, 194–205. [Google Scholar] [CrossRef] [PubMed]
- Santo, B.A.; Janbeh Sarayi, S.M.M.; McCall, A.D.; Monteiro, A.; Donnelly, B.; Siddiqui, A.H.; Tutino, V.M. Multimodal CT imaging of ischemic stroke thrombi identifies scale-invariant radiomic features that reflect clot biology. J. Neurointerv. Surg. 2023, 15, 1257–1263. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Hofmeister, J.; Bernava, G.; Rosi, A.; Vargas, M.I.; Carrera, E.; Montet, X.; Burgermeister, S.; Poletti, P.A.; Platon, A.; Lovblad, K.O.; et al. Clot-Based Radiomics Predict a Mechanical Thrombectomy Strategy for Successful Recanalization in Acute Ischemic Stroke. Stroke 2020, 51, 2488–2494. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Sarioglu, O.; Sarioglu, F.C.; Capar, A.E.; Sokmez, D.F.; Mete, B.D.; Belet, U. Clot-based radiomics features predict first pass effect in acute ischemic stroke. Interv. Neuroradiol. 2022, 28, 160–168. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Romano, D.; Cioni, S.; Leonini, S.; Gennari, P.; Vallone, I.M.; Zandonella, A.; Puliti, A.; Tassi, R.; Casasco, A.; Martini, G.; et al. Manual thromboaspiration technique as a first approach for endovascular stroke treatment: A single-center experience. Interv. Neuroradiol. 2016, 22, 529–534. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Fedorov, A.; Beichel, R.; Kalpathy-Cramer, J.; Finet, J.; Fillion-Robin, J.C.; Pujol, S.; Bauer, C.; Jennings, D.; Fennessy, F.; Sonka, M.; et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn. Reson. Imaging 2012, 30, 1323–1341. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Pinter, C.; Lasso, A.; Fichtinger, G. Polymorph segmentation representation for medical image computing. Comput. Methods Programs Biomed. 2019, 171, 19–26. [Google Scholar] [CrossRef]
- Mehta, G.M.S.; Jha, A.; Mithun, S.; Panchal, S.; Nath, B.; Nautiyal, A.; Sherkhane, U.K.; Jaiswar, V.; Purandare, N.; Rangarajan, V.; et al. Effect of resampling of voxel size on CT Radiomic features extraction. JNM 2022, 63 (Suppl. S2), 3241. [Google Scholar]
- Shipitko, O.; Grigoryev, A. Gaussian filtering for FPGA based image processing with High-Level Synthesis tools. In Proceedings of the IV International Conference on Information Technology and Nanotechnology, Samara, Russia, 27 April 2018. [Google Scholar]
- Demsar, J.; Curk, T.; Erjavec, A.; Gorup, C.; Hocevar, T.; Milutinovic, M.; Mozina, M.; Polajnar, M.; Toplak, M.; Staric, A.; et al. Orange: Data Mining Toolbox in Python. J. Mach. Learn. Res. 2013, 14, 2349–2353. [Google Scholar]
- IBM Corp. IBM SPSS Statistics for Windows, Version 22.0; IBM Corp: Armonk, NY, USA, 2013. [Google Scholar]
- Casagrande, A.; Fabris, F.; Girometti, R. Beyond kappa: An informational index for diagnostic agreement in dichotomous and multivalue ordered-categorical ratings. Med. Biol. Eng. Comput. 2020, 58, 3089–3099. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Lambin, P.; Leijenaar, R.; Deist, T.; Peerlings, J.; de Jong, E.E.C.; van Timmeren, J.; Sanduleanu, S.; Larue, R.T.H.M.; Even, A.J.G.; Jochems, A.; et al. Radiomics: The bridge between medical imaging and personalized medicine. Nat. Rev. Clin. Oncol. 2017, 14, 749–762. [Google Scholar] [CrossRef]
- Kocak, B.; Baessler, B.; Bakas, S.; Cuocolo, R.; Fedorov, A.; Maier-Hein, L.; Mercaldo, N.; Müller, H.; Orlhac, F.; Pinto Dos Santos, D.; et al. CheckList for EvaluAtion of Radiomics research (CLEAR): A step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII. Insights Imaging 2023, 14, 75. [Google Scholar] [CrossRef]
- Turk, A.S., 3rd; Siddiqui, A.; Fifi, J.T.; De Leacy, R.A.; Fiorella, D.J.; Gu, E.; Levy, E.I.; Snyder, K.V.; Hanel, R.A.; Aghaebrahim, A.; et al. Aspiration thrombectomy versus stent retriever thrombectomy as first-line approach for large vessel occlusion (COMPASS): A multicentre, randomised, open label, blinded outcome, non-inferiority trial. Lancet 2019, 393, 998–1008. [Google Scholar] [CrossRef] [PubMed]
- Malhotra, A.; Boltyenkov, A.; Wu, X.; Matouk, C.C.; Forman, H.P.; Gandhi, D.; Sanelli, P. Endovascular Contact Aspiration versus Stent Retriever for Revascularization in Patients with Acute Ischemic Stroke and Large Vessel Occlusion: A Cost-Minimization Analysis. World Neurosurg. 2020, 139, e23–e31. [Google Scholar] [CrossRef] [PubMed]
- Waqas, M.; Li, W.; Patel, T.R.; Chin, F.; Tutino, V.M.; Dossani, R.H.; Ren, Z.; Guerrero, W.R.; Borlongan, C.V.; Pressman, E.; et al. Clot imaging characteristics predict first pass effect of aspiration-first approach to thrombectomy. Interv. Neuroradiol. 2022, 28, 152–159. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Fujimoto, M.; Salamon, N.; Mayor, F.; Yuki, I.; Takemoto, K.; Vinters, H.V.; Viñuela, F. Characterization of Arterial Thrombus Composition by Magnetic Resonance Imaging in a Swine Stroke Model. Stroke 2013, 44, 1463–1465. [Google Scholar] [CrossRef] [PubMed]
- Cahalane, R.; Boodt, N.; Akyildiz, A.C.; Giezen, J.A.; Mondeel, M.; van der Lugt, A.; Marquering, H.; Gijsen, F. A review on the association of thrombus composition with mechanical and radiological imaging characteristics in acute ischemic stroke. J. Biomech. 2021, 129, 110816. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).