Next Article in Journal
A Genomic BSAseq Approach for the Characterization of QTLs Underlying Resistance to Fusarium oxysporum in Eggplant
Next Article in Special Issue
Optical Monitoring in Neonatal Seizures
Previous Article in Journal
MAGED2 Is Required under Hypoxia for cAMP Signaling by Inhibiting MDM2-Dependent Endocytosis of G-Alpha-S
Previous Article in Special Issue
Cerebral Autoregulation Assessment Using the Near Infrared Spectroscopy ‘NIRS-Only’ High Frequency Methodology in Critically Ill Patients: A Prospective Cross-Sectional Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of Two Software Packages for Perfusion Imaging: Ischemic Core and Penumbra Estimation and Patient Triage in Acute Ischemic Stroke

1
Department of Radiology, Tongji Hospital, School of Medicine, Tongji University, 389 Xincun Rd., Shanghai 200065, China
2
YIWEI Medical Technology Co., Ltd., Room 1001, MAI KE LONG Building, Shenzhen 518000, China
3
The Second Affiliated Hospital of Nanjing Medical University, 121 Jiangjiayuan Rd., Nanjing 210011, China
*
Author to whom correspondence should be addressed.
Cells 2022, 11(16), 2547; https://doi.org/10.3390/cells11162547
Submission received: 16 May 2022 / Revised: 20 July 2022 / Accepted: 12 August 2022 / Published: 16 August 2022
(This article belongs to the Special Issue Brain Injury, Microcirculation and Tissue Perfusion)

Abstract

:
Purpose: Automated postprocessing packages have been developed for managing acute ischemic stroke (AIS). These packages identify ischemic core and penumbra using either computed tomographic perfusion imaging (CTP) data or magnetic resonance imaging (MRI) data. Measurements of abnormal tissues and treatment decisions derived from different vendors can vary. The purpose of this study is to investigate the agreement of volumetric and decision-making outcomes derived from two software packages. Methods: A total of 594 AIS patients (174 underwent CTP and 420 underwent MRI) were included. Imaging data were accordingly postprocessed by two software packages: RAPID and RealNow. Volumetric outputs were compared between packages by performing intraclass correlation coefficient (ICC), Wilcoxon paired test and Bland–Altman analysis. Concordance of selecting patients eligible for mechanical thrombectomy (MT) was assessed based on neuroimaging criteria proposed in DEFUSE3. Results: In the group with CTP data, mean ischemic core volume (ICV)/penumbral volume (PV) was 14.9/81.1 mL via RAPID and 12.6/83.2 mL via RealNow. Meanwhile, in the MRI group, mean ICV/PV were 52.4/68.4 mL and 48.9/61.6 mL via RAPID and RealNow, respectively. Reliability, which was measured by ICC of ICV and PV in CTP and MRI groups, ranged from 0.87 to 0.99. The bias remained small between measurements (CTP ICV: 0.89 mL, CTP PV: −2 mL, MRI ICV: 3.5 mL and MRI PV: 6.8 mL). In comparison with CTP ICV with follow-up DWI, the ICC was 0.92 and 0.94 for RAPID and Realnow, respectively. The bias remained small between CTP ICV and follow-up DWI measurements (Rapid: −4.65 mL, RealNow: −3.65 mL). Wilcoxon paired test showed no significant difference between measurements. The results of patient triage were concordant in 159/174 cases (91%, ICC: 0.90) for CTP and 400/420 cases (95%, ICC: 0.93) for MRI. Conclusion: The CTP ICV derived from RealNow was more accurate than RAPID. The similarity in volumetric measurement between packages did not necessarily relate to equivalent patient triage. In this study, RealNow showed excellent agreement with RAPID in measuring ICV and PV as well as patient triage.

Graphical Abstract

1. Introduction

Computed tomographic perfusion (CTP) as well as MRI techniques of diffusion-weighted imaging (DWI) and perfusion-weighted imaging (PWI) have been used for the management of acute ischemic stroke (AIS) [1,2,3,4]. Software packages that can automatically postprocess perfusion imaging were developed to facilitate radiologists and medical doctors in making timely and precise clinical decisions about AIS treatment [1]. These packages compute perfusion maps including relative cerebral blood volume (rCBV), relative cerebral blood flow (rCBF), mean transit time (MTT) and time to maximum peak (Tmax) [5]. These perfusion maps represent hemodynamic properties, and they are used to determine ischemic core and penumbra regions [6].
The DAWN and DEFUSE3 trials have confirmed that mechanical thrombectomy (MT) can improve clinical outcomes for AIS patients selected with either CTP or MRI [7,8]. These trials were based on postprocessing results derived from RAPID (iSchemaView, Menlo Park, CA, USA) to triage patients. Inclusion criteria for MT candidacy were proposed in DEFUSE3 as ischemic core volume (ICV) < 70 mL, mismatch ratio > 1.8 and mismatch volume > 15 mL. In clinical centers relying on software packages other than RAPID, extrapolation of the inclusion criteria needs to be validated [9].
Theoretically, similar measurements of ischemic core and penumbra show equivalent performance among packages [10]. However, different biases (i.e., either overestimation or underestimation) in volumes of ischemic core and penumbra can act associatively and affect patient triage differently [11]. For instance, a patient with a slightly underestimated penumbra and an overestimated ischemic core is likely to be excluded from MT improperly because of a misleading mismatch profile [12]. Prior studies evaluated the differences in measurements among packages, but the impact of volumetric differences on making medical decisions was not addressed at the patient level.
This study aimed to assess the differences between two packages: RAPID and RealNow (Dr. Brain, China), in terms of volumetric estimation and patient stratification based on CTP and MRI data. Similar to RAPID, RealNow is an automated postprocessing package for perfusion imaging, and it has been applied in some clinical centers with no access to RAPID.

2. Materials and Methods

2.1. Study Design and Patients

This was a multicenter and retrospective study. We reviewed AIS patients admitted to the First Affiliated Hospital of Nanjing Medical University, the Second Affiliated Hospital of Nanjing Medical University and Tongji Hospital of Tongji University between December 2015 and July 2021. We retrieved clinical and radiological data, including patient gender, age, site of vascular occlusion, CTP, or MR images. We included patients who met the following criteria: (1) CTP or MRI should be caught on arrival at the stroke center within 6–24 h from symptoms onset, (2) age ≥ 18 years and (3) AIS caused by intracranial large artery occlusion. We excluded cases that (1) had poor scan quality, (2) did not follow the acquisition protocol recommended by software packages and (3) failed in the automated postprocessing method. The study was approved by the Ethics Committee of Tongji Hospital (approval number: K-2020-021). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

2.2. Image Acquisition and Postprocessing

CTP data were acquired on either Siemens or Toshiba CT scanner, while MRI data were acquired on Philips MR scanner. The scan protocols are summarized in Supplementary Tables S1 and S2.
Imaging data were processed using CT or MR postprocessing modules provided by two fully automated software packages: RAPID (referred to as package A) and RealNow (referred to as package B). The main postprocessing steps for CTP and MRI data were illustrated in Figure 1. Details of the algorithms were identical to the vendors, but the necessary steps were consistent. For CTP postprocess, both the ischemic core and the penumbra were determined using a time-series data set; for MRI postprocess, the ischemic core was determined using DWI, and the penumbra was determined using PWI. Shortly, imaging data were preprocessed for motion correction, smoothing and skull-stripping, after which an arterial input function (AIF) that reflected the contrast agent concentration versus time was determined. Then, perfusion parameters were computed using deconvolution algorithms. Both packages calculated perfusion parameters including Tmax, rCBV, rCBF and MTT with definitions as follows:
rCBV = 100 k A V ρ 1 H S V 1 H L V c t ( t ) d t c a ( t ) d t ,   [ mL / 100   g ]
rCBF = 100 60 k A V ρ [ m a x ( r ( t ) ) ] ,   [ mL / 100   g / min ]
MTT = 60 CBV CBF ,   [ s ]
T max = a r g m a x [ r ( t ) ] ,   [ s ]
where c t ( t ) is perfusion image signal, c a ( t ) is arterial inflow function, r ( t ) is tissue property, ρ is density of brain and H S V , H L V and k A V are scaling factors.
More details about stages of RealNow software processing were introduced in Supplementary Material (Introduction S1).
Package A is FDA approved for clinical use. It identified abnormal tissues with thresholds: ischemic core with a threshold as rCBF less than 30% for CTP or apparent diffusion coefficient (ADC) less than 620 × 10−6 mm2/s for MRI and penumbra with a threshold as Tmax greater than 6 s. These thresholds were chosen based on previous published receiver–operator-curve (ROC) analyses as the one that maximized the accuracy of lesion identification. However, these previous validated thresholds may not apply in the setting of early and complete reperfusion [13].
The default thresholds for identifying abnormalities in package B were the same as those adopted in package A. Additionally, package B provides a user interface online that allows the thresholds for rCBF, ADC and Tmax to be self-defined, and thereby radiologists can evaluate perfusion abnormalities dynamically (Figure 2) and define lesion areas accurately with optimal thresholds chosen specifically under different circumstances for a heterogeneous population of AIS patients. To compare package A and B, we selected the default thresholds for ischemic core and penumbra estimation.
In order to validate the accuracy of CTP ischemic core volume (ICV), this study included 24 h follow-up DWI with manual lesion labeling as ground truth. AIS lesions with high signal on DWI should be referenced to the corresponding areas on the apparent diffusion coefficient maps to avoid selecting regions of T2 shine through. The perceived boundary of AIS lesions on DWI were manually delineated by one 8-year-experienced neuroradiologist using the open-source software ITK-Snap (version 3.8.0) (http://www.itksnap.org) (accessed on 28 June 2022). The volume of AIS lesions on DWI was calculated from each labeling slice.

2.3. Data Analysis

Statistical analysis was performed with MedCalc 20.019 (MedCalc software, Ostend, Belgium). Continuous variables were reported using mean (standard deviation, SD) and median (interquartile range, IQR); discrete variables were reported using counts (percentages).
The volumes of ischemic core and penumbra obtained from packages were compared. We performed the Wilcoxon test with a p-value of <0.05 as statistically significant. The Bland–Altman analysis and intraclass correlation coefficients (ICC) were employed to evaluate the agreement between package A and B as well as agreement between both packages and follow-up DWI. ICC were interpreted as proposed: <0.50 (poor), 0.50–0.75 (moderate), 0.75–0.90 (good) and >0.90 (excellent).
Neuroimaging eligibility criteria included in DEFUSE3 were applied for individual patient triage to determine the concordance of treatment decisions based on two packages. Specifically, mismatched profiles, including mismatch volume (i.e., the difference in volumes between penumbra and ischemic core) and mismatch ratio (i.e., the ratio of penumbra and ischemic core), were calculated accordingly using volumetric results. Then, the eligibility of MT for individual AIS patients was assessed derived from each package, and the agreement of patient triage was measured by ICC. To differentiate the factor being either overwhelmed ICV or malignant mismatch profiles that caused the disagreement, patients were divided into subgroups according to package A-based ICV with a threshold of 70 mL. In addition, because the mismatch profiles were used as criteria to triage patients and the differences in mismatch values were not the focus of this study, we did not compare the computing results.

3. Results

3.1. Patient Characteristics

The clinical characteristics of patients recruited in this study were summarized in Table 1. CTP taken by 174 patients (mean age: 65 years) and MRI taken by 420 patients (mean age: 64 years) were used.

3.2. Comparison of Measurements between Packages

Comparison of ischemic core volume (ICV) and penumbra volume (PV) in CTP group with ICV > 70 mL and ICV < 70 mL between two packages is shown in Figure 3 and Figure 4, respectively. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in MRI group with ICV > 70 mL and ICV < 70 mL between two packages is shown in Figure 5 and Figure 6, respectively.
The mean (SD) and median values (IQR) for ICV and PV are summarized in Table 2. In CTP scans, mean ICVs were 14.9 (36.0) mL and 14.0 (28.3) mL; mean PVs were 81.1 (95.7) mL and 83.2 (91.4) mL for package A and B, respectively. The Wilcoxon test revealed no significant difference in ICV (p = 0.264) and PV (p = 0.354) measurements. As to the 420 MRI scans, mean ICVs were 52.4 (69.5) mL and 48.9 (69.1) mL; mean PVs were 68.4 (77.3) mL and 61.6 (72.6) mL for package A and B, respectively, and the measurements did not differ significantly (ICV: p = 0.463 and PV: p = 0.178).
As shown in Table 3, volumetric results derived from the two packages showed strong agreement regardless of imaging modality. In the CTP group, the mean differences were 0.89 (12.7) and −2.0 (13.0) mL for ICV and PV, respectively; in the MRI group, the mean differences were 3.5 (4.1) and 10.8 (46.9) mL for ICV and PV, respectively. Package B showed excellent agreement with package A in estimating ICV in both CTP and MRI groups with ICCs above 0.95. Good agreement was found in PV measurement in the MRI group with a slightly lower ICC of 0.87.
The Bland–Altman analysis showed the measuring difference in relation to the volume. As shown in Figure 7 and Figure 8, in the CTP group, positive bias was found in ICV measurement. The bias seemed to be mainly driven by measurements with a mean volume above 70 mL, leading to an underestimated result for large ischemic core by package B. PV measurement, however, showed a negative bias, and this was possibly attributed to the overestimation by package B for objects with size below 100 mL. In the MRI group, both ICV and PV showed positive biases between the two packages. This might be caused by the underestimation by package B at a volume greater than 50 mL, indicating a better agreement between packages in measuring small objects.
In order to validate the accuracy of CTP ICV, this study included follow-up DWI with manual lesion labeling as ground truth of ischemic core to compare the CTP performance of package A against package B. Among the 174 AIS patients with CTP scanning, 53 patients had follow-up DWI. This study calculated the volume of labeled AIS lesions and compared the CTP ICV derived from package A and B with the follow-up DWI lesion volume. As shown in Table 4, volumetric results derived from the two packages showed strong agreement with follow-up DWI. The mean differences were −4.65 (16.3) mL and −3.65 (16.3) mL for package A and B, respectively. Both packages showed excellent volumetric agreement with follow-up DWI in estimating CTP ICV. The ICC of package A was 0.92, while the ICC of package B was 0.94. The CTP ICV derived from package B was more accurate than package A in comparison with the follow-up DWI lesion volume.
The Bland–Altman analysis showed the measuring difference in relation to the volume. As shown in Figure 9 and Figure 10, negative bias was found in CTP ICV measurement for both packages. The bias seemed to be mainly driven by measurements with a mean volume below 10 mL, leading to an underestimated result for small ischemic core. In 12 AIS cases, CTP ICV and follow-up DWI lesion volume were below 3 mL. In eight AIS cases, CTP ICV was below 3 mL while follow-up DWI lesion volume was 3–10 mL. In two AIS cases, follow-up DWI lesion volume was below 3 mL while CTP ICV was 3–10 mL.

3.3. Comparison of Patient Triage

Diagnostic agreement based on DEFUSE3 criteria between packages was analyzed, and the number of patients eligible for MT is listed in Table 5. Of 174 CTP scans, excellent agreement was achieved with ICC of 0.90. Concordance was found in 16/19 (84%) cases in subgroup with package-A-based ICV > 70 mL, and 143/155 case (92%) in the subgroup with ICV < 70 mL. Of 420 MRI scans, excellent agreement was achieved with ICC of 0.93. Concordant results were obtained in 125/130 (96%) in the subgroup with ICV > 70 mL and 275/290 (94%) in the subgroup with ICV < 70 mL. Interestingly, in subgroups with a large ischemic core, eight cases with discrepant treatment decisions from CTP and MRI group had smaller ICV based on package B, qualifying patients for MT, while package A did not qualify. In subgroups with ICV below the threshold of 70 mL, different biases in ICV and PV led to discordance in mismatched profiles, which affected patient selection for MT. Specifically, 15 patients were assumed to be ineligible for MT by package A solely, with 9 of them due to an inadequate mismatch ratio and 4 of them due to inadequate mismatch volume; while 12 patients were excluded from MT by package B with only 8 patients due to a malignant mismatch ratio and 4 patients due to a malignant mismatch volume.

4. Discussion

This study evaluated the agreement between two software packages for both CTP and MR postprocessing modules. Our findings suggested there was a remarkable concordance between the performances of the two packages in terms of estimating ischemic core and penumbra volumes as well as making treatment decisions for AIS patients. Compared with package A, package B classified more patients as candidacies for MT.
Accurate estimation of ICV and PV is of great importance. The under- and overestimation of volumes may have important consequences in clinical practice [10]. With a cutoff ICV of 70 mL being proposed as one of the inclusion criteria in DEFUSE3, overestimating ICV may inaccurately exclude patients from MT, while underestimating ICV may result in poor clinical outcomes due to hemorrhage following endovascular procedures [14]. As for PV estimation, since the volume indicates the amount of potentially salvageable tissue by timely treatment [15], accurate measurement is crucial to finding patients who will respond well to MT [16]. Previous software comparison studies found discrepant volumetric results among different software packages [17,18,19,20]. A software comparison study found that IntelliSpace Portal CT Brain Perfusion (Royal Philips Healthcare, Best, The Netherlands) and syngo.via (Siemens Healthcare, Erlange, Germany) showed increased deviation from Rapid, with ICV increasing from 25 mL to over 70 mL [10]. The discrepancy is related to the differences in postprocessing algorithms such as defining arterial input, motion correction and smoothing [1,21,22]. The results of this study were in line with those of previous studies, where variation in volumetric measurement in relation to the size were described.
Compared with package A, package B underestimated volumes in both groups except CTP penumbra. Previous studies indicated that penumbra was likely to be overestimated in package A [14,23,24,25]. Researchers attributed this to several factors: (1) artificial volumes for the sake of presenting, (2) erroneous Tmax calculations with some cases showing bi-hemispheric penumbra due to the demyelination of bilateral periventricular white matter, which indicated myelin sheath injury mediated by cerebral small vessel diseases [26], and (3) altered arterial input function attributed to quantum noise during imaging acquisition. Given these facts, the underestimation of PV in package B seems preferable. Moreover, cases with inappropriate bi-hemispheric penumbra were fewer in results derived from package B. Additional restrictions may be applied in the postprocessing algorithm in package B to avoid unreasonable outcomes.
For the purpose of validating the accuracy of CTP ICV, 24 h follow-up DWI was included and labeled as ground truth. DWI is a useful method to detect diffusivity capacity of water molecule with high sensitivity, especially for AIS, with cytotoxic edema showing a high signal on DWI. The DWI-restricted lesions were once regarded as representation of the damaged ischemic core. However, DWI lesion reversal occurred in some patients with ischemic stroke indicating the alleviation of cytotoxic edema. A systematic review of the published literature on DWI hyperintense tissue outcome reported variable rates of DWI reversal (0–83%), with a mean reversal rate of 24% in patients with ischemic stroke [27]. In a previous study, DWI reversal was associated with small infarct volume in patients with TIA (Transient Ischemic Attacks) and minor stroke [28]. In our study, two minor AIS cases with CTP ICV 3–10 mL and follow-up DWI lesion volume below 3 mL may indicate DWI reversal caused by timely reperfusion of ischemic region occurred in these AIS cases. Eight AIS cases with CTP ICV below 3 mL and follow-up DWI lesion volume 3–10 mL may be attributed to the small amount of cytotoxic edema existing around acute infarct, which was not sensitive for CT to detect tiny HU changes caused by cytotoxic edema. Twelve AIS cases with CTP ICV and follow-up DWI lesion volume below 3 mL may be attributed to good collateral circulation around the infarct. Furthermore, since there is no independent imaging approach for verifying penumbra measurement [29], the reference standard is lacking for assessing which package is more accurate.
As comparing differences in volume independently cannot explain the impact of these changes in a clinical setting, we moved forward to assess the agreement between packages in patient selection for MT. It is verified that treatment selections could vary at the individual level despite similar volumetric results between packages. Simultaneously, patient triage may rarely be affected even though volumetric estimations were of apparent discordance [23]. For instance, one patient will be excluded from MT based on the result of package A (ICV/PV: 74/164 mL), but the result measured by package B (ICV/PV: 67/148 mL) will lead the other way. Inappropriate patient stratification is likely to increase the risk of undesirable clinical outcomes [30]. When evaluating the performance of these software packages, the accuracy of triaging AIS patients based on neuroimaging inclusion criteria needs to be considered.
This study has several limitations. First, a small sample size for CTP limited the power to detect differences between software packages. Only a small number of cases had package-A-based ICV larger than 70 mL (n = 19), limiting the power to accurately test the consistency of patient triage between packages. Second, CTP data acquired in this study were obtained from two different scanner platforms, and MR data were from only one scanner platform. Data from various scanner brands are preferred to satisfy data heterogeneity. Furthermore, one exclusion criterion for imaging data relied on the success of postprocessing in package A, and some CTP cases were excluded because of the processing errors. These failures in package A can be attributed to poor image quality or the way of managing time-series data. With this restriction, data variability was affected, and the postprocessing results of abnormal cases were not considered in this study. Another limitation is the lack of enough cases of large ischemic core shown on 24 h follow-up MRI performed after CTP examination. DWI data are reliable for identifying ischemic core [31,32], and follow-up DWI that were acquired within the recommended time window have been applied in prior studies for determining the accuracy of volumetric and spatial estimation of ischemic core on CTP [10,33]. However, 24 h follow-up MRI was not available for some severe AIS patients in this study because of the postponement and contraindications of follow-up MR examinations. Additionally, 24 h follow-up MRI was not a clinical routine for AIS patients who had accepted DWI-PWI examination. Last, the final ischemic core was no longer comparable due to the possible penumbra evolution [34]. Considering that RAPID-based results have been validated in previous studies [11,35,36,37,38], using results derived from RAPID as reference remains clinically relevant.

5. Conclusions

RealNow has similar volumetric measurements as RAPID for CTP and MRI postpossessing modules. A high degree of concordance between the two packages was achieved in terms of making treatment decisions for AIS patients. Our study suggested that RAPID and RealNow can be used interchangeably. As for CTP ICV, RealNow was validated to be more accurate than RAPID by 24 h follow-up DWI. Since we did not validate DWI and PWI for each method separately, we refrain from concluding which package is more accurate in MRI. Additional research is required to validate the accuracy of volumetric measurements and patient triage.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cells11162547/s1, Table S1: Scan protocols of CTP; Table S2: Scan protocols of MRI; Introduction S1: Stages of RealNow software processing; References [39,40,41] cited in supplementary document.

Author Contributions

X.Z., Y.N. and H.X. made substantial contributions to the design of the work. J.J. accomplished the acquisition of data. X.Z., Y.N., J.Z. and H.X. accomplished the statistical analysis, interpretation of the data and drafted the manuscript. S.W. revised it for important intellectual content. All authors have read and agreed to the published version of the manuscript.

Funding

This study was partially supported by the Science and Technology Commission of Shanghai Municipality (grant No. 19411951400); the Clinical Research Plan of SHDC (grant No. SHDC2020CR1038B); National Natural Science Foundation of China (Grant Nos. 81830059, 82102023).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board: Ethics Committee of Tongji Hospital (approval number: K-2020-021; date of approval: 20 November 2020).

Informed Consent Statement

Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Data Availability Statement

Data may be made available from the corresponding authors upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mokli, Y.; Pfaff, J.; dos Santos, D.P.; Herweh, C.; Nagel, S. Computer-Aided Imaging Analysis in Acute Ischemic Stroke—Background and Clinical Applications. Neurol. Res. Pract. 2019, 1, 23. [Google Scholar] [CrossRef]
  2. Powers, W.J.; Rabinstein, A.A.; Ackerson, T.; Adeoye, O.M.; Bambakidis, N.C.; Becker, K.; Biller, J.; Brown, M.; Demaerschalk, B.M.; Hoh, B.; et al. Guidelines for the Early Management of Patients with Acute Ischemic Stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals from the American Heart Association/American Stroke Association. Stroke 2019, 50, 211. [Google Scholar] [CrossRef]
  3. Christensen, S.; Lansberg, M.G. CT Perfusion in Acute Stroke: Practical Guidance for Implementation in Clinical Practice. J. Cereb. Blood Flow Metab. 2019, 39, 1664–1668. [Google Scholar] [CrossRef]
  4. Copen, W.A.; Schaefer, P.W.; Wu, O. MR Perfusion Imaging in Acute Ischemic Stroke. Neuroimaging Clin. N. Am. 2011, 21, 259–283. [Google Scholar] [CrossRef]
  5. Demeestere, J.; Wouters, A.; Christensen, S.; Lemmens, R.; Lansberg, M.G. Review of Perfusion Imaging in Acute Ischemic Stroke: From Time to Tissue. Stroke 2020, 51, 1017–1024. [Google Scholar] [CrossRef]
  6. Liu, Y.; Karonen, J.O.; Vanninen, R.L.; Østergaard, L.; Roivainen, R.; Nuutinen, J.; Perkio, J.; Könönen, M.; Hämäläinen, A.; Vanninen, E.J.; et al. Cerebral Hemodynamics in Human Acute Ischemic Stroke: A Study with Diffusion- and Perfusion-Weighted Magnetic Resonance Imaging and SPECT. J. Cereb. Blood Flow Metab. 2000, 20, 910–920. [Google Scholar] [CrossRef]
  7. Lindsay, E. Thrombectomy 6 to 24 Hours after Stroke with a Mismatch between Deficit and Infarct. J. Emerg. Med. 2018, 54, 583–584. [Google Scholar] [CrossRef]
  8. Albers, G.W.; Marks, M.P.; Kemp, S.; Christensen, S.; Tsai, J.P.; Ortega-Gutierrez, S.; McTaggart, R.A.; Torbey, M.T.; Kim-Tenser, M.; Leslie-Mazwi, T.; et al. Thrombectomy for Stroke at 6 to 16 Hours with Selection by Perfusion Imaging. N. Engl. J. Med. 2018, 378, 708–718. [Google Scholar] [CrossRef] [PubMed]
  9. Albers, G.W. Use of Imaging to Select Patients for Late Window Endovascular Therapy. Stroke 2018, 49, 2256–2260. [Google Scholar] [CrossRef]
  10. Koopman, M.S.; Berkhemer, O.A.; Geuskens, R.R.E.G.; Emmer, B.J.; van Walderveen, M.A.A.; Jenniskens, S.F.M.; van Zwam, W.H.; van Oostenbrugge, R.J.; van der Lugt, A.; Dippel, D.W.J.; et al. Comparison of Three Commonly Used CT Perfusion Software Packages in Patients with Acute Ischemic Stroke. J. NeuroIntervent. Surg. 2019, 11, 1249–1256. [Google Scholar] [CrossRef] [PubMed]
  11. Austein, F.; Riedel, C.; Kerby, T.; Meyne, J.; Binder, A.; Lindner, T.; Huhndorf, M.; Wodarg, F.; Jansen, O. Comparison of Perfusion CT Software to Predict the Final Infarct Volume after Thrombectomy. Stroke 2016, 47, 2311–2317. [Google Scholar] [CrossRef] [PubMed]
  12. Harston, G.W.J.; Rane, N.; Shaya, G.; Thandeswaran, S.; Cellerini, M.; Sheerin, F.; Kennedy, J. Imaging Biomarkers in Acute Ischemic Stroke Trials: A Systematic Review. AJNR Am. J. Neuroradiol. 2015, 36, 839–843. [Google Scholar] [CrossRef] [PubMed]
  13. Bivard, A.; Kleinig, T.; Miteff, F.; Butcher, K.; Lin, L.; Levi, C.; Parsons, M. Ischemic core thresholds change with time to reperfusion: A case control study. Ann. Neurol. 2017, 82, 995–1003. [Google Scholar] [CrossRef] [PubMed]
  14. Rava, R.A.; Snyder, K.V.; Mokin, M.; Waqas, M.; Allman, A.B.; Senko, J.L.; Podgorsak, A.R.; Shiraz Bhurwani, M.M.; Hoi, Y.; Siddiqui, A.H.; et al. Assessment of a Bayesian Vitrea CT Perfusion Analysis to Predict Final Infarct and Penumbra Volumes in Patients with Acute Ischemic Stroke: A Comparison with RAPID. AJNR Am. J. Neuroradiol. 2020, 41, 206–212. [Google Scholar] [CrossRef]
  15. Ramos-Cabrer, P.; Campos, F.; Sobrino, T.; Castillo, J. Targeting the Ischemic Penumbra. Stroke 2011, 42, S7–S11. [Google Scholar] [CrossRef]
  16. Liu, S.; Levine, S.R.; Winn, H.R. Targeting Ischemic Penumbra: Part I—From Pathophysiology to Therapeutic Strategy. J. Exp. Stroke Transl. Med. 2010, 3, 47–55. [Google Scholar] [CrossRef]
  17. Shi, Z.; Li, J.; Zhao, M.; Zhang, M.; Wang, T.; Chen, L.; Liu, Q.; Wang, H.; Lu, J.; Zhao, X. Baseline Cerebral Ischemic Core Quantified by Different Automatic Software and Its Predictive Value for Clinical Outcome. Front. Neurosci. 2021, 15, 608799. [Google Scholar] [CrossRef]
  18. Kudo, K.; Sasaki, M.; Yamada, K.; Momoshima, S.; Utsunomiya, H.; Shirato, H.; Ogasawara, K. Differences in CT Perfusion Maps Generated by Different Commercial Software: Quantitative Analysis by Using Identical Source Data of Acute Stroke Patients. Radiology 2010, 254, 200–209. [Google Scholar] [CrossRef]
  19. Bathla, G.; Limaye, K.; Policeni, B.; Klotz, E.; Juergens, M.; Derdeyn, C. Achieving Comparable Perfusion Results across Vendors. The next Step in Standardizing Stroke Care: A Technical Report. J. Neurointervent. Surg. 2019, 11, 1257–1260. [Google Scholar] [CrossRef]
  20. Fahmi, F.; Marquering, H.A.; Streekstra, G.J.; Beenen, L.F.M.; Velthuis, B.K.; VanBavel, E.; Majoie, C.B. Differences in CT Perfusion Summary Maps for Patients with Acute Ischemic Stroke Generated by 2 Software Packages. AJNR Am. J. Neuroradiol. 2012, 33, 2074–2080. [Google Scholar] [CrossRef]
  21. Ferreira, R.M.; Lev, M.H.; Goldmakher, G.V.; Kamalian, S.; Schaefer, P.W.; Furie, K.L.; Gonzalez, R.G.; Sanelli, P.C. Arterial Input Function Placement for Accurate CT Perfusion Map Construction in Acute Stroke. AJR Am. J. Roentgenol. 2010, 194, 1330–1336. [Google Scholar] [CrossRef] [PubMed]
  22. Peerlings, D.; Bennink, E.; Dankbaar, J.W.; Velthuis, B.K.; de Jong, H.W.A.M.; Majoie, C.B.; Roos, Y.B.; Duijm, L.E.; Keizer, K.; van der Lugt, A.; et al. Variation in Arterial Input Function in a Large Multicenter Computed Tomography Perfusion Study. Eur. Radiol. 2021, 31, 8317–8325. [Google Scholar] [CrossRef] [PubMed]
  23. Bathla, G.; Ortega-Gutierrez, S.; Klotz, E.; Juergens, M.; Zevallos, C.B.; Ansari, S.; Ward, C.E.; Policeni, B.; Samaniego, E.; Derdeyn, C. Comparing the Outcomes of Two Independent Computed Tomography Perfusion Softwares and Their Impact on Therapeutic Decisions in Acute Ischemic Stroke. J. Neurointervent. Surg. 2020, 12, 1028–1032. [Google Scholar] [CrossRef]
  24. Bulwa, Z.; Dasenbrock, H.; Osteraas, N.; Cherian, L.; Crowley, R.W.; Chen, M. Incidence of Unreliable Automated Computed Tomography Perfusion Maps. J. Stroke Cerebrovasc. Dis. 2019, 28, 104471. [Google Scholar] [CrossRef]
  25. Kauw, F.; Heit, J.J.; Martin, B.W.; van Ommen, F.; Kappelle, L.J.; Velthuis, B.K.; de Jong, H.W.A.M.; Dankbaar, J.W.; Wintermark, M. Computed Tomography Perfusion Data for Acute Ischemic Stroke Evaluation Using Rapid Software: Pitfalls of Automated Postprocessing. J. Comput. Assist. Tomogr. 2020, 44, 75–77. [Google Scholar] [CrossRef]
  26. Markus, H.S.; Lythgoe, D.J.; Ostegaard, L.; O’Sullivan, M.; Williams, S.C.R. Reduced Cerebral Blood Flow in White Matter in Ischaemic Leukoaraiosis Demonstrated Using Quantitative Exogenous Contrast Based Perfusion MRI. J. Neurol. Neurosurg. Psychiatry 2000, 69, 48–53. [Google Scholar] [CrossRef]
  27. Kranz, P.G.; Eastwood, J.D. Does diffusion-weighted imaging represent the ischemic core? An evidence-based systematic review. AJNR. Am. J. Neuroradiol. 2009, 30, 1206–1212. [Google Scholar] [CrossRef]
  28. Asdaghi, N.; Campbell, B.C.; Butcher, K.S.; Coulter, J.I.; Modi, J.; Qazi, A.; Goyal, M.; Demchuk, A.M.; Coutts, S.B. DWI reversal is associated with small infarct volume in patients with TIA and minor stroke. AJNR. Am. J. Neuroradiol. 2014, 35, 660–666. [Google Scholar] [CrossRef]
  29. Ermine, C.M.; Bivard, A.; Parsons, M.W.; Baron, J.-C. The Ischemic Penumbra: From Concept to Reality. Int. J. Stroke 2021, 16, 497–509. [Google Scholar] [CrossRef]
  30. Kaithoju, S. Ischemic Stroke: Risk Stratification, Warfarin Teatment and Outcome Measure. J. Atr. Fibrillation 2015, 8, 1144. [Google Scholar] [CrossRef]
  31. Boldsen, J.K.; Engedal, T.S.; Pedraza, S.; Cho, T.-H.; Thomalla, G.; Nighoghossian, N.; Baron, J.-C.; Fiehler, J.; Østergaard, L.; Mouridsen, K. Better Diffusion Segmentation in Acute Ischemic Stroke through Automatic Tree Learning Anomaly Segmentation. Front. Neuroinformatics 2018, 12, 21. [Google Scholar] [CrossRef]
  32. Yoshimoto, T.; Inoue, M.; Yamagami, H.; Fujita, K.; Tanaka, K.; Ando, D.; Sonoda, K.; Kamogawa, N.; Koga, M.; Ihara, M.; et al. Use of Diffusion-Weighted Imaging-Alberta Stroke Program Early Computed Tomography Score (DWI-ASPECTS) and Ischemic Core Volume to Determine the Malignant Profile in Acute Stroke. J. Am. Heart Assoc. 2019, 8, e012558. [Google Scholar] [CrossRef] [PubMed]
  33. Sakai, Y.; Delman, B.N.; Fifi, J.T.; Tuhrim, S.; Wheelwright, D.; Doshi, A.H.; Mocco, J.; Nael, K. Estimation of Ischemic Core Volume Using Computed Tomographic Perfusion: Bayesian Versus Singular Value Deconvolution Postprocessing. Stroke 2018, 49, 2345–2352. [Google Scholar] [CrossRef] [PubMed]
  34. Wetterling, F.; Chatzikonstantinou, E.; Tritschler, L.; Meairs, S.; Fatar, M.; Schad, L.R.; Ansar, S. Investigating Potentially Salvageable Penumbra Tissue in an in Vivo Model of Transient Ischemic Stroke Using Sodium, Diffusion, and Perfusion Magnetic Resonance Imaging. BMC Neurosci. 2016, 17, 82. [Google Scholar] [CrossRef]
  35. Cereda, C.W.; Christensen, S.; Campbell, B.C.; Mishra, N.K.; Mlynash, M.; Levi, C.; Straka, M.; Wintermark, M.; Bammer, R.; Albers, G.W.; et al. A Benchmarking Tool to Evaluate Computer Tomography Perfusion Infarct Core Predictions against a DWI Standard. J. Cereb. Blood Flow Metab. 2016, 36, 1780–1789. [Google Scholar] [CrossRef]
  36. Mokin, M.; Levy, E.I.; Saver, J.L.; Siddiqui, A.H.; Goyal, M.; Bonafé, A.; Cognard, C.; Jahan, R.; Albers, G.W. Predictive Value of RAPID Assessed Perfusion Thresholds on Final Infarct Volume in SWIFT PRIME (Solitaire with the Intention for Thrombectomy as Primary Endovascular Treatment). Stroke 2017, 48, 932–938. [Google Scholar] [CrossRef]
  37. Hoving, J.W.; Marquering, H.A.; Majoie, C.B.L.M.; Yassi, N.; Sharma, G.; Liebeskind, D.S.; van der Lugt, A.; Roos, Y.B.; van Zwam, W.; van Oostenbrugge, R.J.; et al. Volumetric and Spatial Accuracy of Computed Tomography Perfusion Estimated Ischemic Core Volume in Patients with Acute Ischemic Stroke. Stroke 2018, 49, 2368–2375. [Google Scholar] [CrossRef]
  38. Albers, G.W.; Goyal, M.; Jahan, R.; Bonafe, A.; Diener, H.-C.; Levy, E.I.; Pereira, V.M.; Cognard, C.; Cohen, D.J.; Hacke, W.; et al. Ischemic Core and Hypoperfusion Volumes Predict Infarct Size in SWIFT PRIME: CT Perfusion Volumes. Ann. Neurol. 2016, 79, 76–89. [Google Scholar] [CrossRef]
  39. Pisana, F.; Henzler, T.; Schönberg, S.; Klotz, E.; Schmidt, B.; Kachelrieß, M. Noise reduction and functional maps image quality improvement in dynamic CT perfusion using a new k-means clustering guided bilateral filter (KMGB). Med. Phys. 2017, 44, 3464–3482. [Google Scholar] [CrossRef]
  40. Najm, M.A.; Kuang, H.; Fedorico, A.; Jogiat, U.; Goyal, M.; Hill, M.D.; Demchuk, A.; Menon, B.K.; Qiu, W. Automated brain extraction from head CT and CTA images using convex optimization with shape propagation. Comput. Methods Programs Biomed. 2019, 176, 1–8. [Google Scholar] [CrossRef]
  41. Mouridsen, K.; Christensen, S.; Gyldensted, L.; Ostergaard, L. Automatic selection of arterial input function using cluster analysis. Magn. Reson. Med. 2010, 55, 524–531. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Postprocessing procedure for perfusion imaging.
Figure 1. Postprocessing procedure for perfusion imaging.
Cells 11 02547 g001
Figure 2. Package B provides a user interface online that allows the thresholds for rCBF, ADC and Tmax to be self-defined.
Figure 2. Package B provides a user interface online that allows the thresholds for rCBF, ADC and Tmax to be self-defined.
Cells 11 02547 g002
Figure 3. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in CTP group with ICV > 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Figure 3. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in CTP group with ICV > 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Cells 11 02547 g003
Figure 4. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in CTP group with ICV < 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Figure 4. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in CTP group with ICV < 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Cells 11 02547 g004
Figure 5. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in MRI group with ICV > 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Figure 5. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in MRI group with ICV > 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Cells 11 02547 g005
Figure 6. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in MRI group with ICV < 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Figure 6. Comparison of ischemic core volume (ICV) and penumbra volume (PV) in MRI group with ICV < 70 mL between two packages. Red and fuchsia areas are ischemic core defined by package A and B, respectively. Green areas are penumbra.
Cells 11 02547 g006
Figure 7. Scatter plots of ischemic core (A) and penumbra volumes (B) in CTP group, ischemic core (C) and penumbra volumes (D) in MRI group.
Figure 7. Scatter plots of ischemic core (A) and penumbra volumes (B) in CTP group, ischemic core (C) and penumbra volumes (D) in MRI group.
Cells 11 02547 g007
Figure 8. Bland–Altman plots for volumetric agreement of ischemic core (A) and penumbra volumes (B) in CTP group, ischemic core (C) and penumbra volumes (D) in MRI group. Solid lines represent the mean difference between two packages. Dotted lines represent 95% limits of agreement.
Figure 8. Bland–Altman plots for volumetric agreement of ischemic core (A) and penumbra volumes (B) in CTP group, ischemic core (C) and penumbra volumes (D) in MRI group. Solid lines represent the mean difference between two packages. Dotted lines represent 95% limits of agreement.
Cells 11 02547 g008
Figure 9. Scatter plots of ischemic core volumes estimated with RAPID versus follow-up DWI (A) and RealNow versus follow-up DWI (B).
Figure 9. Scatter plots of ischemic core volumes estimated with RAPID versus follow-up DWI (A) and RealNow versus follow-up DWI (B).
Cells 11 02547 g009
Figure 10. Bland–Altman plots for volumetric agreement of ischemic core estimated with RAPID versus follow-up DWI (A) and RealNow versus follow-up DWI (B). Solid lines represent the mean difference between two packages. Dotted lines represent 95% limits of agreement.
Figure 10. Bland–Altman plots for volumetric agreement of ischemic core estimated with RAPID versus follow-up DWI (A) and RealNow versus follow-up DWI (B). Solid lines represent the mean difference between two packages. Dotted lines represent 95% limits of agreement.
Cells 11 02547 g010
Table 1. Demography of subjects in two groups.
Table 1. Demography of subjects in two groups.
GroupsCTP Group
(n = 174)
MRI Group
(n = 420)
  Age in years (SD)65 (20.6)64 (17.1)
  Gender(M/F)135/39286/134
Occlusion sites, n (%)
  Middle cerebral artery101 (58.0)218 (51.9)
  Posterior cerebral artery17 (9.8)58(13.8)
  Anterior cerebral artery11 (6.3)32 (7.6)
  Internal carotid artery33 (18.9)74 (17.6)
  Basilar artery12 (6.8)38(9.0)
SD, standard deviation.
Table 2. Comparison of ischemic core volume (ICV) and penumbra volume (PV) between two packages.
Table 2. Comparison of ischemic core volume (ICV) and penumbra volume (PV) between two packages.
Package APackage B
CTP groupICV, mLMean (SD)14.9 (36.0)14.0 (28.3)
median [IQR]0.0 [0.0–6.4]2.7 [0.0–13.1]
PV, mLMean (SD)81.1 (95.7)83.2 (91.4)
median [IQR]39.2 [12.0–129.1]43.7 [14.6–128.3]
MRI groupICV, mLMean (SD)52.4 (69.5)48.9 (69.1)
median [IQR]24.0 [12.0–64.0]21 [0.0–59.5]
PV, mLMean (SD)68.4 (77.3)61.6 (72.6)
median [IQR]44.0 [4.0–108.0]38.3 [0.0–99.4]
ICV, ischemic core stroke volume; PV, penumbra volume.
Table 3. Mean difference, limits of agreement (LoA), intraclass correlation coefficient (ICC) and Wilcoxon test between two packages.
Table 3. Mean difference, limits of agreement (LoA), intraclass correlation coefficient (ICC) and Wilcoxon test between two packages.
CTP GroupMRI Group
ICVPVICVPV
Mean difference (SD), mL0.89 (12.7)−2.0 (13.0)3.5 (4.1)6.8 (46.9)
95% Lower LoA (95% CI)−24.1 (−27.4 to −20.9)−27.6 (−30.9 to −24.3)−4.5 (−5.1 to −3.8)−81.2 (−89.6 to −72.8)
95% Upperer LoA (95% CI)25.9 (22.6 to 29.2)23.4 (20.1 to 26.8)11.5 (10.8 to 12.2)102.9 (94.6 to 111.3)
ICC (95% CI)0.95 (0.94 to 0.97)0.99 (0.98 to 0.99)0.99 (0.98 to 0.99)0.87 (0.84 to 0.89)
Wilcoxon test (p value)0.2640.3540.4630.178
Package A as reference; package B as variable; difference: reference—variable.
Table 4. Mean difference, limits of agreement (LoA), intraclass correlation coefficient (ICC) and Wilcoxon test between two packages and follow-up DWI.
Table 4. Mean difference, limits of agreement (LoA), intraclass correlation coefficient (ICC) and Wilcoxon test between two packages and follow-up DWI.
RAPIDRealNow
Mean difference (SD), mL−4.65 (16.3)−3.65 (16.3)
95% Lower LoA (95% CI)−8.14 (−11.2 to −5.05)−7.06 (−9.64 to −4.47)
95% Upperer LoA (95% CI)17.4 (14.4 to 20.5)14.3 (11.8 to 16.9)
ICC (95% CI)0.92 (0.86 to 0.95)0.94 (0.90 to 0.97)
Wilcoxon test (p value)0.1440.253
Follow-up DWI as reference; package A and B as variable; difference: reference—variable.
Table 5. Patient triage for mechanical thrombectomy (MT) conducted by two packages based on imaging eligibility criteria included in DEFUSE3.
Table 5. Patient triage for mechanical thrombectomy (MT) conducted by two packages based on imaging eligibility criteria included in DEFUSE3.
ICCSubgroupPackage APackage B
EligibleNot EligibleEligibleNot Eligible
CTP group0.90ICV > 70 mL163190
ICV < 70 mL145101532
MRI group0.93ICV > 70 mL12551300
ICV < 70 mL285528010
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhou, X.; Nan, Y.; Ju, J.; Zhou, J.; Xiao, H.; Wang, S. Comparison of Two Software Packages for Perfusion Imaging: Ischemic Core and Penumbra Estimation and Patient Triage in Acute Ischemic Stroke. Cells 2022, 11, 2547. https://doi.org/10.3390/cells11162547

AMA Style

Zhou X, Nan Y, Ju J, Zhou J, Xiao H, Wang S. Comparison of Two Software Packages for Perfusion Imaging: Ischemic Core and Penumbra Estimation and Patient Triage in Acute Ischemic Stroke. Cells. 2022; 11(16):2547. https://doi.org/10.3390/cells11162547

Chicago/Turabian Style

Zhou, Xiang, Yashi Nan, Jieyang Ju, Jingyu Zhou, Huanhui Xiao, and Silun Wang. 2022. "Comparison of Two Software Packages for Perfusion Imaging: Ischemic Core and Penumbra Estimation and Patient Triage in Acute Ischemic Stroke" Cells 11, no. 16: 2547. https://doi.org/10.3390/cells11162547

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop