Next Article in Journal
Glaucoma Detection Using Support Vector Machine Method Based on Spectralis OCT
Previous Article in Journal
Pindborg Tumor—An Uncommon Odontogenic Tumor Detected by 68Ga-DOTATOC
Previous Article in Special Issue
The Interplay between Myocardial Fibrosis, Strain Imaging and Collagen Biomarkers in Adults with Repaired Tetralogy of Fallot
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Added Value of Computed Tomography Virtual Intravascular Endoscopy in the Evaluation of Coronary Arteries with Stents or Plaques

1
Department of Medical Imaging and Intervention, Linkou Chang Gung Memorial Hospital, College of Medicine, Chang Gung University, Taoyuan City 333423, Taiwan
2
Department of Public Health and Center of Biostatistics, College of Medicine, Chang Gung University, Taoyuan City 333323, Taiwan
3
Discipline of Medical Radiation Science, Curtin Medical School, Curtin University, Bentley, WA 6102, Australia
4
Professional Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei City 110301, Taiwan
5
Department of Electrical Engineering, National United University, Miaoli 360302, Taiwan
6
Department of Cardiology, Linkou Chang Gung Memorial Hospital, College of Medicine, Chang Gung University, Taoyuan City 333423, Taiwan
*
Author to whom correspondence should be addressed.
Diagnostics 2022, 12(2), 390; https://doi.org/10.3390/diagnostics12020390
Submission received: 24 December 2021 / Revised: 16 January 2022 / Accepted: 31 January 2022 / Published: 3 February 2022
(This article belongs to the Special Issue Advances in Cardiovascular Imaging 2021)

Abstract

:
Coronary computed tomography angiography (CCTA) is a widely used imaging modality for diagnosing coronary artery disease (CAD) but is limited by a high false positive rate when evaluating coronary arteries with stents and heavy calcifications. Virtual intravascular endoscopy (VIE) images generated from CCTA can be used to qualitatively assess the vascular lumen and might be helpful for overcoming this challenge. In this study, one hundred subjects with coronary stents underwent both CCTA and invasive coronary angiography (ICA). A total of 902 vessel segments were analyzed using CCTA and VIE. The vessel segments were first analyzed on CCTA alone. Then, using VIE, the segments were classified qualitatively as either negative or positive for in-stent restenosis (ISR) or CAD. These results were compared, using ICA as the reference, to determine the added diagnostic value of VIE. Of the 902 analyzed vessel segments, CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 93.9/90.2, 96.2/98.2, 96.0/97.7, 70.0/83.1, and 99.4/99.0, respectively, in diagnosing ISR or CAD, with significantly improved specificity (p = 0.025), accuracy (p = 0.046), and positive predictive value (p = 0.047). VIE can be a helpful addition to CCTA when evaluating coronary arteries.

1. Introduction

With rapid technological advancements, coronary computed tomography angiography (CCTA) has become an increasingly useful tool in the diagnosis of coronary artery disease (CAD) [1,2,3]. Its improved spatial and temporal resolution is reflected in the high diagnostic accuracy achieved with multi-detector computed tomography (CT) scanners (64-slice and higher). CCTA is now regarded as a reliable modality for diagnosing CAD in patients with low to intermediate risk of CAD; its high specificity and negative predictive value make it a highly useful screening tool, reducing unnecessary invasive procedures [4,5,6,7,8]. However, one of the main limitations of CCTA is that its diagnostic value, especially its specificity and positive predictive value, is relatively low, and is significantly decreased in patients with coronary stents or heavy calcifications (Agatston score > 400) due to blooming artifacts, which result in high false positive rates [9,10,11,12,13].
Meta-analyses of CCTA performed on 64-slice multi-detector CT scanners showed a sensitivity of 86–91% and specificity of 91–93% in diagnosing in-stent restenosis (ISR), while the positive predictive value remained low at 68% [14,15,16]. It has been reported that 320-row CCTA had a specificity of 83–96% and a positive predictive value of 46–74% in diagnosing ISR [17,18]. On patient-based analysis, the specificity of CCTA decreases as the calcium score (CS) increases; the specificity is 92.9% for patients with zero CS, 83.3% when CS is between 11 and 100, and 60% when CS is between 401 and 1000 [9], indicating the negative impact of coronary artery calcifications on the diagnostic performance of CCTA. This presents a challenge for CCTA because the low specificity could lead to invasive procedures that could have been avoided in these patients.
Virtual intravascular endoscopy (VIE), a CCTA-generated 3D visualization tool, is another approach that provides unique intraluminal views of the blood vessels, including endovascular stents or stent grafts [19,20,21,22,23,24,25,26,27,28], thus having potential to overcome the limitations of CCTA. To our knowledge, there are very few reports investigating the application of virtual intravascular endoscopy (VIE) in assessing coronary arteries [25,26,27,28]. Only one study has compared the diagnostic performance of VIE with that of CCTA, via an investigation of 61 patients with calcified coronary plaques [26]. Another article has described using VIE to assess coronary arteries with stents, but the case number is limited to only 13 patients [27].
The purpose of this study is to investigate the role of VIE in delineating coronary intraluminal changes in the presence of coronary stents and plaques. By performing both CCTA and invasive coronary angiography (ICA) for each patient within 4 days, the added diagnostic value of VIE was compared with that of CCTA alone, using ICA as the gold standard.

2. Materials and Methods

2.1. Study Population

The Institutional Review Board approved this project. For a prior prospective study assessing the diagnostic value of CCTA using a 320-detector CT scanner, 100 patients with previously placed coronary stents were recruited from a single tertiary medical hospital to undergo both CCTA and ICA within a 4-day time interval. Informed consent forms were obtained from all subjects. The exclusion criteria comprised the following: previous history of cardiac bypass surgery; adverse reactions to iodinated contrast media; renal insufficiency with glomerular filtration rates of less than 45 mL/min/1.73 m2; difficulty in cooperating with the aims of the study; hemodynamic instability; and severe tachycardia or arrhythmias. The subjects’ CCTA and ICA images were then used retrospectively for this study.

2.2. CT Techniques for Coronary Calcium Scoring and CCTA

All patients underwent both non-enhanced CT and CCTA on a 320-detector CT scanner (Aquilion ONE, Toshiba Medical Systems, Otawara, Japan) with 320 detector rows, each 0.5 mm wide, and a gantry rotation time of 0.35 s with z-axial coverage of up to 160 mm. Calcium scores were measured on non-enhanced CT images, assessed and recorded on a separate workstation (Vitrea FX, Vital Images, Inc., Minnetonka, MIN, USA). Slice thickness was set at 3 mm for Agatston scoring and 1 mm for CCTA, with the coverage area extending from the pulmonary trunk to the diaphragm. The CT images were obtained based on a standard protocol [18,29,30].
Tube voltage (kV) and current (mA) were selected according to the patients’ BMI. Kernel settings FC03 and FC05 were used. For vascular enhancement, a bolus of contrast medium (Iohexol; Omnipaque 350, GE Healthcare, Cork, Ireland) was administered intravenously, with a volume of 60 to 70 mL at a rate of 5 mL/s through the antecubital vein using a power injector (Mallinckrodt LF OptiVantage DH V8402, Cincinnati, OH, USA), followed by 40 mL of saline chase at a rate of 5 mL/s. CT scanning was started manually when contrast medium reached peak attenuation in the left ventricle.
Before the scan, a β-blocker Inderal (Propranolol Hydrochloride 10 mg/tab, AstraZeneca UK Ltd., Chesire, UK) was administered orally to keep the heart rate below 65 bpm for the one-beat scan. A short-acting cardio-selective β-blocker, Esmolol (Esmolol solution, Esmolol HCL 10 mg/mL, JenYa Biotech Inc. Ltd., Hsing Chu, Taiwan) was administered intravenously if there were any contraindications to Inderal, such as asthma, atrioventricular conduction block, and Raynaud syndrome. For dilatation and optimal visualization of the coronary arteries, 0.6 mg of Nitrostat (Nitroglycerin 0.6 mg/tab, Pfizer Pharmaceuticals LLC, Puerto Rico, USA) was administered sublingually 3–5 min before the scan.

2.3. Invasive Coronary Angiography

All ICA was performed within 4 days after CCTA. All images were recorded at 15 frames/s by a monoplane X-ray angiogram (AXIOM-Artis, Siemens, Forchheim, Germany) at a resolution of 512 × 512 pixels. The ICA studies were performed and analyzed by two experienced cardiologists blinded to the CCTA data. Minimal lumen diameters were quantitatively measured in projections showing the most severe narrowing, using a quantitative analysis software package (Scientific QCA Analysis, Siemens, Forchheim, Germany), as shown in Figure 1. A stenosis of more than 50% was considered to be ISR if the stenosis was located within 0.5 cm of a stented vessel segment [31], or CAD if the stenosis was found in a native vessel.

2.4. Generation of Virtual Intravascular Endoscopy Images

CT volume data converted from original DICOM (digital imaging and communications in medicine) images were transferred to a separate workstation equipped with the software Analyze V 11.0 (AnalyzeDirect, Inc., Overland Park, KS, USA) for image post-processing and generation of 3D VIE images. Post-processing of CT data was performed with a CT number thresholding technique [27,28]. Generation of VIE images of coronary plaques and coronary lumen depends on the selection of an appropriate CT threshold, which was determined by measuring the CT attenuation in the ascending aorta according to previous reports [23,24,25], as illustrated in Figure 1. An upper CT threshold of 150 to 200 HU was applied to remove the contrast-enhanced blood from the coronary artery for optimal demonstration of intraluminal views of coronary walls.

2.5. Analysis and Interpretation of CCTA and VIE Images

The minimal luminal diameters were quantitatively measured on curved planar reformatted CCTA images, in views showing the greatest degree of stenosis in the left anterior descending (LAD), left circumflex (LCX), and right coronary (RCA) arteries. All vessels greater than 1.5 mm in diameter were evaluated [8]. A stenosis of more than 50% was considered to be ISR if the stenosis was located within 0.5 cm of a stented vessel segment, or CAD if the stenosis was found in a native vessel. The presence of calcified, mixed, and non-calcified plaques was recorded.
VIE interpretation was performed jointly by 2 observers (with 6 and 15 years of experience in cardiac CT imaging, respectively) who were blinded to the results of ICA, but not CCTA, because CCTA images are required to generate the VIE images and locate the vessel segments. Thirty patients’ CCTA and ICA images were used to train both observers to construct and interpret VIE images, as well as to determine the inter- and intra-observer variability, before proceeding with the main study. During this training session, the observers learned to choose appropriate CT thresholds in order to generate VIE images of optimal quality, so that the degree of stenosis in each vessel matched their appearance on CCTA images under most circumstances (especially in vessels without extensive artifacts). The LAD, LCX, and RCA were each divided into proximal, middle, and distal segments for VIE analysis. The left main coronary artery, posterior descending artery, and other branches (such as diagonal and obtuse marginal branches) were included only if they had stents or suspected CAD on CCTA. Vessel segments were excluded if they could not be evaluated on VIE due to hypoplasia or a location distal to totally occluded segments.
The VIE images were interpreted qualitatively, categorizing each vessel segment as either negative or positive for CAD or ISR; vessel segments were considered positive if the lumen appeared to be more than 50% obstructed, either by filling defects or circumferential narrowing. If the degree of stenosis was visually equivocal (more or less 50%), the diagnosis of VIE generally followed that of CCTA. The diagnostic value of CCTA alone is compared with that of CCTA-based VIE (which, for simplicity, will be referred to as VIE in the rest of this article), using ICA results as the gold standard.

2.6. Statistical Analysis

All quantitative variables were expressed as mean ± standard deviation and compared by Student’s t-test. Categorical variables were expressed as numbers and percentages and analyzed by Chi-square or Fisher’s Exact test. Sensitivity, specificity, accuracy, positive predictive value, and negative predictive value for original CCTA and VIE images in detecting stenosis in coronary arteries with stents or calcifications were calculated from χ2 tests of contingency. Kappa values were used to assess inter- and intra-observer variability, and to estimate the degree of agreement between CCTA, VIE and ICA in diagnosing coronary stenosis. A p value of less than 0.05 was considered significant for all statistical evaluations.

3. Results

Between November 2010 and July 2012, one hundred patients with coronary stents agreed to undergo both CCTA and ICA examinations. All subjects except one underwent both CCTA and ICA within a one-day interval; one subject underwent ICA four days after CCTA. Of these 100 subjects (mean age 55.3 years, ranging from 35 to 74 years), 91 were males. All patients had at least one coronary stent placed in the main coronary arteries. The average total Agatson’s calcium score was 249.5 (range 0 to 2928).
All vessel segments with either stents or suspected CAD seen on CCTA were analyzed using VIE. In total, 902 vessel segments, including 193 stented vessel segments and 231 plaque segments, including 115 calcified plaque segments, 85 mixed plaque segments, and 31 non-calcified plaque segments, were analyzed. Some examples of CCTA, VIE, and ICA images in corresponding vessel segments are shown in Figure 2, Figure 3 and Figure 4.

3.1. Inter- and Intra-Observer Variability

The intra-observer agreement was weak for both observers (kappa = 0.584 and 0.414, respectively) when comparing the results from the first 30 training cases with the second-round interpretation. Inter-observer agreement was moderate after the training round was completed (kappa = 0.726).

3.2. Diagnostic Performance of CCTA and VIE

Overall, out of a total of 902 analyzed vessel segments (Table 1), 82 (9.1%) segments were proven to have significant ISR or CAD by ICA. CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 93.9/90.2, 96.2/98.2, 96.0/97.7, 70.0/83.1, and 99.4/99.0, respectively, in diagnosing ISR or CAD, with significantly improved specificity (p = 0.025), accuracy (p = 0.046), and positive predictive value (p = 0.047). The kappa value for CCTA agreement with ICA in diagnosing ISR or CAD showed an overall improvement from 0.779 to 0.851 following the addition of VIE interpretation, although this change did not reach statistical significance (p = 0.112).
Of the 193 stented vessel segments, 22 (11.4%) were proven to have ISR by ICA. CCTA had a sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 95.7, 93.5, 93.8, 66.7, and 99.4, respectively, in diagnosing ISR. With VIE, the corresponding values (shown in %) were 87.0, 97.6, 96.9, 83.3, and 98.2, respectively, for diagnosing ISR (Table 2). The specificity, accuracy, and positive predictive value seemed to be slightly improved, although these changes did not reach statistical significance.
Of the 115 vessel segments with calcified plaques, four (3.5%) were proven to have CAD by ICA. For these segments, CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 75.0/50.0, 88.3/95.5, 87.8/93.9, 18.8/28.6, and 99.0/98.1, respectively, in diagnosing CAD (Table 3). The specificity and accuracy seemed to be partially improved, although again this change did not reach statistical significance.
Of the 85 vessel segments with mixed plaques, 34 (40.0%) were proven to have CAD by ICA. For these segments, CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 91.2/91.2, 88.2/92.2, 89.4/91.8, 83.8/88.6, and 93.8/94.0, respectively, in diagnosing CAD (Table 4). There was no significant difference between the diagnostic values of CCTA and VIE in detecting CAD in vessel segments with mixed plaques.
Of the 31 vessel segments with non-calcified plaques, 21 (67.7%) were proven to have CAD by ICA. For these segments, CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 100.0/100.0, 70.0/80.0, 94.3/93.6, 87.5/91.3, and 100.0/100.0, respectively, in diagnosing CAD, without any statistically significant difference (Table 5).
Overall, for the combined 424 vessel segments with stents and plaques, CCTA/VIE had sensitivity, specificity, accuracy, positive predictive value, and negative predictive value (shown in %) of 93.9/90.2, 90.4/95.6, 91.0/94.6, 70.0/83.1, and 98.4/97.6, respectively, in diagnosing CAD (Table 6). The specificity and positive predictive value were significantly improved (p = 0.011 and p = 0.047, respectively).

3.3. Effect of Stents on the Diagnostic Performance of CCTA and VIE

Stent details were available for 190 out of the 193 stented vessel segments, including 144 drug-eluting stents and 46 bare-metal stents. The stents ranged from 1.3 mm to 5 mm in diameter. Smaller stent diameters were significantly associated with ISR in CCTA (p = 0.001), VIE (p < 0.001), and ICA (p < 0.001). Smaller stent diameters also resulted in significantly decreased diagnostic accuracy for both CCTA (p = 0.004) and VIE (p < 0.001), although there was no significant difference in this effect between CCTA and VIE (p = 0.547). Stent types (bare-metal stents or drug-eluting stents) had no significant effect on ICA results (p = 0.822).

4. Discussion

One of the main limitations of CCTA is the decrease in its diagnostic accuracy in the presence of high-absorption materials such as calcifications and stents. The evaluation of stented or calcified vessels presents challenges for CCTA due to the presence of blooming artifacts, which lead to relatively low specificity and positive predictive value [9,10,11,12,13]. VIE generated from CCTA data provides unique intraluminal views that allow qualitative assessment of the arterial lumen. Several other studies have used VIE to evaluate the aorta [19,20,21,22,23,24], but only three studies have used VIE to assess coronary arteries [25,26,27]. Only one study has evaluated the diagnostic value of VIE in assessing coronary stenosis, via an investigation of 61 patients with calcified coronary plaques, and showed a significant improvement in specificity and positive predictive value when compared with CCTA [26]. To our knowledge, the present study is the largest series to have assessed the added value of VIE in coronary artery evaluation—including stented, calcified plaques, mixed plaques and non-calcified plaques—compared with the diagnostic value of CCTA alone, using ICA as the reference method.
The results of our study showed that the use of VIE was able to significantly improve the specificity, accuracy, and positive predictive value of CCTA when evaluating coronary arteries, without sacrificing the already high sensitivity and negative predictive value of CCTA. This appears to be especially promising in vessels with stents and plaques, which were assessed with significantly improved specificity (p = 0.011). Of the 902 vessel segments analyzed in this study, CCTA had 33 false positive results, among which VIE was able to correctly identify 25 (75.8%) as true negative results (Figure 4). These 25 segments comprised 11 stents, eight calcified plaque segments, four soft plaque segments and two mixed plaque segments. The remaining eight segments, which also received false positive results by using VIE, comprised five calcified and three mixed plaque segments.
The increased specificity, accuracy, and positive predictive value of VIE may be attributed to the CT number thresholding technique, which is able to remove both enhanced blood and abnormal blooming artifacts from the VIE images. However, during VIE image interpretation, the threshold often requires manual adjustment to avoid under-deletion of image data, which would result in increased false positive findings, and over-deletion, which can result in the appearance of a “perforated” vessel wall. As mentioned in our Methods section, the threshold for VIE image construction was set between 150 and 200HU. When generating VIE images, we usually begin with a threshold of 200 HU, then gradually adjust to lower thresholds if a vessel that is clearly patent on CCTA appears narrowed on VIE. This is based on the assumption that CCTA has a high negative predictive value, and thus we should adjust the threshold so that the VIE images match the CCTA images in negative vessel segments. On the other hand, when the threshold is too low, the vessel walls get deleted and will appear perforated (this tends to occur in the LCX, as it is very close to the left atrium); in such instances, the threshold needs to be set higher. With some practice, observers can become adequately adept at choosing the appropriate threshold and constructing quality VIE images for interpretation.
In our study, there were seven vessel segments (four stented vessel segments and three native vessel segments with either mixed or non-calcified plaques) that appeared to be ISR or CAD on VIE images, but were diagnosed as only intimal hyperplasia (IH) or mild stenosis on both CCTA and ICA (an example is shown in Figure 5); these segments were either located at the distal edges of stents or in distal or small caliber vessels. Tortuous vessels, long segmental stenoses, and small caliber vessels are all pitfalls during VIE image interpretation. Thus, it may be deduced that VIE may provide more value when evaluating larger and more proximal vessel segments, but becomes less useful when evaluating smaller and more distal vessel segments. It should be emphasized that because VIE images are created using CCTA images, there is no need to interpret VIE images alone, either in a clinical setting or in this study. In cases of difficult vessel segments, CCTA images should be reviewed again to obtain a consensus.
Another limitation of this technique is that the use of appropriate software to generate VIE images has a learning curve, requiring several steps and some decision-making. Thin slice images (0.5 mm axial) are required for optimal VIE image generation. Assessing all of the coronary artery segments in a patient without referring to CCTA images is time-consuming and may require well over an hour per patient. Since CCTA already has a high negative predictive value (97.8% in a previously published meta-analysis [32]), a more practical approach is to evaluate the vessels on CCTA first, and then recheck the suspected lesions using VIE for confirmation, especially in segments with stents and heavy calcifications. In our experience, the time spent on assessing each patient using CCTA and VIE together depends largely on the number of suspected CAD/ISR lesions, image quality, and familiarity with the software. On average, each vessel takes about 5 min to evaluate on CCTA and VIE together.
In addition to the limitations of VIE, this study has some limitations of its own. This is a single-center study, with only 100 subjects and 902 evaluated vessel segments—in particular, the number of positive vessel segments with calcified plaques is small, only four. Based on our results, a larger scale study might be expected to produce more statistically significant results. Second, the learning curve of the VIE software may have affected the interpreters differently as they gradually gained experience evaluating the one hundred subjects’ CCTA, VIE, and ICA images, as reflected in the intra- and inter-observer variability. Furthermore, in our study, the stents’ sizes had a significant impact on the diagnostic accuracy for both CCTA and VIE, which was expected since smaller diameter stents are known to affect the diagnostic accuracy of CCTA [17]. Future studies, possibly utilizing images from dual-source CT [33], which has shown promising results in all size stents, may be warranted. Lastly, ICA was used as the reference method in our study, but VIE could be better validated with other intravascular imaging modalities, such as intravascular ultrasound (IVUS) [34] and optical coherence tomography (OCT) [35], which can provide better information on plaque conditions. Further studies should be conducted to assess the comparability of these intravascular imaging modalities.

5. Conclusions

Our study showed that VIE can be a helpful tool when evaluating coronary arteries with stents and plaques using CCTA, significantly improving the specificity, accuracy, and positive predictive value. This advantage may ultimately benefit patients by improving the diagnostic accuracy of CCTA and reducing unnecessary invasive procedures. Thus, CCTA-generated VIE could be incorporated into standard CCTA during the diagnostic assessment of coronary stents or plaques.

Author Contributions

Conceptualization, P.W.W., Z.S. and Y.-L.W.; methodology, P.W.W., Z.S., M.-Y.H., Y.-S.K., I.-C.H., M.-S.W. and Y.-L.W.; software, S.-J.P. and C.-Y.L.; validation, P.-K.T., Y.-L.W., Y.-S.K., I.-C.H. and M.-S.W.; formal analysis, P.-K.T.; investigation, P.W.W., M.-Y.H. and Y.-L.W.; resources, Y.-L.W.; writing—original draft preparation, P.W.W. and Y.-L.W.; writing—review and editing, P.W.W., Z.S. and Y.-L.W.; supervision, Z.S. and Y.-L.W.; project administration, M.-S.W. and Y.-L.W.; funding acquisition, Y.-L.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Science and Technology, Taiwan, grant numbers 107-2314-B-182A-170, 108-2314-B-182A-152 and 109-2314-B-182A-163.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and was approved by the Institutional Review Board of Chang Gung Memorial Hospital at Linkou (document number: 201702160B0, date of approval: 2 January 2018).

Informed Consent Statement

Informed consent was obtained from all subjects undergoing coronary CTA and ICA who were involved in the study.

Data Availability Statement

The data are not publicly available to maintain the privacy of study subjects.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sun, Z.; Wan, Y.L.; Hsieh, I.C.; Liu, Y.C.; Wen, M.S. Coronary CT angiography in the diagnosis of coronary artery disease. Curr. Med. Imaging Rev. 2013, 9, 184–193. [Google Scholar] [CrossRef]
  2. Sun, Z.; Choo, G.H.; Ng, K.H. Coronary CT angiography: Current status and continuing challenges. Br. J. Radiol. 2012, 85, 495–510. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Jeng, C.M.; Wu, M.T.; Wang, P.C.; Chan, T.; Wan, Y.L. A survey of the current status of coronary CT angiography using 64-slice multidetector CT in Taiwan. J. Formos. Med. Assoc. 2014, 113, 124–132. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Vanhoenacker, P.K.; Heijenbrok-Kal, M.H.; Van Heste, R.; Decramer, I.; Van Hoe, L.R.; Wijns, W.; Hunink, M.M. Diagnostic performance of multidetector CT angiography for assessment of coronary artery disease: Meta-analysis. Radiology 2007, 244, 419–428. [Google Scholar] [CrossRef] [PubMed]
  5. Sun, Z.; Lin, C.; Davidson, R.; Dong, C.; Liao, Y. Diagnostic value of 64-slice CT angiography in coronary artery disease: A systematic review. Eur. J. Radiol. 2008, 67, 78–84. [Google Scholar] [CrossRef] [PubMed]
  6. Abdulla, J.; Abildstrom, S.Z.; Gotzsche, O.; Christensen, E.; Kober, L.; Torp-Pedersen, C. 64-multislice detector computed tomography coronary angiography as potential alternative to conventional coronary angiography: A systematic review and meta-analysis. Eur. Heart J. 2007, 28, 3042–3050. [Google Scholar] [CrossRef] [Green Version]
  7. Mowatt, G.; Cook, J.A.; Hillis, G.S.; Walker, S.; Fraser, C.; Jia, X.; Waugh, N. 64-slice computed tomography angiography in the diagnosis and assessment of coronary artery disease: Systematic review and meta-analysis. Heart 2008, 94, 1386–1393. [Google Scholar] [CrossRef] [Green Version]
  8. Cury, R.C.; Abbara, S.; Achenbach, S.; Agatson, A.; Berman, D.S.; Budoff, M.J.; Dill, K.E.; Jacobs, J.E.; Maroules, C.D.; Rubin, G.D.; et al. Coronary artery disease-reporting and data system (CAD-RADS): An expert consensus document of SCCT, ACR and NASCI: Endorsed by the ACC. J. Am. Coll. Cardiol. Imaging 2016, 9, 1099–1113. [Google Scholar] [CrossRef]
  9. Chen, C.C.; Chen, C.C.; Hsieh, I.C.; Liu, C.Y.; Chan, T.; Wen, M.S.; Wan, Y.L. The effect of calcium score on the diagnostic accuracy of coronary computed tomography angiography. Int. J. Cardiovasc. Imaging 2011, 27 (Suppl. 1), 37–42. [Google Scholar] [CrossRef]
  10. Diederichsen, A.C.; Petersen, H.; Jensen, L.O.; Thayeesn, P.; Gerke, O.; Sandgaard, N.C.F.; Carlsen, P.F.H.; Mickley, H. Diagnostic value of cardiac 64-slice computed tomography: Importance of coronary calcium. Scand. Cardiovasc. J. 2009, 43, 337–344. [Google Scholar] [CrossRef]
  11. Kuettner, A.; Kopp, A.F.; Schroeder, S.; Rieger, T.; Brunn, J.; Meisner, C.; Heuschmid, M.; Trabold, T.; Burgstahler, C.; Martensen, J.; et al. Diagnostic accuracy of multidetector computed tomography coronary angiography in patients with angiographically proven coronary artery disease. J. Am. Coll. Cardiol. 2004, 43, 831–839. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Budoff, M.J.; Dowe, D.; Jollis, J.G.; Gitter, M.; Sutherland, J.; Halamert, E.; Scherer, M.; Bellinger, R.; Martin, A.; Benton, R.; et al. Diagnostic performance of 64-multidetector row coronary computed tomographic angiography for evaluation of coronary artery stenosis in individuals without known coronary artery disease: Results from the prospective multicenter ACCURACY (assessment by coronary computed tomographic angiography of individuals undergoing invasive coronary angiography) trial. J. Am. Coll. Cardiol. 2008, 52, 1724–1732. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Abbara, S.; Blanke, P.; Maroules, C.D.; Cheezum, M.; Choi, A.D.; Han, B.K.; Marwan, M.; Naoum, C.; Norgaard, B.L.; Rubinshtein, R.; et al. SCCT guidelines for the performance and acquisition of coronary computed tomographic angiography: A report of the society of cardiovascular computed tomography guidelines committee: Endorsed by the North American Society for Cardiovascular Imaging (NASCI). J. Cardiovasc. Comput. Tomogr. 2016, 10, 435–449. [Google Scholar] [CrossRef] [PubMed]
  14. Carrabba, N.; Schuijf, J.D.; de Graaf, F.R.; Parodi, G.; Maffei, E.; Valenti, R.; Palumbo, A.; Wenustink, A.C.; Mollet, N.R.; Accetta, G.; et al. Diagnostic accuracy of 64-slice computed tomography coronary angiography for the detection of in-stent restenosis: A meta-analysis. J. Nucl. Cardiol. 2010, 17, 470–478. [Google Scholar] [CrossRef] [Green Version]
  15. Kumbhani, D.J.; Ingelmo, C.P.; Schoenhagen, P.; Curtin, R.J.; Flamm, S.D.; Desai, M.Y. Meta-analysis of diagnostic efficacy of 64-slice computed tomography in the evaluation of coronary in-stent restenosis. Am. J. Cardiol. 2009, 103, 1675–1681. [Google Scholar] [CrossRef]
  16. Sun, Z.; Almutairi, A.M. Diagnostic accuracy of 64 multislice CT angiography in the assessment of coronary in-stent restenosis: A meta-analysis. Eur. J. Radiol. 2010, 73, 266–273. [Google Scholar] [CrossRef] [Green Version]
  17. de Graaf, F.R.; Schuijf, J.D.; van Velzen, J.E.; Boogers, M.J.; Kroft, L.J.; de Roos, A.; Reiber, J.H.C.; Slieders, A.; Spanó, F.; Jukema, J.W.; et al. Diagnostic accuracy of 320-row multidetector computed tomography coronary angiography to noninvasively assess in-stent restenosis. Investig. Radiol. 2010, 45, 331–340. [Google Scholar] [CrossRef] [Green Version]
  18. Wan, Y.L.; Tsay, P.K.; Chen, C.C.; Juan, Y.H.; Huang, Y.C.; Chan, W.H.; Wen, M.S.; Hsieh, I.C. Coronary in-stent restenosis: Predisposing clinical and stent-related factors, diagnostic performance and analyses of inaccuracies in 320-row computed tomography angiography. Int. J. Cardiovasc. Imaging 2016, 32 (Suppl. 1), 105–115. [Google Scholar] [CrossRef]
  19. Sun, Z.; Winder, R.J.; Kelly, B.E.; Ellis, P.K.; Kennedy, P.T.; Hirst, D.G. Diagnostic value of CT virtual intravascular endoscopy in aortic stent-grafting. J. Endovasc. Ther. 2004, 11, 13–25. [Google Scholar] [CrossRef]
  20. Sun, Z.; Zheng, H. Effect of suprarenal stent struts on the renal artery with ostial calcification observed on CT virtual intravascular endoscopy. Eur. J. Vasc. Endovasc. Surg. 2004, 28, 534–542. [Google Scholar] [CrossRef] [Green Version]
  21. Sun, Z.; Ferris, C. Optimal scanning protocol of multislice CT virtual intravascular endoscopy in pre-aortic stent grafting: In vitro phantom study. Eur. J. Radiol. 2006, 58, 310–316. [Google Scholar] [CrossRef] [Green Version]
  22. Sun, Z.; Mwipatayi, B.P.; Allen, Y.B.; Hartley, D.E.; Lawrence-Brown, M.M. Computed tomography virtual intravascular endoscopy in the evaluation of fenestrated stent graft repair of abdominal aortic aneurysms. ANZ J. Surg. 2009, 79, 836–840. [Google Scholar] [CrossRef] [PubMed]
  23. Louis, N.; Bruguiere, E.; Kobeiter, H.; Desgranges, P.; Allaire, E.; Kirsch, M.; Becquemin, J.P. Virtual angioscopy and 3D navigation: A new technique for analysis of the aortic arch after vascular surgery. Eur. J. Vasc. Endovasc. Surg. 2010, 40, 340–347. [Google Scholar] [CrossRef] [Green Version]
  24. Qi, Y.; Ma, X.; Li, G.; Ma, X.; Wang, Q.; Yu, D. Three-dimensional visualization and imaging of the entry tear and intimal flap of aortic dissection using CT virtual intravascular endoscopy. PLoS ONE 2016, 11, e0164750. [Google Scholar] [CrossRef] [PubMed]
  25. Sun, Z.; Dimpudus, F.J.; Nugroho, J.; Adipranoto, J.D. CT virtual intravascular endoscopy assessment of coronary artery plaques: A preliminary study. Eur. J. Radiol. 2010, 75, e112–e119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Xu, L.; Sun, Z. Virtual intravascular endoscopy visualization of calcified coronary plaques: A novel approach of identifying plaque features for more accurate assessment of coronary lumen stenosis. Medicine 2015, 94, e805. [Google Scholar] [CrossRef] [PubMed]
  27. Sun, Z.; Xu, L. CT virtual intravascular endoscopy in the visualization of coronary plaques: A pictorial essay. Curr. Med. Imaging Rev. 2017, 13, 154–161. [Google Scholar] [CrossRef] [Green Version]
  28. Sun, Z. Coronary CT angiography in coronary artery disease: Correlation between virtual intravascular endoscopic appearances and left bifurcation angulation and coronary plaques. Biomed. Res. Int. 2013, 2013, 732059. [Google Scholar] [CrossRef] [Green Version]
  29. Juan, Y.H.; Huang, Y.C.; Sun, Z.; Hsieh, I.C.; Chan, W.H.; Chen, C.C.; Hung, K.C.; Wen, M.S.; Wan, Y.L. The evolution and investigation of native coronary arteries in patients after coronary stent implantation: A study by 320-detector CT angiography. Int. J. Cardiovasc. Imaging 2014, 30 (Suppl. 1), 13–24. [Google Scholar] [CrossRef]
  30. Dewey, M.; Zimmermann, E.; Deissenrieder, F.; Laule, M.; Dübel, H.P.; Schlattmann, P.; Knebel, F.; Rutsch, W.; Bernd, H. Noninvasive coronary angiography by 320-row computed tomography with lower radiation exposure and maintained diagnostic accuracy: Comparison of results with cardiac catheterization in a head-to-head pilot investigation. Circulation 2009, 120, 867–875. [Google Scholar] [CrossRef] [Green Version]
  31. Alfonso, F.; Zueco, J.; Cequier, A.; Mantilla, R.; Bethencourt, A.; López-Minguez, J.R.; Angel, J.; Augé, J.M.; Gómez-Recio, M.; Morís, C.; et al. A randomized comparison of repeat stenting with balloon angioplasty in patients with in-stent restenosis. J. Am. Coll. Cardiol. 2003, 42, 796–805. [Google Scholar] [CrossRef] [Green Version]
  32. Sun, Z.; Lin, C. Diagnostic value of 320-slice coronary CT angiography in coronary artery disease: A systematic review and meta-analysis. Curr. Med. Imaging Rev. 2015, 10, 272–280. [Google Scholar] [CrossRef] [Green Version]
  33. Li, Y.; Yu, M.; Li, W.; Lu, Z.; Wei, M.; Zhang, J. Third generation dual-source CT enables accurate diagnosis of coronary restenosis in all size stents with low radiation dose and preserved image quality. Eur. Radiol. 2018, 28, 2647–2654. [Google Scholar] [CrossRef] [PubMed]
  34. Bangalore, S.; Bhatt, D. Coronary intravascular ultrasound. Circulation 2013, 127, e868–e874. [Google Scholar] [CrossRef] [Green Version]
  35. Jang, I.-K.; Bouma, B.E.; Kang, D.H.; Park, S.J.; Park, S.W.; Seung, K.B.; Choi, K.B.; Shishkov, M.; Schlendorf, K.; Pomerantsev, E.; et al. Visualization of coronary atherosclerotic plaques in patients using optical coherence tomography: Comparison with intravascular ultrasound. J. Am. Coll. Cardiol. 2002, 39, 604–609. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Flowchart showing image post-processing steps from original DICOM images to generating VIE images. The CT attenuation is measured in the ascending aorta on original DICOM images (A) to set the approximate threshold for generation of VIE (B), revealing intimal hyperplasia in a stent placed in the proximal- to middle- left anterior descending artery (C). This is then compared with the results of invasive coronary angiography (D), which also shows intimal hyperplasia with 31% stenosis (arrow).
Figure 1. Flowchart showing image post-processing steps from original DICOM images to generating VIE images. The CT attenuation is measured in the ascending aorta on original DICOM images (A) to set the approximate threshold for generation of VIE (B), revealing intimal hyperplasia in a stent placed in the proximal- to middle- left anterior descending artery (C). This is then compared with the results of invasive coronary angiography (D), which also shows intimal hyperplasia with 31% stenosis (arrow).
Diagnostics 12 00390 g001aDiagnostics 12 00390 g001b
Figure 2. A case of true negative results for both CCTA and VIE. Subject is a 45-year-old woman with hypertension and type 2 diabetes mellitus and has a metallic stent (Xience V, 2.5 mm × 38 mm) (arrow) placed in the left anterior descending artery (LAD). Both CCTA (A) and VIE (B) showed patency of the stent without ISR, which was confirmed by ICA (arrow) (C).
Figure 2. A case of true negative results for both CCTA and VIE. Subject is a 45-year-old woman with hypertension and type 2 diabetes mellitus and has a metallic stent (Xience V, 2.5 mm × 38 mm) (arrow) placed in the left anterior descending artery (LAD). Both CCTA (A) and VIE (B) showed patency of the stent without ISR, which was confirmed by ICA (arrow) (C).
Diagnostics 12 00390 g002
Figure 3. A case of true positive result for both CCTA and VIE. Subject is a 57-year-old man with hypertension and obesity (body mass index = 30.7 kg/m2) and with a total calcium score of 1125. A metallic stent was placed in the left circumflex artery. Both CCTA (A) and VIE (B) showed ISR at the distal edge of the stent (arrow). This was confirmed by ICA (C), showing 88% stenosis (arrow).
Figure 3. A case of true positive result for both CCTA and VIE. Subject is a 57-year-old man with hypertension and obesity (body mass index = 30.7 kg/m2) and with a total calcium score of 1125. A metallic stent was placed in the left circumflex artery. Both CCTA (A) and VIE (B) showed ISR at the distal edge of the stent (arrow). This was confirmed by ICA (C), showing 88% stenosis (arrow).
Diagnostics 12 00390 g003
Figure 4. A case of false positive result for CCTA but true negative result for VIE. Subject is a 51-year-old man with obesity (body mass index = 32.8 kg/m2) and a total calcium score of 815. A metallic stent (Xience V, 2.5 mm × 23 mm) was placed in the left anterior descending artery. CCTA (A) showed severe calcifications with poor opacification at the proximal end of the stent (arrow) suggestive of ISR, but VIE (B) found only intimal hyperplasia. ICA (C) showed only intimal hyperplasia with 12% stenosis in this stent.
Figure 4. A case of false positive result for CCTA but true negative result for VIE. Subject is a 51-year-old man with obesity (body mass index = 32.8 kg/m2) and a total calcium score of 815. A metallic stent (Xience V, 2.5 mm × 23 mm) was placed in the left anterior descending artery. CCTA (A) showed severe calcifications with poor opacification at the proximal end of the stent (arrow) suggestive of ISR, but VIE (B) found only intimal hyperplasia. ICA (C) showed only intimal hyperplasia with 12% stenosis in this stent.
Diagnostics 12 00390 g004
Figure 5. A case of true negative result for CCTA but false positive result for VIE. Subject is a 72-year-old man with hypertension and with 3 metallic stents placed in the right coronary artery. CCTA (A) showed intimal hyperplasia in all three stents without ISR, but VIE (B) found ISR in the middle stent. ICA (C) showed only intimal hyperplasia with 34% stenosis in the middle stent.
Figure 5. A case of true negative result for CCTA but false positive result for VIE. Subject is a 72-year-old man with hypertension and with 3 metallic stents placed in the right coronary artery. CCTA (A) showed intimal hyperplasia in all three stents without ISR, but VIE (B) found ISR in the middle stent. ICA (C) showed only intimal hyperplasia with 34% stenosis in the middle stent.
Diagnostics 12 00390 g005
Table 1. Diagnostic performance of CCTA versus VIE in detecting either in-stent restenosis or coronary artery disease in 902 vessel segments with stents or plaques, using ICA as the gold standard.
Table 1. Diagnostic performance of CCTA versus VIE in detecting either in-stent restenosis or coronary artery disease in 902 vessel segments with stents or plaques, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity77/82 = 93.9%
(86.3–98.0%)
74/82 = 90.2%
(81.7–95.7%)
0.563
Specificity789/820 = 96.2%
(94.7–97.4%)
805/820 = 98.2%
(97.0–98.9%)
0.025
Accuracy866/902 = 96.0%
(94.5–97.2%)
879/902 = 97.7%
(96.2–98.4%)
0.046
Positive predictive value77/110 = 70.0%
(60.5–78.4%)
74/89 = 83.1%
(73.7–90.4%)
0.047
Negative predictive value787/792 = 99.4%
(98.5–99.8%)
805/813 = 99.0%
(98.1–99.6%)
0.610
kappa value0.7790.713–0.8470.8510.791–0.9110.112
Table 2. Diagnostic performance of CCTA versus VIE in detecting in-stent restenosis in 193 stented vessels, using ICA as the gold standard.
Table 2. Diagnostic performance of CCTA versus VIE in detecting in-stent restenosis in 193 stented vessels, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity22/23 = 95.7%
(78.1–99.9%)
20/23 = 87.0%
(66.4–97.2%)
0.608
Specificity159/170 = 93.5%
(88.7–96.7%)
166/170 = 97.6%
(94.1–99.4%)
0.113
Accuracy181/193 = 93.8%
(89.4–96.8%)
186/193 = 96.9%
(92.7–98.5%)
0.347
Positive predictive value22/33 = 66.7%
(48.2–82.0%)
20/24 = 83.3%
(62.6–95.3%)
0.269
Negative predictive value159/160 = 99.4%
(96.6–99.9%)
166/169 = 98.2%
(94.9–99.4%)
0.623
kappa value0.7510.622–0.8810.8300.709–0.9410.391
Table 3. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 115 vessel segments with calcified plaques, using ICA as the gold standard.
Table 3. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 115 vessel segments with calcified plaques, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity3/4 = 75.0%
(19.4–99.4%)
2/4 = 50.0%
(6.8–93.2%)
0.999
Specificity98/111 = 88.3%
(80.8–93.6%)
106/111 = 95.5%
(89.8–98.5%)
0.085
Accuracy101/115 = 87.8%
(80.4–93.2%)
108/115 = 93.9%
(87.9–97.5%)
0.170
Positive predictive value3/16 = 18.8%
(4.1–45.7%)
2/7 = 28.6%
(3.7–71.0%)
0.621
Negative predictive value98/99 = 99.0%
(94.5–99.9%)
106/108 = 98.1%
(93.5–99.8%)
0.999
kappa value0.2590.109–0.4980.3340.094–0.5730.743
Table 4. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 85 vessel segments with mixed plaques, using ICA as the gold standard.
Table 4. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 85 vessel segments with mixed plaques, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity31/34 = 91.2%
(76.3–98.1%)
31/34 = 91.2%
(76.3–98.1%)
0.999
Specificity45/51 = 88.2%
(76.1–95.6%)
47/51 = 92.2%
(81.1–97.8%)
0.739
Accuracy76/85 = 89.4%
(80.9–95.0%)
78/85 = 91.8%
(83.8–96.6%)
0.793
Positive predictive value31/37 = 83.8%
(68.0–93.8%)
31/35 = 88.6%
(73.3–96.8%)
0.806
Negative predictive value45/48 = 93.8%
(82.8–98.7%)
47/50 = 94.0%
(83.5–98.8%)
0.999
kappa value0.7830.662–0.9030.8290.708–0.9490.617
Table 5. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 31 vessel segments with non-calcified plaques, using ICA as the gold standard.
Table 5. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 31 vessel segments with non-calcified plaques, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity21/21 = 100.0%
(83.9–100.0%)
21/21 = 100.0%
(83.9–100.0%)
0.999
Specificity7/10 = 70.0%
(34.8–93.3%)
8/10 = 80.0%
(44.4–97.5%)
0.999
Accuracy28/31 = 94.3%
(74.3–98.0%)
29/31 = 93.6%
(78.6–99.2%)
0.999
Positive predictive value21/24 = 87.5%
(67.6–97.3%)
21/23 = 91.3%
(72.0–98.9%)
0.999
Negative predictive value7/7 = 100.0%
(59.0–100.0%)
8/8 = 100.0%
(63.1–100.0%)
0.999
kappa value0.7600.641–0.8800.8440.710–0.9660.612
Table 6. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 424 vessel segments with stents, CP, MP, or SP, using ICA as the gold standard.
Table 6. Diagnostic performance of CCTA versus VIE in detecting coronary artery disease in 424 vessel segments with stents, CP, MP, or SP, using ICA as the gold standard.
CCTAVIEp Value
Sensitivity77/82 = 93.9%
(86.3–98.0%)
74/82 = 90.2%
(81.7–95.7%)
0.563
Specificity309/342 = 90.4%
(86.7–93.3%)
327/342 = 95.6%
(93.9–97.5%)
0.011
Accuracy386/424 = 91.0%
(87.9–93.6%)
401/424 = 94.6%
(92.0–96.5%)
0.063
Positive predictive value77/110 = 70.0%
(60.5–78.4%)
74/89 = 83.1%
(73.7–90.3%)
0.047
Negative predictive value309/314 = 98.4%
(96.3–99.5%)
327/335 = 97.6%
(95.4–99.0%)
0.658
kappa value0.7460.675–0.8260.8320.764–0.9010.092
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, P.W.; Tsay, P.-K.; Sun, Z.; Peng, S.-J.; Lee, C.-Y.; Hsu, M.-Y.; Ko, Y.-S.; Hsieh, I.-C.; Wen, M.-S.; Wan, Y.-L. Added Value of Computed Tomography Virtual Intravascular Endoscopy in the Evaluation of Coronary Arteries with Stents or Plaques. Diagnostics 2022, 12, 390. https://doi.org/10.3390/diagnostics12020390

AMA Style

Wu PW, Tsay P-K, Sun Z, Peng S-J, Lee C-Y, Hsu M-Y, Ko Y-S, Hsieh I-C, Wen M-S, Wan Y-L. Added Value of Computed Tomography Virtual Intravascular Endoscopy in the Evaluation of Coronary Arteries with Stents or Plaques. Diagnostics. 2022; 12(2):390. https://doi.org/10.3390/diagnostics12020390

Chicago/Turabian Style

Wu, Patricia Wanping, Pei-Kwei Tsay, Zhonghua Sun, Syu-Jyun Peng, Chia-Yen Lee, Ming-Yi Hsu, Yu-Shien Ko, I-Chang Hsieh, Ming-Shien Wen, and Yung-Liang Wan. 2022. "Added Value of Computed Tomography Virtual Intravascular Endoscopy in the Evaluation of Coronary Arteries with Stents or Plaques" Diagnostics 12, no. 2: 390. https://doi.org/10.3390/diagnostics12020390

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop