Practical Application of DaTQUANT with Optimal Threshold for Diagnostic Accuracy of Dopamine Transporter SPECT
by
, ,
Matthew Neill
1, 
Julia M. Fisher
2
,
Christine Brand
3,
Hong Lei
4,
Scott J. Sherman
4,
Ying-Hui Chou
5 and
Phillip H. Kuo
6,* 
1
Department of Medical Imaging, University of Arizona, Tucson, AZ 85724, USA
2
Statistics Consulting Laboratory, BIO5 Institute, University of Arizona, Tucson, AZ 85721, USA
3
General Electric Healthcare, Marlborough, MA 01752, USA
4
Department of Neurology, University of Arizona, Tucson, AZ 85724, USA
5
Department of Psychology, University of Arizona, Tucson, AZ 85721, USA
6
Departments of Medical Imaging, Medicine, and Biomedical Engineering, University of Arizona, Tucson, AZ 85724, USA
*
Author to whom correspondence should be addressed.
Tomography 2021, 7(4), 980-989; https://doi.org/10.3390/tomography7040081
Submission received: 12 October 2021
/
Revised: 28 November 2021
/
Accepted: 10 December 2021
/
Published: 18 December 2021
(This article belongs to the Special Issue Neuro-Imaging in Parkinson’s Disease)
Abstract
:Evaluation of Parkinsonian Syndromes (PS) with Ioflupane iodine-123 dopamine transporter single photon emission computed tomography (DaT-SPECT), in conjunction with history and clinical examination, aids in diagnosis. FDA-approved, semi-quantitative software, DaTQUANTTM (GE Healthcare, Chicago, IL, USA) is available to assist in interpretation. This study aims to evaluate the optimal variables and thresholds of DaTQUANT to yield the optimal diagnostic accuracy. It is a retrospective review with three different patient populations. DaT-SPECT images from all three study groups were evaluated using DaTQUANTTM software, and both single and multi-variable logistic regression were used to model PS status. The optimal models were chosen via accuracy, sensitivity, and specificity, then evaluated on the other study groups. Among single variable models, the posterior putamen yielded the highest accuracy (84% to 95%), while balancing sensitivity and specificity. Multi-variable models did not substantially improve the accuracy. When the optimal single variable models for each group were used to evaluate the remaining two groups, comparable results were achieved. In typical utilization of DaT-SPECT for differentiation between nigrostriatal degenerative disease (NSDD) and non-NSDD, the posterior putamen was the single variable that yielded the highest accuracy across three different patient populations. The posterior putamen’s recommended thresholds for DaTQUANT are SBR ≤ 1.0, z-score of ≤−1.8 and percent deviation ≤ −0.34.
1. Introduction
Parkinson’s disease and related neurodegenerative disorders, such as multiple system atrophy and dementia with Lewy Bodies (DLB), demonstrate pathologic loss of nigrostriatal dopaminergic neurons. In conjunction with history and clinical examination, evaluation of nigrostriatal dopamine transporters (DaT) in Parkinsonian Syndromes (PS) can be performed with DaTSCANTM (Ioflupane iodine-123 [I123]) using single photon emission computed tomography (SPECT). DaT-SPECT imaging evaluates the dopaminergic neuronal pathway via radiotracer uptake by presynaptic dopamine transporters in the striatum [1,2,3,4,5,6]. This allows for the differentiation between nigrostriatal degenerative disease (NSDD) and other non-NSDD entities, such as essential tremor, vascular Parkinson’s, drug-induced Parkinson’s, and Alzheimer’s disease, which do not involve degeneration of dopaminergic neurons, but may present with similar clinical features.
Semi-quantitative software has been developed to assist in the interpretation of DaT-SPECT imaging using reproducible, standardized methods [7,8,9]. Semi-quantitative software can be optimized to be comparable to visual reads by experienced readers, potentially allowing inexperienced readers to increase their accuracy in everyday practice, as well as improving the confidence of experienced and inexperienced reader interpretations [10,11,12,13]. DaTQUANTTM (GE Healthcare, Chicago, IL, USA) is an FDA-approved, semi-quantitative software that enables the visual evaluation and quantification of DaTSCANTM images relative to normal population databases of I-123-ioflupane uptake.
Despite the well-characterized algorithms for quantification of DaT-SPECT images, no clear guidelines for clinical practice exist for how to use the multitude of parameters for optimal diagnostic accuracy [14]. To date, there has been no published assessment of the most important quantitative parameter (or combination of parameters) to distinguish normal from abnormal, nor any ideal threshold values for quantitative parameters for DaT-SPECT. Optimizing the application of commercial semi-quantitative software for routine clinical practice would improve the value of computer-aided detection (CAD) of abnormalities to improve reader accuracy and confidence. In this study, we evaluated DaTQUANTTM with I-123-ioflupane images acquired across multiple patient populations and imaging centers to develop guidelines for assisting with semi-quantitative interpretation of cases in routine practice.
2. Materials and Methods
2.1. Study Population
This is an IRB-approved, retrospective review using participants from three study groups: (1) single center, movement disorder clinic population (single center, SC); (2) participants from three multicenter, Phase 3 or 4 trials (multicenter, MC); and (3) Parkinson’s Progression Markers Initiative subjects (PPMI) Available online: http://www.ppmi-info.org (accessed on 31 December 2013).
The single-center movement clinic population (SC) included movement disorder neurology clinic patients who underwent DaT-SPECT imaging and had at least two years of clinical follow-up. A total of 129 subjects, including 79 diagnosed with PS, were included in the analysis, with seven subjects being excluded because of an inability to quantify data due to a lack of raw tomographic data.
The multi-center population (MC) comprised a total of 309 subjects involved in three separate Phase 3 or 4 trials, including 151 with a diagnosis of PS or probable DLB (pDLB). Overall, two of the trials included 120 subjects with a clinical diagnosis of either PS or non-PS [15,16], and one trial included 189 subjects with a clinical diagnosis of either pDLB or non-DLB [17]. All subjects had one–three years of clinical follow-up.
The Parkinson’s Progression Markers Initiative subjects (PPMI) included a total of 370 subjects, which were randomly selected from both the de novo PD and healthy control populations, with 195 healthy controls and 175 diagnosed with PS after 1+ years of clinical follow-up.
2.2. Quantification Software
DaT-SPECT images from all three study groups were evaluated using DaTQUANTTM software, which reconstructed all SPECT data with the same reconstruction algorithm and filter parameters as those used for the normal database and performed a volume-of-interest (VOI) determination of radiotracer binding in different regions of the striatum bilaterally. An area in the occipital cortex served as the background region. The quantified regions include striatum, caudate, putamen, anterior putamen, and posterior putamen. For each region, the striatal binding ratio (SBR: difference in mean counts between the region and background divided by the mean background counts), percent deviation from the age-matched mean of the normal database, z-score, and the age-matched mean value from the normal database is presented. Age-matching to the normal database is done on a year-by-year basis. The normal data base includes 118 healthy volunteers (no diagnosis of PS or first-degree blood relative with PS), including 73 men and 45 women, aged 31 to 84 years, who contributed to PPMI. Additional calculated values which are not background-corrected include putamen to caudate ratio (P:C), striatum asymmetry, caudate asymmetry, and putamen asymmetry (Figure 1).
2.3. Statistics
For each data set (MC, SC, PPMI) and DaTQUANTTM summary measure (z-score, SBR, percent deviation), the ability of different combinations of VOIs to predict NSDD is evaluated where the summary measures for each VOI are the predictor variables. For each dataset, the VOIs, described previously in quantification software section above, were used with the exception of striatum asymmetry, which was not present in the MC group. For each participant and each VOI, the “more affected side” was defined as the one with the lower z-score. Only the summary measure for the more affected side is used in the modeling. Note that this means that the more affected side was not forced to be consistent across VOIs.
The binary diagnosis was modeled with logistic regression. Additionally, since prediction from logistic regression requires setting a threshold at or above which a participant is predicted to have a positive outcome (i.e., have PS/DLB), 21 equally spaced thresholds in probability space were considered, ranging from 0 to 1 by increments of 0.05. For each model and threshold combination, prediction (accuracy, sensitivity, specificity) via leave-one-out cross validation were evaluated. Two-sided bootstrap case cross validation 95% confidence intervals (1000 bootstrap data sets) are provided for the leave-one-out cross validation accuracies, a slight modification to the one-sided confidence intervals in Jiang et al., 2008 [18].
Using the results from the leave-one-out cross validation, optimal models for each combination of predictors, summary measure, and threshold were identified. These models were refit to the full data sets to get the model equations, and then evaluated on the other data sets. For this study, 95% Wilson confidence intervals for cross-group accuracies are provided [19].
3. Results
3.1. Demographics
The mean age of the participants overall was 66 years old, with 40% female participants. The mean age for each individual group ranged from 62 (PPMI) to 71 (MC) years old, with 33% (PPMI) to 48% (SC) female participants (Table 1). A majority of participants were in their sixth to eighth decades of life, with the youngest participant being 36 years old and the oldest being 88 years old (Figure 2).
3.2. Single Variate Models
In single variable analysis for all groups, the posterior putamen of the more affected side demonstrated the highest accuracy, while still maintaining a sensitivity and specificity above 0.80 (Table 2). Overall, there were no substantial differences in accuracy, sensitivity, or specificity between the SBR, z-score, or percent deviation variables within each group (differences ranged from 0.01 to 0.03 for the different summary measures). The PPMI models overall had the highest accuracy (0.95), followed by SC (0.91), then MC (0.85). The optimum thresholds for the discussed SBR, z-score, and percent deviation models are shown in Table 2.
For all three variables in the SC group (SBR, z-score, and percent deviation), the posterior putamen demonstrated the highest accuracy, 0.90–0.91, with a sensitivity and specificity of 0.91–0.92 and 0.88, respectively. Three other regions (putamen, anterior putamen, and striatum) had identical accuracy with small (up to 0.06) differences in sensitivity and specificity, but gain in one was coupled with similar loss in the other. Additionally, multiple thresholds for the posterior putamen region demonstrate identical results for accuracy. For example, the posterior putamen SBR variable threshold value of ≤0.95 yields the same accuracy as using a threshold value of ≤1.00. For the MC group, the posterior putamen alone demonstrates the highest accuracy for all three variables (0.84–0.85), with balanced sensitivity and specificity (0.80–0.82 and 0.88–0.89, respectively). For the z-score variable, use of a threshold value of −1.52 instead of −1.73 yields identical accuracy, with 0.03 increase in sensitivity while reducing specificity by 0.03.
For the PPMI group, the posterior putamen alone demonstrates the highest accuracy for all three variables (0.94–0.95), with balanced sensitivity and specificity (0.91–0.92 and 0.95–0.97, respectively). No additional threshold models were identical for this group.
3.3. Multi-Variate Models
Multi-variable models did not substantially improve the accuracy, sensitivity, or specificity of the three groups, with most of the models resulting in 0.01–0.04 differences in accuracy, sensitivity, or specificity (Table 3). Several models showed increased specificity (SC group: SBR and percent deviation, MC group: SBR), but only improved the specificity by 0.03–0.04, and sacrificed up to 0.03 in sensitivity.
3.4. Cross Group Results
When the best models for each group were tested on the remaining two groups, the models yielded very similar results to the within-group analysis for each (Table 4). While some models showed minor differences (0.01–0.05) in certain results, the differences in improvement in one result were coupled with similar sacrifices in another result, such as sensitivity for specificity. While variables other than posterior putamen had identical accuracy results for the SC group, when these models were tested on the other groups, significant drops in accuracy were seen. For example, the SC striatum SBR accuracy when tested on the PPMI group is 0.85 versus 0.95 for the PPMI posterior putamen SBR model.
4. Discussion
In single-variable evaluation of optimal variables and thresholds in DaTQUANTTM, the posterior putamen consistently yields the highest accuracy in diagnosis. The critical importance of the posterior putamen correlates with the expected natural history of the disease process [20]. Furthermore, the single-variable posterior putamen models performed similarly when tested across all study groups, providing evidence that the models perform consistently across different patient populations and different clinical settings. While the putamen, anterior putamen, and striatum models yielded identical accuracy for the SC group, they experienced slight to moderate losses of accuracy across other groups, suggesting that these models are not quite as robust and therefore not as useful in a clinical environment.
In determining the recommended single variable threshold values for each summary measure, the SC and PPMI results were more heavily weighted, given that their patient populations are more reflective of the standard patient population undergoing DaT-SPECT in the United States of America, namely evaluation for tremor rather than dementia (which was prevalent in the MC group). With this in mind, the recommended threshold values for DaTQUANTTM posterior putamen are: SBR of ≤1.0, z-score of ≤−1.8, and percent deviation of ≤−0.34.
When comparing each group’s highest accuracy single-variable model, the results differed substantially, with the highest accuracy seen in the PPMI group (0.95), and the lowest accuracy seen in the MC group (0.85). This can likely be attributed to differences in patient population. The PPMI is an observational study that has recruited normal age-matched controls (with neither movement disorder nor other indication of a PS), and a study population of PD subjects with imaging performed under clinical research protocol standards, which included exclusion of movement disorder patients without evidence of dopaminergic deficits (SWEDD). Meanwhile the SC and MC groups reflect a patient population similar to what is seen in everyday practice; thus their results may more closely reflect “real-world” accuracy of DaT-SPECT imaging.
When comparing the three summary measures SBR, z-score, and percent deviation, each measure performed similarly for all models and across all study groups. These results would allow for the interpreting radiologist to use either variable preferentially without significant differences in accuracy, sensitivity, or specificity. Additionally, while the optimal threshold values for each summary measure have small differences (for instance, optimal posterior putamen z-score thresholds from each of the three groups are ≤−1.9 vs. −1.73 vs. −1.68), each model’s optimal threshold performed similarly across all three study groups (Table 4). This consistency across different study groups suggests that, while the exact threshold values of a specific model may not be the optimal value for other patient cohorts, it performs in a similar enough fashion to be of clinical use.
A multi-variable approach did not substantially improve results. Many of the best multi-variable models in the three participant groups incorporated some form of asymmetry variable (striatum, caudate, or putamen asymmetry) without substantial improvement in accuracy, sensitivity, or specificity. Asymmetry is a prominent feature of neurodegenerative disorders, particularly Parkinson’s disease [21,22], but these findings suggest that asymmetry is not a reliable predictor overall, and focus should instead be placed onto the more affected side rather than primarily comparing sides.
Limitations and caveats to the use of the threshold provided by this study include the inclusion of movement disorder and dementia patients, as well as the age range of the patients included. The populations of the SC/PPMI and MC groups differed in one distinct, important way: the SC/PPMI groups consisted of movement disorder patients only, while the MC group consisted of movement disorder and dementia patients. Known DaT-SPECT imaging differences between patients presenting with different symptoms (tremor versus dementia) may lead to different predictive models or quantification thresholds [23,24,25]. Additionally, the age range of patients within this study should be noted, with a majority of patients in their sixth to eighth decades of life. It is known that normal loss of nigrostriatal dopaminergic neurons occurs with age [26]. Patients at either extreme of age, young and old, should be evaluated with caution, as the quantitative software results and associated predictive models may not provide similar accuracy. Furthermore, all three groups used the same reconstruction algorithm with associated parameters and normal database for determining z-score and percent deviation. Any change in the underlying reconstruction or normal database used to calculate these measures will impact the accuracy of the provided models/thresholds.
Further research areas include difficult to read cases and dementia versus movement disorder cases. The difference between movement disorder and dementia patients would benefit from further study to maximize benefit to practices that use DaT-SPECT in the evaluation of dementia. Additionally, there may be a subset of cases that are particularly hard to read and could benefit from multi-variable modeling. Further investigation into difficult or borderline cases may require a more sophisticated approach. Future research may include the use of deep learning algorithms, such as convolutional neural networks (CNN) to further optimize sensitivity and specificity. Such a method would not be restricted to pre-specified regions of interest and their derived parameters. Furthermore, the integration of clinical information may be necessary to push beyond the limitations of imaging alone.
It is helpful to keep in mind that quantitative evaluation should not be used in isolation. Evaluating study quality and identifying potential artifacts may prevent mistakes in interpretation [27]. Example cases are provided in Figure 3, Figure 4 and Figure 5, illustrating the usefulness and limitations of quantification using the single variable models and thresholds in this study.
5. Conclusions
In typical utilization of DaT-SPECT for differentiation between NSDD and other non-NSDD, the posterior putamen was the single variable that yielded the highest accuracy across three different patient populations. For SPECT data acquired and reconstructed per the DaTQUANTTM procedure specified for the IRNC database, the posterior putamen’s recommended threshold values for DaTQUANTTM are SBR ≤ 1.0, z-score of ≤−1.8 and percent deviation ≤ −0.34. Multi-variable models did not substantially improve accuracy.
Author Contributions
Conceptualization, P.H.K. and M.N.; methodology, P.H.K., M.N., Y.-H.C. and J.M.F.; software, J.M.F.; validation, J.M.F.; formal analysis, J.M.F.; investigation, M.N.; resources, C.B., S.J.S. and H.L.; data curation, C.B. and J.M.F.; writing—original draft preparation, M.N.; writing—review and editing, P.H.K., C.B., Y.-H.C. and J.M.F.; visualization, M.N. and J.M.F.; supervision, P.H.K.; project administration, P.H.K.; funding acquisition, P.H.K. and C.B. All authors have read and agreed to the published version of the manuscript.
Funding
This manuscript was supported by a grant from General Electric Healthcare, grant number 4252270.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of University of Arizona (protocol number 1810994753, date of approval 10 September 2018).
Informed Consent Statement
Patient consent was waived as deemed by the University of Arizona IRB due to retrospective nature of the study.
Data Availability Statement
Data cannot be made publicly available for multiple reasons. Part of the data belongs to General Electric Healthcare and is not for public use. Part of the data from the University of Arizona belongs to the health network and the authors do not have permission to release for public use. The PPMI data should be requested from the Michael J. Fox Foundation.
Acknowledgments
The authors would like to thank James Reynolds CNMT for his assistance with quantifying the scans. Data used in the preparation of this article were obtained from the Parkinson Progression Markers Initiative (PPMI) database: http://www.ppmi-info.org (accessed on 31 December 2013). For up-to-date information on the study, visit www.ppmi-info.org. PPMI—a public-private partnership—is funded by the Michael J. Fox Foundation for Parkinson’s Research and funding partners, including Abbvie, Acurex Therapeutics, Allergan, Amathus Therapeutics, Aligning Science Across Parkinson’s, Avid Radiopharmaceuticals, Bial Biotech, Biogen, Biolegend, Bristol Myers Squibb, Calico, Celgene, Dacapo Brainscience, Jenali, 4D Pharma PLC, Edmond J. Safra Philanthropic Foundations, GE Healthcare, Genentech, GlaxoSmithKline, Golub Capital, Handl Therapeutics, Insitro, Janssen Neuroscience, Lilly, Lundbeck, Merck, Meso Scale Discovery, Neurocrine, Pfizer, Piramal, Prevail Therapeutics, Roche, Sanofi Genzyme, Servier, Takeda, Teva, UCB, Verily, and Voyager Therapeutics.
Conflicts of Interest
Phillip Kuo is an employee of Invicro and is a consultant, speaker, and grant recipient for General Electric Healthcare. He is also a consultant and/or speaker for Amgen, Eisai, Novartis, Invicro, Bayer, Chimerix, Fusion Pharma, and UroToday, and has a research grant from Blue Earth Diagnostics. Scott J. Sherman is a paid speaker for General Electric Healthcare. Christine Brand is an employee of General Electric Healthcare and assisted in collection and analysis of data and the editing of the manuscript. The remaining authors declare no conflict of interest.
References
- Perju-Dumbrava, L.D.; Kovacs, G.G.; Pirker, S.; Jellinger, K.; Hoffmann, M.; Asenbaum, S.; Pirker, W. Dopamine transporter imaging in autopsy-confirmed Parkinson’s disease and multiple system atrophy. Mov. Disord. 2011, 27, 65–71. [Google Scholar] [CrossRef] [PubMed]
- Colloby, S.J.; McParland, S.; O’Brien, J.; Attems, J. Neuropathological correlates of dopaminergic imaging in Alzheimer’s disease and Lewy body dementias. Brain 2012, 135, 2798–2808. [Google Scholar] [CrossRef] [Green Version]
- Tatsch, K. Imaging of the dopaminergic system in differential diagnosis of dementia. Eur. J. Nucl. Med. Mol. Imaging 2008, 35, 51–57. [Google Scholar] [CrossRef] [PubMed]
- Seibyl, J.; Russell, D.; Jennings, D.; Marek, K. The molecular basis of dopaminergic brain imaging in Parkinson’s disease. Q. J. Nucl. Med. Mol. Imaging 2012, 56, 4–16. [Google Scholar]
- Chouker, M.; Tatsch, K.; Linke, R.; Pogarell, O.; Hahn, K.; Schwarz, J. Striatal dopamine transporter binding in early to moderately advanced Parkinson’s disease: Monitoring of disease progression over 2 years. Nucl. Med. Commun. 2001, 22, 721–725. [Google Scholar] [CrossRef] [PubMed]
- Bega, D.; Kuo, P.H.; Chalkidou, A.; Grzeda, M.T.; Macmillan, T.; Brand, C.; Sheikh, Z.H.; Antonini, A. Clinical utility of DaTscan in patients with suspected Parkinsonian syndrome: A systematic review and meta-analysis. Npj Park. Dis. 2021, 7, 43. [Google Scholar] [CrossRef]
- Stokkel, M.P.M.; Dibbets-Schneider, P.; Koestering, E.; Dragoiescu, C.; Blokland, K.A.K. Reproducibility of a standardized quantita-tive analysis using fixed regions of interest to differentiate movement disorders on 123I-FP-CIT SPECT. J. Nucl. Med. Technol. 2007, 35, 21–26. [Google Scholar] [PubMed]
- Zubal, I.G.; Early, M.; Yuan, O.; Jennings, D.; Marek, K.; Seibyl, J.P. Optimized, Automated Striatal Uptake Analysis Applied to SPECT Brain Scans of Parkinson’s Disease Patients. J. Nucl. Med. 2007, 48, 857–864. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Ottaviani, S.; Tinazzi, M.; Pasquin, I.; Nothdurfter, W.; Tomelleri, G.; Fincati, E.; Nordera, G.; Moretto, G.; Fiaschi, A.; Smania, N.; et al. Comparative analysis of visual and semi-quantitative assessment of striatal [123I]FP-CIT-SPET binding in Parkinson’s disease. Neurol. Sci. 2006, 27, 397–401. [Google Scholar] [CrossRef] [PubMed]
- Werner, R.A.; Marcus, C.; Sheikhbahaei, S.; Solnes, L.B.; Leal, J.P.; Du, Y.; Rowe, S.P.; Higuchi, T.; Buck, A.K.; Lapa, C.; et al. Visual and Semiquantitative Accuracy in Clinical Baseline 123I-Ioflupane SPECT/CT Imaging. Clin. Nucl. Med. 2019, 44, 1–3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Booij, J.; Dubroff, J.; Pryma, D.; Yu, J.Q.; Agarwal, R.; Lakhani, P.; Kuo, P.H. Diagnostic performance of the visual reading of (123)I-ioflupane SPECT images when assessed with or without quantification in patients with movement disorders or dementia. J. Nucl. Med. 2017, 58, 1821–1826. [Google Scholar] [CrossRef] [Green Version]
- Tinaz, S.; Chow, C.; Kuo, P.H.; Krupinski, E.A.; Blumenfeld, H.; Louis, E.D.; Zubal, G. Semiquantitative Analysis of Dopamine Transporter Scans in Patients with Parkinson Disease. Clin. Nucl. Med. 2018, 43, e1–e7. [Google Scholar] [CrossRef] [PubMed]
- Kuo, P.H.; Avery, R.; Krupinski, E.A.; Lei, H.; Bauer, A.; Sherman, S.; McMillan, N.; Seibyl, J.; Zubal, G. Receiver-Operator-Characteristic Analysis of an Automated Program for Analyzing Striatal Uptake of 123I-Ioflupane SPECT images: Calibration Using Visual Reads. J. Nucl. Med. Technol. 2013, 41, 26–31. [Google Scholar] [CrossRef] [Green Version]
- Subramaniam, R.M.; Frey, K.A.; Hunt, C.H.; Mercier, G.A.; Solnes, L.B.; Colletti, P.M.; Lu, Y.; Savir-Baruch, B.; Williams, H.T. ACR–ACNM Practice Parameter for the Performance of Dopamine Transporter (DaT) Single Photon Emission Computed Tomography (SPECT) Imaging for Movement Disorders. Clin. Nucl. Med. 2017, 42, 847–852. [Google Scholar] [CrossRef] [PubMed]
- Kupsch, A.R.; Bajaj, N.; Weiland, F.; Tartaglione, A.; Klutmann, S.; Buitendyk, M.; Sherwin, P.; Tate, A.; Grachev, I.D. Impact of DaTSCAN SPECT imaging in clinical management, diagnosis, confidence of diagnosis, quality of life, health resource use and safety in patients with clinically uncertain parkinsonian syndromes: A prospective 1-year follow-up of an open-label controlled study. J. Neurol. Neurosurg. Psychiatry 2012, 83, 620–628. [Google Scholar] [PubMed]
- Marshall, V.L.; Reininger, C.B.; Marquardt, M.; Patterson, J.; Hadley, D.M.; Oertel, W.H.; Benamer, H.T.S.; Kemp, P.; Burn, D.; Tolosa, E.; et al. Parkinson’s disease is overdiagnosed clinically at baseline in diagnostically uncertain cases: A 3-year European multicenter study with repeat [123I]FP-CIT SPECT. Mov. Disord. 2009, 24, 500–508. [Google Scholar] [CrossRef]
- McKeith, I.; O’Brien, J.; Walker, Z.; Tatsch, K.; Booij, J.; Darcourt, J.; Padovani, A.; Giubbini, R.; Bonuccelli, U.; Volterrani, D.; et al. Sensitivity and specificity of dopamine transporter imaging with 123I-FP-CIT SPECT in dementia with Lewy bodies: A phase III, multicentre study. Lancet Neurol. 2007, 6, 305–313. [Google Scholar] [CrossRef]
- Jiang, W.; Varma, S.; Simon, R. Calculating Confidence Intervals for Prediction Error in Microarray Classification Using Resampling. Stat. Appl. Genet. Mol. Biol. 2008, 7. [Google Scholar] [CrossRef] [PubMed]
- Agresti, A.; Coull, B.A. Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions. Am. Stat. 1998, 52, 119–126. [Google Scholar] [CrossRef]
- Pagano, G.; Niccolini, F.; Politis, M. Imaging in Parkinson’s disease. Clin. Med. 2016, 16, 371–375. [Google Scholar] [CrossRef] [PubMed]
- Shigekiyo, T.; Arawaka, S. Laterality of specific binding ratios on DAT-SPECT for differential diagnosis of degenerative parkin-sonian syndromes. Sci. Rep. 2020, 10, 15761. [Google Scholar] [CrossRef] [PubMed]
- Kuo, P.H.; Lei, H.H.; Avery, R.; Krupinski, E.A.; Bauer, A.; Sherman, S.; McMillan, N.; Seibyl, J.; Zubal, G.I. Evaluation of an Objective Striatal Analysis Program for Determining Laterality in Uptake of 123I-Ioflupane SPECT Images: Comparison to Clinical Symptoms and to Visual Reads. J. Nucl. Med. Technol. 2014, 42, 105–108. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Yousaf, T.; Dervenoulas, G.; Valkimadi, P.E.; Politis, M. Neuroimaging in Lewy body dementia. J. Neurol. 2018, 266, 1–26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Walker, Z.; Moreno, E.; Thomas, A.; Inglis, F.; Tabet, N.; Rainer, M.; Pizzolato, G.; Padovani, A. Clinical usefulness of dopamine transporter SPECT imaging with 123 I-FP-CIT in pa-tients with possible dementia with Lewy bodies: Randomised study. Br. J. Psychiatry 2015, 206, 145–152. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Walker, Z.; Costa, D.C.; Walker, R.W.H.; Lee, L.; Livingston, G.; Jaros, E.; Perry, R.; McKeith, I.; Katona, C.L.E. Striatal dopamine transporter in dementia with Lewy bodies and Parkinson disease: A comparison. Neurology 2004, 62, 1568–1572. [Google Scholar] [CrossRef] [PubMed]
- Matsuda, H.; Murata, M.; Mukai, Y.; Sako, K.; Ono, H.; Toyama, H.; Inui, Y.; Taki, Y.; Shimomura, H.; Nagayama, H.; et al. Japanese multicenter database of healthy controls for [123I]FP-CIT SPECT. Eur. J. Nucl. Med. Mol. Imaging 2018, 45, 1405–1416. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Mushtaq, R.; Kay, M.D.; Steinmeyer, L.; Warhadpande, D.; Kuo, P.H. Pearls and pitfalls of quantitative software analysis of dopa-mine transporter SPECT. Clin. Nucl. Med. 2020, 45, e469–e476. [Google Scholar] [CrossRef]
Figure 1.
Sample result of the DaTQUANT software with the SBR (mean and deviation), z-scores, and percent deviation for multiple variables.
Figure 1.
Sample result of the DaTQUANT software with the SBR (mean and deviation), z-scores, and percent deviation for multiple variables.
Figure 2.
Box and whisker plots for all three data sets.
Figure 3.
Example DaTQUANT results in a non-PS patient demonstrating asymmetric loss of uptake within the left posterior putamen. Despite the asymmetry, none of the summary measures, SBR (1.39), z-score (−0.31), or percent deviations (−0.07) meet the threshold for abnormal.
Figure 3.
Example DaTQUANT results in a non-PS patient demonstrating asymmetric loss of uptake within the left posterior putamen. Despite the asymmetry, none of the summary measures, SBR (1.39), z-score (−0.31), or percent deviations (−0.07) meet the threshold for abnormal.
Figure 4.
Example DaTQUANT results in a non-PS patient demonstrating apparent loss of the normal “comma shape”, particularly on the right. However, none of the summary measures, SBR (1.23 to 1.33), z-score (−0.51 to −0.88), or percent deviations (−0.12 to −0.19) meet thresholds for abnormal. The caudate nuclei are noted to have relatively increased uptake (SBR 3.10–3.45, z-score 2.42–3.48) causing an apparent decrease in putaminal activity where there is none (“hot caudate” sign).
Figure 4.
Example DaTQUANT results in a non-PS patient demonstrating apparent loss of the normal “comma shape”, particularly on the right. However, none of the summary measures, SBR (1.23 to 1.33), z-score (−0.51 to −0.88), or percent deviations (−0.12 to −0.19) meet thresholds for abnormal. The caudate nuclei are noted to have relatively increased uptake (SBR 3.10–3.45, z-score 2.42–3.48) causing an apparent decrease in putaminal activity where there is none (“hot caudate” sign).
Figure 5.
Example DaTQUANT results in a non-PS patient demonstrating visually normal appearing striatum bilaterally. However, the right posterior putamen z-score is −2.15, meeting the threshold for a diagnosis of PS. This is an example of false-positive quantification, reinforcing the idea that quantification is a useful tool for interpretation, but should not replace visual evaluation. Interestingly, the SBR (1.27) does not meet the threshold for PS, and the percent deviation (−0.35) is right at the threshold value for the optimal model (≤−0.36).
Figure 5.
Example DaTQUANT results in a non-PS patient demonstrating visually normal appearing striatum bilaterally. However, the right posterior putamen z-score is −2.15, meeting the threshold for a diagnosis of PS. This is an example of false-positive quantification, reinforcing the idea that quantification is a useful tool for interpretation, but should not replace visual evaluation. Interestingly, the SBR (1.27) does not meet the threshold for PS, and the percent deviation (−0.35) is right at the threshold value for the optimal model (≤−0.36).
Table 1.
Demographic data of the three study groups.
| Patient Characteristic | SC | MC | PPMI | Total |
|---|---|---|---|---|
| Mean Age (years) | 67 ± 11 | 71 ± 10 | 62 ± 10 | 66 ± 11 |
| Gender | ||||
| Male | 67 (52%) | 169 (56%) | 249 (67%) | 485 (60%) |
| Female | 62 (48%) | 134 (44%) | 121 (33%) | 317 (40%) |
Table 2.
Single Variable Results.
| Study Group | Summary Measure | Variable; Threshold | Accuracy | Sensitivity | Specificity |
|---|---|---|---|---|---|
| SC | SBR | Post. Putamen *; ≤0.94 † | 0.91 [0.85, 0.95] | 0.92 | 0.88 |
| z-score | Post. Putamen; ≤−1.9 | 0.90 [0.83, 0.96] | 0.91 | 0.88 | |
| Percent Deviation | Post. Putamen ‡; ≤−0.36 § | 0.90 [0.84, 0.95] | 0.91 | 0.88 | |
| MC | SBR | Post. Putamen; ≤0.90 | 0.85 [0.80, 0.90] | 0.82 | 0.88 |
| z-score | Post. Putamen; ≤−1.73 ‖ | 0.84 [0.80, 0.89] | 0.80 | 0.89 | |
| Percent Deviation | Post. Putamen; ≤−0.39 | 0.85 [0.81, 0.89] | 0.82 | 0.89 | |
| PPMI | SBR | Post. Putamen; ≤1.01 | 0.95 [0.92, 0.97] | 0.91 | 0.97 |
| z-score | Post. Putamen; ≤−1.68 | 0.94 [0.91, 0.96] | 0.91 | 0.95 | |
| Percent Deviation | Post. Putamen; ≤−0.32 | 0.94 [0.91, 0.97] | 0.92 | 0.95 |
The accuracy, sensitivity, and specificity for each group’s best single variable model for each summary measure (SBR, z-score, and percent deviation) with the corresponding threshold value. If the posterior putamen value is less than or equal to the indicated threshold, the patient is predicted to have Parkinson’s disease. *: Striatum and anterior putamen models result in accuracies of 0.91 with sensitivities of 0.89–0.91 and specificities of 0.90–0.94. †: Threshold of ≤1.05 resulted in accuracy of 0.91 with sensitivity of 0.94 and specificity of 0.86. Threshold of ≤1.00 resulted in identical results to ≤0.94. ‡: Anterior putamen and striatum models demonstrate identical results. §: Thresholds of ≤−0.36 to −0.42 demonstrate identical results. ‖: Threshold of ≤−1.52 results in identical accuracy (0.84) with sensitivity of 0.83 and specificity of 0.86.
Table 3.
Multi-variable results: The accuracy, sensitivity, and specificity for each group’s best multiple variable models, including three or fewer variables.
Table 3.
Multi-variable results: The accuracy, sensitivity, and specificity for each group’s best multiple variable models, including three or fewer variables.
| Study Group | Summary Measure | Variables | Accuracy | Sensitivity | Specificity |
|---|---|---|---|---|---|
| SC | SBR | Putamen, Post Putamen, Caudate Asymmetry | 0.92 [0.85, 0.98] | 0.92 | 0.92 |
| z-score | Putamen, Post Putamen, Putamen Asymmetry | 0.91 [0.84, 0.96] | 0.92 | 0.88 | |
| Percent Deviation | Striatum, Post Putamen, Striatum Asymmetry | 0.92 [0.86, 0.98] | 0.92 | 0.92 | |
| MC | SBR | Striatum, Post Putamen | 0.85 [0.81, 0.90] | 0.79 | 0.91 |
| z-score | Striatum, Caudate | 0.85 [0.81, 0.89] | 0.80 | 0.90 | |
| Percent Deviation | Post Putamen, Putamen Asymmetry | 0.85 [0.81, 0.89] | 0.82 | 0.89 | |
| PPMI | SBR | Striatum, Caudate, Putamen Asymmetry | 0.95 [0.93, 0.98] | 0.92 | 0.98 |
| z-score | Striatum, Caudate, Striatum Asymmetry | 0.95 [0.92, 0.97] | 0.92 | 0.97 | |
| Percent Deviation | Post Putamen, P:C | 0.95 [0.92, 0.97] | 0.91 | 0.98 |
Table 4.
Cross-group single variable results.
| Study Group | Variable; Summary Measure Threshold | SC Test | MC Test | PPMI Test | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Acc | Sens | Spec | Acc | Sens | Spec | Acc | Sens | Spec | ||
| SC | Post. Putamen *; SBR ≤ 0.94 † | 0.91 [0.85, 0.95] | 0.92 | 0.88 | 0.83 [0.79, 0.87] | 0.83 | 0.84 | 0.94 [0.91, 0.96] | 0.89 | 0.97 |
| Post. Putamen; z-score ≤ −1.9 | 0.90 [0.83, 0.96] | 0.91 | 0.88 | 0.85 [0.80, 0.88] | 0.78 | 0.91 | 0.92 [0.89, 0.95] | 0.89 | 0.95 | |
| Post. Putamen ‡; % Deviation ≤ −0.36 § | 0.90 [0.84, 0.95] | 0.91 | 0.88 | 0.86 [0.82, 0.90] | 0.83 | 0.89 | 0.94 [0.91, 0.96] | 0.91 | 0.95 | |
| MC | Post. Putamen; SBR ≤ 0.90 | 0.90 [0.84, 0.94] | 0.90 | 0.90 | 0.85 [0.80, 0.90] | 0.82 | 0.88 | 0.93 [0.90, 0.95] | 0.87 | 0.97 |
| Post. Putamen; z-score ≤ −1.73 ‖ | 0.89 [0.83, 0.93] | 0.91 | 0.86 | 0.84 [0.80, 0.89] | 0.80 | 0.89 | 0.93 [0.90, 0.95] | 0.91 | 0.95 | |
| Post. Putamen; % deviation ≤ −0.39 | 0.90 [0.84, 0.94] | 0.91 | 0.88 | 0.85 [0.81, 0.89] | 0.82 | 0.89 | 0.94 [0.91, 0.96] | 0.91 | 0.96 | |
| PPMI | Post. Putamen; SBR ≤ 1.01 | 0.91 [0.85, 0.95] | 0.94 | 0.88 | 0.82 [0.77, 0.86] | 0.83 | 0.80 | 0.95 [0.92, 0.97] | 0.91 | 0.97 |
| Post. Putamen; z-score ≤ −1.68 | 0.89 [0.83, 0.93] | 0.91 | 0.86 | 0.84 [0.80, 0.88] | 0.80 | 0.88 | 0.94 [0.91, 0.96] | 0.91 | 0.95 | |
| Post. Putamen; % deviation ≤ −0.32 | 0.89 [0.83, 0.93] | 0.92 | 0.84 | 0.83 [0.79, 0.87] | 0.83 | 0.84 | 0.94 [0.91, 0.97] | 0.92 | 0.95 | |
The accuracy, sensitivity, and specificity of each group’s best single variable model when tested on the other two groups (bolded numbers are same leave-one-out cross validation group results per Table 2). 95% confidence intervals for the cross-group accuracies are Wilson confidence intervals. *: The striatum, anterior putamen, and putamen models that had similar results on the SC group resulted in drops in accuracy (0.85–0.91 for PPMI) and sensitivity (0.71–0.87 PPMI). †: Threshold values of SBR ≤ 1.00 and ≤1.05 demonstrate similar results, although had lower specificity on the MC group (0.78—0.81). ‡: The anterior putamen model that had similar results on the SC group resulted in drops in accuracy (0.88–0.89 PPMI) and sensitivity (0.79–0.82 PPMI). §: Thresholds of % deviation ≤ −0.39 and ≤−0.42 had similar results to the threshold provided in the table (within 0.01–0.02) except for ≤−0.42 sensitivity for MC (0.79 vs. 0.83). ‖: Threshold value of z-score ≤ −1.52 demonstrated similar results (within 0.02) except for specificity on the SC group (0.82 vs. 0.86).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Neill, M.; Fisher, J.M.; Brand, C.; Lei, H.; Sherman, S.J.; Chou, Y.-H.; Kuo, P.H. Practical Application of DaTQUANT with Optimal Threshold for Diagnostic Accuracy of Dopamine Transporter SPECT. Tomography 2021, 7, 980-989. https://doi.org/10.3390/tomography7040081
AMA Style
Neill M, Fisher JM, Brand C, Lei H, Sherman SJ, Chou Y-H, Kuo PH. Practical Application of DaTQUANT with Optimal Threshold for Diagnostic Accuracy of Dopamine Transporter SPECT. Tomography. 2021; 7(4):980-989. https://doi.org/10.3390/tomography7040081
Chicago/Turabian StyleNeill, Matthew, Julia M. Fisher, Christine Brand, Hong Lei, Scott J. Sherman, Ying-Hui Chou, and Phillip H. Kuo. 2021. "Practical Application of DaTQUANT with Optimal Threshold for Diagnostic Accuracy of Dopamine Transporter SPECT" Tomography 7, no. 4: 980-989. https://doi.org/10.3390/tomography7040081
APA StyleNeill, M., Fisher, J. M., Brand, C., Lei, H., Sherman, S. J., Chou, Y. -H., & Kuo, P. H. (2021). Practical Application of DaTQUANT with Optimal Threshold for Diagnostic Accuracy of Dopamine Transporter SPECT. Tomography, 7(4), 980-989. https://doi.org/10.3390/tomography7040081
