Next Article in Journal
Integrating Youth Perspectives: Adopting a Human Rights and Public Health Approach to Climate Action
Next Article in Special Issue
Integrated Analysis of Behavioural and Health COVID-19 Data Combining Bayesian Networks and Structural Equation Models
Previous Article in Journal
Effects of a Short-Term Slackline Training Program on Energy Expenditure and Balance in Healthy Young Adults: A Preliminary Report of a Randomized Controlled Trial
Previous Article in Special Issue
Exploring the Relationship between Urban Youth Sentiment and the Built Environment Using Machine Learning and Weibo Comments
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Machine Learning Classifier for Predicting Stable MCI Patients Using Gene Biomarkers

1
Institute of Biotechnology and Pharmaceutical Research, National Health Research Institutes, Miaoli County 35053, Taiwan
2
Graduate Institute of Data Science, College of Management, Taipei Medical University, Taipei 10675, Taiwan
3
Department and Graduate Institute of Veterinary Medicine, School of Veterinary Medicine, National Taiwan University, Taipei 10617, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(8), 4839; https://doi.org/10.3390/ijerph19084839
Submission received: 25 February 2022 / Revised: 12 April 2022 / Accepted: 14 April 2022 / Published: 15 April 2022
(This article belongs to the Special Issue 2nd Edition of Big Data, Decision Models, and Public Health)

Abstract

:
Alzheimer’s disease (AD) is a neurodegenerative disorder with an insidious onset and irreversible condition. Patients with mild cognitive impairment (MCI) are at high risk of converting to AD. Early diagnosis of unstable MCI patients is therefore vital for slowing the progression to AD. However, current diagnostic methods are either highly invasive or expensive, preventing their wide applications. Developing low-invasive and cost-efficient screening methods is desirable as the first-tier approach for identifying unstable MCI patients or excluding stable MCI patients. This study developed feature selection and machine learning algorithms to identify blood-sample gene biomarkers for predicting stable MCI patients. Two datasets obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database were utilized to conclude 29 genes biomarkers (31 probes) for predicting stable MCI patients. A random forest-based classifier performed well with area under the receiver operating characteristic curve (AUC) values of 0.841 and 0.775 for cross-validation and test datasets, respectively. For patients with a prediction score greater than 0.9, an excellent concordance of 97% was obtained, showing the usefulness of the proposed method for identifying stable MCI patients. In the context of precision medicine, the proposed prediction model is expected to be useful for identifying stable MCI patients and providing medical doctors and patients with new first-tier diagnosis options.

1. Introduction

Alzheimer’s disease (AD) is an irreversible neurodegenerative condition characterized by progressive cognitive and memory impairments, which negatively influence an individual’s daily life and the social healthcare system [1]. The total cost of care and treatment related to AD worldwide reaches up to USD 1 trillion per year [2]. As of now, there is no cure for AD, and currently available treatments can only postpone the progression of the disease [3]. Several independent studies indicated that treatment decisions would greatly benefit from early diagnosis, which may delay the progression of AD [2,4,5,6]. In clinical trials, cholinesterase inhibitors (ChEIs) have demonstrated therapeutic benefits for symptoms of cognition, function, and behavior across the disease course [7,8]. These agents are most effective when started early in the disease course and persistently used without treatment gaps.
It was reported that 10.0–15.0% of patients diagnosed with mild cognitive impairment (MCI), an intermediate stage between normal aging (NL) and AD, will develop AD within the first year [9]. After six years of follow-up, approximately 80.0% of MCI patients would convert to AD [1,9]. Therefore, it is of high clinical interest to develop prognostic markers for the early detection of unstable MCI patients [8]. Several early diagnostic methods were developed in recent years with high accuracy. Successful cases include image-based methods of magnetic resonance imaging (MRI) and positron emission tomography (PET), and cerebrospinal fluid (CSF)-based protein biomarkers [10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28]. However, the image-based methods are expensive, and CSF-based methods require highly invasive lumbar puncture. It is therefore of special interest to develop low-invasive and cost-effective alternatives, such as plasma-based gene biomarkers [29,30,31,32,33]. Owing to the limited number of samples, their generalization ability may require further validation. Furthermore, the accuracy of low-invasive alternatives may not be sufficient for replacing the image- and CSF-based methods. Instead, they can be applied as first-tier screening methods to identify potential unstable MCI patients or exclude stable MCI patients for image- and CSF-based methods.
This study, therefore, proposed to develop a cost-effective and low-invasive screening method based on plasma gene biomarkers for distinguishing stable and unstable MCI patients. Gene expression and corresponding diagnosis data of study subjects were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI). Machine learning and feature selection algorithms were developed to identify biomarkers for predicting stable MCI patients. The overfitting issues caused by the small number of subjects for biomarkers identification were overcome by incorporating a bigger progression dataset considering any progression from NL and MCI. Based on the two datasets, a common gene set of 31 probes was identified with robust predictive performance. MCI patients with a high stable score can be identified by the developed model with a high accuracy of over 90%. For clinical usage, the developed model offers a new precision diagnosis option with low cost and high efficiency for filtering out MCI patients unlikely to convert to AD. The resource-intensive and invasive diagnostic methods can be reserved for the other patients. It is expected to reduce the overwhelming financial burden of medical care.

2. Materials and Methods

2.1. Dataset

Gene expression and corresponding diagnosis data of study subjects were obtained from the database of Alzheimer’s Disease Neuroimaging Initiative (ADNI) [4]. The primary goal of ADNI is to support the intervention, prevention, and treatment of AD through the application of new diagnostic methods at the earliest possible stages. Data of serial MRI, PET, biological markers, and clinical and neuropsychological assessment are available at http://adni.loni.usc.edu/ (accessed on 10 June 2020). This study considered only the gene expression data from plasma samples.
Patients with diagnosis data both in the enrollment and second-year follow-up and gene expression data from plasma sampled in the enrollment were first identified. A total of 577 subjects were utilized in this study for biomarker identification and belonged to three groups: NL, MCI, and AD. The numbers of subjects for NL, MCI, and AD are 195, 271, and 112, respectively. Two types of progression models were considered in this study. The first model (named StableMCI model) distinguishes stable MCI patients from unstable MCI patients diagnosed with AD in the second-year follow-up. The second model (named Progression model) considered any progression toward AD, including NL conversion to MCI, NL conversion to AD, and MCI conversion to AD. The development of the StableMCI Model is the primary aim of this study. At the same time, the Progression model was utilized to facilitate the selection of biomarkers for improving the prediction of stable MCI patients.
Specifically, 358 subjects were identified for developing the Stable MCI model with 46 stable and 312 unstable MCI patients, respectively. There are 577 subjects with 69 unstable and 508 stable patients for developing the Progression model. The gene expression data for each subject was obtained from ADNI and was based on the Affymetrix Human Genome U219 Array with RMA (robust multichip average) preprocessing method [34]. The gene expression data consisting of 49,386 probes was then log2-transformed and z-score normalized to form the feature vector for each subject using the scikit-learn package. Each of the two sets was randomly divided into a training dataset and a test dataset with a ratio of 4:1. The training datasets were utilized for feature selection and model development. Their corresponding test datasets were used for the independent test of the developed models.

2.2. Model Development

Given a large number of features in our dataset, this study applied a rank-based feature selection method to identify the informative features for predicting stable MCI patients. The rank-based method consists of two steps. First, a filter-based method is applied to rank features. The second step applies a wrapper-based method to include top-ranking features until the user-specified convergence condition. Compared to wrapper-based methods, rank-based methods are more computationally efficient and are widely used in previous studies [35,36,37,38,39]. First, chi-square tests were applied to calculate the chi-square value for each probe using the training dataset. Second, the top-n probes were utilized as a feature vector for machine learning, where n ∈ {1, 5, 10, 15, 20, 25, 50, 100, 250, 500, 1000, 49386}. Subsequently, 10-fold cross-validation (10-CV) was conducted to evaluate the area under the receiver operating characteristic curve (AUC) performance for each number of n. Finally, the feature number n giving the highest AUC value was selected as the informative feature for developing a final model. The AUC value ranged from 0 (worse) to 1 (best).
In this study, a random forest algorithm was applied to develop prediction models. The algorithm was developed by Leo Breiman for learning tree ensembles which were used for classification and regression problems [40]. Each decision tree was constructed based on bootstrap samples and randomly selected variables. A majority vote of outputs from all decision trees was applied to make the final prediction. Random forest is shown to be effective and robust for small datasets [41,42,43,44,45] and is considered suitable for this study. The percentage of stable prediction was utilized as the prediction score ranging from 1 (stable) to 0 (unstable). Two parameters of the number of trees and features for constructing a decision tree were set to 100 and log2(total features + 1). The feature selection and random forest algorithms were implemented using the WEKA (Waikato Environment for Knowledge Analysis) package of version 3.8.4.

3. Results and Discussion

3.1. Subject Characteristics

The included individuals in this study were identified from ADNI studies. The demographic statistics of the study population are shown in Table 1. A total of 732 subjects (StableMCI: 358, Progression: 577) were included in the present study whose gene expression profiles from blood samples were available for biomarker identification. For StableMCI and Progression datasets, the average chronological ages were 73.5 and 74.4, and the ratios of males were 57.5% and 54.0%, respectively. Both age and gender showed no significant difference in StableMCI and Progression datasets (Table 1).

3.2. Identification of Gene Biomarkers

The overall workflow of this study is illustrated in Figure 1. In brief, datasets were extracted from ANDI database and were divided into training and test datasets in a ratio of 4:1 (Figure 1A). A rank-based feature selection algorithm was applied to select informative features with the highest 10-CV performance from 49,386 probes. Prediction models were developed based on the identified informative features and corresponding training dataset. The constructed models were evaluated using the testing dataset.
This study focused on the prediction of stable MCI patients using gene biomarkers. A set of 358 subjects (the StableMCI dataset) were utilized for developing prediction models using the random forest algorithm. First, a chi-square test was applied to rank the probes based on the training dataset. Subsequently, the 10-CV performance of the top n features was evaluated. Since the samples of stable and unstable are unbalanced, the non-parametric AUC measurement was used for evaluating the performance of built models. As shown in Figure 2, the top 250 features gave the highest AUC performance of 0.919. A huge improvement was obtained compared to the AUC value of 0.382 for the classifier using all 49,386 probes. Since the training dataset is small, the feature selection and model development process is likely to be overfitted. Therefore, it is not surprising to see the poor performance of the classifier built on the top 250 features and the whole training dataset with a low test AUC of 0.439 on the test dataset.
While data size is critical for the machine learning task, it is unlikely to obtain a greater number of samples from ADNI in the near future. We therefore proposed to incorporate additional information from the ADNI database. A Progression dataset with 577 subjects was prepared and utilized for feature selection of predictive probes for any progression from NL and MCI to AD. The hypothesis of this study is that true predictive biomarkers for AD should be both useful for predicting stable MCI patients and any progression to AD. The chi-square test was again applied to rank the probes for the Progression dataset, and the AUC performance of the top 250 probes were 0.856 and 0.556 for cross-validation and test, respectively. A total of 31 common probes in the two sets of top 250 probes were then identified. Based on the 31 common probes, reduced cross-validation performance of AUC values of 0.841 and 0.772 was observed for the StableMCI and Progression datasets, respectively. Please note that a few machine learning algorithms, including k-nearest neighbors, naive Bayes, decision tree, and logistic regression, were also evaluated for their prediction performance. However, all of them performed worse than the random forest classifier presented in this study with AUC values less than 0.8. In contrast, the test performance was largely improved, with AUC values of 0.775 and 0.687 for the StableMCI and Progression datasets, respectively. The common probes were considered more robust than the individual probe sets identified from the StableMCI and Progression datasets. The 31 common probes were then utilized to construct the final model for the following analysis.

3.3. Independent Test

To evaluate the generalization ability of the StableMCI model built with the 31 common probes, two independent datasets were extracted from ADNI with the same criteria except that the selection of subjects is based on the first-year (StableMCI-1y) and third-year (StableMCI-3y) diagnosis results. To avoid overestimation of prediction performance, subjects included in the StableMCI dataset were excluded from the following analysis. The numbers of unstable and stable subjects are 14 and 130 for StableMCI-1y, and 12 and 53 for StableMCI-3y. Note that the subjects of StableMCI-1y and StableMCI-3y datasets are different from the subjects of the StableMCI dataset. The StableMCI model built with the 31 common probes performed well, with AUC performance of 0.832 and 0.765 for StableMCI-1y and StableMCI-3y, respectively.
The developed machine learning model with good AUC values can be applied to prioritize the MCI patients for progression to AD. To further evaluate the usefulness of the prediction scores made by the developed model, the MCI patients with a StableMCI score greater than thresholds of 0.5, 0.6, 0.7, 0.8, and 0.9 were identified, and the corresponding concordance was calculated. As shown in Figure 3, a higher threshold of the StableMCI score leads to better concordance in all of the datasets of StableMCI, StableMCI-1y, and StableMCI-3y. For the threshold of 0.9, excellent concordance of 97.3% (143/147) and 96.7% (29/30) and coverage of 51.2% and 42.3% were obtained for the 10-CV and test in the StableMCI dataset, respectively. Only four and one patients with a StableMCI score greater than 0.9 were converted to AD. For StableMCI-1y and StableMCI-3y, the same threshold gives excellent concordance of 97.8% (89/91) and 92.3% (48/52), with coverage of 63.2% and 73.2%, respectively.
While good performance was obtained from this study, it is interesting to compare the proposed method with previous studies. We found one study utilizing the same data source and developing a prediction model based on plasma gene biomarkers [29]. In the study, only 66 patients were included in their study. Two partial least square regression models based on 1123 and 225 genes yielded 74% and 77% accuracy using leave-one-out cross-validation. Please note that prediction performance based on only cross-validation without further testing on external datasets could be overestimated. Our model based on only 31 probes is more practical for clinical use and provides better performance than the previous study.

3.4. Analysis of the Identified Gene Biomarkers

To provide a better understanding of the association between the 31 common probes (29 genes) and AD, a literature search and enrichment analysis were conducted. First, the keywords of “Alzheimer’s disease” and “dementia” were utilized along with each gene name to search PubMed for identifying published studies with both genes and AD/dementia. As shown in Table 2, 13 and 11 genes were mentioned in the published literature with Alzheimer’s disease and dementia, respectively. Notably, several genes identified in this study are known to be associated with AD. For example, the upregulation of CXCR2 could result in increased production of amyloid-β (Aβ) [46]. CLN3 affects the metabolism of the Aβ protein precursor [47]. Inhibition of CAMKK2 protects hippocampal neurons from the synaptogenic effects of Aβ42 oligomers [48]. The other genes not mentioned in the AD/dementia papers can be further investigated for their roles in AD.
Some known AD markers, such as TDP43 and tau, were not identified from this study. Our analysis showed both genes of TDP43 and tau are included in the probe list of the studied dataset. However, they were not identified in this study based on the rank-based method. Both algorithmic or biological conditions could be responsible for the exclusion. First, since the dataset is not very big, and a data-driven approach is utilized for the identification of biomarkers, sampling bias could underrate the importance of the two genes. Second, the ranking could be further affected by potential diagnosis errors and experimental variation. Third, the gene expression profiling was done in the enrollment stage, where the gene expression level of the two AD markers may not be affected yet.

4. Conclusions

Early detection of unstable MCI patients is important for better disease management. Current diagnosis methods are, however, highly invasive and expensive. Therefore, this study developed a machine learning model based on gene biomarkers for predicting stable MCI patients. A set of gene probes was first identified from the StableMCI dataset. However, overfitting issues were observed due to the small size of the dataset. An additional Progression dataset was then utilized to derive an additional set of gene probes. A total of 31 common probes were identified with good AUC performance of 0.841 and 0.775 for 10-CV and test, respectively. External tests on unseen subjects of StableMCI-1y and StableMCI-3y datasets achieved good AUC performance of 0.832 and 0.765, respectively. The results showed that the proposed strategy for gene biomarker identification by incorporating the information of any progression to AD is successful.
Among the 29 gene biomarkers (31 probes) identified in this study, 13 and 11 genes were mentioned in the published literature with Alzheimer’s disease and dementia, respectively. Since the expression levels of genes may not be directly related to the inhibitory activity of AD, further experiments are required for studying their roles in AD progression. We also noticed that some known AD markers were not included in the studied dataset. The inclusion of more comprehensive datasets is expected to further improve the study. The investigation of the identified genes without associated papers is also desirable.
Altogether, the proposed method provides an economic and low-invasive way for the identification of stable MCI patients. While the prediction performance is good, more advanced machine learning algorithms such as XGBoost could be further developed to improve the prediction performance. Based on the proposed method, the identified stable MCI patients will not suffer from invasive or high-cost diagnoses. In addition, medical systems are expected to benefit from the proposed method for resource reallocation, facilitating the precision diagnosis of AD.

Author Contributions

Conceptualization, R.-H.L., C.-C.W., and C.-W.T.; data curation, R.-H.L.; funding acquisition, C.-W.T.; investigation, C.-C.W. and C.-W.T.; methodology, R.-H.L. and C.-W.T.; project administration, C.-W.T.; Supervision, C.-W.T.; writing—original draft, R.-H.L. and C.-W.T.; writing—review and editing, C.-C.W. and C.-W.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Ministry of Science and Technology of Taiwan, grant numbers MOST-110-2221-E-400-004-MY3, MOST-107-2221-E-038-020-MY3 and MOST-110-2313-B-002-051.

Institutional Review Board Statement

Ethical review and approval were waived for this study using the de-identified secondary data that were approved and provided by ADNI database.

Informed Consent Statement

Patient consent was waived due to the use of de-identified secondary data that were approved and provided by ADNI database.

Data Availability Statement

Data used in the preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (https://adni.loni.usc.edu/) (accessed on 10 June 2020).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Albert, M.S.; DeKosky, S.T.; Dickson, D.; Dubois, B.; Feldman, H.H.; Fox, N.C.; Gamst, A.; Holtzman, D.M.; Jagust, W.J.; Petersen, R.C.; et al. The Diagnosis of Mild Cognitive Impairment Due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease. Alzheimers Dement. 2011, 7, 270–279. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Alzheimer’s Disease International. World Alzheimer Report 2019|Alzheimer’s Disease International (ADI); Alzheimer’s Disease International: London, UK, 2019. [Google Scholar]
  3. Siedlecki-Wullich, D.; Català-Solsona, J.; Fábregas, C.; Hernández, I.; Clarimon, J.; Lleó, A.; Boada, M.; Saura, C.A.; Rodríguez-Álvarez, J.; Miñano-Molina, A.J. Altered MicroRNAs Related to Synaptic Function as Potential Plasma Biomarkers for Alzheimer’s Disease. Alzheimers Res. Ther. 2019, 11, 46. [Google Scholar] [CrossRef] [PubMed]
  4. Mueller, S.G.; Weiner, M.W.; Thal, L.J.; Petersen, R.C.; Jack, C.R.; Jagust, W.; Trojanowski, J.Q.; Toga, A.W.; Beckett, L. Ways toward an Early Diagnosis in Alzheimer’s Disease: The Alzheimer’s Disease Neuroimaging Initiative (ADNI). Alzheimers Dement. 2005, 1, 55–66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Pasquier, F. Early Diagnosis of Dementia: Neuropsychology. J. Neurol. 1999, 246, 6–15. [Google Scholar] [CrossRef]
  6. Leifer, B.P. Early Diagnosis of Alzheimer’s Disease: Clinical and Economic Benefits. J. Am. Geriatr. Soc. 2003, 51, S281–S288. [Google Scholar] [CrossRef]
  7. Sharma, K. Cholinesterase Inhibitors as Alzheimer’s Therapeutics. Mol. Med. Rep. 2019, 20, 1479–1487. [Google Scholar] [CrossRef] [Green Version]
  8. Seltzer, B. Cholinesterase Inhibitors in the Clinical Management of Alzheimer’s Disease: Importance of Early and Persistent Treatment. J. Int. Med. Res. 2006, 34, 339–347. [Google Scholar] [CrossRef]
  9. Petersen, R.C.; Smith, G.E.; Waring, S.C.; Ivnik, R.J.; Tangalos, E.G.; Kokmen, E. Mild Cognitive Impairment: Clinical Characterization and Outcome. Arch. Neurol. 1999, 56, 303–308. [Google Scholar] [CrossRef]
  10. Jain, G.; Stuendl, A.; Rao, P.; Berulava, T.; Pena Centeno, T.; Kaurani, L.; Burkhardt, S.; Delalle, I.; Kornhuber, J.; Hüll, M.; et al. A Combined MiRNA–PiRNA Signature to Detect Alzheimer’s Disease. Transl. Psychiatry 2019, 9, 250. [Google Scholar] [CrossRef] [Green Version]
  11. Huang, K.; Lin, Y.; Yang, L.; Wang, Y.; Cai, S.; Pang, L.; Wu, X.; Huang, L. A Multipredictor Model to Predict the Conversion of Mild Cognitive Impairment to Alzheimer’s Disease by Using a Predictive Nomogram. Neuropsychopharmacology 2020, 45, 358–366. [Google Scholar] [CrossRef] [Green Version]
  12. Guo, M.; Li, Y.; Zheng, W.; Huang, K.; Zhou, L.; Hu, X.; Yao, Z.; Hu, B. A Novel Conversion Prediction Method of MCI to AD Based on Longitudinal Dynamic Morphological Features Using ADNI Structural MRIs. J. Neurol. 2020, 267, 2983–2997. [Google Scholar] [CrossRef] [PubMed]
  13. Gao, F.; Yoon, H.; Xu, Y.; Goradia, D.; Luo, J.; Wu, T.; Su, Y. AD-NET: Age-Adjust Neural Network for Improved MCI to AD Conversion Prediction. Neuroimage Clin. 2020, 27, 102290. [Google Scholar] [CrossRef] [PubMed]
  14. Ottoy, J.; Niemantsverdriet, E.; Verhaeghe, J.; De Roeck, E.; Struyfs, H.; Somers, C.; Wyffels, L.; Ceyssens, S.; Van Mossevelde, S.; Van den Bossche, T.; et al. Association of Short-Term Cognitive Decline and MCI-to-AD Dementia Conversion with CSF, MRI, Amyloid- and 18F-FDG-PET Imaging. Neuroimage Clin. 2019, 22, 101771. [Google Scholar] [CrossRef] [PubMed]
  15. Westman, E.; Muehlboeck, J.-S.; Simmons, A. Combining MRI and CSF Measures for Classification of Alzheimer’s Disease and Prediction of Mild Cognitive Impairment Conversion. Neuroimage 2012, 62, 229–238. [Google Scholar] [CrossRef]
  16. Gómez-Sancho, M.; Tohka, J.; Gómez-Verdejo, V. Alzheimer’s Disease Neuroimaging Initiative Comparison of Feature Representations in MRI-Based MCI-to-AD Conversion Prediction. Magn. Reson. Imaging 2018, 50, 84–95. [Google Scholar] [CrossRef] [Green Version]
  17. Shen, T.; Jiang, J.; Li, Y.; Wu, P.; Zuo, C.; Yan, Z. Decision Supporting Model for One-Year Conversion Probability from MCI to AD Using CNN and SVM. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2018, 2018, 738–741. [Google Scholar] [CrossRef]
  18. Caminiti, S.P.; Ballarini, T.; Sala, A.; Cerami, C.; Presotto, L.; Santangelo, R.; Fallanca, F.; Vanoli, E.G.; Gianolli, L.; Iannaccone, S.; et al. FDG-PET and CSF Biomarker Accuracy in Prediction of Conversion to Different Dementias in a Large Multicentre MCI Cohort. Neuroimage Clin. 2018, 18, 167–177. [Google Scholar] [CrossRef]
  19. Liu, F.; Wee, C.-Y.; Chen, H.; Shen, D. Inter-Modality Relationship Constrained Multi-Modality Multi-Task Feature Selection for Alzheimer’s Disease and Mild Cognitive Impairment Identification. Neuroimage 2014, 84, 466–475. [Google Scholar] [CrossRef] [Green Version]
  20. DeToledo-Morrell, L.; Stoub, T.R.; Bulgakova, M.; Wilson, R.S.; Bennett, D.A.; Leurgans, S.; Wuu, J.; Turner, D.A. MRI-Derived Entorhinal Volume Is a Good Predictor of Conversion from MCI to AD. Neurobiol. Aging 2004, 25, 1197–1203. [Google Scholar] [CrossRef]
  21. Hojjati, S.H.; Ebrahimzadeh, A.; Khazaee, A.; Babajani-Feremi, A. Alzheimer’s Disease Neuroimaging Initiative Predicting Conversion from MCI to AD Using Resting-State FMRI, Graph Theoretical Approach and SVM. J. Neurosci. Methods 2017, 282, 69–80. [Google Scholar] [CrossRef] [Green Version]
  22. Zhang, D.; Shen, D.; Initiative, A.D.N. Predicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers. PLoS ONE 2012, 7, e33182. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Teng, L.; Li, Y.; Zhao, Y.; Hu, T.; Zhang, Z.; Yao, Z.; Hu, B. ; Alzheimer’ s Disease Neuroimaging Initiative (ADNI) Predicting MCI Progression with FDG-PET and Cognitive Scores: A Longitudinal Study. BMC Neurol. 2020, 20, 148. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Yue, L.; Hu, D.; Zhang, H.; Wen, J.; Wu, Y.; Li, W.; Sun, L.; Li, X.; Wang, J.; Li, G.; et al. Prediction of 7-year’s Conversion from Subjective Cognitive Decline to Mild Cognitive Impairment. Hum. Brain Mapp. 2020, 42, 192–203. [Google Scholar] [CrossRef] [PubMed]
  25. Ewers, M.; Walsh, C.; Trojanowski, J.Q.; Shaw, L.M.; Petersen, R.C.; Jack, C.R.; Feldman, H.H.; Bokde, A.L.W.; Alexander, G.E.; Scheltens, P.; et al. Prediction of Conversion from Mild Cognitive Impairment to Alzheimer’s Disease Dementia Based upon Biomarkers and Neuropsychological Test Performance. Neurobiol. Aging 2012, 33, 1203–1214. [Google Scholar] [CrossRef] [Green Version]
  26. Hampel, H.; Teipel, S.J.; Fuchsberger, T.; Andreasen, N.; Wiltfang, J.; Otto, M.; Shen, Y.; Dodel, R.; Du, Y.; Farlow, M.; et al. Value of CSF Beta-Amyloid1-42 and Tau as Predictors of Alzheimer’s Disease in Patients with Mild Cognitive Impairment. Mol. Psychiatry 2004, 9, 705–710. [Google Scholar] [CrossRef] [Green Version]
  27. Llano, D.A.; Devanarayan, P.; Devanarayan, V. ; Alzheimer’s Disease Neuroimaging Initiative (ADNI) VGF in Cerebrospinal Fluid Combined with Conventional Biomarkers Enhances Prediction of Conversion from MCI to AD. Alzheimer Dis. Assoc. Disord. 2019, 33, 307–314. [Google Scholar] [CrossRef]
  28. Varatharajah, Y.; Ramanan, V.K.; Iyer, R.; Vemuri, P. Predicting Short-Term MCI-to-AD Progression Using Imaging, CSF, Genetic Factors, Cognitive Resilience, and Demographics. Sci. Rep. 2019, 9, 2235. [Google Scholar] [CrossRef] [Green Version]
  29. Roed, L.; Grave, G.; Lindahl, T.; Rian, E.; Horndalsveen, P.O.; Lannfelt, L.; Nilsson, C.; Swenson, F.; Lönneborg, A.; Sharma, P.; et al. Prediction of Mild Cognitive Impairment That Evolves into Alzheimer’s Disease Dementia within Two Years Using a Gene Expression Signature in Blood: A Pilot Study. J. Alzheimers Dis. 2013, 35, 611–621. [Google Scholar] [CrossRef] [Green Version]
  30. Shaughnessy, L.; Sheard, S.; Goldfarb, D.; Atri, A. Cognitive Assessment of Alzheimer’s Disease and Dementias in Clinical Practice: Pragmatics of Brief Instruments and Neuropsychological Evaluation. J. Clin. Psychiatry 2019, 80, MS18002BR2C. [Google Scholar] [CrossRef]
  31. Lunnon, K.; Sattlecker, M.; Furney, S.J.; Coppola, G.; Simmons, A.; Proitsi, P.; Lupton, M.K.; Lourdusamy, A.; Johnston, C.; Soininen, H.; et al. A Blood Gene Expression Marker of Early Alzheimer’s Disease. J. Alzheimers Dis. 2013, 33, 737–753. [Google Scholar] [CrossRef] [Green Version]
  32. Rye, P.D.; Booij, B.B.; Grave, G.; Lindahl, T.; Kristiansen, L.; Andersen, H.-M.; Horndalsveen, P.O.; Nygaard, H.A.; Naik, M.; Hoprekstad, D.; et al. A Novel Blood Test for the Early Detection of Alzheimer’s Disease. J. Alzheimers Dis. 2011, 23, 121–129. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Shigemizu, D.; Akiyama, S.; Higaki, S.; Sugimoto, T.; Sakurai, T.; Boroevich, K.A.; Sharma, A.; Tsunoda, T.; Ochiya, T.; Niida, S.; et al. Prognosis Prediction Model for Conversion from Mild Cognitive Impairment to Alzheimer’s Disease Created by Integrative Analysis of Multi-Omics Data. Alzheimer Res. Ther. 2020, 12, 145. [Google Scholar] [CrossRef] [PubMed]
  34. Nho, K.; Kim, S.; Soares, H.D.; Singh, P.; Wang, L.; Qi, Z.; He, A.; Neuhaus, I.; Patel, V.; Faber, K.M.; et al. Microarray Gene Expression of ADNI Participants. ADNI Off. Doc. 2015. [Google Scholar]
  35. Ding, C.; Luktarhan, N.; Lu, B.; Zhang, W. A Hybrid Analysis-Based Approach to Android Malware Family Classification. Entropy 2021, 23, 1009. [Google Scholar] [CrossRef]
  36. Diwan, T.D.; Choubey, S.; Hota, H.S.; Goyal, S.B.; Jamal, S.S.; Shukla, P.K.; Tiwari, B. Feature Entropy Estimation (FEE) for Malicious IoT Traffic and Detection Using Machine Learning. Mob. Inf. Syst. 2021, 2021, e8091363. [Google Scholar] [CrossRef]
  37. Kazemi, A.; Kazemi, K.; Sami, A.; Sharifian, R. Identifying Factors That Affect Patient Survival After Orthotopic Liver Transplant Using Machine-Learning Techniques. Exp. Clin. Transpl. 2019, 17, 775–783. [Google Scholar] [CrossRef]
  38. Tung, C.-W. Prediction of Pupylation Sites Using the Composition of K-Spaced Amino Acid Pairs. J. Theor. Biol. 2013, 336, 11–17. [Google Scholar] [CrossRef]
  39. Imrana, Y.; Xiang, Y.; Ali, L.; Abdul-Rauf, Z.; Hu, Y.-C.; Kadry, S.; Lim, S. Χ2-BidLSTM: A Feature Driven Intrusion Detection System Based on Χ2 Statistical Model and Bidirectional LSTM. Sensors 2022, 22, 2018. [Google Scholar] [CrossRef]
  40. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  41. Wang, C.-C.; Liang, Y.-C.; Wang, S.-S.; Lin, P.; Tung, C.-W. A Machine Learning-Driven Approach for Prioritizing Food Contact Chemicals of Carcinogenic Concern Based on Complementary in Silico Methods. Food Chem. Toxicol. 2022, 160, 112802. [Google Scholar] [CrossRef]
  42. Kan, H.-L.; Wang, C.-C.; Lin, Y.-C.; Tung, C.-W. Computational Identification of Preservatives with Potential Neuronal Cytotoxicity. Regul. Toxicol. Pharm. 2020, 119, 104815. [Google Scholar] [CrossRef] [PubMed]
  43. Huang, S.-H.; Lin, Y.-C.; Tung, C.-W. Identification of Time-Invariant Biomarkers for Non-Genotoxic Hepatocarcinogen Assessment. Int. J. Environ. Res. Public Health 2020, 17, 4298. [Google Scholar] [CrossRef] [PubMed]
  44. Liaw, C.; Tung, C.-W.; Ho, S.-Y. Prediction and Analysis of Antibody Amyloidogenesis from Sequences. PLoS ONE 2013, 8, e53235. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Huang, S.-H.; Tung, C.-W.; Fülöp, F.; Li, J.-H. Developing a QSAR Model for Hepatotoxicity Screening of the Active Compounds in Traditional Chinese Medicines. Food Chem. Toxicol. 2015, 78, 71–77. [Google Scholar] [CrossRef]
  46. Bakshi, P.; Margenthaler, E.; Laporte, V.; Crawford, F.; Mullan, M. Novel Role of CXCR2 in Regulation of Gamma-Secretase Activity. ACS Chem. Biol. 2008, 3, 777–789. [Google Scholar] [CrossRef]
  47. Golabek, A.A.; Kida, E.; Walus, M.; Kaczmarski, W.; Michalewski, M.; Wisniewski, K.E. CLN3 Protein Regulates Lysosomal PH and Alters Intracellular Processing of Alzheimer’s Amyloid-Beta Protein Precursor and Cathepsin D in Human Cells. Mol. Genet. Metab. 2000, 70, 203–213. [Google Scholar] [CrossRef]
  48. Mairet-Coello, G.; Courchet, J.; Pieraut, S.; Courchet, V.; Maximov, A.; Polleux, F. The CAMKK2-AMPK Kinase Pathway Mediates the Synaptotoxic Effects of Aβ Oligomers through Tau Phosphorylation. Neuron 2013, 78, 94–108. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Flow diagram of the present work.
Figure 1. Flow diagram of the present work.
Ijerph 19 04839 g001
Figure 2. Rank-based feature selection of predictive probes for predicting stable MCI patients.
Figure 2. Rank-based feature selection of predictive probes for predicting stable MCI patients.
Ijerph 19 04839 g002
Figure 3. Concordance for various thresholds of the StableMCI score.
Figure 3. Concordance for various thresholds of the StableMCI score.
Ijerph 19 04839 g003
Table 1. Characteristics information of datasets for biomarker identification.
Table 1. Characteristics information of datasets for biomarker identification.
Stablemci DatasetProgression Dataset
Unstable Stablep-ValueUnstable Stablep-Value
Number of samples46312 69508
Age ± years 174.6 ± 7.572.4 ± 8.60.5275.2 ± 7.273.6 ± 8.00.28
Gender (M/F)24/22182/1300.7435/34277/2310.64
1 Continuous variables are presented as mean ± standard deviation, and categorical variables are presented as numbers.
Table 2. Co-occurrence analysis of the identified 31 probes (29 genes) and AD/dementia in published literature and corresponding test AUC.
Table 2. Co-occurrence analysis of the identified 31 probes (29 genes) and AD/dementia in published literature and corresponding test AUC.
ProbesGeneTest AUC for Each ProbeNumber of Papers Related to AD Number of Papers Related to Dementia
11750555_a_atNUP2140.66900
11715122_atRAB3D0.63400
11731423_atCXCR20.6252123
11731424_x_at0.530
11731425_at0.502
11731472_a_atTMEM700.61910
11731473_at0.611
11755078_a_atTADA2B0.61300
11731379_x_atMED250.59901
11731508_a_atZNF6490.58700
11716944_a_atYIPF30.58200
11731513_atXPO40.58110
11724775_atFDX10.57100
11722278_a_atSMUG10.56600
11731478_x_atCHMP1B0.56510
11731477_at0.473
11731375_a_atCAMKK20.53487
11731422_s_atFCGR3A0.53401
11724369_atKIAA16440.51400
11731479_s_atTXNDC90.51310
11730994_atS1PR40.50900
11722300_a_atETS10.50644
11731409_atSLC8A20.49932
11723938_s_atGLOD40.48710
11755519_x_atTGS10.44600
11731471_a_atAKT20.44453
11731408_x_atCLN30.434624
11731475_a_atSFRP40.43300
11727610_atENSA0.39431
11731476_x_atMYL10.38701
11731377_s_atRABL2B || RABL2A0.37611
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lin, R.-H.; Wang, C.-C.; Tung, C.-W. A Machine Learning Classifier for Predicting Stable MCI Patients Using Gene Biomarkers. Int. J. Environ. Res. Public Health 2022, 19, 4839. https://doi.org/10.3390/ijerph19084839

AMA Style

Lin R-H, Wang C-C, Tung C-W. A Machine Learning Classifier for Predicting Stable MCI Patients Using Gene Biomarkers. International Journal of Environmental Research and Public Health. 2022; 19(8):4839. https://doi.org/10.3390/ijerph19084839

Chicago/Turabian Style

Lin, Run-Hsin, Chia-Chi Wang, and Chun-Wei Tung. 2022. "A Machine Learning Classifier for Predicting Stable MCI Patients Using Gene Biomarkers" International Journal of Environmental Research and Public Health 19, no. 8: 4839. https://doi.org/10.3390/ijerph19084839

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop