Next Article in Journal
ICU-Acquired Hypernatremia Is Associated with Persistent Inflammation, Immunosuppression and Catabolism Syndrome
Next Article in Special Issue
Alexithymia in Alzheimer’s Disease
Previous Article in Journal
Effect of Orthopedic Treatment for Class III Malocclusion on Upper Airways: A Systematic Review and Meta-Analysis
Previous Article in Special Issue
A Comprehensive Machine-Learning Model Applied to Magnetic Resonance Imaging (MRI) to Predict Alzheimer’s Disease (AD) in Older Subjects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Accurate Blood-Based Diagnostic Biosignatures for Alzheimer’s Disease via Automated Machine Learning

by
Makrina Karaglani
1,2,
Krystallia Gourlia
3,
Ioannis Tsamardinos
2,3,4 and
Ekaterini Chatzaki
1,5,*
1
Laboratory of Pharmacology, Medical School, Democritus University of Thrace, 68100 Alexandroupolis, Greece
2
Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, GR-700 13 Vassilika Vouton, Greece
3
Department of Computer Science, University of Crete, GR-700 13 Vassilika Vouton, Greece
4
Institute of Applied and Computational Mathematics, Foundation for Research and Technology Hellas, GR-700 13 Vassilika Vouton, Greece
5
Institute of Agri-Food and Life Sciences, University Research Centre, Hellenic Mediterranean University, GR-71410 Heraklion, Greece
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(9), 3016; https://doi.org/10.3390/jcm9093016
Submission received: 3 August 2020 / Revised: 4 September 2020 / Accepted: 14 September 2020 / Published: 18 September 2020
(This article belongs to the Special Issue Addressing Alzheimer’s Disease: Blueprints and Therapeutic Hints)

Abstract

:
Alzheimer’s disease (AD) is the most common form of neurodegenerative dementia and its timely diagnosis remains a major challenge in biomarker discovery. In the present study, we analyzed publicly available high-throughput low-sample -omics datasets from studies in AD blood, by the AutoML technology Just Add Data Bio (JADBIO), to construct accurate predictive models for use as diagnostic biosignatures. Considering data from AD patients and age–sex matched cognitively healthy individuals, we produced three best performing diagnostic biosignatures specific for the presence of AD: A. A 506-feature transcriptomic dataset from 48 AD and 22 controls led to a miRNA-based biosignature via Support Vector Machines with three miRNA predictors (AUC 0.975 (0.906, 1.000)), B. A 38,327-feature transcriptomic dataset from 134 AD and 100 controls led to six mRNA-based statistically equivalent signatures via Classification Random Forests with 25 mRNA predictors (AUC 0.846 (0.778, 0.905)) and C. A 9483-feature proteomic dataset from 25 AD and 37 controls led to a protein-based biosignature via Ridge Logistic Regression with seven protein predictors (AUC 0.921 (0.849, 0.972)). These performance metrics were also validated through the JADBIO pipeline confirming stability. In conclusion, using the automated machine learning tool JADBIO, we produced accurate predictive biosignatures extrapolating available low sample -omics data. These results offer options for minimally invasive blood-based diagnostic tests for AD, awaiting clinical validation based on respective laboratory assays. They also highlight the value of AutoML in biomarker discovery.

1. Introduction

Alzheimer’s disease (AD) is the most common form of neurodegenerative dementia [1] and the fifth leading cause of death for those over 65 years [2]. AD is considered to be a chronic and slowly progressive disease, with a slow buildup of pathology during a long pre-symptomatic period [3]. AD causes a progressive loss of cognitive abilities, short-term memory impairment being the most typical initial symptom. However, there are also atypical clinical presentations of AD, e.g., primary progressive aphasia or posterior cortical atrophy. Medical diagnosis of AD is difficult, particularly at the early stage of the disease, mainly because symptoms are often dismissed as normal consequences of aging [4]. As of today, clinical diagnosis of AD is usually based on medical records, physical, and neurological examination, neuroimaging, laboratory tests, and neuropsychological evaluation, while its final diagnosis can only be achieved by autopsy [4], making the discovery of early and accessible biomarkers a major challenge. Early AD diagnosis in middle-aged individuals years ahead of cognitive decline might be the key to successful treatment, as currently available therapeutics only allow small benefits for diagnosed AD patients.
Targeted discovery approaches have been previously employed to identify some initial biofluid markers for AD diagnosis. Cerebrospinal fluid levels of amyloid beta protein (Aβ) and the microtubule-associated protein tau display good diagnostic utility and can be used to monitor aspects of therapeutic development [3]. However, there are no reliable blood biomarkers, although there is an emerging literature on P-tau concentration in neuronally derived blood exosomes, with contrasting results with regard to association with AD clinical manifestations [5]. The benefit of searching for blood-based biomarkers is evident due to the easy and minimally-invasive nature of blood sample collection compared with any other biofluid. Blood transcriptomics, proteomics, and/or metabolomics may pave the way for the development of accurate, cost-effective, and minimally-invasive AD diagnostics and/or screening tools for high risk individuals.
In the present study, we utilized publicly available multi -omics datasets from studies in AD blood for automated machine learning (autoML), using the Just Add Data Bio (JADBIO) platform [6] JADBIO is a recently launched autoML technology readily applicable to low-sample, high-dimensional data producing accurate predictive models with their corresponding biosignatures [7,8,9,10,11]. For a given outcome and set of features, JADBIO provides both (i) the minimal subset of predictors (namely, the biomarker biosignature) that ensures maximal predictive power and (ii) the optimal predictive model associated with the selected biosignature. This is achieved by combining the feature selection method Statistically Equivalent biosignatures (SES) [12] with Support Vector Machines, Random Forest, and Penalized Linear Models algorithms. Cross validation is used in order to optimize the algorithms over their corresponding hyper-parameter configurations and to select the best performing configuration. The expected predictive performance on external data is estimated using bootstrapping techniques and was proven free of over-optimistic estimates (Bootstrap Bias Corrected cross validation (CV) protocol, BBC-CV [13]).
Using JADBIO, we reprocessed publicly available datasets against clinically diagnosed AD to produce accurate biosignatures/models that could subsequently be translated into cost-effective benchmark diagnostic solutions.

2. Materials and Methods

2.1. Datasets

In the present study, we searched for publicly available -omic datasets generated from blood samples of AD patients and cognitively healthy individuals that include both molecular profiles (transcriptomic, proteomic, and metabolomic), and curated meta-data (i.e., study design information and clinical data) in BioDataome [14], Metabolomics Workbench [15], and Gene Expression Omnibus (GEO) [16] repositories. BioDataome is an online repository with transcriptome (both microarray and RNA-seq) and epigenetics (methylation array) datasets, which uniformly processes and automatically annotates datasets from the GEO and the RECOUNT database [17]. The available information about the patients/cases in the datasets used regarding age and sex are presented in Supplementary Table S1.

2.2. Construction of Biosignatures/Models via AutoML

For automated machine learning we employed the autoML JADBIO [6] platform, version 1.1.20 (10 June 2020). Specifically, JADBIO [6] has the following functionality and properties: (a) given a 2D matrix of data, it automatically produces predictive models for a categorical (classification), continuous (regression), or time-to-event (survival analysis) outcome. No selection of appropriate algorithms to apply is necessary or tuning of their hyper-parameter values. Available classification algorithms are: Classification Random Forests, Support Vector Machines (SVM), Ridge Logistic Regression and Classification Decision Trees. (b) It identifies multiple equivalent biosignatures, (c) it produces conservative predictive performance estimates and corresponding confidence intervals. It reliably processes up to hundreds of thousands of features and sample sizes as low as a couple of dozen. JADBIO also employs the recently developed BBC-CV protocol for tuning the hyper-parameters of algorithms while estimating performance and adjusting for multiple tries. JADBIO architecture can be found in Montesanto et al., 2020 [7].
Seven different omics 2D csv matrixes, including molecular profile data and respective clinical information were uploaded in JADBIO and were automatically analyzed via extensive tuning effort. For all datasets the performance was evaluated via internal validation (BBC-CV within each dataset). In addition, external validation was plausible in the large-sample datasets (transcriptomic 2, 3 and 4), which were randomly automatically split into train and test sub-datasets by 70/30 ratio via JADBIO.

2.3. Correlation of Selected Features to AD

The biological involvement and related pathways of identified features, i.e., proteins, mRNAs and miRNAs to AD was searched using the GeneCards—The Human gene database tool (https://www.genecards.org/). MiRNA Predicted targets were identified in the miRbase database (http://www.mirbase.org/).

3. Results

3.1. Datasets

Searching in the available repositories, we were able to identify two metabolomic datasets, two proteomic datasets, three microRNA (miRNA) transcriptomic datasets (one excluded from further analysis due to very low sample number) and seven mRNA transcriptomic datasets (three excluded from further analysis due to very low sample numbers, non-availability of processed data or inclusion of only female samples). Specifically, AD patient samples and age and sex matched cognitively healthy individual samples were retrieved from the following datasets: the metabolomic datasets ST000046 (Project doi:10.21228/M88G6G) (metabolomic 1) and ST000433 Project DOI:10.21228/M8HS40) (metabolomic 2) from Metabolomics Workbench, the proteomic datasets GSE39087 [18] and GSE29676 [19] from GEO, pooled as they contained the same profiles (proteomic), the two miRNA transcriptomic datasets GSE46579 [20] (transcriptomic 1) and GSE120584 [21] (transcriptomic 2) from Bio-dataome and GEO respectively, and two mRNA transcriptomic datasets GSE63060 [22] (transcriptomic 3) and GSE63063 [22] (transcriptomic 4) from GEO. All in all, we analyzed seven different datasets in our study. Table 1 gives a summary of the dataset dimensions used in the study.

3.2. Biosignatures

Considering all the suitable multi-omics blood-based data from AD patients identified in the available depositories and age–sex matched cognitively healthy individuals, we produced biosignatures of AUC ranging from 0.489 to 0.975 described below.

3.2.1. Proteomic Biosignature

AutoML analysis of the 9483-feature proteomic data from 25 AD patients and 37 cognitively healthy individuals led to one protein-based biosignature via a Ridge Logistic Regression model with seven protein predictors with high AUC (0.921 (0.849, 0.972)). The biosignature’s performance, selected predictors and model inspection are presented in Figure 1.
Selected protein features include: Leucine Rich Repeats and IQ Motif Containing Protein 2 (LRRIQ2), Calcium signal-modulating cyclophilin ligand (CAMLG), interleukin 4 (IL4), tropomyosin 1 (TPM1), interleukin 20 (IL20), diablo homolog (Drosophila) (DIABLO), and Serine/threonine-protein kinase 3 (VRK3). Relation to AD according to GeneCards search (https://www.genecards.org/Search/Keyword?queryString=Alzheimer%27s&startPage=0&pageSize=-1), revealed some relation to AD for all but the first two proteins, IL4 being the one presenting the highest score (Supplementary Table S2).

3.2.2. miRNA Biosignatures

AutoML analysis of the 506-feature miRNA-transcriptomic data from 48 AD patients and 22 cognitively healthy individuals led to one miRNA-based predictive biosignature via a Support Vector Machines model with three miRNA predictors with high AUC (0.975 (0.908, 1.000)). Biosignature performance, selected predictors and model inspection are presented in Figure 2.
Selection of a clinical cut-off threshold taking into consideration cost and disease prevalence is facilitated by the JADBIO ROC curve outcome, which contains all possible trade-offs between the False Positive Rate and the True Positive Rate, as well as the Precision-Recall Curve which contains all possible trade-offs between the Precision and Recall that are achievable by the model. JADBIO calculates statistics, performance metrics, and confidence intervals for 10 such points on these two curves (Figure 2A,B). Performance metrics (sensitivity, specificity, PPV, NVP, etc.) for three standard cut-off thresholds are included in Supplementary Figures S7–S9.
Further interactive peruse for cut-off thresholds and metrics for this analysis is provided in the link https://app.jadbio.com/share/3f050861-da6b-447a-b2b1-908c71d65c3d.
Relation of the three identified miRNAs to the AD according to GeneCards search (https://www.genecards.org/Search/Keyword?queryString=ALZHEIMER&pageSize=-1&startPage=0) revealed relation to the disease, with MIR29C related to the MicroRNAs in cancer and Metastatic brain tumor pathway presenting the highest score (Supplementary Table S3). MIR30D and MIR182 were identified in the miRNA targets in extracellular matrix ECM and membrane receptors and MicroRNAs in cancer and Alzheimer’s Disease pathways, respectively.
AutoML analysis of the 2566-feature miRNA-transcriptomic data from 301 AD patients and 288 cognitively healthy individuals led to an mRNA-based predictive biosignature via a Ridge Logistic Regression model with 25 mRNA predictors with AUC 0.797 (0.746, 0.845). The biosignature’s performance, selected predictors and model inspection are presented in Supplementary Figure S1.
Most importantly, the size of this dataset allowed further internal automated validation, i.e., this same transcriptomic dataset was randomly split into train and test sub-datasets by a 70/30 ratio. The train 2566-feature miRNA-transcriptomic data from 232 AD patients and 200 cognitively healthy individuals led again to a similar but not identical mRNA-based predictive biosignature via a Ridge Logistic Regression model with 25 mRNA predictors with high AUC 0.812 (0.758, 0.862). A total of 14 of predictors were common with the original signature. While validated in the test 2566-feature mRNA-transcriptomic data from 84 AD patients and 73 cognitively healthy individuals, this biosignature showed AUC 0.807, verifying the stability of model’s performance. The biosignature’s performance, selected predictors and model inspection are presented in Supplementary Figure S2 and the performance of the validation dataset is shown in Supplementary Figure S3.

3.2.3. mRNA Biosignatures

AutoML analysis of the 38,327-feature mRNA-transcriptomic data from 134 AD patients and 100 cognitively healthy individuals led to six mRNA-based statistically equivalent predictive biosignatures via a Classification Random Forests model with 25 mRNA predictors presenting high AUC (0.846 (0.778, 0.905)). A total of 24 of 25 predictors were common in all six of them. The biosignatures’ performance, selected predictors for all six models and model inspection are presented in Figure 3.
Relation of the 30 identified mRNAs to AD according to GeneCards search (https://www.genecards.org/Search/Keyword?queryString=ALZHEIMER&pageSize=-1&startPage=0) revealed no or poor relation, with the exception of CHAT gene of Choline O-Acetyltransferase, related to the pathways of Neurotransmitter Release Cycle and Transmission across Chemical Synapses (Supplementary Table S4).
The size of this dataset also allowed internal validation and was automatically split into train and test sub-datasets by a 70/30 ratio. The train 38,327-feature mRNA-transcriptomic data from 100 AD patients and 73 cognitively healthy individuals led to an mRNA-based predictive biosignature via a Classification Random Forests model with 25 mRNA predictors with high AUC (0.822 (0.740, 0.894)). A total of 11 predictors were common to the original signature. When this biosignature was applied in the test sub-dataset from 34 AD patients and 27 cognitively healthy individuals, it showed AUC 0.824, verifying model’s performance stability. The biosignature’s performance, selected predictors and model inspection are presented in Figure 4 and performance of the validation dataset is shown in Figure 5.
AutoML analysis of the 32,053-feature mRNA-transcriptomic data from 126 AD patients and 131 cognitively healthy individuals led to two statistically equivalent mRNA-based predictive biosignatures via a Classification Random Forests model with 25 mRNA predictors with AUC 0.726 (0.644, 0.802), with 24 common features. The biosignature’s performance, selected predictors and model inspection are presented in Supplementary Figure S4.
This same transcriptomic dataset was split into train and test sub-datasets by a 70/30 ratio. The train 32,053-feature mRNA-transcriptomic data from 100 AD patients and 90 cognitively healthy individuals led to four statistically equivalent mRNA-based predictive biosignatures via a Classification Random Forests model, with 25 mRNA predictors of AUC 0.728 (0.636, 0.817) and 11common predictors. The test data from 26 AD patients and 41 cognitively healthy individuals showed AUC 0.814, again verifying model’s performance stability. The biosignature’s performance, selected predictors and model inspection are presented in Supplementary Figure S5 and performance of validation dataset is shown in Supplementary Figure S6.

3.2.4. Metabolomic Biosignatures

AutoML analysis of the 3734-feature metabolomic data from 15 AD patients and 15 cognitively healthy individuals as well as the 25-feature metabolomic data from 18 AD patients and 21 cognitively healthy individuals data produced low performing biosignatures. Specifically, the first dataset led to a biosignature via a Support Vector Machines model with four metabolite predictors with poor AUC (0.556 (0.375, 0.709)). Similarly, the second lipidomic data led to a biosignature via Support Vector Machines model with one lipid predictor again of poor AUC (0.489 (0.294, 0.688)).

4. Discussion

Automated Machine Learning (AutoML) is a new reality in translational medicine and molecular biology, that promises to democratize data analysis to non-experts, drastically increase productivity, improve replicability of the statistical analysis, facilitate the interpretation of results, and shield against common methodological analysis pit-falls such as overfitting [6]. Most importantly, it to extract maximum information from laborious and expensive array examinations from precious and scarce clinical samples towards personalized clinical decisions and disease management. In this study, we employed the autoML technology JADBIO, in order to obtain easily and quickly accurate predictive models for AD disease, using all available archived proteomics, metabolomics and transcriptomics datasets. The JADBIO platform has been designed for non-experts to deliver high-quality predictive and diagnostic models, employing standard, best-practices and state-of-the-art statistical and machine learning methods. It identifies multiple (in case of biological redundancy) equivalent biosignatures of selective predictive features. It scales up to hundreds of thousands of features, which implies that it can simultaneously consider multi-omics, clinical, and epidemiological parameters. JADBIO scales down to tiny sample sizes (e.g., 40) often encountered with molecular biology data, in the sense that it still manages to provide accurate, non-optimistic estimates of maximum predictive performance. JADBIO is specifically devised for life scientists without knowledge of coding, advanced statistics or data analysis expertise. It shields against typical methodological pitfalls in data analysis that lead to overfitting and overestimating performance and therefore to misleading results [6]. Using this innovative but validated autoML tool, we were able to construct three best performing accurate diagnostic biosignatures from proteomics, miRNA-transcriptomics and mRNA-transcriptomics data via Ridge Logistic Regression, Support Vector Machines and Classification Random Forests models. All three biosignatures (and their statistically equivalent ones) showed high performance and the miRNA-transcriptomic biosignature reached the highest AUC (0.975 (0.906, 1.000)) with only three miRNA-predictors. These three miRNAs were also shown to be related to AD in a Genecards search, pointing into a biological role of the pathways involved in disease pathophysiology.
The bootstrapping technique used performs a correction to the estimation of out-of-sample performance of the final model. The correction (adjustment) is required because JADBIO tries thousands of machine learning pipelines to identify the best one that produces the optimal, final model. The correction is conceptually similar to the Bonferroni adjustment required for multiple hypothesis testing due to performing multiple tests. Intuitively, the selection process, which selects the best out of numerous pipelines is bootstrapped. This technique has been shown to produce conservative estimates of performance in massive evaluation experiments with general types of data [13] as well as hundreds of -omics data [23]. It has been used to produce several novel scientific results [9,10,11,12].
Blood-based biomarkers have emerged as promising minimally invasive AD diagnostic options [24] and machine learning has been employed for their development. In fact, multiple miRNA or mRNA (gene expression) biosignatures have previously been re-ported for early AD diagnosis. Specifically, Leidinger et al. produced a 12-miRNA biosignature via support vector machines that showed accuracy of 0.930 in diagnosing AD [20]. This same 506-feature miRNA dataset was analyzed here via JADBIO, resulting in a shorter biosignature of three predictors performing even better (AUC 0.975). Reducing the dimensions of a signature is a great advantage in terms of translatability to cost-effective assays with less need for multiplexing. Recently, Zhao et al. produced a 12-miRNA biosignature developed via a random forest algorithm that showed good accuracy (0.760) for AD diagnosis [25]. Similarly, Shigemizu et al. analyzing the same 2566-feature miRNA dataset used in our study, produced a 78-miRNA biosignature based on a supervised principal component analysis logistic regression method that showed accuracy 0.873 [21]. Our autoML approach led to a reduced size biosignature via a Ridge Logistic Regression model (25 predictors), and internal validation confirmed stability of its performance. Overall, earlier produced miRNA-biosignatures through machine learning, contain multiple predictors hampering their clinical adaptation. An additional advantage of our approach is the application of several machine learning algorithms at once automatically revealing the best.
Omics mRNA data have also been analyzed to produce diagnostic biosignatures. Patel et al. using an XGBoost classification algorithm reported two mRNA-biosignatures, a 57-mRNA biosignature for the discrimination between AD patients and healthy individuals with 0.450 AUC and an 89 mRNA-biosignature for the discrimination between AD patients and non-AD patients (consisted of either healthy individuals or patients with other diseases) with AUC 0.860 [26]. Lee and Lee produced three mRNA-biosignatures via logistic regression, L1-regularized logistic regression, random forest, support vector machine, and deep neural network using three independent datasets reaching AUC 0.657, 0.874, and 0.804, respectively. [27] Li et al., using the same 38,327-feature mRNA transcriptomic dataset of our study (containing all the available samples) and trying “manually” different ML approaches, including support vector machines, random forest and logistic Ridge Regression models, produced a three-mRNA biosignature which discriminated between AD patients and controls with 0.860 AUC [28]. AutoML analysis of this dataset here led to six statistically equivalent biosignatures via a Classification Random Forests model of similar performance.
To the best of our knowledge, to date only Ravetti et al. produced a five-protein biosignature via machine learning models for predicting clinical AD disease with 0.960 total accuracy using more than 20 different classifiers available in the widely-used Weka software package [29]. Whereas the original proteomic datasets [18,19] pooled to the one analyzed here, were originally used to study AD-specific autoantibodies in serum, our autoML analysis led to a seven-feature proteomic accurate biosignature for the diagnosis of AD, also highlighting the importance of this meta-analysis for maximal conclusion extraction from a given experimental observation. Selected protein features include: Leucine Rich Repeats and IQ Motif Containing Protein 2 (LRRIQ2), Calcium signal-modulating cyclophilin ligand (CAMLG), interleukin 4 (IL4), tropomyosin 1 (TPM1), interleukin 20 (IL20), diablo homolog (Drosophila) (DIABLO), and Serine/threonine-protein kinase 3 (VRK3). Interestingly, although the majority of them were found to be related to the AD disease according to our GeneCards—The Human gene database search their low score values were so far leading to their neglect from further attention in biological pathway and hypothesis-driven publications. Even more surprising was that the last three proteins have never been related to the AD disease before and this would certainly be interesting to further investigate. The deployment of our approach led to their surfacing, highlighting the offer of secondary data extrapolation and information digging approaches of machine learning analysis for translational purposes.
Although, metabolomic measurements act as a molecular fingerprint of disease progression, it is widely accepted that there is a degree of uncertainty in these datasets due to the limited overall coverage of the mass spectrometry (MS) methods. Combined with the inherent irreproducibility of the MS measurements, they may lead to challenges and difficulty in the development of accurate predictive biosignatures, also observed here in our metabolomic biosignatures. Interestingly, Stamate et al., using a 883-feature metabolomic dataset produced three biosignatures: one with AUC 0.850 (0.800–0.890) via Deep learning, a second of AUC 0.880 (0.860–0.890) via an XGBoost model and a last of AUC 0.850 (0.830–0.870) via an Random Forest model, respectively. However, all those biosignatures contained as much as 347 predictors [30].
A limitation worth mentioning of our study is the absence of external validation (cross dataset analysis) of the biosignatures, due to the lack of independent datasets run with common platforms. However, JADBIO implements internal cross-validation with the bootstrap corrected cross-validation (BBC-CV) algorithm [6] and it has been shown to produce accurate out-of-sample estimates of predictive performance. We also validated the developed signatures in 70/30 subsets, whenever the sample size of the dataset allowed it, and were able to show the stability of their performance. Another limitation is the low sample numbers of the proteomic and the metabolomic datasets, which is however overcome by the autoML tool used resulting in promising results at least in the proteome biomarkers. Overall, the high performance of our blood-based biosignatures paves the way for prospective clinical validation for timely identification of people with AD, in terms of early and accurate minimally invasive diagnosis.
The only available information about the patients/cases in the datasets available in the repositories, also in those used in this study, are age and sex. Clinical information is restricted to the presence of diagnosed AD or not (cognitive healthy controls). No information whatsoever is provided on the stage, duration since diagnosis, disease progression, moreover on the type of dementia. This is a most common situation in the deposited -omics datasets which undoubtfully raises an intrinsic limitation of these data-driven approaches. Even more, as reanalyzing and reevaluating archived data attracts gradually the interest of researchers, as new analyzing tools emerge, such as that used in our study, the quality and completeness of the data stored becomes a major issue and groups producing the original datasets are encouraged to share more information about their samples. This is strongly supported by studies such as this one, aiming to highlight the potential of these approaches.
The biosignatures built here can only differentiate between AD and healthy controls, as this was the only available clinical end-point. Our analysis cannot offer any additional diagnostic information against other clinically important endpoints, such as the type of dementia, disease progression and therapeutic outcome. Nevertheless, they offer a mature starting point for researchers working on developing diagnostic tools in AD, should they choose to further check their clinical performance in new and well described datasets, hopefully saving time and resources.
Upon further validation in complete datasets by groups with a special interest in AD, the biosignatures described could offer feasible solutions for routine blood-based laboratory tests that could be realized in any standard equipped diagnostic lab. This is the most significant merit of the present study for the scientific community, moving from the -omics multi-dimensional results to simpler classifiers. Reducing the dimensions of a signature is a great advantage in terms of translationability to cost-effective assays with less need for multiplexing. In specific, proteomic and miRNA biosignatures could be applied in a clinical setting due to their limited number of predictors. Proteomic biosignature could be used as a seven-protein ELISA assay, while miRNA biosignature as a three-plex RT-PCR assay measured on plasma samples, both technically feasible.
Combining proteomic, transcriptomic and metabolomic data in a multi-omic approach could theoretically be implemented for more effective data exploitation. However, any datasets jointly including more than one modality on the same sample set are rare, obviously due to high resource requirements. Alternatively, efforts to create computational methods that “translate” one platform and technology (e.g., transcriptomic) to another (e.g., proteomics) are at the moment the spearhead of bioinformatics development, with several labs (including ours) intensively working on such technologies, however still with less-than-optimal results [31]. Nevertheless, as far as it concerns applicability as an effective test in a clinical setting, biosignatures combining features of different nature (i.e., both nucleic acids and proteins) would be technically more complicated to implement in a single blood sample.

5. Conclusions

In conclusion, using the autoML JADBIO tool, we produced specific predictive biosignatures extrapolating available low sample multi-omics data. These results offer options for minimally invasive blood-based diagnostic tests, awaiting clinical validation based on respective laboratory assays for the classification of Alzheimer’s disease. They also highlight the value of autoML in biomarker discovery.
All three reported biosignatures showing high performance and AUC > 0.85 are worthy of further validation. Still, if we were to choose one as the most promising, we would propose this to be the miRNA-transcriptomic biosignature based on three apparent advantages: highest performance [AUC 0.975 (0.906, 1.000)], fewer features (three predictors), entities allowing easy multiplexing assays (miRNA).
A side-conclusion of this study yet quite important, is the following: revisiting and reanalyzing “old” datasets is not only potentially fruitful but scientifically necessary. The current mentality of life-scientists is often to discard public data as “used”, under the assumption that all discoveries to be made, are already published. However, as new and powerful statistical and computational methods are introduced, such as JADBIO and AutoML, new types of analyses become possible and new patterns and results become ripe for discovery [32]. It is not only computational methods that change; the analysis context is constantly changing. It is thus worth re-analyzing past datasets in the context of new datasets submitted [23] recent scientific publications, or newly added or revised knowledge in biological databases (e.g., updated pathways).

Supplementary Materials

The following are available online at https://www.mdpi.com/2077-0383/9/9/3016/s1, Figure S1: 2566-feature miRNA-transcriptomic dataset signature performance, selected predictors and model inspection: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Probabilities density plot, D. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, E. Cumulative feature importance plot of the 25 miRNA predictors of the signature. Figure S2: 2566-feature miRNA-transcriptomic sub-dataset (train) signature performance, selected predictors and model inspection: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Probabilities density plot, D. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, E. Cumulative feature importance plot of the 25 miRNA predictors of the signature. Figure S3: Validation of 2566-feature miRNA sub-dataset (test) signature performance: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals in test dataset. Figure S4: 32,053-feature mRNA-transcriptomic dataset signature performance, selected predictors and model inspection: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Probabilities density plot, D. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, E. Cumulative feature importance plot of the 25 mRNA predictors of the reference signature. Figure S5: 32,053-feature mRNA-transcriptomic sub-dataset (train) signature performance, selected predictors and model inspection: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Probabilities density plot, D. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, E. Cumulative feature importance plot of the 25 mRNA predictors of the reference signature. Figure S6: Validation of 32,053-feature mRNA sub-dataset (test) signature performance: A. Receiver Operating Characteristic (ROC) Curve for AD class, B. Precision-recall plot, C. Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals in test dataset. Table S1: Available information about the patients/cases in the datasets used regarding age and sex. Table S2 Results of the GeneCards search of the proteins selected in the biosignatures in relation to AD. Supplementary Table S3 Results of the GeneCards search of the miRNAs selected in the biosignatures in relation to AD. Supplementary Table S4 Results of the GeneCards search of the mRNAs selected in the biosignatures in relation to AD.

Author Contributions

Conceptualization, M.K., E.C. and I.T.; methodology, M.K.; software, I.T.; validation, M.K.; data curation, K.G.; writing—original draft preparation, M.K.; writing—review and editing, E.C.; visualization, K.G.; supervision, K.C.; project administration, I.T.; funding acquisition, I.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by “Matching funds” from the General Secretariat for Research and Technology, Greece.

Conflicts of Interest

M.K., K.G. and I.T. are directly or indirectly affiliated with Gnosis Data Analysis that offers the JADBIO service commercially.

References

  1. Winblad, B.; Amouyel, P.; Andrieu, S.; Ballard, C.; Brayne, C.; Brodaty, H.; Cedazo-Minguez, A.; Dubois, B.; Edvardsson, D.; Feldman, H.H.; et al. Defeating Alzheimer’s disease and other dementias: A priority for European science and society. Lancet Neurol. 2016, 15, 455–532. [Google Scholar] [CrossRef] [Green Version]
  2. Nichols, E.; Szoeke, C.E.; Vollset, S.E.; Abbasi, N.; Abd-Allah, F.; Abdela, J.; Aichour, M.T.E.; Akinyemi, R.O.; Alahdab, F.; Asgedom, S.W.; et al. Global, regional, and national burden of Alzheimer’s disease and other dementias: A systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol. 2019, 18, 88–106. [Google Scholar] [CrossRef] [Green Version]
  3. Galasko, D. Expanding the Repertoire of Biomarkers for Alzheimer’s Disease: Targeted and Non-targeted Approaches. Front. Neurol. 2015, 6, 256. [Google Scholar] [CrossRef] [Green Version]
  4. Zverova, M. Alzheimer’s disease and blood-based biomarkers—Potential contexts of use. Neuropsychiatr. Dis. Treat. 2018, 14, 1877–1882. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Zetterberg, H. Applying fluid biomarkers to Alzheimer’s disease. Am. J. Physiol. Physiol. 2017, 313, C3–C10. [Google Scholar] [CrossRef] [Green Version]
  6. Tsamardinos, I.; Charonyktakis, P.; Lakiotaki, K.; Borboudakis, G.; Zenklusen, J.C.; Juhl, H.; Chatzaki, E.; Lagani, V. Just Add Data: Automated Predictive Modeling and BioSignature Discovery. Biorxiv. 2020. [Google Scholar] [CrossRef]
  7. Montesanto, A.; D’Aquila, P.; Lagani, V.; Paparazzo, E.; Geracitano, S.; Formentini, L.; Giacconi, R.; Cardelli, M.; Provinciali, M.; Bellizzi, D.; et al. A New Robust Epigenetic Model for Forensic Age Prediction. J. Forensic Sci. 2020. [CrossRef] [PubMed]
  8. Panagopoulou, M.; Karaglani, M.; Balgkouranidou, I.; Biziota, E.; Koukaki, T.; Karamitrousis, E.; Nena, E.; Tsamardinos, I.; Kolios, G.; Lianidou, E.; et al. Circulating cell-free DNA in breast cancer: Size profiling, levels, and methylation patterns lead to prognostic and predictive classifiers. Oncogene 2019, 38, 3387–3401. [Google Scholar] [CrossRef]
  9. Orfanoudaki, G.; Markaki, M.; Chatzi, K.; Tsamardinos, I.; Economou, A. MatureP: Prediction of secreted proteins with exclusive information from their mature regions. Sci. Rep. 2017, 7, 3263. [Google Scholar] [CrossRef] [Green Version]
  10. Borboudakis, G.; Stergiannakos, T.; Frysali, M.; Klontzas, E.; Tsamardinos, I.; Froudakis, G.E. Chemically intuited, large-scale screening of MOFs by machine learning techniques. NPJ Comput. Mater. 2017, 3. [Google Scholar] [CrossRef]
  11. Adamou, M.; Antoniou, G.; Greasidou, E.; Lagani, V.; Charonyktakis, P.; Tsamardinos, I.; Doyle, M. Toward Automatic Risk Assessment to Support Suicide Prevention. Crisis 2019, 40, 249–256. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Lagani, V.; Athineou, G.; Farcomeni, A.; Tsagris, M.; Tsamardinos, I. Feature Selection with the R Package MXM: Discovering Statistically Equivalent Feature Subsets. J. Stat. Softw. 2017, 80. [Google Scholar] [CrossRef] [Green Version]
  13. Tsamardinos, I.; Greasidou, E.; Borboudakis, G. Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation. Mach. Learn. 2018, 107, 1895–1922. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Lakiotaki, K.; Vorniotakis, N.; Tsagris, M.; Georgakopoulos, G.; Tsamardinos, I. BioDataome: A collection of uniformly preprocessed and automatically annotated datasets for data-driven biology. Database (Oxford) 2018, 2018. [Google Scholar] [CrossRef]
  15. Sud, M.; Fahy, E.; Cotter, D.; Azam, K.; Vadivelu, I.; Burant, C.F.; Edison, A.S.; Fiehn, O.; Higashi, R.; Nair, K.S.; et al. Metabolomics Workbench: An international repository for metabolomics data and metadata, metabolite standards, protocols, tutorials and training, and analysis tools. Nucleic Acids Res. 2015, 44, D463–D470. [Google Scholar] [CrossRef] [Green Version]
  16. Barrett, T.; Wilhite, S.E.; Ledoux, P.; Evangelista, C.; Kim, I.F.; Tomashevsky, M.; Marshall, K.A.; Phillippy, K.H.; Sherman, P.M.; Holko, M.; et al. NCBI GEO: Archive for functional genomics data sets--update. Nucleic Acids Res. 2013, 41, D991–D995. [Google Scholar] [CrossRef] [Green Version]
  17. Collado-Torres, L.; Nellore, A.; Kammers, K.; Ellis, S.E.; Taub, M.A.; Hansen, K.D.; Jaffe, A.E.; Langmead, B.; Leek, J.T. Reproducible RNA-seq analysis using recount2. Nat. Biotechnol. 2017, 35, 319–321. [Google Scholar] [CrossRef]
  18. Nagele, E.P.; Han, M.; Acharya, N.K.; DeMarshall, C.; Kosciuk, M.C.; Nagele, R.G. Natural IgG autoantibodies are abundant and ubiquitous in human sera, and their number is influenced by age, gender, and disease. PLoS ONE 2013, 8, e60726. [Google Scholar] [CrossRef] [Green Version]
  19. Nagele, E.; Han, M.; Demarshall, C.; Belinka, B.; Nagele, R. Diagnosis of Alzheimer’s disease based on disease-specific autoantibody profiles in human sera. PLoS ONE 2011, 6, e23112. [Google Scholar] [CrossRef]
  20. Leidinger, P.; Backes, C.; Deutscher, S.; Schmitt, K.; Mueller, S.C.; Frese, K.; Haas, J.; Ruprecht, K.; Paul, F.; Stähler, C.; et al. A blood based 12-miRNA signature of Alzheimer disease patients. Genome Boil. 2013, 14, R78. [Google Scholar] [CrossRef] [Green Version]
  21. Shigemizu, D.; Akiyama, S.; Asanomi, Y.; Boroevich, K.A.; Sharma, A.; Tsunoda, T.; Matsukuma, K.; Ichikawa, M.; Sudo, H.; Takizawa, S.; et al. Risk prediction models for dementia constructed by supervised principal component analysis using miRNA expression data. Commun. Boil. 2019, 2, 77. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Sood, S.; Gallagher, I.J.; Lunnon, K.; Rullman, E.; Keohane, A.; Crossland, H.; Phillips, B.; Cederholm, T.; Jensen, T.; Van Loon, L.J.C.; et al. A novel multi-tissue RNA diagnostic of healthy ageing relates to cognitive health status. Genome Boil. 2015, 16, 185. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Kerkentzes, K.; Lagani, V.; Tsamardinos, I.; Vyberg, M.; Røe, O.D. Hidden Treasures in “Ancient” Microarrays: Gene-Expression Portrays Biology and Potential Resistance Pathways of Major Lung Cancer Subtypes and Normal Tissue. Front. Oncol. 2014, 4, 251. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Hampel, H.; O’Bryant, S.E.; Molinuevo, J.L.; Zetterberg, H.; Masters, C.L.; Lista, S.; Kiddle, S.J.; Batrla, R.; Blennow, K. Blood-based biomarkers for Alzheimer disease: Mapping the road to the clinic. Nat. Rev. Neurol. 2018, 14, 639–652. [Google Scholar] [CrossRef]
  25. Zhao, X.; Kang, J.; Svetnik, V.; Warden, D.; Wilcock, G.; Smith, A.D.; Savage, M.J.; Laterza, O.F. A Machine Learning Approach to Identify a Circulating MicroRNA Signature for Alzheimer Disease. J. Appl. Lab. Med. 2019, 5, 15–28. [Google Scholar] [CrossRef]
  26. Patel, H.; Iniesta, R.; Stahl, D.; Dobson, R.J.B.; Newhouse, S.J. Working Towards a Blood-Derived Gene Expression Biomarker Specific for Alzheimer’s Disease. J. Alzheimers Dis. 2020, 74, 545–561. [Google Scholar] [CrossRef]
  27. Lee, T.; Lee, H. Prediction of Alzheimer’s disease using blood gene expression data. Sci. Rep. 2020, 10, 1–13. [Google Scholar] [CrossRef]
  28. Li, X.; Wang, H.; Long, J.; Pan, G.; He, T.; Anichtchik, O.; Belshaw, R.; Albani, D.; Edison, P.; Green, E.K.; et al. Systematic Analysis and Biomarker Study for Alzheimer’s Disease. Sci. Rep. 2018, 8, 17394. [Google Scholar] [CrossRef]
  29. Gómez Ravetti, M.; Moscato, P. Identification of a 5-Protein Biomarker Molecular Signature for Predicting Alzheimer’s Disease. PLoS ONE 2008, 3, e3111. [Google Scholar] [CrossRef] [Green Version]
  30. Stamate, D.; Kim, M.; Proitsi, P.; Westwood, S.; Baird, A.; Nevado-Holgado, A.; Hye, A.; Bos, I.; Vos, S.J.; Vandenberghe, R.; et al. A metabolite-based machine learning approach to diagnose Alzheimer-type dementia in blood: Results from the European Medical Information Framework for Alzheimer disease biomarker discovery cohort. Alzheimer’s Dement. (New York, NY) 2019, 5, 933–938. [Google Scholar] [CrossRef]
  31. Normand, R.; Du, W.; Briller, M.; Gaujoux, R.; Starosvetsky, E.; Ziv-Kenet, A.; Shalev-Malul, G.; Tibshirani, R.J.; Shen-Orr, S.S. Found In Translation: A machine learning model for mouse-to-human inference. Nat. Methods 2018, 15, 1067–1073. [Google Scholar] [CrossRef] [PubMed]
  32. Chatzaki, E.; Tsamardinos, I. Somatic copy number aberrations detected in circulating tumor DNA can hold diagnostic value for early detection of hepatocellular carcinoma. EBioMedicine 2020, 57. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Proteomic signature. 9483-feature proteomic dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve, (B). Precision-recall plot, (C). Probabilities density plot—These are the out-of-sample probabilities for a given sample to belong to Alzheimer’s disease (AD) class. (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, in the space of the selected features. (E). Cumulative feature importance plot of the 7 protein predictors of the signature - y axis represents the Relative change of the Area under the ROC curve achieved by adding, one at a time, the features presented with that specific order.
Figure 1. Proteomic signature. 9483-feature proteomic dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve, (B). Precision-recall plot, (C). Probabilities density plot—These are the out-of-sample probabilities for a given sample to belong to Alzheimer’s disease (AD) class. (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, in the space of the selected features. (E). Cumulative feature importance plot of the 7 protein predictors of the signature - y axis represents the Relative change of the Area under the ROC curve achieved by adding, one at a time, the features presented with that specific order.
Jcm 09 03016 g001
Figure 2. miRNA-transcriptomic signature. The 506-feature miRNA-transcriptomic dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 3 miRNA predictors of the signature.
Figure 2. miRNA-transcriptomic signature. The 506-feature miRNA-transcriptomic dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 3 miRNA predictors of the signature.
Jcm 09 03016 g002
Figure 3. The 38,327-feature mRNA-transcriptomic original dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 25 mRNA predictors of the reference signature.
Figure 3. The 38,327-feature mRNA-transcriptomic original dataset signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 25 mRNA predictors of the reference signature.
Jcm 09 03016 g003
Figure 4. The 38,327-feature mRNA-transcriptomic sub-dataset (train) signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 25 mRNA predictors of the signature.
Figure 4. The 38,327-feature mRNA-transcriptomic sub-dataset (train) signature performance, selected predictors and model inspection: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Probabilities density plot, (D). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals, (E). Cumulative feature importance plot of the 25 mRNA predictors of the signature.
Jcm 09 03016 g004
Figure 5. Validation of 38,327-feature mRNA transcriptomic sub-dataset (test) signature performance: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals.
Figure 5. Validation of 38,327-feature mRNA transcriptomic sub-dataset (test) signature performance: (A). Receiver Operating Characteristic (ROC) Curve for AD class, (B). Precision-recall plot, (C). Supervised Principal Component Analysis plot depicting discrimination between AD patients and age–sex matched cognitively healthy individuals.
Jcm 09 03016 g005
Table 1. Datasets and selected samples used in the study.
Table 1. Datasets and selected samples used in the study.
DatasetData TypeAlzheimer’s Disease SamplesCognitively Healthy SamplesFeatures
Metabolomic 1Metabolites profiles15153734
Metabolomic 2Sphingolipid and fatty acid profiles182125
ProteomicProtein profiles25379483
Transcriptomic 1miRNA profiles4822506
Transcriptomic 2miRNA profiles3002892566
Transcriptomic 3mRNA profiles13410038,327
Transcriptomic 4mRNA profiles12613132,053

Share and Cite

MDPI and ACS Style

Karaglani, M.; Gourlia, K.; Tsamardinos, I.; Chatzaki, E. Accurate Blood-Based Diagnostic Biosignatures for Alzheimer’s Disease via Automated Machine Learning. J. Clin. Med. 2020, 9, 3016. https://doi.org/10.3390/jcm9093016

AMA Style

Karaglani M, Gourlia K, Tsamardinos I, Chatzaki E. Accurate Blood-Based Diagnostic Biosignatures for Alzheimer’s Disease via Automated Machine Learning. Journal of Clinical Medicine. 2020; 9(9):3016. https://doi.org/10.3390/jcm9093016

Chicago/Turabian Style

Karaglani, Makrina, Krystallia Gourlia, Ioannis Tsamardinos, and Ekaterini Chatzaki. 2020. "Accurate Blood-Based Diagnostic Biosignatures for Alzheimer’s Disease via Automated Machine Learning" Journal of Clinical Medicine 9, no. 9: 3016. https://doi.org/10.3390/jcm9093016

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop