Next Article in Journal
Deterioration in the Quality of Recalcitrant Quercus robur Seeds during Six Months of Storage at Subzero Temperatures: Ineffective Activation of Prosurvival Mechanisms and Evidence of Freezing Stress from an Untargeted Metabolomic Study
Previous Article in Journal
LDL Promotes Disorders in β-Cell Cholesterol Metabolism, Implications on Insulin Cellular Communication Mediated by EVs
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Metabolites
Volume 12
Issue 8
10.3390/metabo12080755
metabolites-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Hypertension Subtypes with Machine Learning Using Targeted Metabolites and Their Ratios

by
Smarti Reel
1,*,†,
Parminder S. Reel
1,†,
Zoran Erlic
2,†,
Laurence Amar
3,4,
Alessio Pecori
5,
Casper K. Larsen
3,
Martina Tetti
5,
Christina Pamporaki
6,
Cornelia Prehn
7,
Jerzy Adamski
8,9,10,
Aleksander Prejbisz
11,
Filippo Ceccato
12,
Carla Scaroni
12,
Matthias Kroiss
13,14,15,16,
Michael C. Dennedy
17,
Jaap Deinum
18,
Graeme Eisenhofer
19,
Katharina Langton
19,
Paolo Mulatero
5,
Martin Reincke
16,
Gian Paolo Rossi
20,
Livia Lenzini
20,
Eleanor Davies
21,
Anne-Paule Gimenez-Roqueplo
3,22,
Guillaume Assié
23,24,
Anne Blanchard
25,
Maria-Christina Zennaro
3,22,
Felix Beuschlein
2,16 and
Emily R. Jefferson
1,26,*add Show full author list remove Hide full author list
1
Division of Population Health and Genomics, School of Medicine, University of Dundee, Dundee DD2 4BF, UK
2
Diabetologie und Klinische Ernährung, Klinik für Endokrinologie, UniversitätsSpital Zürich (USZ) und Universität Zürich (UZH), CH-8091 Zurich, Switzerland
3
Université Paris Cité, INSERM, PARCC, F-75015 Paris, France
4
Unité Hypertension Artérielle, Assistance Publique-Hôpitaux de Paris, Hôpital Européen Georges Pompidou, F-75015 Paris, France
5
Division of Internal Medicine and Hypertension Unit, Department of Medical Sciences, University of Torino, 10124 Torino, Italy
6
Department of Medicine III, Universitätsklinikum Carl Gustav Carus, Technische Universität, 01307 Dresden, Germany
7
Metabolomics and Proteomics Core (MPC), Helmholtz Zentrum München, German Research Center for Environmental Health, 85764 Neuherberg, Germany
8
Institute of Experimental Genetics, Helmholtz Zentrum München, German Research Center for Environmental Health, Ingolstädter Landstraße 1, 85764 Neuherberg, Germany
9
Department of Biochemistry, Yong Loo Lin School of Medicine, National University of Singapore, 8 Medical Drive, Singapore 117597, Singapore
10
Institute of Biochemistry, Faculty of Medicine, University of Ljubljana, Vrazov trg 2, 1000 Ljubljana, Slovenia
11
Department of Hypertension, National Institute of Cardiology, 04-628 Warsaw, Poland
12
UOC Endocrinologia, Dipartimento di Medicina DIMED, Azienda Ospedaliera-Università di Padova, 35128 Padua, Italy
13
Clinical Chemistry and Laboratory Medicine, Core Unit Clinical Mass Spectrometry, Universitätsklinikum Würzburg, 97080 Würzburg, Germany
14
Schwerpunkt Endokrinologie/Diabetologie, Medizinische Klinik und Poliklinik I, Universitätsklinikum Würzburg, 97080 Würzburg, Germany
15
Comprehensive Cancer Center Mainfranken, Universität Würzburg, 97070 Würzburg, Germany
16
Medizinische Klinik und Poliklinik IV, Klinikum der Universität München, LMU München, 80336 Munich, Germany
17
The Discipline of Pharmacology and Therapeutics, School of Medicine, National University of Ireland 33 Galway, H91 TK33 Galway, Ireland
18
Department of Medicine, Section of Vascular Medicine, Radboud University Medical Center, 6525 GA Nijmegen, The Netherlands
19
Department of Medicine III and Institute of Clinical Chemistry and Laboratory Medicine, Universitätsklinikum Carl Gustav Carus, 01307 Dresden, Germany
20
Internal & Emergency Medicine, ESH Specialized Hypertension Center, Department of Medicine-DIMED, University of Padua, 35128 Padua, Italy
21
Institute of Cardiovascular & Medical Sciences, BHF Glasgow Cardiovascular Research Centre, University of Glasgow, Glasgow G12 8TA, UK
22
Service de Génétique, Assistance Publique-Hôpitaux de Paris, Hôpital Européen Georges Pompidou, F-75015 Paris, France
23
Institut Cochin, Université de Paris, INSERM, CNRS, F-75014 Paris, France
24
Department of Endocrinology, Center for Rare Adrenal Diseases, Assistance Publique–Hôpitaux de Paris, Hôpital Cochin, F-75014 Paris, France
25
Centre d’Investigations Cliniques 9201, Assistance Publique-Hôpitaux de Paris, Hôpital Européen Georges Pompidou, F-75015 Paris, France
26
Institute of Health & Wellbeing, University of Glasgow, Glasgow G12 8RZ, UK
 
add Show full affiliation list
 
remove Hide full affiliation list
*
Authors to whom correspondence should be addressed.
†
These authors contributed equally to this work (shared first authorship).
Metabolites 2022, 12(8), 755; https://doi.org/10.3390/metabo12080755
Submission received: 16 June 2022 / Revised: 2 August 2022 / Accepted: 4 August 2022 / Published: 16 August 2022
(This article belongs to the Section Endocrinology and Clinical Metabolic Research)
Browse Figures
Versions Notes

Abstract

:
Hypertension is a major global health problem with high prevalence and complex associated health risks. Primary hypertension (PHT) is most common and the reasons behind primary hypertension are largely unknown. Endocrine hypertension (EHT) is another complex form of hypertension with an estimated prevalence varying from 3 to 20% depending on the population studied. It occurs due to underlying conditions associated with hormonal excess mainly related to adrenal tumours and sub-categorised: primary aldosteronism (PA), Cushing’s syndrome (CS), pheochromocytoma or functional paraganglioma (PPGL). Endocrine hypertension is often misdiagnosed as primary hypertension, causing delays in treatment for the underlying condition, reduced quality of life, and costly antihypertensive treatment that is often ineffective. This study systematically used targeted metabolomics and high-throughput machine learning methods to predict the key biomarkers in classifying and distinguishing the various subtypes of endocrine and primary hypertension. The trained models successfully classified CS from PHT and EHT from PHT with 92% specificity on the test set. The most prominent targeted metabolites and metabolite ratios for hypertension identification for different disease comparisons were C18:1, C18:2, and Orn/Arg. Sex was identified as an important feature in CS vs. PHT classification.

1. Introduction

One of the main risk factors for cardiovascular disease is arterial hypertension. Arterial hypertension is a significant health problem that affects a wide population every year [1]. The underlying mechanisms of primary (essential) arterial hypertension are multiple and largely unknown. There are forms of so-called secondary hypertension, where arterial hypertension is one of the clinical manifestations of the underlying disease. Among those, we distinguish the endocrine hypertension cases, caused by hormonal hypersecretion mainly related to diseases of the adrenal glands. The latter are represented by primary aldosteronism (PA), Cushing’s syndrome (CS), and pheochromocytoma/functional paraganglioma (PPGL), which are highly challenging to diagnose in the early stages [2]. The reason for this lies in the cumbersome diagnostic process, requiring complex pre-analytical procedures and expertise in the interpretation of the test results, making it less available for the high number of patients of this global pandemic. Metabolomics has already been successfully used in patients with endocrine-related hypertension [3,4,5] and recently our research group identified different metabolic fingerprint discrimination between primary and endocrine hypertension cases [6]. Metabolomics is a relatively new approach for the parallel and high-throughput identification and quantification of numerous low molecular weight molecules (metabolites). Whilst untargeted metabolomics identifies numerous molecules without prior knowledge of their presence, there is often a lack of quantification and definite biochemical annotation. In contrast, targeted metabolomics provides the advantage of reliable quantification of metabolites with known biochemical annotation making it more suitable for the diagnostic purpose [7].
Machine learning (ML) is capable of processing large datasets in a minimal time frame and can provide accurate clinical insights to aid physicians in diagnosis and treatments. In recent years, ML methods have been widely popular in medicine [8,9], biomarker discovery in high-dimensional omics data [10], and detecting signatures of disease in liquid biopsies [11]. Some studies investigated targeted metabolomics markers of preclinical Alzheimer’s disease [12], psoriasis [13], and the detection of intrauterine growth restriction [14]. In the past, a variety of ML methods such as k-nearest neighbours, support vector machines, and decision trees have been evaluated for targeted metabolomics [15,16].
In this study, we investigated various supervised machine learning methods and evaluate their classification performance through overall classification accuracy, specificity, and sensitivity using the targeted metabolomics dataset previously published [6]. The dataset was also investigated within subsets of age and sex to evaluate its impact on the model training, prediction performance, and corresponding selected features. The most prominent metabolites and their ratios were identified for distinguishing various hypertension subtypes.

2. Materials and Methods

2.1. Omic Dataset

The metabolomics dataset was described in detail in our previous work [6]. Briefly, blood plasma samples were collected from 294 male and female patients between 16–78 years with one of the four underlying hypertension subtypes, (PA, PPGL, CS, and PHT). Of the 282 patients included in the final analyses (see the exclusion of outliers below), we had information on the presence of diabetes mellitus in 88.7% and BMI data for 86.9% of cases. Diabetes mellitus was present in 12% of cases, with a higher prevalence in patients with CS (26.7%) and PPGL (26.5%), as expected [17,18,19]. Obesity (BMI ≥ 30 kg/m2) was present in 24.5% of patients, with the highest prevalence in patients with CS (40%), followed by PA (32.6%), PHT (22.4%), and PPGL (7.7%), in accordance with the literature [17,18,19]. The PA patients comprised of aldosterone-producing adenoma (APA) (n = 66), bilateral adrenal hyperplasia (BAH) (n = 36), and unknown (n = 5, adrenal venous sampling failed: 1 and refused: 4). The samples were provided by 11 centers of the ENS@T-HT consortium (http://www.ensat-ht.eu accessed on 1 June 2022). The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the local ethics committees of participating centers.
Table 1 presents a breakdown of the patients by their disease subtypes for analysis, after the exclusion of outliers (see below). The specific inclusion and exclusion criteria for each hypertension subtype are provided in Appendix B.
The targeted metabolomics approach was based on LC-ESI-MS/MS and FIA-ESI-MS/MS measurements by AbsoluteIDQTM p180 Kit (BIOCRATES Life Sciences AG, Innsbruck, Austria). The assay allows simultaneous quantification of 188 metabolites and includes free carnitine, 39 acylcarnitines, 21 amino acids (19 proteinogenic + citrulline + ornithine), 21 biogenic amines, hexoses (sum of hexoses—about 90–95% glucose), 90 glycerophospholipids (14 lysophosphatidylcholines (lysoPC) and 76 phosphatidylcholines (PC)), and 15 sphingolipids (SM). Further details are provided in Appendix C.
In addition to the investigated samples, five aliquots of a pooled reference plasma were analysed on each kit plate. The results of these reference plasma aliquots were used for the calculation of potential batch effects and data normalization. We included all metabolite measurements with peaks above the limit of detection, defined as three times the values of the zero samples, as well as those below this threshold if the respective peak was detectable visually. To ensure the comparability of received data between batches, each metabolite value was normalized as previously described [20,21]. Metabolites for which measurement values were valid in less than 3 of 5 reference plasma were excluded from normalization and further statistical analysis. We further excluded metabolites for which the coefficient of variance of reference plasma was >25% within and between batches (exceptions included 8 metabolites for which only the variance between batches, but not within, were only slightly above the predetermined cut-off prior normalization) and those metabolites for which values were not detectable in >40% of samples. From 188 metabolites, 155 passed these selection criteria. In addition to the 155 eligible metabolites, 18 pre-defined metabolite sums and ratios were eligible for further analyses (See Table A1 in Appendix A). The missing values of the metabolites with <40% of undetectable data were estimated using the KNN method, considering each subgroup of clinical conditions separately [22].
Using the heatmap analysis method, we identified potential outliers among the studied patients as previously described [23], and those patients were excluded from the statistical analysis. In total, 282 patients were eligible for further analyses (See Table 1).
The missing data estimation and outlier detection were performed using the MetaboAnalyst platform [23]. The final dataset was catalogued in RDMP Software [24] for systematic access.

2.2. ML Analysis Pipeline

The small metabolites data was evaluated for five different disease comparisons namely All vs. All (i.e., PA vs. PPGL vs. CS vs. PHT), EHT (i.e., PA + PPGL + CS) vs. PHT, PA vs. PHT, PPGL vs. PHT, and CS vs. PHT (See Figure 1). Each of these comparisons was investigated for possible bias due to age and sex by creating six sets. These sets included: A. All patients, all metabolite features (including age and sex); B. All patients, all metabolite features (excluding age and sex); C. Male patients, all metabolite features (including age); D. Female patients, all metabolite features (including age); E. All patients (with age ≥ 50 years), all metabolite features (including sex); and F. All patients (with age < 50 years), all metabolite features (including sex). Set E and F were bifurcated based on average female menopausal age i.e., 50 years to understand the effect of patient age on metabolites. These segregated sets were also useful in comparing their respective significant discriminating features and using them for final model training.
The ML analysis pipeline investigated (See Figure 1) three feature selection methods: (a) Using all features, (b) CFS: correlation-based feature selection [25], and (c) Boruta [26]; and eight different supervised learning classifiers (J48 [27], IBk [28], Bayes Net [29], Logitboost [30], Logistic Model Tree (LMT) [31], Simple Logistic (SL) [32], Random Forest (RF) [33], and Sequential minimal optimization (SMO) [34]).
The complete metabolomics dataset was randomly partitioned into 80% training and 20% testing sets (See Table A2 in Appendix A). The training set was used for the Monte Carlo Cross-Validation (MCCV) approach [35] and, therefore, further partitioned into 80% training and 20% validation sets. On the other hand, the testing set was only used to test the final model (See Figure 1). A set of five metrics: balanced accuracy (arithmetic mean between sensitivity and specificity) [36], sensitivity, specificity, F1 score (with beta = 1), and AUC were used to evaluate the classification performance. These were calculated using the confusionMatrix function from caret package [37].
The ML analysis pipeline was divided into three phases. Phase 1 studied the best feature selection and top classification algorithms using All vs. All disease comparison for set A (as they represent the complete dataset) with the MCCV approach. It used 100 random repeats (as in [38]) to train algorithms and then compared their average performance metrics (accuracy, sensitivity, and specificity) on the validation set.
In Phase 2, the best feature selection and top 4 classifiers from Phase 1 are used to find the discriminating features (metabolites and their ratios) for remaining disease combinations with MCCV. The most selected features during the 100 random repeats are considered as top features and hence saved.
Finally, in Phase 3, the subset of top common features from the training set was downsampled (to avoid class imbalance) and then used for training the best-performing classifier (from Phase 2). This final classifier was then tested on the test set and the predictions were saved (for each disease comparison and set combination). All classifications were implemented with the RWeka package [39] in the R language [40].

3. Results

3.1. Evaluation of Feature Selection Methods & Classifiers

Phase 1 of the ML analysis pipeline investigated ALL vs. ALL (PA vs. PPGL vs. CS vs. PHT) disease comparison using CFS and Boruta feature selection methods. The classification was also performed using all features (i.e., no feature reduction). Table 2 shows the mean values of five performance metrics (i.e., balanced accuracy, sensitivity, specificity, F1 score, and AUC) for all three feature selection approaches when used in conjunction with different classifiers across the 100 MCCV repeats. It was observed that using all features for classification provided the best metrics followed by Boruta and CFS methods. Although the mean accuracies for ALL vs. ALL disease comparisons are low, since it is a complex multi-class problem, still it is evident that Boruta being a wrapper-based method provides reasonably better classification than CFS. Table A3, Table A4, Table A5 and Table A6 show the classification performance for the remaining four disease combinations. Hence, Boruta was empirically selected for the rest of the ML analysis pipeline. Similarly, based on the metrics, SL, LMT, LB, and RF were selected as the top four classifiers. RF was selected instead of NB since it was able to provide a consistent performance irrespective of the choice of the feature selection method). Hence, Boruta and SL, LMT, LB, and RF were selected for Phase 2 of the analysis.

3.2. Classification Performance and Discriminating Features

In Phase 2 of the analysis, the classification performance and corresponding top discriminating features for the various disease comparisons were individually evaluated.

3.2.1. MCCV Classification Performance

Figure 2 shows mean balanced accuracy, sensitivity, specificity, F1 score, and AUC for five disease comparisons in six sets (A–F) using the top four classifiers with 100 MCCV repeats. The sets were compared as Set A vs. Set B, Set C vs. Set D, and Set E vs. Set F for all five disease comparisons. The non-uniform number of samples in different sets, (e.g., Sets C & D in CS & Set E & F in PPGL) does not validate a direct metric comparison among them, however, it was useful in evaluating the prominent discriminating features in a given disease comparison based on sex and age.
In Set A and Set B, the highest accuracy (~82%) was observed for CS vs. PHT with SL and LMT. The corresponding F1 score and AUC were 0.8 and 0.9 respectively. On the other hand, RF provided the highest specificity (~92%) in CS vs. PHT (Set A). Although EHT vs. PHT had a low accuracy (~54%) and specificity (16%), it still was able to achieve high sensitivity (~93%) using SL in both Set A and B. The corresponding F1 score and AUC were 0.9 and 0.7 respectively. For ALL vs. ALL, SL and LMT achieved higher accuracy (~60%) and specificity (~80%) in comparison to LB and RF. Amongst the two sets, Set A provided better performance for all five metrics irrespective of the classifier used. As earlier in CS vs. PHT, both SL and LMT provided better performance for PA vs. PHT in comparison to RF and LB. For PPGL vs. PHT, LB and RF outperformed LMT and SL. Overall, there is no notable difference in any of the metrics values within Set A and Set B. This shows that age and sex did not appear as significant features in metabolites-based hypertension classification. In Set C vs. Set D, bifurcation based on patients’ sex, higher accuracy was observed for CS vs. PHT in Set D (~73%) compared to Set C (~64%). However, the specificities for Set D were lower than Set C. Also, the corresponding sensitivities for Set D were higher than those compared to Set C. For EHT vs. PHT, PA vs. PHT, and PPGL vs. PHT, Set C had consistently higher accuracies than Set D except for a few classifiers in PPGL vs. PHT. The sensitivities for EHT vs. PHT, PA vs. PHT, and PPGL vs. PHT were higher for the female set (Set D) in comparison to the male set (Set C). The accuracies, sensitivities, and F1 scores for All vs. All were very low for both sets, however, the corresponding specificities were high.
Next, Set E was compared to Set F, where higher accuracies and AUC were observed for younger patients (Set F) only for CS vs. PHT. For other disease combinations, older patients (Set E) had higher accuracies. The specificities for CS vs. PHT and PPGL vs. PHT were higher for Set F than Set E, but opposite in the case of all other disease combinations. Overall, higher sensitivities were observed for EHT vs. PHT in Set F than Set E.

3.2.2. Discriminating Features

Figure 3a shows the list of important metabolites (in green) and metabolite ratios (in pink) with the most common on top and used >50 times during MCCV for various sets within EHT vs. PHT disease classification. C18:1 and C18:2 were the two most prominent features for almost all sets except Set C. Almost similar features were selected for Set A and B. However, for Set C and D, Orn, Orn/Arg, and C9 were not selected for Set D, while C3-DC (C4-OH) was not selected for Set C. Notably, C9 was prominently selected only in Set C and not any other Set. In the case of Set F, three metabolites (C16, SM C16:0, and PC ae C32:2) were selected, which did not appear as prominent in any of the other Sets. On the other hand, Set E Spermidine was selected along with C18:1, C18:2, and Orn.
Figure A1 in Appendix A shows a combined summary list of all features used for classifying the remaining disease combinations for all given sets (Set A–F).
Figure 3b shows rank details of selected features during 100 MCCV repeats for EHT vs. PHT disease classification based on Set A. Metabolite C18:2 was selected during all 100 MCCV repeats and ranked as second for 32 times, third for 55 times followed by 11 and 2 times in position four and four, respectively. Similarly, C18:1 was selected 99 times, however, it was ranked first 31 times and second 55 times, followed by 11 and 2 times. This indicates that although C18:2, it was selected more times than C18:1. However, still C18:1 was ranked higher 31 times in comparison to C18:2. In the case of Orn, Orn/Arg, and lysoPC, of C18:2, they are selected as 81, 72, and 59 times, respectively. Amongst the three, Orn was ranked higher consistently (rank third and fourth) and therefore should be considered more important due to its higher ranking. The ranking of all selected features and their frequency of selection during 100 MCCV thus provides a robust evaluation of the prominent discriminating features in disease classification. The corresponding results for the other four disease comparisons were shown in Appendix A (Figure A2, Figure A3, Figure A4 and Figure A5).

3.3. Final Model Training and Testing

In Phase 3 of the ML pipeline, the training set based on the list of selected features (from Phase 2) is used to train the best classifier (from Phase 1). Table 3 shows the classification results on the test set for the five disease combinations using the best-performing classifier. It also shows the distribution of the reduced feature set along with the balanced accuracy, sensitivity, specificity, F1 score, and AUC. CS vs. PHT provided the best classification (balanced accuracy: 83%, sensitivity: 75%, specificity: 92%) on the test set using the LMT classifier with a reduced set of 22 features (16 metabolites and 5 metabolite ratios and sex). Similarly, for EHT vs. PHT, 92% specificity was achieved although balanced accuracy, and specificity was 74% and 57%, respectively.
In terms of age and sex as features, it is evident that age and sex were only selected for ALL vs. ALL and CS vs. PHT respectively and were not used for the training of the remaining three disease combinations’ classifiers.
Finally, Table 4 shows the confusion matrix for the classification using the test set for CS vs. PHT disease combination. The values in the diagonal position show the number of correctly classified patients. For example, for CS vs. PHT, 6 CS and 11 PHT patients were correctly classified; however, in total three patients were misclassified. Table A7, Table A8, Table A9 and Table A10 show the confusion matrices for the test sets of the remaining four disease combinations.

4. Discussion

The application of machine learning has recently facilitated the use of high-throughput omics technologies in healthcare. In this study, we investigate the use of targeted metabolomics data for classifying and distinguishing the various subtypes of endocrine and primary hypertension using machine learning methods. From a clinical perspective, discriminating individuals with endocrine hypertension from primary hypertension is a challenging task that often involves intensive medical work-up and imaging protocols (See details in Appendix B). However, this study used a data-driven approach for identifying metabolomic patterns that can provide further insight into different hypertension subtypes without any other a priori information.
We investigated a range of disease comparisons in different sets using three feature selection methods and eight classifiers with the MCCV approach. Amongst the three feature selection methods, Boruta outperformed others in terms of classification performance as it is a wrapper-based method that detects interactions between features during selection. It evaluates the most optimal subset of features using its importance scoring mechanism [41]. On the other hand, CFS is a filter-based method that does not consider relationships between features during selection. Out of eight, four classifiers (LB, LMT, RF, and SL) provided better performance amongst all while using the same selected metabolomic features.
Our current results correspond well with our preliminary results [6] and also provide a more detailed and insightful feature ranking for each disease classification. For example, in the case of EHT vs. PHT, the common top metabolomic features were C18:2, C18:1, C9, C16, ornithine, spermidine, and ornithine/arginine, pointing to our possible association of acylcarnitine and bioamine metabolic disturbances in the pathogenesis of the morbidity and cardiovascular complications in patients with EHT, as discussed in our previous work [6]. Similarly, for other disease comparisons, distinct discriminating features emerged that can be further investigated. In particular, elevated long-chain acylcarnitines (e.g., C18:1, C18:2) have been observed in patients with heart failure and have been shown to play a role in disrupting cardiac electrophysiology and cell contractility as well as being associated with insulin resistance and diabetes mellitus. The identified amino acids and biogenic amines alterations in patients with endocrine hypertension may be related to increased inflammation and endothelial dysfunction, all of which may contribute together to the increased cardiovascular morbidity observed in EHT compared with PHT, as discussed previously [6]. Further studies are needed to clarify whether these findings are associated with a common pathogenic mechanism or are related to EHT. Instead of using a standardised ML pipeline, this work utilised a novel approach that used three phases to find a robust list of selected metabolomic features, which were used for model training and then evaluated on the test set. The selected features are not considered just based on their random repeat frequency but rather on the number of times a feature is selected along with its ranking, which provides greater insight into the most discriminating features. It was interesting to identify the variation in selected features based on the age of patients. For example, in the case of EHT vs. PHT disease combination, alongside common features (C18:1 and C18:2), a different combination of unique features was selected for patients younger than 50 years of age.
This machine learning-based study had few limitations. Firstly, class imbalance was observed in the acquired dataset. For example, fewer CS patients, since it is a rarer disease. To balance the classifier training, a downsampling approach was adopted, which led to the loss of samples from the majority class. This strong natural disbalance between different aetiologies can be improved in future by using advanced oversampling techniques such as Synthetic Minority Over-sampling TEchnique (SMOTE) [42] for ML model training. Secondly, due to the unavailability of an independent test dataset, the dataset was randomly partitioned into a training/testing dataset for MCCV (with 100 random repeats) approach for an extended validation. The reported results are based on the limited size of the cohort. Further, sensitivity for discrimination was not optimal in all subgroup analyses; it was best in discriminating EHT from PHT. Thus, while we were able to confirm the results of our previous work that our approach could potentially be used as a pre-screening test to identify patients requiring further endocrine testing by a specialist, namely the EHT group [6], it is not suitable for distinguishing the different endocrine entities from each other due to its low sensitivity (Figure 2). Finally, within our study, we did not differentiate between distinct aetiologies of the hormonal excess in the EHT cases (e.g., adrenal or pituitary cause of cortisol excess, bilateral or unilateral PA).
While clinical presentation, further diagnostic procedures, and treatment will be dependent on the final diagnosis, the overall aim of this study was to evaluate the use of metabolites and their ratios for developing a prediction tool to distinguish the endocrine hypertension forms from primary hypertension as a first screening step in the evaluation of hypertension patients. The subtype classification of the aetiology of hormonal excess in endocrine hypertension cases was considered out of scope at this stage, however, in future studies, it would be interesting to analyse the potential of metabolomics for this purpose. Another study (currently in progress) with a larger prospective dataset would further help in understanding the top discriminating features and allow refinement of the machine learning-based modelling. In future prospective studies, it will be also of interest to analyse the role of metabolomics as a prognostic factor e.g., medical treatment outcome or risk of cardiovascular events in patients with arterial hypertension. Similarly, the most recently studied TroponinT, which is a widely used diagnostic marker for cardiac ischemia, has shown a promising role as a marker for predicting cardiac surgery outcomes [43].

5. Conclusions

This study classified different hypertension subtypes using targeted metabolomics and their ratios. The ML pipeline comprised of five disease comparisons and nine supervised learning algorithms that used different age and sex-based sets. Amongst all the different disease combinations, CS vs. PHT and EHT vs. PHT provided the highest specificity (92%) on the test dataset using LMT and RF classifiers respectively. The evaluation showed promising results with a reduced set of features, which can be further investigated in the future on a much larger prospective dataset.

Author Contributions

Conceptualization, E.R.J., F.B. and M.-C.Z.; methodology, S.R. and P.S.R.; software, S.R. and P.S.R.; formal analysis, S.R., P.S.R., Z.E., C.P. (Cornelia Prehn) and J.A.; resources, J.A., F.B. and E.R.J.; data curation, all authors.; writing—original draft preparation, S.R., P.S.R., Z.E., F.B. and E.R.J.; writing—review and editing, all authors; visualization, S.R. and P.S.R.; supervision, F.B., J.A. and E.R.J.; project administration, F.B., M.-C.Z. and E.R.J.; funding acquisition, F.B., M.-C.Z. and E.R.J. All authors have read and agreed to the published version of the manuscript.

Funding

This project received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 633983 and was supported by the Clinical Research Priority Program of the University of Zurich for the CRPP HYRENE (to ZE and FB).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by Ethikkommission an der TU Dresden (EK 407122010).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data generated or analyzed during this study are included in this published article. Some datasets generated during and/or analyzed during the current study are not publicly accessible but are available from the corresponding author on reasonable request.

Acknowledgments

We thank all participating centers from the ENSAT-HT consortium for contributing to patient recruitment. We thank Julia Scarpa, Werner Römisch-Margl, and Silke Becker for metabolomics measurements performed at the Helmholtz Zentrum München, Genome Analysis Center, Metabolomics Core Facility. We thank all members of the Genetics Department, Biological Resources Center, and Tumor Bank Platform, Hopital européeen Georges Pompidou (BB-0033-00063) for technical support.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A. Tables and Figures

Table
Table A1. List of metabolites measured with the AbsoluteIDQ® p180 Kit GAC, Helmholtz Zentrum München. Note: Complete list of the 188 metabolites. With the asterisk (*) are marked the 33 metabolites excluded after selection as described in the method section. With the double-asterisk (**) are marked 8 metabolites included in the analyses for which only the variance between batches, but not within the batches, were only slightly above the predetermined cutoff prior normalization. Abbreviations: Cx:y indicates the lipid chain composition, where “x” is the number of carbons and “y” the number of double bonds. LysoPC, lysophosphatidylcholine, PC, phosphatidylcholine; a, acyl; aa, diacyl; ae, acyl-alkyl; SM, sphingomyelin; SM(OH), hydroxysphingomyelin.
Table A1. List of metabolites measured with the AbsoluteIDQ® p180 Kit GAC, Helmholtz Zentrum München. Note: Complete list of the 188 metabolites. With the asterisk (*) are marked the 33 metabolites excluded after selection as described in the method section. With the double-asterisk (**) are marked 8 metabolites included in the analyses for which only the variance between batches, but not within the batches, were only slightly above the predetermined cutoff prior normalization. Abbreviations: Cx:y indicates the lipid chain composition, where “x” is the number of carbons and “y” the number of double bonds. LysoPC, lysophosphatidylcholine, PC, phosphatidylcholine; a, acyl; aa, diacyl; ae, acyl-alkyl; SM, sphingomyelin; SM(OH), hydroxysphingomyelin.
Acylcarnitines (40)
AbbreviationFull-NameAbbreviationFull-Name
C0CarnitineC10:1Decenoylcarnitine
C2AcetylcarnitineC10:2Decadienylcarnitine
C3PropionylcarnitineC12Dodecanoylcarnitine
C3:1 **PropenoylcarnitineC12:1Dodecenoylcarnitine
C3-OH *HydroxypropionylcarnitineC12-DC **Dodecanedioylcarnitine
C4ButyrylcarnitineC14Tetradecanoylcarnitine
C4:1ButenoylcarnitineC14:1Tetradecenoylcarnitine
C4-OH (C3-DC)HydroxybutyrylcarnitineC14:1-OHHydroxytetradecenoylcarnitine
C5ValerylcarnitineC14:2Tetradecadienylcarnitine
C5:1 *TiglylcarnitineC14:2-OH *Hydroxytetradecadienylcarnitine
C5:1-DC *GlutaconylcarnitineC16Hexadecanoylcarnitine
C5-DC
(C6-OH) *		Glutarylcarnitine
(Hydroxyhexanoylcarnitine)		C16:1Hexadecenoylcarnitine
C5-M-DC **MethylglutarylcarnitineC16:1-OHHydroxyhexadecenoylcarnitine
C5-OH
(C3-DC-M) *		Hydroxyvalerylcarnitine
(Methylmalonylcarnitine)		C16:2 *Hexadecadienylcarnitine
C6 (C4:1-DC) *Hexanoylcarnitine
(Fumarylcarnitine)		C16:2-OH *Hydroxyhexadecadienylcarnitine
C6:1 *HexenoylcarnitineC16-OH *Hydroxyhexadecanoylcarnitine
C7-DC **PimelylcarnitineC18Octadecanoylcarnitine
C8OctanoylcarnitineC18:1Octadecenoylcarnitine
C9NonanoylcarnitineC18:1-OH *Hydroxyoctadecenoylcarnitine
C10DecanoylcarnitineC18:2Octadecadienylcarnitine
Amino Acids (21)
AbbreviationFull-NameAbbreviationFull-Name
AlaAlanineLysLysine
ArgArginineMetMethionine
AsnAsparagineOrnOrnithine
AspAspartatePhePhenylalanine
CitCitrullineProProline
GlnGlutamineSerSerine
GluGlutamateThrThreonine
GlyGlycineTrpTryptophan
HisHistidineTyrTyrosine
IleIsoleucineValValine
LeuLeucine
Monosaccharides (1)
AbbreviationFull-Name
H1Sum of Hexoses (including Glucose)
Glycerophospholipids (90)
AbbreviationFull-NameAbbreviationFull-Name
lysoPC a C14:0PC aa C34:1PC aa C42:0PC ae C38:2
lysoPC a C16:0PC aa C34:2PC aa C42:1PC ae C38:3
lysoPC a C16:1PC aa C34:3PC aa C42:2PC ae C38:4
lysoPC a C17:0PC aa C34:4PC aa C42:4PC ae C38:5
lysoPC a C18:0PC aa C36:0PC aa C42:5PC ae C38:6
lysoPC a C18:1PC aa C36:1PC aa C42:6PC ae C40:1
lysoPC a C18:2PC aa C36:2PC ae C30:0PC ae C40:2
lysoPC a C20:3PC aa C36:3PC ae C30:1*PC ae C40:3
lysoPC a C20:4PC aa C36:4PC ae C30:2PC ae C40:4
lysoPC a C24:0 **PC aa C36:5PC ae C32:1PC ae C40:5
lysoPC a C26:0 *PC aa C36:6PC ae C32:2PC ae C40:6
lysoPC a C26:1 *PC aa C38:0PC ae C34:0PC ae C42:0
lysoPC a C28:0 **PC aa C38:1 *PC ae C34:1PC ae C42:1
lysoPC a C28:1 **PC aa C38:3PC ae C34:2PC ae C42:2
PC aa C24:0 *PC aa C38:4PC ae C34:3PC ae C42:3
PC aa C26:0PC aa C38:5PC ae C36:0PC ae C42:4
PC aa C28:1PC aa C38:6PC ae C36:1PC ae C42:5
PC aa C30:0PC aa C40:1PC ae C36:2PC ae C44:3
PC aa C30:2 *PC aa C40:2PC ae C36:3PC ae C44:4
PC aa C32:0PC aa C40:3PC ae C36:4PC ae C44:5
PC aa C32:1PC aa C40:4PC ae C36:5PC ae C44:6
PC aa C32:2 **PC aa C40:5PC ae C38:0
PC aa C32:3PC aa C40:6PC ae C38:1
Sphingolipids (15)
AbbreviationFull-NameAbbreviationFull-Name
SM (OH) C14:1SM C18:0SM (OH) C22:1SM (OH) C24:1
SM C16:0SM C18:1SM (OH) C22:2SM C26:0 *
SM C16:1SM C20:2SM C24:0SM C26:1 *
SM (OH) C16:1SM C22:3 *SM C24:1
Biogenic Amines (21)
AbbreviationFull-NameAbbreviationFull-Name
Ac-OrnAcetylornithinePEA *Phenylethylamine
ADMA *Asymmetric dimethylargininecis-OH-Pro *cis-4-Hydroxyproline
alpha-AAAalpha-Aminoadipic acidtrans-OH-Protrans-4-Hydroxyproline
Carnosine *CarnosinePutrescinePutrescine
CreatinineCreatinineSDMA *Symmetric dimethylarginine
DOPA *DOPASerotonin *Serotonin
Dopamine *DopamineSpermidineSpermidine
Histamine *HistamineSpermine *Spermine
Kynurenine *KynurenineTaurineTaurine
Met-SOMethionine sulfoxidetotal DMATotal dimethylarginine
Nitro-Tyr *Nitrotyrosine
Table
Table A2. Details of randomly partitioned training and testing datasets.
Table A2. Details of randomly partitioned training and testing datasets.
DataDiseaseSexAge DistributionTotal Count
MaleFemalePatient Age ≥ 50Patient Age < 50
Training (80%)CS329171532
PA4541335386
PPGL2734392261
PHT2918222547
Testing (20%)CS17538
PA13891221
PPGL699615
PHT11111112
Table
Table A3. Mean balanced accuracy, sensitivity, and specificity for EHT vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
Table A3. Mean balanced accuracy, sensitivity, and specificity for EHT vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
EHT vs. PHT
ClassifierAllCFSBoruta
B. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUC
IBk6183390.840.616280440.820.625881360.820.58
J485883340.830.565685270.830.585686250.840.63
LB6189330.870.745989300.860.745988290.860.75
LMT6291330.870.765693180.870.705592190.860.69
NB7062780.740.767261830.740.786856810.700.76
RF539970.890.775894220.880.755790240.860.74
SL6191310.880.765594160.870.705493160.870.69
SMO6291330.870.625010000.890.505010000.890.50
Table
Table A4. Mean balanced accuracy, sensitivity, and specificity for CS vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
Table A4. Mean balanced accuracy, sensitivity, and specificity for CS vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
CS vs. PHT
ClassifierAllCFSBoruta
B. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUC
IBk8273910.770.828374910.78820.8780940.840.87
J487673780.710.757470780.68740.7471780.690.74
LB7566840.690.857666860.70850.7667850.700.85
LMT8375910.790.928274900.77910.8274900.780.92
NB8174880.760.878167950.75910.8370960.780.94
RF7760950.700.927865910.71890.7965920.730.90
SL8375910.790.928274900.77910.8274900.780.91
SMO8782930.840.878169930.76810.8370950.780.83
Table
Table A5. Mean balanced accuracy, sensitivity, and specificity for PA vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
Table A5. Mean balanced accuracy, sensitivity, and specificity for PA vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
PA vs. PHT
ClassifierAllCFSBoruta
B. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUC
IBk6372550.730.636066540.690.606269550.710.62
J486372540.730.646470590.730.666572590.740.67
LB6576530.760.746578520.760.756576540.760.75
LMT6777560.770.786675570.750.776676570.760.77
NB6957810.680.757359880.700.797256870.680.78
RF6288370.790.786578520.770.766477510.760.75
SL6777560.770.786675570.760.786776580.760.78
SMO7077620.780.705984350.760.595888290.780.58
Table
Table A6. Mean balanced accuracy, sensitivity, and specificity for PPGL vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
Table A6. Mean balanced accuracy, sensitivity, and specificity for PPGL vs. PHT disease comparison using various classifiers with all features, CFS, and Boruta feature selection methods.
PPGL vs. PHT
ClassifierAllCFSBoruta
B. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUC
IBk6254710.610.626663700.670.666564660.670.65
J486671620.710.666672600.710.676873630.720.69
LB7074670.740.787175670.750.807479690.780.82
LMT7173690.750.796973660.730.766974650.730.76
NB7367790.730.817364820.720.817059800.680.79
RF7384620.790.837379670.770.817479680.780.82
SL7274700.750.797073670.730.767074650.730.77
SMO7479680.780.747174680.750.717073660.740.70
Table
Table A7. Confusion matrix showing the actual and predicted labels for PA vs. PHT.
Table A7. Confusion matrix showing the actual and predicted labels for PA vs. PHT.
Reference
PAPHT
PredictionPA153
PHT69
Table
Table A8. Confusion matrix showing the actual and predicted labels for PPGL vs. PHT.
Table A8. Confusion matrix showing the actual and predicted labels for PPGL vs. PHT.
Reference
PPGLPHT
PredictionPPGL123
PHT39
Table
Table A9. Confusion matrix showing the actual and predicted labels for EHT vs. PHT.
Table A9. Confusion matrix showing the actual and predicted labels for EHT vs. PHT.
Reference
EHTPHT
PredictionEHT251
PHT1911
Table
Table A10. Confusion matrix showing the actual and predicted labels for ALL vs. ALL.
Table A10. Confusion matrix showing the actual and predicted labels for ALL vs. ALL.
Reference
CSPAPHTPPGL
PredictionCS2205
PA0620
PHT21083
PPGL4327
Metabolites 12 00755 g0a1 550
Figure A1. Combined heatmap showing the number of times featured for Sets A–F, showing all metabolites (in green) and metabolite ratios (in pink) selected for all 5 disease combinations.
Figure A1. Combined heatmap showing the number of times featured for Sets A–F, showing all metabolites (in green) and metabolite ratios (in pink) selected for all 5 disease combinations.
Metabolites 12 00755 g0a1
Metabolites 12 00755 g0a2 550
Figure A2. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for ALL vs. ALL disease comparison in different sets (A–F); (b) Feature ranking for Set A in ALL vs. ALL disease comparison.
Figure A2. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for ALL vs. ALL disease comparison in different sets (A–F); (b) Feature ranking for Set A in ALL vs. ALL disease comparison.
Metabolites 12 00755 g0a2
Metabolites 12 00755 g0a3 550
Figure A3. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for CS vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in CS vs. PHT disease comparison.
Figure A3. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for CS vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in CS vs. PHT disease comparison.
Metabolites 12 00755 g0a3
Metabolites 12 00755 g0a4 550
Figure A4. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for PA vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in PA vs. PHT disease comparison.
Figure A4. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for PA vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in PA vs. PHT disease comparison.
Metabolites 12 00755 g0a4
Metabolites 12 00755 g0a5 550
Figure A5. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for PPGL vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in PPGL vs. PHT disease comparison.
Figure A5. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for PPGL vs. PHT disease comparison in different sets (A–F); (b) Feature ranking for Set A in PPGL vs. PHT disease comparison.
Metabolites 12 00755 g0a5

Appendix B. Patient Recruitment and Diagnostic Work-Up

Patient data and suitable plasma specimen following overnight fasting were available from patients from 11 centres of the ENSAT-HT consortium (http://www.ensat-ht.eu accessed on 1 June 2022). Included were patients with the diagnosis of arterial hypertension either by use of antihypertensive medication or if untreated confirmed by daytime ambulatory blood pressure monitoring, or home blood pressure monitoring, with blood pressure higher or equal to 135 mmHg for systolic blood pressure and/or higher or equal to 85 mmHg for diastolic blood pressure. Patients were classified as primary or essential hypertension (PHT) after exclusion of primary hyperaldosteronism (PA), cathecholamin-excess due to pheochromocytoma/paraganglioma (PPGL) and Cushing syndrome (CS) (adrenal and pituitary), and other forms of secondary hypertension (renal disease, pharmacological cause and obstructive sleep apnea syndrome). CS was diagnosed in the presence of two abnormal test results of any of the following tests: urine free cortisol (UFC; at least two measurements), late-night salivary cortisol (two measurements), 1 mg overnight dexamethasone suppression test (DST), and longer low-dose DST (2 mg/d for 48 h). The diagnosis (PA, PPGL) was made according to the current guidelines for screening and management of the specific diseases [44,45]. Only patients with PHT, CS, PA, and PPGL were included in the study. Excluded were also patients with low-renin hypertension, unclear diagnosis, pregnancy, and severe comorbidities (e.g., heart failure, chronic kidney disease, active malignancy). All patients provided written consent to participate in the study according to the protocol approved by the Ethics Committee of each participating centre.

Appendix C. Metabolite Quantification by AbsoluteIDQTM p180 Kit

For the LC-part, compound identification and quantification were based on scheduled multiple reaction monitoring measurements (sMRM). The method of AbsoluteIDQTM p180 Kit has been proven to be in conformance with the EMEA-Guideline [46], which implies proof of reproducibility within a given error range. Sample preparation and LC-MS/MS measurements were performed as described in the manufacturer in manual UM-P180. Analytical specifications for LOD and evaluated quantification ranges, further LOD for semiquantitative measurements, identities of quantitative and semiquantitative metabolites, specificity, potential interferences, linearity, precision and accuracy, reproducibility, and stability were described in Biocrates manual AS-P180. The LODs were set to three times the values of the zero samples (PBS). The assay procedures of the AbsoluteIDQTM p180 Kit as well as the metabolite nomenclature have been described in detail previously [20,21]. Sample handling was performed by a Hamilton Microlab STARTM robot (Hamilton Bonaduz AG, Bonaduz, Switzerland) and a Ultravap nitrogen evaporator (Porvair Sciences, Leatherhead, UK), beside standard laboratory equipment. Mass spectrometric analyses were done on an API 4000 triple quadrupole system (Sciex Deutschland GmbH, Darmstadt, Germany) equipped with a 1200 Series HPLC (Agilent Technologies Deutschland GmbH, Böblingen, Germany) and a HTC PAL auto sampler (CTC Analytics, Zwingen, Switzerland) controlled by the software Analyst 1.6.2. Data evaluation for quantification of metabolite concentrations and quality assessment was performed with the software MultiQuant 3.0.1 (Sciex) and the MetIDQTM software package, which is an integral part of the AbsoluteIDQTM Kit. Metabolite concentrations were calculated using internal standards and reported in µM.

References

  1. Mills, K.T.; Stefanescu, A.; He, J. The Global Epidemiology of Hypertension. Nat. Rev. Nephrol. 2020, 16, 223–237. [Google Scholar] [CrossRef] [PubMed]
  2. Williams, B.; Mancia, G.; Spiering, W.; Rosei, E.A.; Azizi, M.; Burnier, M.; Clement, D.L.; Coca, A.; de Simone, G.; Dominiczak, A.; et al. 2018 ESC/ESH Guidelines for the Management of Arterial Hypertension. Eur. Heart J. 2018, 39, 3021–3104. [Google Scholar] [CrossRef] [PubMed]
  3. Di Dalmazi, G.; Quinkler, M.; Deutschbein, T.; Prehn, C.; Rayes, N.; Kroiss, M.; Berr, C.M.; Stalla, G.; Fassnacht, M.; Adamski, J.; et al. Cortisol-Related Metabolic Alterations Assessed by Mass Spectrometry Assay in Patients with Cushing’s Syndrome. Eur. J. Endocrinol. 2017, 177, 227–237. [Google Scholar] [CrossRef] [PubMed]
  4. Murakami, M.; Rhayem, Y.; Kunzke, T.; Sun, N.; Feuchtinger, A.; Ludwig, P.; Strom, T.M.; Gomez-Sanchez, C.; Knösel, T.; Kirchner, T.; et al. In Situ Metabolomics of Aldosterone-Producing Adenomas. JCI Insight 2019, 4, e130356. [Google Scholar] [CrossRef] [PubMed]
  5. Erlic, Z.; Kurlbaum, M.; Deutschbein, T.; Nölting, S.; Prejbisz, A.; Timmers, H.; Richter, S.; Prehn, C.; Weismann, D.; Adamski, J.; et al. Metabolic Impact of Pheochromocytoma/Paraganglioma: Targeted Metabolomics in Patients before and after Tumor Removal. Eur. J. Endocrinol. 2019, 181, 647–657. [Google Scholar] [CrossRef] [PubMed]
  6. Erlic, Z.; Reel, P.; Reel, S.; Amar, L.; Pecori, A.; Larsen, C.K.; Tetti, M.; Pamporaki, C.; Prehn, C.; Adamski, J.; et al. Targeted Metabolomics as a Tool in Discriminating Endocrine from Primary Hypertension. J. Clin. Endocrinol. Metab. 2020, 106, e1111–e1128. [Google Scholar] [CrossRef]
  7. Roberts, L.D.; Souza, A.L.; Gerszten, R.E.; Clish, C.B. Targeted Metabolomics. Curr. Protoc. Mol. Biol. 2012, 98, 30.2.1–30.2.24. [Google Scholar] [CrossRef]
  8. Ramasubbu, R.; Brown, M.R.G.; Cortese, F.; Gaxiola, I.; Goodyear, B.; Greenshaw, A.J.; Dursun, S.M.; Greiner, R. Accuracy of Automated Classification of Major Depressive Disorder as a Function of Symptom Severity. NeuroImage Clin. 2016, 12, 320–331. [Google Scholar] [CrossRef]
  9. Nouretdinov, I.; Costafreda, S.G.; Gammerman, A.; Chervonenkis, A.; Vovk, V.; Vapnik, V.; Fu, C.H.Y. Machine Learning Classification with Confidence: Application of Transductive Conformal Predictors to MRI-Based Diagnostic and Prognostic Markers in Depression. Neuroimage 2011, 56, 809–813. [Google Scholar] [CrossRef]
  10. Leclercq, M.; Vittrant, B.; Martin-Magniette, M.L.; Boyer, M.P.S.; Perin, O.; Bergeron, A.; Fradet, Y.; Droit, A. Large-Scale Automatic Feature Selection for Biomarker Discovery in High-Dimensional OMICs Data. Front. Genet. 2019, 10, 452. [Google Scholar] [CrossRef]
  11. Ko, J.; Baldassano, S.N.; Loh, P.-L.; Kording, K.; Litt, B.; Issadore, D. Machine Learning to Detect Signatures of Disease in Liquid Biopsies—A User’s Guide. Lab Chip 2018, 18, 395–405. [Google Scholar] [CrossRef] [PubMed]
  12. Casanova, R.; Varma, S.; Simpson, B.; Kim, M.; An, Y.; Saldana, S.; Riveros, C.; Moscato, P.; Griswold, M.; Sonntag, D.; et al. Blood Metabolite Markers of Preclinical Alzheimer’s Disease in Two Longitudinally Followed Cohorts of Older Individuals. Alzheimer’s Dement. 2016, 12, 815–822. [Google Scholar] [CrossRef] [PubMed]
  13. Ottas, A.; Fishman, D.; Okas, T.-L.; Kingo, K.; Soomets, U. The Metabolic Analysis of Psoriasis Identifies the Associated Metabolites While Providing Computational Models for the Monitoring of the Disease. Arch. Dermatol. Res. 2017, 309, 519–528. [Google Scholar] [CrossRef] [PubMed]
  14. Bahado-Singh, R.O.; Yilmaz, A.; Bisgin, H.; Turkoglu, O.; Kumar, P.; Sherman, E.; Mrazik, A.; Odibo, A.; Graham, S.F. Artificial Intelligence and the Analysis of Multi-Platform Metabolomics Data for the Detection of Intrauterine Growth Restriction. PLoS ONE 2019, 14, e0214121. [Google Scholar] [CrossRef] [PubMed]
  15. Baumgartner, C.; Böhm, C.; Baumgartner, D.; Marini, G.; Weinberger, K.; Olgemöller, B.; Liebl, B.; Roscher, A.A. Supervised Machine Learning Techniques for the Classification of Metabolic Disorders in Newborns. Bioinformatics 2004, 20, 2985–2996. [Google Scholar] [CrossRef]
  16. Takahashi, Y.; Ueki, M.; Yamada, M.; Tamiya, G.; Motoike, I.N.; Saigusa, D.; Sakurai, M.; Nagami, F.; Ogishima, S.; Koshiba, S.; et al. Improved Metabolomic Data-Based Prediction of Depressive Symptoms Using Nonlinear Machine Learning with Feature Selection. Transl. Psychiatry 2020, 10, 157. [Google Scholar] [CrossRef]
  17. Braun, L.T.; Vogel, F.; Reincke, M. Long-Term Morbidity and Mortality in Patients with Cushing’s Syndrome. J. Neuroendocrinol. 2022, e13113. [Google Scholar] [CrossRef]
  18. Bothou, C.; Beuschlein, F.; Spyroglou, A. Links between Aldosterone Excess and Metabolic Complications: A Comprehensive Review. Diabetes Metab. 2020, 46, 1–7. [Google Scholar] [CrossRef]
  19. Erlic, Z.; Beuschlein, F. Metabolic Alterations in Patients with Pheochromocytoma. Exp. Clin. Endocrinol. Diabetes 2019, 127, 129–136. [Google Scholar] [CrossRef]
  20. Römisch-Margl, W.; Prehn, C.; Bogumil, R.; Röhring, C.; Suhre, K.; Adamski, J. Procedure for Tissue Sample Preparation and Metabolite Extraction for High-Throughput Targeted Metabolomics. Metabolomics 2012, 8, 133–142. [Google Scholar] [CrossRef]
  21. Zukunft, S.; Sorgenfrei, M.; Prehn, C.; Möller, G.; Adamski, J. Targeted Metabolomics of Dried Blood Spot Extracts. Chromatographia 2013, 76, 1295–1305. [Google Scholar] [CrossRef]
  22. Troyanskaya, O.; Cantor, M.; Sherlock, G.; Brown, P.; Hastie, T.; Tibshirani, R.; Botstein, D.; Altman, R.B. Missing Value Estimation Methods for DNA Microarrays. Bioinformatics 2001, 17, 520–525. [Google Scholar] [CrossRef] [PubMed]
  23. Chong, J.; Wishart, D.S.; Xia, J. Using MetaboAnalyst 4.0 for Comprehensive and Integrative Metabolomics Data Analysis. Curr. Protoc. Bioinform. 2019, 68, e86. [Google Scholar] [CrossRef] [PubMed]
  24. Nind, T.; Galloway, J.; McAllister, G.; Scobbie, D.; Bonney, W.; Hall, C.; Tramma, L.; Reel, P.; Groves, M.; Appleby, P.; et al. The Research Data Management Platform (RDMP): A Novel, Process Driven, Open-Source Tool for the Management of Longitudinal Cohorts of Clinical Data. GigaScience 2018, 7, giy060. [Google Scholar] [CrossRef]
  25. Hall, M.A. Correlation-Based Feature Selection for Machine Learning. Ph.D. Thesis, University of Waikato, Hamilton, New Zealand, 1999. [Google Scholar]
  26. Kursa, M.B.; Rudnicki, W.R. Feature Selection with the Boruta Package. J. Stat. Softw. 2010, 36, 1–13. [Google Scholar] [CrossRef]
  27. Breiman, L.; Friedman, J.; Olshen, R.A.; Stone, C.J. Classification and Regression Trees; Chapman & Hall: Boca Raton, FL, USA, 1998; ISBN 978-0-412-04841-8. [Google Scholar]
  28. Bentley, J.L. Multidimensional Binary Search Trees Used for Associative Searching. Commun. ACM 1975, 18, 509–517. [Google Scholar] [CrossRef]
  29. Zheng, Z.; Webb, G.I. Lazy Learning of Bayesian Rules. Mach. Learn. 2000, 41, 53–84. [Google Scholar] [CrossRef]
  30. Friedman, J.; Hastie, T.; Tibshirani, R. Additive Logistic Regression: A Statistical View of Boosting. Ann. Stat. 1998, 28, 337–407. [Google Scholar] [CrossRef]
  31. Landwehr, N.; Hall, M.; Frank, E. Logistic Model Trees. Mach. Learn. 2005, 59, 161–205. [Google Scholar] [CrossRef]
  32. Sumner, M.; Frank, E.; Hall, M. Speeding up Logistic Model Tree Induction. In Proceedings of the 9th European Conference on European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Porto, Portugal, 3 October 2005; Springer: Berlin/Heidelberg, Germany, 2005; pp. 675–683. [Google Scholar]
  33. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
  34. Platt, J. Fast Training of Support Vector Machines Using Sequential Minimal Optimization; Technical Report MSR-TR-98-14; Microsoft Reserch: Redmond, WA, USA, 1998. [Google Scholar]
  35. Simon, R. Resampling Strategies for Model Assessment and Selection. In Fundamentals of Data Mining in Genomics and Proteomics; Dubitzky, W., Granzow, M., Berrar, D., Eds.; Springer: Boston, MA, USA, 2007; pp. 173–186. ISBN 978-0-387-47509-7. [Google Scholar]
  36. Velez, D.R.; White, B.C.; Motsinger, A.A.; Bush, W.S.; Ritchie, M.D.; Williams, S.M.; Moore, J.H. A Balanced Accuracy Function for Epistasis Modeling in Imbalanced Datasets Using Multifactor Dimensionality Reduction. Genet. Epidemiol. 2007, 31, 306–315. [Google Scholar] [CrossRef] [PubMed]
  37. ConfusionMatrix: Create a Confusion Matrix in Caret: Classification and Regression Training. Available online: https://rdrr.io/cran/caret/man/confusionMatrix.html (accessed on 24 July 2022).
  38. Kuhn, M.; Johnson, K. Over-Fitting and Model Tuning. In Applied Predictive Modeling; Kuhn, M., Johnson, K., Eds.; Springer: New York, NY, USA, 2013; pp. 61–92. ISBN 978-1-4614-6849-3. [Google Scholar]
  39. Hornik, K.; Buchta, C.; Zeileis, A. Open-Source Machine Learning: R Meets Weka. Comput. Stat. 2009, 24, 225–232. [Google Scholar] [CrossRef]
  40. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2013. [Google Scholar]
  41. Leong, L.K.; Abdullah, A.A. Prediction of Alzheimer’s Disease (AD) Using Machine Learning Techniques with Boruta Algorithm as Feature Selection Method. J. Phys. Conf. Ser. 2019, 1372, 012065. [Google Scholar] [CrossRef]
  42. Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic Minority Over-Sampling Technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  43. Duchnowski, P.; Hryniewiecki, T.; Zatorska, K.; Żebrowska, A.; Kuśmierczyk, M.; Szymański, P. High-sensitivity Troponin T as a Prognostic Marker in Patients Undergoing Aortic Valve Replacement. Pol. Arch. Intern. Med. 2017, 127, 628–630. [Google Scholar] [CrossRef]
  44. Mulatero, P.; Monticone, S.; Deinum, J.; Amar, L.; Prejbisz, A.; Zennaro, M.-C.; Beuschlein, F.; Rossi, G.P.; Nishikawa, T.; Morganti, A.; et al. Genetics, Prevalence, Screening and Confirmation of Primary Aldosteronism: A Position Statement and Consensus of the Working Group on Endocrine Hypertension of The European Society of Hypertension∗. J. Hypertens. 2020, 38, 1919–1928. [Google Scholar] [CrossRef]
  45. Lenders, J.W.M.; Kerstens, M.N.; Amar, L.; Prejbisz, A.; Robledo, M.; Taieb, D.; Pacak, K.; Crona, J.; Zelinka, T.; Mannelli, M.; et al. Genetics, Diagnosis, Management and Future Directions of Research of Phaeochromocytoma and Paraganglioma: A Position Statement and Consensus of the Working Group on Endocrine Hypertension of the European Society of Hypertension. J. Hypertens. 2020, 38, 1443–1456. [Google Scholar] [CrossRef]
  46. European Medicines Agency. Guideline on Bioanalytical Method Validation; Committee for Medicinal Products for Human Use (CHMP): London, UK, 2011. [Google Scholar]
Metabolites 12 00755 g001 550
Figure 1. ML analysis pipeline showing the three phases of the analysis and corresponding data flow.
Figure 1. ML analysis pipeline showing the three phases of the analysis and corresponding data flow.
Metabolites 12 00755 g001
Metabolites 12 00755 g002 550
Figure 2. Heatmap comparing accuracy, sensitivity, and specificity for Sets A–F using 5 classifiers for 5 disease combinations (Phase 2). The count in each box is a weighted average of 100 runs (MCCV repeats).
Figure 2. Heatmap comparing accuracy, sensitivity, and specificity for Sets A–F using 5 classifiers for 5 disease combinations (Phase 2). The count in each box is a weighted average of 100 runs (MCCV repeats).
Metabolites 12 00755 g002
Metabolites 12 00755 g003 550
Figure 3. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for EHT vs. PHT disease comparison in different sets (A–F). (b) Feature ranking for Set A in EHT vs. PHT disease comparison.
Figure 3. (a) Heatmap showing the number of times a feature (metabolites or its ratios) was selected for EHT vs. PHT disease comparison in different sets (A–F). (b) Feature ranking for Set A in EHT vs. PHT disease comparison.
Metabolites 12 00755 g003
Table
Table 1. Patient data for all disease types namely Cushing’s syndrome (CS), primary aldosteronism (PA), pheochromocytoma or paraganglioma (PPGL), and primary hypertension (PHT). There was a significant difference in the distribution of patients according to sex (p < 0.001) and age (p = 0.006) between the disease groups. The difference was significant also when considering CS, PA, and PPGL in the common EHT group for sex (p = 0.009), but not for age (p = 0.088). For distribution difference analysis, the Pearson Chi-Square Test was performed using the SPSS® Statistics v26.0 (IBM).
Table 1. Patient data for all disease types namely Cushing’s syndrome (CS), primary aldosteronism (PA), pheochromocytoma or paraganglioma (PPGL), and primary hypertension (PHT). There was a significant difference in the distribution of patients according to sex (p < 0.001) and age (p = 0.006) between the disease groups. The difference was significant also when considering CS, PA, and PPGL in the common EHT group for sex (p = 0.009), but not for age (p = 0.088). For distribution difference analysis, the Pearson Chi-Square Test was performed using the SPSS® Statistics v26.0 (IBM).
DiseasePatient Count
(n=)		SexAge Distribution
Male
(n=)		Female
(n=)		Patient Age ≥ 50Patient Age < 50
Cushing’s Syndrome (CS)404362218
Primary Aldosteronism (PA)10758494265
Pheochromocytoma or Paraganglioma (PPGL)7633434828
Primary Hypertension (PHT)5940192336
Table
Table 2. Mean balanced accuracy, sensitivity, and specificity (across the 100 MCCV repeats) for ALL vs. ALL disease combinations for all 9 classifiers using all features, CFS, and Boruta methods.
Table 2. Mean balanced accuracy, sensitivity, and specificity (across the 100 MCCV repeats) for ALL vs. ALL disease combinations for all 9 classifiers using all features, CFS, and Boruta methods.
ALL vs. ALL
ClassifierAllCFSBoruta
B. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUCB. Acc (%)Sen (%)Spec (%)F1AUC
IBk6041790.390.605735780.290.575837790.350.58
J485635780.300.585736780.310.605634780.270.57
LB6142800.410.716040800.310.686040800.320.68
LMT6954840.530.815838790.320.696041800.360.69
NB6448810.440.735940790.260.686041800.290.68
RF6040800.240.765938790.290.685938790.280.70
SL6954840.540.825838790.310.696041800.350.70
SMO7156850.570.785127760.20.635431770.060.64
Table
Table 3. Classification results for disease comparisons showing balanced accuracy, sensitivity, specificity, F1 score, and AUC for the test set (Phase 3). It includes the breakdown of features and highlights whether age and sex were selected amongst them.
Table 3. Classification results for disease comparisons showing balanced accuracy, sensitivity, specificity, F1 score, and AUC for the test set (Phase 3). It includes the breakdown of features and highlights whether age and sex were selected amongst them.
Disease
Comparisons		ClassifierFeatures UsedB. Accuracy
(%)		Sensitivity
(%)		Specificity
(%)
Age
Included?		Sex
Included?		No of
Metabolites		No of
Metabolite Ratios		TotalF1AUC
PA vs. PHTSL✕✕6397371750.80.7
CS vs. PHTLMT✕✔165228375920.80.8
PPGL vs. PHTLB✕✕132157880750.80.8
EHT vs. PHTRF✕✕101117457920.70.8
ALL vs. ALLLMT✔✕104156142810.40.7
Table
Table 4. Confusion matrix showing the actual and predicted labels for CS vs. PHT.
Table 4. Confusion matrix showing the actual and predicted labels for CS vs. PHT.
Reference
CSPHT
PredictionCS61
PHT211
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Reel, S.; Reel, P.S.; Erlic, Z.; Amar, L.; Pecori, A.; Larsen, C.K.; Tetti, M.; Pamporaki, C.; Prehn, C.; Adamski, J.; et al. Predicting Hypertension Subtypes with Machine Learning Using Targeted Metabolites and Their Ratios. Metabolites 2022, 12, 755. https://doi.org/10.3390/metabo12080755

AMA Style

Reel S, Reel PS, Erlic Z, Amar L, Pecori A, Larsen CK, Tetti M, Pamporaki C, Prehn C, Adamski J, et al. Predicting Hypertension Subtypes with Machine Learning Using Targeted Metabolites and Their Ratios. Metabolites. 2022; 12(8):755. https://doi.org/10.3390/metabo12080755

Chicago/Turabian Style

Reel, Smarti, Parminder S. Reel, Zoran Erlic, Laurence Amar, Alessio Pecori, Casper K. Larsen, Martina Tetti, Christina Pamporaki, Cornelia Prehn, Jerzy Adamski, and et al. 2022. "Predicting Hypertension Subtypes with Machine Learning Using Targeted Metabolites and Their Ratios" Metabolites 12, no. 8: 755. https://doi.org/10.3390/metabo12080755

APA Style

Reel, S., Reel, P. S., Erlic, Z., Amar, L., Pecori, A., Larsen, C. K., Tetti, M., Pamporaki, C., Prehn, C., Adamski, J., Prejbisz, A., Ceccato, F., Scaroni, C., Kroiss, M., Dennedy, M. C., Deinum, J., Eisenhofer, G., Langton, K., Mulatero, P., ... Jefferson, E. R. (2022). Predicting Hypertension Subtypes with Machine Learning Using Targeted Metabolites and Their Ratios. Metabolites, 12(8), 755. https://doi.org/10.3390/metabo12080755

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop