Next Article in Journal
Overview of Artificial Intelligence in Breast Cancer Medical Imaging
Previous Article in Journal
Venous Thromboembolism and Bleeding after Transurethral Resection of the Prostate (TURP) in Patients with Preoperative Antithrombotic Therapy: A Single-Center Study from a Tertiary Hospital in China
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 2
10.3390/jcm12020418
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predictive Performance of Machine Learning-Based Methods for the Prediction of Preeclampsia—A Prospective Study

by
Alina-Sinziana Melinte-Popescu
1,
Ingrid-Andrada Vasilache
2,*,
Demetra Socolov
2 and
Marian Melinte-Popescu
3
1
Department of Mother and Newborn Care, Faculty of Medicine and Biological Sciences, ‘Ștefan cel Mare’ University, 720229 Suceava, Romania
2
Department of Obstetrics and Gynecology, ‘Grigore T. Popa’ University of Medicine and Pharmacy, 700115 Iasi, Romania
3
Department of Internal Medicine, Faculty of Medicine and Biological Sciences, ‘Ștefan cel Mare’ University, 720229 Suceava, Romania
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(2), 418; https://doi.org/10.3390/jcm12020418
Submission received: 17 November 2022 / Revised: 12 December 2022 / Accepted: 1 January 2023 / Published: 4 January 2023
(This article belongs to the Section Obstetrics & Gynecology)
Browse Figures
Versions Notes

Abstract

:
(1) Background: Preeclampsia (PE) prediction in the first trimester of pregnancy is a challenge for clinicians. The aim of this study was to evaluate and compare the predictive performances of machine learning-based models for the prediction of preeclampsia and its subtypes. (2) Methods: This prospective case-control study evaluated pregnancies that occurred in women who attended a tertiary maternity hospital in Romania between November 2019 and September 2022. The patients’ clinical and paraclinical characteristics were evaluated in the first trimester and were included in four machine learning-based models: decision tree (DT), naïve Bayes (NB), support vector machine (SVM), and random forest (RF), and their predictive performance was assessed. (3) Results: Early-onset PE was best predicted by DT (accuracy: 94.1%) and SVM (accuracy: 91.2%) models, while NB (accuracy: 98.6%) and RF (accuracy: 92.8%) models had the highest performance when used to predict all types of PE. The predictive performance of these models was modest for moderate and severe types of PE, with accuracies ranging from 70.6% and 82.4%. (4) Conclusions: The machine learning-based models could be useful tools for EO-PE prediction and could differentiate patients who will develop PE as early as the first trimester of pregnancy.

1. Introduction

Preeclampsia (PE) is a complex condition associated with pregnancy that could lead to important feto-maternal morbidity and mortality. The subclassification of PE includes: (a) early-onset PE (EO-PE), with delivery at <34 + 0 weeks of gestation; (b) late-onset PE (LO-PE), with delivery at ≥34 + 0 weeks of gestation; (c) preterm PE, with delivery at <37 + 0 weeks of gestation; (d) and term PE, with delivery at ≥37 + 0 weeks of gestation [1]. The incidence of preeclampsia varies among different regions of the world, and a recent meta-analysis estimated a global incidence of 4.6 % (95 % confidence interval (CI): 2.7–8.2) for this disorder [2]. PE is more widespread in developing nations, where the prevalence ranges between 1.8 and 16.7% [3,4].
Among the most frequently cited adverse pregnancy outcomes for patients affected by preeclampsia are stillbirth, preterm birth, intrauterine growth restriction, low Apgar scores, and higher admission rates in the neonatal intensive care units of the newborns [5,6]. Moreover, these adverse pregnancy outcomes appear to be more severe for the early-onset form of preeclampsia [1,7,8]. Therefore, it is important to identify women at risk of developing PE as early as the first trimester, considering that the administration of aspirin is necessary before 16 weeks of gestation in order to prevent this disorder and its complications [9,10].
Numerous screening strategies have been developed over time in order to obtain the best results in terms of the predictive performance of the various approaches. Thus, researchers have used maternal characteristics, the mean arterial pressure (MAP), serum biomarkers, and the mean uterine artery pulsatility index (UTPI) measured in the first trimester of pregnancy as key parameters included in the screening process [11]. The risk stratification used in these strategies is based on individual risk factors, logistic regression (LR), or the competing risk approach [12,13,14,15,16].
The risk factors for PE derived from the maternal characteristics include: advanced maternal age, Afro-Caribbean or South Asian ethnicity, nulliparity, a previous history of PE, short or long inter-pregnancy intervals, the use of assisted reproductive technologies (ART), a family history of PE, obesity, hyperglycemia in pregnancy, pre-existing chronic hypertension, renal disease, and autoimmune diseases such as systemic lupus erythematosus (SLE), and anti-phospholipid syndrome (APS) [17,18,19].
On the other hand, the panel of biomarkers evaluated in different screening algorithms varies considerably [20,21]. The most used biomarkers in the first trimester of pregnancy, with good predictive performance, are placental growth factor (PLGF) and pregnancy-associated plasma protein-A (PAPP-A). Three prospective non-intervention screening studies of PE in the first trimester of pregnancy, which included a combination of maternal risk factors (MAP, PLGF, and UtA-PI), using a risk cut-off of 1 in 100 for preterm PE, demonstrated that the detection rates for early-onset, preterm, and term PE were 88%, 69%, and 40%, respectively [22].
Placental protein-13 (PP-13) is another serum biomarker that can be incorporated in the combined first trimester screening of PE. A recent meta-analysis indicated a higher accuracy of PP-13 for the screening of late-onset preeclampsia when compared with early-onset preeclampsia [23]. Moreover, biomarkers derived from proteomic, metabolomic, and genomic studies have the potential to reveal a greater specificity for the disease, although the costs of such technologies are high [24,25,26].
Artificial intelligence and machine learning techniques have the potential to outperform the conventional screening strategies of preeclampsia, and to evaluate big datasets in order to provide a comprehensive picture over the heterogenous phenotypic manifestation of the disorder. Machine learning is a new field that evaluates how computers learn from data [27,28]. Computer learning can be conveniently divided into two categories: supervised learning and unsupervised learning [29]. Supervised learning starts with the goal of predicting a known output or target, while in unsupervised learning, the algorithm attempts to find naturally occurring patterns or groupings within the data [27]. The machine learning-based methods for the prediction of PE fall under the supervised category and include random forest (RF), decision trees (DT), gradient boosting (GB), naïve Bayes (NB), and support vector machine (SVM) [30,31]. Various medical data are selected as features for training and testing algorithms, and the results are interpreted in forms of predictive performance [32].
A recent systematic review and meta-analysis evaluated machine learning models and compared their predictive performances with logistic regression models for the predictions of pregnancy events [33]. The authors found a superior performance of machine learning models for the prediction of preeclampsia when using random forest or decision trees. Moreover, a cross-sectional study that evaluated six data mining methods for the prediction of PE in a cohort of 1452 pregnant women found that the SVM method had the highest accuracy (0.791), followed by DT (0.788) and RF (0.758) [34].
The aim of this study was to evaluate and compare the predictive performances of machine learning-based models for the prediction of preeclampsia and its subtypes.

2. Materials and Methods

We conducted a prospective case-control study of pregnancies that occurred in women who attended a tertiary maternity hospital (‘Cuza-Voda’, Iasi, Romania) between November 2019 and September 2022. Ethical approval for this study was obtained from the Institutional Ethics Committee of the University of Medicine and Pharmacy ‘Grigore T. Popa’ (No. 151/13 February 2022). Informed consent was obtained from all participants included in the study. All methods were carried out in accordance with the relevant guidelines and regulations.
We recruited participants at the time of the routine first trimester screening. The inclusion criteria taken into consideration were pregnant patients with singleton pregnancies, maternal age ≥ 18, and certain first trimester pregnancy dating. Exclusion criteria comprised patients who had multiple pregnancies, ectopic pregnancies, first and second trimester abortions, fetal intrauterine demise, fetuses with chromosomal or structural abnormalities, intrauterine infection, incomplete medical records, incorrect/lack of first trimester sonographic pregnancy dating, or who were unable to offer informed consent.
Maternal characteristics and previous medical history were evaluated by a physician, and maternal risk factors for preeclampsia were recorded in the database. The following parameters were evaluated: demographic data, parity, obstetrical comorbidities, BMI (body mass index), smoking status during pregnancy, inter-pregnancy intervals, the use of ART, a personal or family history of PE, and comorbidities (hyperglycemia in pregnancy, pre-existing chronic hypertension, renal disease, SLE, and APS).
Blood pressure was measured using the Fetal Medicine Foundation (FMF) guidelines [35] with a calibrated device (Omron M3 COMFORT; Omron Corp, Kyoto, Japan), and the mean arterial pressure was recorded. The first trimester ultrasound screening and UtA-PI evaluation was performed transabdominally according to FMF guidelines [36] by certified physicians in maternal–fetal medicine.
Blood (serum and plasma) samples were collected before the first trimester scan and stored at −80 °C degrees for further studies. For the current study, PAPP-A and PLGF serum levels were measured using a BRAHMS Kryptor analyzer (Thermo Fisher Scientific, Germany), while PP-13 serum levels were determined using the quantitative sandwich ELISA (enzyme-linked immunosorbent assay) method. The serum levels of these biomarkers were converted to multiples of median (MoM) by logarithm.
All pregnant women were evaluated by an experienced obstetrician with an early ultrasound scan, using an E8/E10 (General Electric Healthcare, Zipf, Austria) scanner with a 4.8 MHz transabdominal probe (GE Medical Systems, Milwaukee, WI, USA), between 10 + 0 and 13 + 6 weeks, in order to determine gestational age by measuring the crown–rump length (CRL), as well as UtA-PI.
A total of 233 patients were included in the analysis of this study and divided into two equal groups: those who developed preeclampsia (116 patients, group 1), and those who did not develop preeclampsia (116 patients, group 2). PE was defined as the de novo development of hypertension (blood pressure ≥ 140/90 mm Hg, four hours apart) and any sign(s) of organ deficiency, including proteinuria (daily urinary protein loss ≥ 0.3 g), liver function deterioration (high transaminase levels), thrombocytopenia (platelet count ≤ 150.000/mL), or neurologic symptoms (visual sensations) appearing during the second half of pregnancy [37]. The following pregnancy outcomes were recorded: type of birth, presentation, gestational age at birth, newborn’s gender, birthweight, length, and Apgar scores at 1 and 5 min.
In the first stage of the statistical analysis, each variable was evaluated with chi-squared and Fisher’s exact tests for categorical variables, which were presented as frequencies with corresponding percentages, and t-tests for continuous variables, which were presented as means and standard deviations (SD).
The pregnant patients affected by preeclampsia were subsequently divided into the following subgroups: subgroup 1 (EO-PE, n = 22), subgroup 2 (LO-PE, n = 94), subgroup 3 (moderate PE, n = 88), and subgroup 4 (severe PE, n = 28). EO-PE was defined considering the onset of the disease at less than 34 weeks of gestation, while LO-PE had an onset at or after 34 weeks of gestation [38]. Severe preeclampsia was considered in the presence of the following criteria: systolic blood pressure of 160 mm Hg or more, or diastolic blood pressure of 110 mm Hg or more on two occasions, at least 4 h apart; thrombocytopenia (<100 × 109/L); renal insufficiency (serum creatinine > 1.1 mg/dl or doubling of serum creatinine in the absence of other renal disease); impaired liver function (elevated blood concentrations of liver transaminases to twice normal concentration); pulmonary edema; unexplained new-onset headache unresponsive to medication (without an alternative diagnosis); or visual disturbances [39].
An ANOVA analysis with the Bonferroni post hoc test was used to determine whether or not there was a statistically significant difference between the subgroups regarding their paraclinical characteristics (serum biomarkers, MAP, and UtA-PI), and boxplots were used for graphical representations of these differences. The statistical analyses were performed using STATA SE (version 14, 2015, StataCorp LLC, College Station, TX, USA).
In the second stage of the analysis, we evaluated the predictive performance of 4 machine learning- based models: decision tree, naïve Bayes, support vector machine, and random forest algorithm.
One of the first and most well-known machine learning techniques is the DT, which represents the tests and outcomes for categorizing data elements into a tree-like structure [40]. A DT tree’s nodes typically have numerous layers, with the first node referred to as the root node [41,42]. All internal nodes reflect input variable or attribute testing. The classification algorithm branches towards the appropriate internal node based on the test result, and the process of testing and branching is repeated until it reaches the leaf node. The predicted outcomes are represented by the leaf or terminal nodes.
NB is a classification technique based on the Bayes’ theorem [43]. This theorem can predict the likelihood of an occurrence depending on prior knowledge of the event’s conditions. This classifier asserts that a given characteristic in a class is not directly related to any other feature, even though the features in that class may be interdependent [41].
An SVM is a supervised learning algorithm used for classification and regression [44,45]. This algorithm is a relatively new method that has shown promising results in recent years for disease prediction. SVM classifiers are based on linear classifiers and seek to select a line that is slightly more confident.
Random forests are ensemble classifiers that randomly learn multiple decision trees [46]. The random forest approach consists of a training stage in which many decision trees are built and a testing step in which an outcome variable is classified or predicted based on an input vector [41]. The different decision trees of an RF are trained using the different parts of the training dataset. To classify or predict a new sample, the input vector of that sample needs to be passed down with each DT of the forest. Each DT then considers a different part of that input vector and offers a prediction outcome. The forest then selects the prediction with the greatest number of ‘votes’ (for discrete outcomes) or the average of all trees in the forest (for numeric outcomes).
The data were segregated into data for testing (70%) and data for training (30%). In order to protect from overfitting, all models underwent 5-fold cross validation. Their true positive rates (TPR), false negative rates (FNR), positive predictive values (PPV), false detection rates (FDR), accuracies, values for area under the curve (AUC), precision, recall, and F1 scores were calculated, and compared for preeclampsia, EO-PE, LO-PE, moderate PE, and severe PE subgroups, respectively. The comparison was made using between-groups variance, measured by an ANOVA and a Bonferroni post hoc test. The models were constructed and analyzed using Matlab (version R2021b, The MathWorks, Inc., Natick, MA, USA).

3. Results

A total of 233 pregnant patients were evaluated in our prospective study. Their clinical and paraclinical characteristics are presented in Table 1 and are segregated into the following groups: preeclampsia (116 patients, group 1), without preeclampsia (group 2, 116 patients). The preeclampsia group contained significantly more patients with a personal history of hypertension (p = 0.005) and preeclampsia in previous pregnancies (p < 0.001). Moreover, obesity was more prevalent in the first group compared to the second group (p < 0.001). Regarding the paraclinical characteristics measured in the first trimester of pregnancy, the MAP, UtA-PI, and PLGF were significantly higher for the PE group, while PP-13 and PAPP-A were significantly lower for this group (p < 0.001).
The pregnancy outcomes for the main groups are presented in Table 2. Pregnancies affected by PE were significantly associated with complications such as preterm birth (p< 0.001), intrauterine growth restriction (p < 0.001), and oligoamnios (p = 0.01). Eclampsia, abruptio placentae, and HELLP syndrome (Hemolysis, Elevated Liver enzymes and Low Platelets) had a low incidence in group 1 of patients, and none of them manifested in the second group, mainly because they are specifically associated with this disorder.
The patients in the PE group had a significantly higher cesarean delivery rate (n = 112 patients, 96.55%; p < 0.001), and their newborns had a significantly lower birthweight, Apgar scores at 1 and 5 min, and length (p < 0.001).
We further comparatively analyzed the paraclinical characteristics of the following subgroups: EO-PE (22 patients, subgroup 1), LO-PE (n = 94, subgroup 2), moderate preeclampsia (n = 88, subgroup 3), severe preeclampsia (n = 28, subgroup 4) (Table 3). The serum values of PLGF determined in the first trimester of pregnancy were significantly higher for the EO-PE and severe PE subgroups (p < 0.001), while the serum levels of PP-13 were significantly lower for the LO-PE subgroup (p = 0.003). A graphical representation of the comparison is represented in Figure 1 and Figure 2.
In the second stage of the analysis, we incorporated the pregnant patient’s clinical and paraclinical characteristics into four machine learning-based models, and we calculated their predictive performance (Table 4). DT achieved the highest accuracy when predicting the EO-PE group (94.1%), with an AUC value of 0.95, while its highest TPR was achieved for all types of preeclampsia prediction. The NB model had the highest performance when used to predict all types of PE, with an accuracy of 98.6%, and an AUC value of 0.98. A similar situation described the predictive performance of the RF model, which achieved an accuracy of 92.8%, with an AUC value of 0.94 for all types of preeclampsia. Finally, the SVM model appeared to have the highest predictive performance when used to predict EO-PE patients, achieving an accuracy of 91.2%, and an AUC value of 0.91. DT and RF had the highest TPR for all types of preeclampsia prediction (94.1%), while SVM and NB were characterized by a high TPR (96.4%) when used to predict EO-PE.
We analyzed the variance between preeclampsia groups, taking into consideration the predictive parameters from the machine learning-based models (Table 5). Our results showed significant variance between groups for all the parameters (p < 0.001). The large F value indicates that the means of the groups are greatly different from each other compared to the variation of the individual observations in each group and support the hypothesis that the differences between group means are larger than what would be expected by chance.

4. Discussion

This is the first prospective study in the literature that trained four machine learning-based models (DT, NB, SVM, and RF) for the prediction of preeclampsia in a cohort of pregnant patients with singleton pregnancies, using clinical and paraclinical parameters determined in the first trimester. Other particularities of this study are that we included the serum levels of PP-13, expressed as MoM in the analysis, and we calculated the predictive performance of these models for preeclampsia subtypes.
Our results showed that EO-PE was best predicted by DT and SVM models, while NB and RF models had the highest performance when used to predict all types of PE. The predictive performance of these models was modest for moderate and severe types of PE subgroups, with accuracies ranging from 70.6% and 82.4%.
Regarding the prediction of LO-PE, the highest accuracy was achieved by DT and RF models (88.2%), with AUC values of 0.80 and 0.84, respectively. A recent retrospective study that evaluated the predictive performance of six ML-based models for LO-PE in a cohort with singleton pregnancies, and used clinical and paraclinical parameters determined as early as the second trimester of pregnancy, indicated similar performances for DT (C- statistic: 0.857) and RF models (C- statistic: 0.894), and higher performances for the stochastic gradient-boosting model (C- statistic: 0.924) [30]. However, the above-mentioned study included repeated common laboratory measurements in the analysis, while we included the biomarkers recognized in the literature as predictors of PE [11,47,48].
Additionally, our results showed that the serum values of PLGF determined in the first trimester of pregnancy, expressed as MoM, were significantly higher for the EO-PE, and severe PE subgroups (p < 0.001), while the serum levels of PP-13 were significantly lower for the LO-PE subgroup (p = 0.003). These findings are in line with data published in the literature that confirmed the superior predictive performance of PLGF for early onset and severe types of PE [49,50,51], and of PP-13 for LO-PE [23].
Many of the existing models for predicting preeclampsia are risk score models that are based on epidemiological data and/or clinical factors [14,18,21,52,53]. In a prospective study by Di Lorenzo et al. evaluating the detection of preeclampsia by integrating maternal history, serum biomarkers, and uterine artery Doppler in the first trimester, the authors reported a sensitivity of 60% (TPR) for a 20% FPR for all types of PE when using a combination of UtA-PI, PlGF, and a maternal history of chronic hypertension [47]. Our combined models achieved higher sensitivities for all types of preeclampsia (TPR ranges: 70.6–96.3%).
A recent unicentric study on 498 patients, which evaluated the results from the first trimester screening of PE in a 5 years’ time frame, revealed that an algorithm based on risk factors from the maternal history, the serum level of PlGF and PAPP-A, the calculated value of MAP, and the measured values of the uterine arteries PI achieved a PPV for early PE of 21.3% [54]. We obtained higher PPV (range: 71.4–80%) for EO-PE prediction using the proposed machine learning-based methods, and these results could be due to the inclusion of PP-13 as a biomarker that has high sensitivity for EO-PE [55].
Our study has several limitations, including a small cohort of patients and number of predictors, but at the same time, the trained models have the advantage of easier implementation by physicians. All chosen machine learning-based models have the ability to handle small sample data. We hypothesize that the model’s accuracy could be improved by adding repeated measurements during pregnancy of the paraclinical parameters, as well as the sFlt-1 (soluble fms-like tyrosine kinase 1)/PLGF ratio, which has been proven as a useful biomarker for PE prediction in the second trimester of pregnancy [56,57,58].
Further studies, on larger cohorts of patients, could evaluate the predictive performance of these ML-based models in different settings and populations. The results could aid clinicians in the risk stratification process of pregnant patients as early as the first trimester and could help calculate the risk–benefit ratio in order to support the decision of PE prophylaxis with aspirin, 150 mg/night, from 11–14 until 36 weeks of gestation [1].

5. Conclusions

The machine learning-based models could be useful tools for EO-PE prediction and could differentiate patients who will develop PE as early as the first trimester of pregnancy.
These finding are important for clinicians because very often the early-onset form of preeclampsia needs an individualized management of delivery, which in most cases is recommended prematurely, before 37 weeks of gestation, adding supplementary distress to the newborn.
Moreover, the proposed methods showed good results for differentiating patients who will develop preeclampsia later in pregnancy from patients who will not develop this disease. This information could support clinicians’ decision of aspirin prophylaxis early in pregnancy.

Author Contributions

This paper was written as part of the doctoral program of I.-A.V. at UMF “Grigore T. Popa”. Conceptualization: A.-S.M.-P. and I.-A.V.; methodology: D.S., M.M.-P., A.-S.M.-P. and I.-A.V.; formal analysis: A.-S.M.-P., M.M.-P. and D.S.; investigation: A.-S.M.-P.; data curation: M.M.-P. and D.S.; writing—original draft preparation: D.S., M.M.-P., A.-S.M.-P. and I.-A.V.; writing—review and editing: D.S., M.M.-P., A.-S.M.-P. and I.-A.V.; supervision: A.-S.M.-P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Ethics Committee of the University of Medicine and Pharmacy ‘Grigore T. Popa’, Iasi (No. No. 151/13 February 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to local policies.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Poon, L.C.; Shennan, A.; Hyett, J.A.; Kapur, A.; Hadar, E.; Divakar, H.; McAuliffe, F.; da Silva Costa, F.; von Dadelszen, P.; McIntyre, H.D.; et al. The International Federation of Gynecology and Obstetrics (FIGO) initiative on pre-eclampsia: A pragmatic guide for first-trimester screening and prevention. Int. J. Gynaecol. Obstet. 2019, 145 (Suppl. S1), 1–33. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Abalos, E.; Cuesta, C.; Grosso, A.L.; Chou, D.; Say, L. Global and regional estimates of preeclampsia and eclampsia: A systematic review. Eur. J. Obstet. Gynecol. Reprod. Biol. 2013, 170, 1–7. [Google Scholar] [CrossRef] [PubMed]
  3. Osungbade, K.O.; Ige, O.K. Public health perspectives of preeclampsia in developing countries: Implication for health system strengthening. J. Pregnancy 2011, 2011, 481095. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Belay, A.S.; Wudad, T. Prevalence and associated factors of pre-eclampsia among pregnant women attending anti-natal care at Mettu Karl referal hospital, Ethiopia: Cross-sectional study. Clin. Hypertens. 2019, 25, 14. [Google Scholar] [CrossRef] [PubMed]
  5. Yang, Y.; Le Ray, I.; Zhu, J.; Zhang, J.; Hua, J.; Reilly, M. Preeclampsia Prevalence, Risk Factors, and Pregnancy Outcomes in Sweden and China. JAMA Netw. Open 2021, 4, e218401. [Google Scholar] [CrossRef] [PubMed]
  6. Backes, C.H.; Markham, K.; Moorehead, P.; Cordero, L.; Nankervis, C.A.; Giannone, P.J. Maternal preeclampsia and neonatal outcomes. J. Pregnancy 2011, 2011, 214365. [Google Scholar] [CrossRef] [Green Version]
  7. Büyükeren, M.; Çelik, H.T.; Örgül, G.; Yiğit, Ş.; Beksaç, M.S.; Yurdakök, M. Neonatal outcomes of early- and late-onset preeclampsia. Turk. J. Pediatr. 2020, 62, 812–819. [Google Scholar] [CrossRef]
  8. Weitzner, O.; Yagur, Y.; Weissbach, T.; Man El, G.; Biron-Shental, T. Preeclampsia: Risk factors and neonatal outcomes associated with early- versus late-onset diseases. J. Matern. Fetal Neonatal Med. 2020, 33, 780–784. [Google Scholar] [CrossRef]
  9. Rolnik, D.L.; Wright, D.; Poon, L.C.; O’Gorman, N.; Syngelaki, A.; de Paco Matallana, C.; Akolekar, R.; Cicero, S.; Janga, D.; Singh, M.; et al. Aspirin versus Placebo in Pregnancies at High Risk for Preterm Preeclampsia. N. Engl. J. Med. 2017, 377, 613–622. [Google Scholar] [CrossRef]
  10. Rolnik, D.L.; Nicolaides, K.H.; Poon, L.C. Prevention of preeclampsia with aspirin. Am. J. Obstet. Gynecol. 2022, 226, S1108–S1119. [Google Scholar] [CrossRef]
  11. Chaemsaithong, P.; Sahota, D.S.; Poon, L.C. First trimester preeclampsia screening and prediction. Am. J. Obstet. Gynecol. 2022, 226, S1071–S1097.e2. [Google Scholar] [CrossRef] [PubMed]
  12. National Collaborating Centre for Women’s and Children’s Health (UK). National Institute for Health and Clinical Excellence: Guidance. In Hypertension in Pregnancy: The Management of Hypertensive Disorders During Pregnancy; RCOG Press: London, UK, 2010. [Google Scholar]
  13. Baschat, A.A.; Magder, L.S.; Doyle, L.E.; Atlas, R.O.; Jenkins, C.B.; Blitzer, M.G. Prediction of preeclampsia utilizing the first trimester screening examination. Am. J. Obstet. Gynecol. 2014, 211, 514.e1–514.e7. [Google Scholar] [CrossRef]
  14. Scazzocchio, E.; Figueras, F.; Crispi, F.; Meler, E.; Masoller, N.; Mula, R.; Gratacos, E. Performance of a first-trimester screening of preeclampsia in a routine care low-risk setting. Am. J. Obstet. Gynecol. 2013, 208, 203.e1–203.e10. [Google Scholar] [CrossRef]
  15. Poon, L.C.; Kametas, N.A.; Chelemen, T.; Leal, A.; Nicolaides, K.H. Maternal risk factors for hypertensive disorders in pregnancy: A multivariate approach. J. Hum. Hypertens. 2010, 24, 104–110. [Google Scholar] [CrossRef] [PubMed]
  16. Chaemsaithong, P.; Pooh, R.K.; Zheng, M.; Ma, R.; Chaiyasit, N.; Tokunaka, M.; Shaw, S.W.; Seshadri, S.; Choolani, M.; Wataganara, T.; et al. Prospective evaluation of screening performance of first-trimester prediction models for preterm preeclampsia in an Asian population. Am. J. Obstet. Gynecol. 2019, 221, 650.e1–650.e16. [Google Scholar] [CrossRef] [PubMed]
  17. Jacquemyn, Y.; Zemtsova, O. Risk factors and prediction of preeclampsia. Acta Clin. Belg. 2010, 65, 1–12. [Google Scholar] [CrossRef]
  18. Goetzinger, K.R.; Tuuli, M.G.; Cahill, A.G.; Macones, G.A.; Odibo, A.O. Development and validation of a risk factor scoring system for first-trimester prediction of preeclampsia. Am. J. Perinatol. 2014, 31, 1049–1056. [Google Scholar]
  19. Poon, L.C.; Nicolaides, K.H. Early prediction of preeclampsia. Obstet. Gynecol. Int. 2014, 2014, 1–11. [Google Scholar] [CrossRef] [Green Version]
  20. Abdi, F.; Aghaie, Z.; Rahnemaie, F.S.; Alimoradi, Z. A Systematic Review of First Trimester Biochemical and Molecular Predictive Tests for Preeclampsia. Curr. Hypertens. Rev. 2018, 14, 21–28. [Google Scholar] [CrossRef]
  21. Kuc, S.; Wortelboer, E.J.; van Rijn, B.B.; Franx, A.; Visser, G.H.; Schielen, P.C. Evaluation of 7 serum biomarkers and uterine artery Doppler ultrasound for first-trimester prediction of preeclampsia: A systematic review. Obstet. Gynecol. Surv. 2011, 66, 225–239. [Google Scholar] [CrossRef] [Green Version]
  22. Tan, M.Y.; Syngelaki, A.; Poon, L.C.; Rolnik, D.L.; O’Gorman, N.; Delgado, J.L.; Akolekar, R.; Konstantinidou, L.; Tsavdaridou, M.; Galeva, S.; et al. Screening for pre-eclampsia by maternal factors and biomarkers at 11–13 weeks’ gestation. Ultrasound Obstet. Gynecol. 2018, 52, 186–195. [Google Scholar] [CrossRef]
  23. Vasilache, I.A.; Carauleanu, A.; Socolov, D.; Matasariu, R.; Pavaleanu, I.; Nemescu, D. Predictive performance of first trimester serum galectin-13/PP-13 in preeclampsia screening: A systematic review and meta-analysis. Exp. Ther. Med. 2022, 23, 370. [Google Scholar] [CrossRef]
  24. Nguyen, T.P.H.; Patrick, C.J.; Parry, L.J.; Familari, M. Using proteomics to advance the search for potential biomarkers for preeclampsia: A systematic review and meta-analysis. PLoS ONE 2019, 14, e0214671. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Ali, A.; Hadlich, F.; Abbas, M.W.; Iqbal, M.A.; Tesfaye, D.; Bouma, G.J.; Winger, Q.A.; Ponsuksili, S. MicroRNA-mRNA Networks in Pregnancy Complications: A Comprehensive Downstream Analysis of Potential Biomarkers. Int. J. Mol. Sci. 2021, 22, 2313. [Google Scholar] [CrossRef] [PubMed]
  26. Yao, M.; Xiao, Y.; Yang, Z.; Ge, W.; Liang, F.; Teng, H.; Gu, Y.; Yin, J. Identification of Biomarkers for Preeclampsia Based on Metabolomics. Clin. Epidemiol. 2022, 14, 337–360. [Google Scholar] [CrossRef] [PubMed]
  27. Deo, R.C. Machine Learning in Medicine. Circulation 2015, 132, 1920–1930. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Lip, G.Y.; Nieuwlaat, R.; Pisters, R.; Lane, D.A.; Crijns, H.J. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: The euro heart survey on atrial fibrillation. Chest 2010, 137, 263–272. [Google Scholar] [CrossRef] [PubMed]
  29. Handelman, G.S.; Kok, H.K.; Chandra, R.V.; Razavi, A.H.; Lee, M.J.; Asadi, H. eDoctor: Machine learning and the future of medicine. J. Intern. Med. 2018, 284, 603–619. [Google Scholar] [CrossRef] [PubMed]
  30. Jhee, J.H.; Lee, S.; Park, Y.; Lee, S.E.; Kim, Y.A.; Kang, S.W.; Kwon, J.Y.; Park, J.T. Prediction model development of late-onset preeclampsia using machine learning-based methods. PLoS ONE 2019, 14, e0221202. [Google Scholar] [CrossRef]
  31. Schmidt, L.J.; Rieger, O.; Neznansky, M.; Hackelöer, M.; Dröge, L.A.; Henrich, W.; Higgins, D.; Verlohren, S. A machine-learning-based algorithm improves prediction of preeclampsia-associated adverse outcomes. Am. J. Obstet. Gynecol. 2022, 227, 77.e1–77.e30. [Google Scholar] [CrossRef] [PubMed]
  32. MacEachern, S.J.; Forkert, N.D. Machine learning for precision medicine. Genome 2021, 64, 416–425. [Google Scholar] [CrossRef] [PubMed]
  33. Sufriyana, H.; Husnayain, A.; Chen, Y.L.; Kuo, C.Y.; Singh, O.; Yeh, T.Y.; Wu, Y.W.; Su, E.C. Comparison of Multivariable Logistic Regression and Other Machine Learning Algorithms for Prognostic Prediction Studies in Pregnancy Care: Systematic Review and Meta-Analysis. JMIR Med. Inform. 2020, 8, e16503. [Google Scholar] [CrossRef] [PubMed]
  34. Manoochehri, Z.; Manoochehri, S.; Soltani, F.; Tapak, L.; Sadeghifar, M. Predicting preeclampsia and related risk factors using data mining approaches: A cross-sectional study. Int. J. Reprod. Biomed. 2021, 19, 959–968. [Google Scholar] [CrossRef] [PubMed]
  35. Gallo, D.; Poon, L.C.; Fernandez, M.; Wright, D.; Nicolaides, K.H. Prediction of preeclampsia by mean arterial pressure at 11–13 and 20–24 weeks’ gestation. Fetal Diagn. Ther. 2014, 36, 28–37. [Google Scholar] [CrossRef]
  36. Khalil, A.; Garcia-Mandujano, R.; Maiz, N.; Elkhouli, M.; Nicolaides, K.H. Longitudinal changes in uterine artery Doppler and blood pressure and risk of pre-eclampsia. Ultrasound Obstet. Gynecol. 2014, 43, 541–547. [Google Scholar] [CrossRef]
  37. Tranquilli, A.; Dekker, G.; Magee, L.; Roberts, J.; Sibai, B.; Steyn, W.; Zeeman, G.; Brown, M. The classification, diagnosis and management of the hypertensive disorders of pregnancy: A revised statement from the ISSHP. Pregnancy Hypertens. 2014, 4, 97–104. [Google Scholar] [CrossRef]
  38. Roberts, J.M.; Rich-Edwards, J.W.; McElrath, T.F.; Garmire, L.; Myatt, L. Subtypes of Preeclampsia: Recognition and Determining Clinical Usefulness. Hypertension 2021, 77, 1430–1441. [Google Scholar] [CrossRef]
  39. Gestational Hypertension and Preeclampsia: ACOG Practice Bulletin, Number 222. Obstet. Gynecol. 2020, 135, e237–e260. [CrossRef]
  40. Quinlan, J.R. Induction of decision trees. Mach. Learn. 1986, 1, 81–106. [Google Scholar] [CrossRef] [Green Version]
  41. Uddin, S.; Khan, A.; Hossain, M.E.; Moni, M.A. Comparing different supervised machine learning algorithms for disease prediction. BMC Med. Inform. Decis. Mak. 2019, 19, 281. [Google Scholar] [CrossRef]
  42. De Felice, F.; Crocetti, D.; Parisi, M.; Maiuri, V.; Moscarelli, E.; Caiazzo, R.; Bulzonetti, N.; Musio, D.; Tombolini, V. Decision tree algorithm in locally advanced rectal cancer: An example of over-interpretation and misuse of a machine learning approach. J. Cancer Res. Clin. Oncol. 2020, 146, 761–765. [Google Scholar] [CrossRef] [PubMed]
  43. Lindley, D.V. Fiducial distributions and Bayes’ theorem. J. R. Stat. Soc. Ser. B 1958, 20, 102–107. [Google Scholar] [CrossRef]
  44. Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  45. Raikwal, J.; Saxena, K. Performance evaluation of SVM and k-nearest neighbor algorithm over medical data set. Int. J. Comput. Appl. 2012, 50, 35–39. [Google Scholar]
  46. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  47. Di Lorenzo, G.; Ceccarello, M.; Cecotti, V.; Ronfani, L.; Monasta, L.; Vecchi Brumatti, L.; Montico, M.; D’Ottavio, G. First trimester maternal serum PIGF, free β-hCG, PAPP-A, PP-13, uterine artery Doppler and maternal history for the prediction of preeclampsia. Placenta 2012, 33, 495–501. [Google Scholar] [CrossRef]
  48. Anderson, U.D.; Gram, M.; Åkerström, B.; Hansson, S.R. First trimester prediction of preeclampsia. Curr. Hypertens. Rep. 2015, 17, 584. [Google Scholar] [CrossRef]
  49. Keikkala, E.; Koskinen, S.; Vuorela, P.; Laivuori, H.; Romppanen, J.; Heinonen, S.; Stenman, U.H. First trimester serum placental growth factor and hyperglycosylated human chorionic gonadotropin are associated with pre-eclampsia: A case control study. BMC Pregnancy Childbirth 2016, 16, 378. [Google Scholar] [CrossRef] [Green Version]
  50. Nevalainen, J.; Korpimaki, T.; Kouru, H.; Sairanen, M.; Ryynanen, M. Performance of first trimester biochemical markers and mean arterial pressure in prediction of early-onset pre-eclampsia. Metabolism 2017, 75, 6–15. [Google Scholar] [CrossRef]
  51. Mendoza, M.; Garcia-Manau, P.; Arévalo, S.; Avilés, M.; Serrano, B.; Sánchez-Durán, M.; Garcia-Ruiz, I.; Bonacina, E.; Carreras, E. Diagnostic accuracy of first-trimester combined screening for early-onset and preterm pre-eclampsia at 8–10 compared with 11–13 weeks’ gestation. Ultrasound Obstet. Gynecol. 2021, 57, 84–90. [Google Scholar] [CrossRef]
  52. Scazzocchio, E.; Figueras, F. Contemporary prediction of preeclampsia. Curr. Opin. Obstet. Gynecol. 2011, 23, 65–71. [Google Scholar] [CrossRef] [PubMed]
  53. Rodriguez, A.; Tuuli, M.G.; Odibo, A.O. First-, Second-, and Third-Trimester Screening for Preeclampsia and Intrauterine Growth Restriction. Clin. Lab. Med. 2016, 36, 331–351. [Google Scholar] [CrossRef] [PubMed]
  54. Capriglione, S.; Gulino, F.A.; Latella, S.; De Felice, G.; Filippini, M.; Farinelli, M.; Martire, F.G.; Viora, E. Results of a Five-Year Experience in First Trimester Preeclampsia Screening. J. Clin. Med. 2022, 11, 4555. [Google Scholar] [CrossRef] [PubMed]
  55. Capriglione, S.; Plotti, F.; Terranova, C.; Gulino, F.A.; Di Guardo, F.; Lopez, S.; Scaletta, G.; Angioli, R. Preeclampsia and the challenge of early prediction: Reality or utopia? State of art and critical review of literature. J. Matern. Fetal Neonatal Med. 2020, 33, 677–686. [Google Scholar] [CrossRef]
  56. Zhao, M.; Zhu, Z.; Liu, C.; Zhang, Z. Dual-cutoff of sFlt-1/PlGF ratio in the stratification of preeclampsia: A systematic review and meta-analysis. Arch. Gynecol. Obstet. 2017, 295, 1079–1087. [Google Scholar] [CrossRef]
  57. Yusuf, A.M.; Kahane, A.; Ray, J.G. First and Second Trimester Serum sFlt-1/PlGF Ratio and Subsequent Preeclampsia: A Systematic Review. J. Obstet. Gynaecol. Can. 2018, 40, 618–626. [Google Scholar] [CrossRef]
  58. Verlohren, S.; Brennecke, S.P.; Galindo, A.; Karumanchi, S.A.; Mirkovic, L.B.; Schlembach, D.; Stepan, H.; Vatish, M.; Zeisler, H.; Rana, S. Clinical interpretation and implementation of the sFlt-1/PlGF ratio in the prediction, diagnosis and management of preeclampsia. Pregnancy Hypertens. 2022, 27, 42–50. [Google Scholar] [CrossRef]
Jcm 12 00418 g001 550
Figure 1. Boxplot representing the comparison of paraclinical parameters in subgroups 1 and 2. Legend: MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A; EO-PE—early- onset preeclampsia; LO-PE—late-onset preeclampsia.
Figure 1. Boxplot representing the comparison of paraclinical parameters in subgroups 1 and 2. Legend: MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A; EO-PE—early- onset preeclampsia; LO-PE—late-onset preeclampsia.
Jcm 12 00418 g001
Jcm 12 00418 g002 550
Figure 2. Boxplot representing the comparison of paraclinical parameters in subgroups 3 and 4. Legend: MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A; PE—preeclampsia.
Figure 2. Boxplot representing the comparison of paraclinical parameters in subgroups 3 and 4. Legend: MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A; PE—preeclampsia.
Jcm 12 00418 g002
Table
Table 1. Clinical and paraclinical characteristics of the patients included in the main groups.
Table 1. Clinical and paraclinical characteristics of the patients included in the main groups.
Patient’s CharacteristicsGroup 1 (PE, n = 116)Group 2 (Without PE, n = 116)p Value
Age, years (mean ± SD)29.22 ± 6.8828.62 ± 6.390.49
BMI (kg/m2)26.4 ± 1.07 **21.87 ± 2.47<0.001
Medium (n/%)Urban = 54 (46.55%)
Rural = 62 (53.45%)		Urban = 53 (45.69%)
Rural = 63 (54.31%)		0.10
Parity (n/%)Nulliparity = 75 (64.66%)
Multiparity = 41 (35.34%)		Nulliparity = 65 (56.03%)
Multiparity = 51 (43.97%)		0.18
Personal history of PE (n/%)Yes = 10 (8.62%) **Yes = 0 (0%)<0.001
Personal history of hypertension (n/%)Yes = 10 (8.62%) **Yes = 1 (0.86%)0.005
Personal history of renal disease (n/%)Yes = 2 (1.72%)Yes = 0 (0%)0.15
Personal history of diabetes (n/%)Yes = 2 (1.72%)Yes = 0 (0%)0.15
Personal history of SLE/APS (n/%)Yes = 9 (7.76%)Yes = 3 (2.59%)0.07
Obesity (n/%)Yes = 31 (26.72%) **Yes = 5 (4.31%)<0.001
Interpregnancy interval, years (mean ± SD) 1.02 ± 1.931.13 ± 1.850.65
MAP, MoM (mean ± SD)1.10 ± 0.10 **0.85 ± 0.15<0.001
UtA-PI, MoM (mean ± SD) 1.54 ± 0.29 **0.82 ± 0.21<0.001
PAPP-A, MoM (mean ± SD)0.82 ± 0.52 **1.00 ± 0.16<0.001
PLGF, MoM (mean ± SD)2.17 ± 0.96 **1.35 ± 0.34<0.001
PP-13, MoM (mean ± SD)0.75 ± 0.12 **1.09 ± 0.13<0.001
Table 1 legend: PE—preeclampsia; SD—standard deviation; APS—antiphospholipid syndrome; SLE—systemic lupus erythematosus; MoM—multiples of median; MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A. Tests used: chi-squared for categorical variables, and t-tests for continuous variables; ** The data from which statistical significance originates.
Table
Table 2. Pregnancy outcome of the patients included in the main groups.
Table 2. Pregnancy outcome of the patients included in the main groups.
Pregnancy OutcomeGroup 1 (PE, n = 116)Group 2 (Without PE, n = 116)p Value
Placenta praevia (n/%)Yes = 5 (4.31%)Yes = 7 (6.03%)0.55
Preterm birth (n/%)Yes = 51 (43.97%) **Yes = 5 (4.31%)<0.001
Intrauterine growth restriction (n/%)Yes = 48 (41.38%) **Yes = 5 (4.31%)<0.001
Oligoamnios (n/%)Yes = 8 (6.90%) **Yes= 1 (0.86%)0.01
Polyhydramnios (n/%)Yes = 0 (0%)Yes= 5 (4.31%) **0.02
PE related complications (n/%)Eclampsia = 2 (1.72%)
bruptio placentae = 3 (2.58%)
HELLP syndrome = 3 (2.58%)		--
Newborn’s gender (n/%)Male = 60 (51.72%)
Female = 56 (48.28%)		Male = 59 (26.72%)
Female = 57 (49.14%)		0.89
Gestational age at birth, weeks (mean ± SD)35.87± 3.41 **38.37 ± 1.40<0.001
Mode of delivery (n/%)Cesarean = 112 (96.55%) **
Vaginal = 4 (3.45%) **		Cesarean = 72 (62.07%)
Vaginal = 44 (37.93%)		<0.001
Presentation (n/%)Cephalic = 105 (90.52%)
Breech = 10 (8.62%)
Transverse = 1(0.86%)		Cephalic = 108 (93.10%)
Breech = 8 (6.90%)
Transverse = 0 (0%)		0.53
Apgar score at 1 min (mean ± SD)7.25 ± 1.86 **8.37 ± 0.88<0.001
Apgar score at 5 min (mean ± SD)7.98 ± 1.36 **8.84 ± 0.71<0.001
Birthweight, g (mean ± SD)2519.91 ± 946.60 **3240 ± 457.60<0.001
Newborn’s length, cm (mean ± SD)46.39 ± 6.00 **50.79 ± 2.27<0.001
Table 2 legend: PE—preeclampsia; SD—standard deviation; g—grams. Tests used: chi-squared for categorical variables, and t-tests for continuous variables; ** the data from which statistical significance originates.
Table
Table 3. Comparison of paraclinical characteristics for the patients included in the analyzed subgroups.
Table 3. Comparison of paraclinical characteristics for the patients included in the analyzed subgroups.
Paraclinical ParameterSubgroup 1 (EO-PE, n = 22)Subgroup 2 (LO-PE, n = 94)Sum of Squares p ValueSubgroup 3 (Moderate PE, n = 88)Subgroup 4 (Severe PE, n = 28)Sum of Squares (SS)p Value
MAP, MoM (mean ± SD)1.13 ± 0.081.09 ± 0.110.020.151.11 ± 0.101.07 ± 0.110.020.13
UtA-PI, MoM (mean ± SD)1.52 ± 0.271.54 ± 0.290.010.611.56 ± 0.271.47 ± 0.340.170.16
PAPP-A, MoM (mean ± SD)0.82 ± 0.240.83 ± 0.580.0010.940.77 ± 0.210.81 ± 0.210.020.43
PLGF, MoM (mean ± SD)1.18 ± 0.51 **0.85 ± 0.321.97<0.0010.86 ± 0.331.07 ± 0.47 **1.04<0.001
PP-13, MoM (mean ± SD)0.94± 0.48 **0.72 ± 0.230.800.0030.74 ± 0.300.83 ± 0.330.140.21
Table 3 legend: PE—preeclampsia; SD—standard deviation; MoM—multiples of median; MAP—mean arterial pressure; UtA-PI—uterine artery pulsatility index; PLGF—placental growth factor; PP-13—placental protein-13; PAPP-A—pregnancy-associated plasma protein-A; EO-PE—early-onset preeclampsia; LO-PE—late-onset preeclampsia. Tests used: ANOVA analysis with the Bonferroni post hoc test; ** the data from which statistical significance originates.
Table
Table 4. The predictive performance of machine learning-based models for the PE and its subtypes.
Table 4. The predictive performance of machine learning-based models for the PE and its subtypes.
ML ModelType of PETPR (%)FNR (%)PPV (%)FDR (%)Accuracy (%)AUC ValuePrecisionRecallF1 Score
DTAll PE94.15.991.48.692.80.930.910.940.93
EO-PE92.97.1752594.10.950.930.750.86
LO-PE66.733.392.97.188.20.800.930.930.93
Moderate PE752591.78.382.40.800.850.920.88
Severe PE82.117.944.455.679.40.700.670.440.53
NBAll PE96.33.796.43.698.60.980.960.960.98
EO-PE96.43.6802091.20.880.670.800.73
LO-PE33.366.787.112.985.30.720.960.870.92
Moderate PE257579.320.773.50.680.880.790.84
Severe PE89.310.7505082.40.670.500.500.50
SVMAll PE70.629.477.822.285.50.980.710.780.88
EO-PE96.43.6802091.20.910.670.800.73
LO-PE33.366.786.713.382.40.760.930.870.90
Moderate PE37.562.580.819.270.60.490.810.810.81
Severe PE85.714.3208073.50.640.170.200.18
RFAll PE94.15.991.48.692.80.940.910.940.93
EO-PE92.97.171.428.691.20.940.830.710.77
LO-PE66.733.392.97.188.20.840.930.930.93
Moderate PE87.512.594.45.670.60.790.650.940.77
Severe PE85.714.333.366.776.50.760.330.330.33
Table 4 legend: All PE—all types of preeclampsia; EO-PE—early- onset preeclampsia; LO-PE—late-onset preeclampsia; ML—machine learning; DT—decision trees; NB—naïve Bayes; SVM—support vector machine; RF—random forest; TPR—true positive rate; FNR—false negative rate; PPV—positive predictive value; FDR—false detection rate; AUC—area under the curve.
Table
Table 5. Analysis of variance among preeclampsia subgroups considering the predictive parameters from machine learning-based models.
Table 5. Analysis of variance among preeclampsia subgroups considering the predictive parameters from machine learning-based models.
Variance between GroupsSum of SquaresMean SQUAREFp ValueEta Squared95% CI Lower Bound95% CI Upper Bound
TPR4895.681631.8912.25<0.0010.750.290.83
PPV7455.692485.2336.96<0.0010.900.670.93
Accuracy546.05182.0113.68<0.0010.770.340.84
AUC0.180.0634.77<0.0010.890.650.93
Precision0.640.2111.41<0.0010.740.270.82
Recall0.760.2537.17<0.0010.900.670.93
F1 score0.780.2632.44<0.0010.890.630.92
Table 5 legend: TPR—true positive rate; PPV—positive predictive value; AUC—area under the curve; CI—confidence interval. Tests used: ANOVA analysis with the Bonferroni post hoc test.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Melinte-Popescu, A.-S.; Vasilache, I.-A.; Socolov, D.; Melinte-Popescu, M. Predictive Performance of Machine Learning-Based Methods for the Prediction of Preeclampsia—A Prospective Study. J. Clin. Med. 2023, 12, 418. https://doi.org/10.3390/jcm12020418

AMA Style

Melinte-Popescu A-S, Vasilache I-A, Socolov D, Melinte-Popescu M. Predictive Performance of Machine Learning-Based Methods for the Prediction of Preeclampsia—A Prospective Study. Journal of Clinical Medicine. 2023; 12(2):418. https://doi.org/10.3390/jcm12020418

Chicago/Turabian Style

Melinte-Popescu, Alina-Sinziana, Ingrid-Andrada Vasilache, Demetra Socolov, and Marian Melinte-Popescu. 2023. "Predictive Performance of Machine Learning-Based Methods for the Prediction of Preeclampsia—A Prospective Study" Journal of Clinical Medicine 12, no. 2: 418. https://doi.org/10.3390/jcm12020418

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop