Next Article in Journal
Use of POCUS in Chest Pain and Dyspnea in Emergency Department: What Role Could It Have?
Previous Article in Journal
Therapy Follows Diagnosis: Old and New Approaches for the Treatment of Acute Porphyrias, What We Know and What We Should Know
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison between Machine Learning and Multiple Linear Regression to Identify Abnormal Thallium Myocardial Perfusion Scan in Chinese Type 2 Diabetes

1
Division of Endocrinology, Department of Internal Medicine, Shuang Ho Hospital, Taipei Medical University, New Taipei City 23651, Taiwan
2
Division of Endocrinology and Metabolism, Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei City 11031, Taiwan
3
School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei 24205, Taiwan
4
Division of Endocrinology and Metabolism, Department of Internal Medicine, Fu Jen Catholic University Hospital, New Taipei 24352, Taiwan
5
Division of Endocrinology and Metabolism, Department of Internal Medicine, Tri-Service General Hospital, School of Medicine, National Defense Medical Center, No. 325. Sec. 2, Chenggong Rd., Neihu District, Taipei City 11490, Taiwan
6
Division of Endocrinology and Metabolism, Department of Internal Medicine, Taipei Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 289, Jianguo Rd., Xindian Dist., New Taipei City 23142, Taiwan
7
Department of Pathology, Tri-Service General Hospital, National Defense Medical Center, No. 325. Sec. 2, Chenggong Rd., Neihu District, Taipei City 11490, Taiwan
*
Authors to whom correspondence should be addressed.
Diagnostics 2022, 12(7), 1619; https://doi.org/10.3390/diagnostics12071619
Submission received: 4 June 2022 / Revised: 27 June 2022 / Accepted: 30 June 2022 / Published: 3 July 2022
(This article belongs to the Special Issue Early Diagnosis of Cardiovascular Diseases: Latest Research)

Abstract

:
Type 2 diabetes mellitus (T2DM) patients have a high risk of coronary artery disease (CAD). Thallium-201 myocardial perfusion scan (Th-201 scan) is a non-invasive and extensively used tool in recognizing CAD in clinical settings. In this study, we attempted to compare the predictive accuracy of evaluating abnormal Th-201 scans using traditional multiple linear regression (MLR) with four machine learning (ML) methods. From the study, we can determine whether ML surpasses traditional MLR and rank the clinical variables and compare them with previous reports.In total, 796 T2DM, including 368 men and 528 women, were enrolled. In addition to traditional MLR, classification and regression tree (CART), random forest (RF), stochastic gradient boosting (SGB) and eXtreme gradient boosting (XGBoost) were also used to analyze abnormal Th-201 scans. Stress sum score was used as the endpoint (dependent variable). Our findings show that all four root mean square errors of ML are smaller than with MLR, which implies that ML is more precise than MLR in determining abnormal Th-201 scans by using clinical parameters. The first seven factors, from the most important to the least are:body mass index, hemoglobin, age, glycated hemoglobin, Creatinine, systolic and diastolic blood pressure. In conclusion, ML is not inferior to traditional MLR in predicting abnormal Th-201 scans, and the most important factors are body mass index, hemoglobin, age, glycated hemoglobin, creatinine, systolic and diastolic blood pressure. ML methods are superior in these kinds of studies.

1. Introduction

Type 2 diabetes (T2DM) is the fifth most common cause of death in Taiwan and its prevalence has been increasing drastically over the last three decades [1]. Now in Taiwan, there are 2.457 million T2DM which is 9.7% of the total population [2]. Similarly, it is expected that there will be 700 million patients throughout the world by 2045 [3]. In the past, having T2DM would reduce life expectancy by around six years compared to healthy comparators [4]. Evidence has shown that approximately 50% of T2DM patients die of cardiovascular disease [5,6]. At the same time, evidence has shown that T2DM increases the risk of coronary artery disease (CAD) and that T2DM is associated with a 70% excess risk of acute myocardial infarction (MI) [7,8,9]. More importantly, 28.5% of the MI is silent in T2DM [10]. Therefore, early detection of CAD in diabetic patients is important for health providers. Guidelines have been developed to define a high-risk profile of diabetic patients who might benefit from routine cardiac screening [11,12].
Several examinations are used to evaluate the status of CAD. For instance, coronary angiography is considered the “gold standard”, but it is invasive and has attendant risks. The second one, computed tomography coronary angiography (CTCA), although non-invasive, is relatively expensive. The third commonly used test is exercise electrocardiogram (ECG). However, this can only be used for patients who can exercise to a sufficient workload [13,14]. Lastly, pharmacologic stress testing with myocardial perfusion scintigraphy (MPS) using Thallium as a tracer is also non-invasive in nature. In diabetic patients, it has been shown to be of value for diagnosing significant CAD, stratifying risk and future management [15]. This examination has been well-accepted as a tool to identify patients with CAD and predicting CAD prognosis in clinical settings. Since MPS could be taken as a surrogate for CAD, there are studies trying to identify risk factors for abnormal MPS [16]. Several risk factors have been identified as being associated with abnormal MPS, including current smoking, duration of diabetes and the cholesterol/high-density lipoprotein (HDL) ratio, etc. It should be noted that all these studies used traditional multiple linear regression (MLR) to analyze the data.
Since the rapid progress of computational facilities, artificial intelligence using machine learning (ML) has developed rapidly and has been used in some of the research areas in the medical field, including cancer, cardiovascular disease, neurological disease, emergency medicine and even in the pharmacological field, etc. [17,18,19,20,21]. The definition of ML is the study of computer algorithms that can improve automatically through experience and by the use of data [22]. It enables machines to learn from past data or experiences without being explicitly programmed. After certain computer algorithms are created using the ML method, the process has many parameters to predict future results. It now becomes a new modality for data analysis competitive with traditional MLR [23,24,25]. Since ML could capture nonlinear relationships in the data and complex interactions among multiple predictors, it has the potential to outperform conventional logistic regression in disease prediction [26].
The present study was performed with a T2DM cohort without diagnosed CAD and there were two aims: 1. To compare whether ML is more accurate than MLR. 2. To rank the risk factors and compare their orders to previous reports.

2. Materials and Methods

2.1. Subjects

T2DM patients, aged between 30 and 95 years old, who had undertaken Thallium-201 myocardial perfusion scans (Th-201 scan) in Cardinal Tien hospital from 1999 to 2008 were recruited for the study. All study subjects were anonymous and the data of the participants were used only for the analysis. This is a retrospective study, and all the data were retrieved from medical records from the hospital. The study proposal was reviewed and approved by the institutional review board of Cardinal Tien hospital before the study began. On the day of the thallium scan, a thallium scan consent form provided by the Nuclear Medicine Department woud be obtained from the individual who received the examination. The diagnostic criteria for T2DM were based on the 2012 American Diabetes Association criteria [27]. In total, 928 T2DM patients were recruited. After some subjects were excluded due to various causes, 796 patients remained for analysis, including 368 men and 428 women. Figure 1 illustrates the flowchart of the subject selection in the present study.
Body mass index (BMI) was calculated as body weight (kg)/height (m)2. Systolic and diastolic blood pressure (SBP and DBP) were measured on the right arm of seated subjects using a standard mercury sphygmomanometer. Blood samples were drawn from the antecubital vein for biochemical analysis.

2.2. Th-201 Scan

On the day of testing, patients fasted for 4 h and withheld dipyridamole, β-blockers, calcium channel blockers, long-acting nitrates, xanthine-containing medications and caffeine-containing beverages. Each patient then received intravenous infusion of dipyridamole over 4 min at a concentration of 0.56 mg/kg in 20 mL of normal saline (an infusion rate of 0.14 mg/kg/min). Th-201 was administered intravenously 3 to 4 min after the dipyridamole infusion was completed. The scans started at 5 to 8 min after radiopharmaceutical administration (stress scan) and 3 h later (rest scan).
The myocardial region was classified into 17 parts and each part was evaluated by nuclear medicine experts based on a 5-point scoring system described previously [28]: 0, normal; 1, slight decrease of tracer uptake; 2, moderate decrease of tracer uptake; 3, severe decrease of tracer uptake; 4, absence of tracer uptake. The stress score and rest score of single vessels were initially counted as individual vessel scores. The sums of individual vessel stress scores (after injection of dipyridamole) were recognized as representative of the Th-201 results (dependent variable) since some of the studies have shown that SSS provides important information for detecting CAD and its outcomes [28,29,30].

2.3. Laboratory Evaluation

After the 10 h overnight fast, blood specimens were collected from each subject for further analysis. Plasma was separated from the whole blood within one hour and stored at −70 °C. A glucose oxidase method (YSI 203 glucose analyzer; Scientific Division, Yellow Springs Instruments, Yellow Springs, OH, USA) was used to determine fasting plasma glucose (FPG) levels. The dry, multilayer analytical slide method of the Fuji Dri-Chem 3000 analyzer (Fuji Photo Film, Minato-Ku, Tokyo, Japan) was used to determine total cholesterol and triglyceride (TG). An enzymatic cholesterol assay following dextran sulfate precipitation was used to determine serum HDL-C and low-density lipoprotein cholesterol (LDL-C) levels. The HbA1c level was measured using the Bio-Rad Variant II automatic analyzer (Bio-Rad Diagnostic Group, Los Angeles, CA, USA). Plasma insulin was assayed using a commercial solid-phase radioimmunoassay technique (Coat-A-Count insulin kit, Diagnostic Products Corporation, Los Angeles, CA, USA) with intra- and inter-assay coefficients of variance of 3.3% and 2.5%, respectively.

2.4. Statistical Analysis:

The data were tested for normal distribution using the Kolmogorov–Smirnov test and for homogeneity of variances using the Levene’s test. Continuous variables were expressed as mean ± standard deviation.
Table 1 lists the definition of the fifteen baseline clinical variables (independent variables, sex, age, BMI, duration of diabetes, smoking, FPG, glycated hemoglobin (HbA1c), TG, HDL-C, LDL-C, alanine aminotransferase (ALT), creatinine (Cr), microalbuminuria, SBP and DBP, used in this study. As aforementioned, the SSS derived from the Th-201 scan is the dependent variable; the other 15 variables are used as predictor variables.

2.5. ML Methods and Proposed Scheme

This research proposed a scheme based on four ML methods, namely classification and regression tree (CART), random forest (RF), stochastic gradient boosting (SGB) and eXtreme gradient boosting (XGBoost) to construct predictive models for determining abnormal MPS and to identify the importance of these risk factors. These ML methods have been widely applied to various healthcare and/or medical informatics applications and do not have prior assumptions about data distribution [31,32,33,34,35,36,37,38,39]. MLR is used as a benchmark for comparison.
The first method, CART, is a tree structure method [40]. It is composed of root nodes, branches and leaf nodes that, based on tree structures, grow recursively from the root nodes and split at each node based on the Gini index to produce branches and leaf nodes using the rule. The nodes of overgrown trees are then pruned for optimal tree size using cost–complexity criterion, and different decision rules are generated to compose a complete tree [41,42].
RF, the second method in this study, is an ensemble learning decision trees algorithm which combines bootstrap resampling and bagging [43]. RF’s principle method is to randomly generate many different and unpruned CART decision trees for which decreased Gini impurity is regarded as the splitting criterion, and then to combine all the trees generated into a forest. Then all the trees in the forest are averaged or voted to generate output probabilities and a final robust model [44].
The third method, SGB, is a tree-based gradient boosting learning algorithm combining both bagging and boosting techniques to minimize the loss function and solve the over-fitting problem of traditional decision trees [45,46]. The SGB sequentially and stochastically generates many weak learner trees through multiple iterations and each tree concentrates on correcting or explaining the errors from the tree of the previous iteration generated. The residual of the previous iteration tree is used as the input for the newly generated tree. This iterative process continues until a stopping criterion is reached at the maximum number of iterations or the convergence condition. The cumulative results of many trees are used to determine a final robust model.
XGBoost, the fourth method in this study, is gradient boosting technology based on SGB optimized extension [47]. Its principle is training many weak models sequentially to ensemble them using the gradient boosting method of outputs to achieve better prediction performance. In XGBoost, the Taylor binomial expansion is used to approximate the objective function and arbitrary differentiable loss functions to accelerate the model construction converging process [48]. Then, XGBoost applies a regularized boosting technique to reduce the complexity of the model and correct the overfitting, thus increasing the model accuracy [47].
The flowchart of the proposed scheme combining the four ML methods is demonstrated in Figure 2. As Figure 2 shows, in the proposed scheme, we first collected patients to prepare the dataset for model construction, and then the dataset was randomly split into 80% training dataset for model building and 20% testing dataset for out-of-sample testing. In the training process, each ML method had its own hyperparameters to be tuned for constructing a relatively well-performing model. We used a 10-fold cross-validation (CV) technique for hyperparameter tuning. To do this, the training dataset was further randomly divided into the training dataset to build the model with a different set of hyperparameters, and the validation dataset for model validation. All possible combinations of hyperparameters were investigated using grid search. The model with the lowest root mean square error on the validation dataset was viewed as the best model of each ML method. The best models of RF, SGB, CART and XGBoost were generated and the corresponding variable importance ranking was obtained.
During the testing process, the testing data set is used to evaluate the predictive performance of the best ML models. The metrics used for model performance comparison are symmetric mean absolute percentage error (SMAPE), root mean square error (RMSE), root-relative square error (RRSE), and relative absolute error (RAE), which are shown in Table 2.
The metrics of RF, SGB, CART and XGBoost models were used to compare the model performance of the benchmark MLR model which used the same training and testing dataset as the ML methods. An ML model with an average metric lower than that of MLR was considered a convincing model. In order to evaluate whether the ML methods outperform MLR, after ML methods were repeated 10 times, means and standard deviations were obtained.
As all of the used ML methods can produce an importance ranking for each predictor variable, we defined that the variable ranked 1 would be the most critical risk factor and the variable ranked as 15 would be the least significant risk factor. The different ML methods may produce different variable importance rankings since they have different modeling characteristics; we integrated the variable importance ranking of the convincing ML models to enhance stability and integrity by re-ranking the importance of risk factors. In the final stage of the proposed scheme, we summarized and discussed our significant findings of convincing ML models and identified important variables.
In this study, all methods were performed with R software version 4.0.5 and R Studio version 1.1.453 with the required packages installed (http://www.R-project.org; https://www.rstudio.com/products/rstudio/ assessed 1 May 2022). The implementations of RF, SGB, CART and XGBoost are, respectively, “random Forest” R package version 4.6-14 [49], “gbm” R package version 2.1.8 [50], “r part” R package version 4.1-15 [51], “XGBoost” R package version 1.5.0.2. [52]. To estimate the best hyperparameters set for developed effective CART, RF, SGB and XGBoost methods, the “caret” R package version 6.0-90 was used [53]. The MLR was implemented by the “stats” R package version 4.0.5, the default setting was used to construct the models.

3. Results

The demographic data of the enrolled T2DM patients are shown in Table 3. Table 4 displays the comparison between conventional MLR and the four ML methods in identifying abnormal Th-201, and we found that all four ML methods exhibited low prediction errors compared to o the MLR method. These findings suggest that all ML methods are reliable and not inferior to traditional MLR. In order to further determine whether the four ML methods significantly outperformed the MLR method, the Wilcoxon signed-rank test was used. We used the test to evaluate the prediction performance of the four ML methods and the MLR method (data not shown). It can be observed that the prediction error values of all ML methods were not significantly different from the MLR method.
The ranking of each factor created by ML is demonstrated in Table 5. Diverse ML methods generated different relative importance rankings for each risk factor. Note that the darkness of the blue color indicates the importance of the risk factors. The darker the blue color is, the more important the risk factor is. For instance, in the SGB method, the top three important factors are BMI, HbA1c and Cr. For the CART method, the most dominant factor is BMI, followed by Cr and age. In addition, to identify the overall predictive power of each parameter from all four ML methods, the mean ranking of each risk factor was obtained by averaging the ranking values of each variable in each method.
Figure 3 shows the risk factors based on the order of their mean ranking values. It can be noted from the figure that the first seven important risk factors in predicting abnormal Th-201 scans are BMI, Hb, age, HbA1c, Cr, SBP and DBP, accordingly.

4. Discussion

As aforementioned in the introduction, there are two goals of the present study. Our results show that: 1. All the ML methods are not inferior to traditional MLR; 2. BMI, Hb, age, HbA1c, Cr, SBP and DBP, from the most important to the least important, are the major influencers.
Not surprisingly, BMI is the top risk factor in detecting abnormal Th-201 scans, which suggests that obesity is the most critical clinical parameter to predict myocardial hypoperfusion. Accumulative evidence has shown that BMI is associated with an increased risk of CAD and the occurrence of acute coronary artery syndrome [54,55], and it is also an independent indicator in predicting exercise-induced myocardial ischemia [56]. The actual mechanism underlying obesity and CAD remains to be determined, and several hypotheses have been proposed. For instance, obesity is a central part of metabolic syndrome and is associated with complicated metabolic derangements, including glucose intolerance, dyslipidemia, HTN, dysregulated inflammatory cytokines and endothelial dysfunction, all of which lead to susceptibility to CAD [55,57]. In addition, obesity is also correlated with increased coagulation factor and platelets activation, which could result in a hypercoagulable state, and subsequently contribute to the development of CAD [55].
The role of anemia has already been reported in much research [58,59]. From these studies, three conclusions can be drawn: 1. Anemia affects the prognosis of acute coronary disease [58]; 2. Anemia could alter ST-segment changes [59]; 3. Different methods of transfusion could have different impacts on the prognosis of MI [60]. Among these studies, Cook et al. performed a study to show the precise impact of anemia on MPS. In 195 anemic participants, the mean SSS was higher than that of the normal comparators (6.8 vs. 4.7, p < 0.01) [61]. It is not surprising that anemia could worsen epicardial CAD and increase blood viscosity and end-diastolic pressure [62,63].
In the present study, age was ranked as the third most important risk factor in predicting abnormal Th-201 scans. It is known that age itself exerts an essential role in the progressive deterioration of overall cardiovascular function, which increases the risk of CAD in the elderly [64]. From a clinical view of point, advanced age is associated with a high risk of T2DM, HTN, dyslipidemia and renal insufficiency, all of which contribute to the occurrence of CAD. On the other hand, old age links certain molecular mechanisms involving vascular aging, and microvascular and macrovascular remodeling, including oxidative stress, mitochondrial dysfunction, inflammation, endothelial dysfunction, etc. [65,66]. All these clinical and molecular factors could facilitate cardiovascular dysfunction and myocardial ischemia in the elderly.
HbA1c, the traditional long-term glycemic control marker of diabetes, was selected as the fourth important parameter for having an abnormal Th-201 scan. In T2DM, sustained exposure to hyperglycemia could increase the incidence and the severity of macrovascular complications, including CAD [67,68,69]. In the additional 10 years of the original UK Prospective Diabetes Study, the intensive glycemic control group demonstrated a long-term reduction of all-cause mortality [70]. Therefore, intensive glycemic control is needed for T2DM patients to reduce macrovascular complications in clinical settings.
Next, Cr was the fifth predictor in the current study, which implies that renal dysfunction was a significant clinical parameter in assessing CAD. In addition to CAD, T2DM is also considered a strong pathogenic factor for having another major microvascular complication, diabetic nephropathy (DN) [71]. DN is the principal cause of chronic kidney disease (CKD) and end-stage renal disease, which is associated with high morbidity and mortality rate [5]. Declined renal function is found to be associated with an increased risk of death, cardiovascular events and hospitalization in a normal population-based study, which suggests CKD is also an independent indicator for CAD risk and mortality [72].
The last two factors chosen were SBP and DBP. It is well-documented that HTN is an independent risk factor for the occurrence of CAD, and BP reduction in hypertensive patients could significantly reduce CAD incidence and mortality [73]. The pathogenesis of HTN in the development of CAD is extremely complicated, including the effect of high BP as a physical pressure on the vessel wall, triggering and aggravating the atherosclerotic process, inducing endothelial dysfunction, facilitating arterial wall stiffness, subsequently leading to left ventricular hypertrophy and increasing myocardial oxygen consumption, ultimately leading to myocardial ischemia [74].
One may question that why certain risk factors, including the duration of diabetes, LDL, HDL, smoking and microalbuminuria, etc., were ranked as less critical clinical parameters in predicting abnormal Th-201 scans using ML methods. This interesting observation could be attributed to the unique nature of ML which are data-directed and non-parametric models. ML methods can process any nonlinear function and a prior hypothesis describing the characteristics of the data is not required. In addition, despite the fact that the actual relationships among the empirical data could be unclear or difficult to illustrate, ML methods can still catch slight functional correlations between them [75,76,77]. Therefore, it is possible that the duration of diabetes, LDL, HDL, smoking and microalbuminuria, etc., may consist of more linear pattern information and less remarkable nonlinear clues than BMI, Hb, age, HbA1c, Cr, SBP and DBP. Consequently, these variables are graded as the less important risk factors using ML methods.
To the best of our knowledge, despite ML methods being used in certain medical fields, however, no study has been carried out to predict abnormal Th-201 scans using ML methods so far. This study is the first one to identify the most critical indicators in predicting diabetic patients with abnormal Th-201 scans and possible CAD using clinical variables together with ML. In addition to evaluating the importance of risk factors ranked by ML, we also compared ML and MLR at the same time. However, there are still limitations to this study. First, this is a cross-sectional study, and our data are less convincing than those of a longitudinal study. Secondly, there were missing values in certain clinical variables, and collecting complete data on these variables would make our results more valuable. Thirdly, as healthy controls were not included in the study, we cannot compare the differences in risk factors between T2DM and non-T2DM subjects. It would be our future plan to recruit healthy subjects as a control group for further analysis to make our results more reliable and comprehensive. Finally, important medication information including lipid-lowering agents, sodium-glucose cotransporter 2 inhibitors and glucagon-like peptide-1 agonists, etc., which can reduce the CAD risk, was not available for the study. Since we did not collect this information, the effects of the aforementioned medications remain unknown.
In conclusion, our data showed that ML methods were not inferior to traditional MLR and might be more accurate than traditional MLR in predicting abnormal Th-201 scans in T2D patients. We recognized that BMI, Hb, age, HbA1c, Cr, SBP and DBP, from most important to least important, are the most significant factors.

Author Contributions

J.-D.L., L.-Y.H., C.-H.K. and F.-Y.C. analyzed the data. S.-W.K., Y.-L.C. wrote the original draft. C.-Z.W. reviewed and edited the manuscript. C.-H.L. and D.P. contributed to the discussion and edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the Research Ethics Review Committee at the Cardinal Tien Hospital (IRB No. CTH-106-2-5-041).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data available on request due to privacy/ethical restrictions.

Acknowledgments

The authors thank all subjects who participated in the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lo, C.J.; Tang, H.Y.; Huang, C.Y.; Lin, C.M.; Ho, H.Y.; Shiao, M.S.; Cheng, M.L. Metabolic Signature Differentiated Diabetes Mellitus from Lipid Disorder in Elderly Taiwanese. J. Clin. Med. 2018, 8, 13–27. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. IDF Diabetes Atlas. Available online: https://www.diabetesatlas.org/data/en/country/194/tw.html (accessed on 1 May 2022).
  3. Sun, H.; Saeedi, P.; Karuranga, S.; Pinkepank, M.; Ogurtsova, K.; Duncan, B.B.; Stein, C.; Basit, A.; Chan, J.C.N.; Mbanya, J.C.; et al. IDF Diabetes Atlas: Global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045. Diabetes Res. Clin. Pract. 2022, 183, 109119. [Google Scholar] [CrossRef] [PubMed]
  4. Emerging Risk Factors Collaboration; Di Angelantonio, E.; Kaptoge, S.; Wormser, D.; Willeit, P.; Butterworth, A.S.; Bansal, N.; O’Keeffe, L.M.; Gao, P.; Wood, A.M.; et al. Association of Cardiometabolic Multimorbidity With Mortality. JAMA 2015, 314, 52–60. [Google Scholar] [CrossRef] [PubMed]
  5. IDF Diabetes Atlas. 7th ed. 2015. Available online: www.idf.org/diabetesatlas (accessed on 1 May 2022).
  6. Morrish, N.J.; Wang, S.L.; Stevens, L.K.; Fuller, J.H.; Keen, H. Mortality and causes of death in the WHO Multinational Study of Vascular Disease in Diabetes. Diabetologia 2001, 44 (Suppl. S2), S14–S21. [Google Scholar] [CrossRef]
  7. Stamler, J.; Vaccaro, O.; Neaton, J.D.; Wentworth, D. Diabetes, other risk factors, and 12-yr cardiovascular mortality for men screened in the Multiple Risk Factor Intervention Trial. Diabetes Care 1993, 16, 434–444. [Google Scholar] [CrossRef]
  8. Schramm, T.K.; Gislason, G.H.; Kober, L.; Rasmussen, S.; Rasmussen, J.N.; Abildstrom, S.Z.; Hansen, M.L.; Folke, F.; Buch, P.; Madsen, M.; et al. Diabetes patients requiring glucose-lowering therapy and nondiabetics with a prior myocardial infarction carry the same cardiovascular risk: A population study of 3.3 million people. Circulation 2008, 117, 1945–1954. [Google Scholar] [CrossRef] [Green Version]
  9. Alabas, O.A.; Hall, M.; Dondo, T.B.; Rutherford, M.J.; Timmis, A.D.; Batin, P.D.; Deanfield, J.E.; Hemingway, H.; Gale, C.P. Long-term excess mortality associated with diabetes following acute myocardial infarction: A population-based cohort study. J. Epidemiol. Community Health 2017, 71, 25–32. [Google Scholar] [CrossRef]
  10. Arenja, N.; Mueller, C.; Ehl, N.F.; Brinkert, M.; Roost, K.; Reichlin, T.; Sou, S.M.; Hochgruber, T.; Osswald, S.; Zellweger, M.J. Prevalence, extent, and independent predictors of silent myocardial infarction. Am. J. Med. 2013, 126, 515–522. [Google Scholar] [CrossRef]
  11. Passa, P.; Drouin, P.; Issa-Sayegh, M.; Blasco, A.; Masquet, C.; Monassier, J.P.; Paillole, C. Coronary disease and diabetes. Diabete Metab. 1995, 21, 446–451. [Google Scholar]
  12. Anonymous. Consensus development conference on the diagnosis of coronary heart disease in people with diabetes: 10–11 February 1998, Miami, Florida. American Diabetes Association. Diabetes Care 1998, 21, 1551–1559. [Google Scholar] [CrossRef]
  13. Mark, D.B.; Hlatky, M.A.; Harrell, F.E., Jr.; Lee, K.L.; Califf, R.M.; Pryor, D.B. Exercise treadmill score for predicting prognosis in coronary artery disease. Ann. Intern. Med. 1987, 106, 793–800. [Google Scholar] [CrossRef] [PubMed]
  14. Mark, D.B.; Shaw, L.; Harrell, F.E., Jr.; Hlatky, M.A.; Lee, K.L.; Bengtson, J.R.; McCants, C.B.; Califf, R.M.; Pryor, D.B. Prognostic value of a treadmill exercise score in outpatients with suspected coronary artery disease. N. Engl. J. Med. 1991, 325, 849–853. [Google Scholar] [CrossRef] [PubMed]
  15. Giri, S.; Shaw, L.J.; Murthy, D.R.; Travin, M.I.; Miller, D.D.; Hachamovitch, R.; Borges-Neto, S.; Berman, D.S.; Waters, D.D.; Heller, G.V. Impact of diabetes on the risk stratification using stress single-photon emission computed tomography myocardial perfusion imaging in patients with symptoms suggestive of coronary artery disease. Circulation 2002, 105, 32–40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Scholte, A.J.; Schuijf, J.D.; Kharagjitsingh, A.V.; Dibbets-Schneider, P.; Stokkel, M.P.; van der Wall, E.E.; Bax, J.J. Prevalence and predictors of an abnormal stress myocardial perfusion study in asymptomatic patients with type 2 diabetes mellitus. Eur. J. Nucl. Med. Mol. Imaging 2009, 36, 567–575. [Google Scholar] [CrossRef] [PubMed]
  17. Koopaie, M.; Ghafourian, M.; Manifar, S.; Younespour, S.; Davoudi, M.; Kolahdooz, S.; Shirkhoda, M. Evaluation of CSTB and DMBT1 expression in saliva of gastric cancer patients and controls. BMC Cancer 2022, 22, 473. [Google Scholar] [CrossRef]
  18. Wang, C.; Li, Y.; Tsuboshita, Y.; Sakurai, T.; Goto, T.; Yamaguchi, H.; Yamashita, Y.; Sekiguchi, A.; Tachimori, H. Alzheimer’s Disease Neuroimaging I: A high-generalizability machine learning framework for predicting the progression of Alzheimer’s disease using limited data. NPJ Digit. Med. 2022, 5, 43. [Google Scholar] [CrossRef]
  19. Xu, S.; Arnetz, J.E.; Arnetz, B.B. Applying machine learning to explore the association between biological stress and near misses in emergency medicine residents. PLoS ONE 2022, 17, e0264957. [Google Scholar] [CrossRef]
  20. Steiner, H.E.; Giles, J.B.; Patterson, H.K.; Feng, J.; El Rouby, N.; Claudio, K.; Marcatto, L.R.; Tavares, L.C.; Galvez, J.M.; Calderon-Ospina, C.A.; et al. Machine Learning for Prediction of Stable Warfarin Dose in US Latinos and Latin Americans. Front. Pharmacol. 2021, 12, 749786. [Google Scholar] [CrossRef]
  21. Lin, Z.; Chou, W.C.; Cheng, Y.H.; He, C.; Monteiro-Riviere, N.A.; Riviere, J.E. Predicting Nanoparticle Delivery to Tumors Using Machine Learning and Artificial Intelligence Approaches. Int. J. Nanomed. 2022, 17, 1365–1379. [Google Scholar] [CrossRef]
  22. Mitchell, T.M. Machine Learning; New York McGraw Hill: New York, NY, USA, 1997. [Google Scholar]
  23. Ye, Y.; Xiong, Y.; Zhou, Q.; Wu, J.; Li, X.; Xiao, X. Comparison of Machine Learning Methods and Conventional Logistic Regressions for Predicting Gestational Diabetes Using Routine Clinical Data: A Retrospective Cohort Study. J. Diabetes Res. 2020, 2020, 4168340. [Google Scholar] [CrossRef]
  24. Marateb, H.R.; Mansourian, M.; Faghihimani, E.; Amini, M.; Farina, D. A hybrid intelligent system for diagnosing microalbuminuria in type 2 diabetes patients without having to measure urinary albumin. Comput. Biol. Med. 2014, 45, 34–42. [Google Scholar] [CrossRef] [PubMed]
  25. Nusinovici, S.; Tham, Y.C.; Chak Yan, M.Y.; Wei Ting, D.S.; Li, J.; Sabanayagam, C.; Wong, T.Y.; Cheng, C.Y. Logistic regression was as good as machine learning for predicting major chronic diseases. J. Clin. Epidemiol. 2020, 122, 56–69. [Google Scholar] [CrossRef] [PubMed]
  26. Miller, D.D.; Brown, E.W. Artificial Intelligence in Medical Practice: The Question to the Answer? Am. J. Med. 2018, 131, 129–133. [Google Scholar] [CrossRef]
  27. Association, A.D. Introduction: The American Diabetes Association’s (ADA) evidence-based practice guidelines, standards, and related recommendations and documents for diabetes care. Diabetes Care 2012, 35 (Suppl. S1), S1–S2. [Google Scholar]
  28. Hachamovitch, R.; Berman, D.S.; Shaw, L.J.; Kiat, H.; Cohen, I.; Cabico, J.A.; Friedman, J.; Diamond, G.A. Incremental prognostic value of myocardial perfusion single photon emission computed tomography for the prediction of cardiac death: Differential stratification for risk of cardiac death and myocardial infarction. Circulation 1998, 97, 535–543. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Gimelli, A.; Rossi, G.; Landi, P.; Marzullo, P.; Iervasi, G.; L’Abbate, A.; Rovai, D. Stress/Rest Myocardial Perfusion Abnormalities by Gated SPECT: Still the Best Predictor of Cardiac Events in Stable Ischemic Heart Disease. J. Nucl. Med. 2009, 50, 546–553. [Google Scholar] [CrossRef] [Green Version]
  30. Nakajima, K.; Yamasaki, Y.; Kusuoka, H.; Izumi, T.; Kashiwagi, A.; Kawamori, R.; Shimamoto, K.; Yamada, N.; Nishimura, T. Cardiovascular events in Japanese asymptomatic patients with type 2 diabetes: A 1-year interim report of a J-ACCESS 2 investigation using myocardial perfusion imaging. Eur. J. Nucl. Med. Mol Imaging 2009, 36, 2049–2057. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Tseng, C.J.; Lu, C.J.; Chang, C.C.; Chen, G.D.; Cheewakriangkrai, C. Integration of data mining classification techniques and ensemble learning to identify risk factors and diagnose ovarian cancer recurrence. Artif. Intell. Med. 2017, 78, 47–54. [Google Scholar] [CrossRef]
  32. Shih, C.C.; Lu, C.J.; Chen, G.D.; Chang, C.C. Risk Prediction for Early Chronic Kidney Disease: Results from an Adult Health Examination Program of 19,270 Individuals. Int. J. Environ. Res. Public Health 2020, 17, 4973. [Google Scholar] [CrossRef]
  33. Chang, C.C.; Chen, S.H. Developing a Novel Machine Learning-Based Classification Scheme for Predicting SPCs in Breast Cancer Survivors. Front. Genet. 2019, 10, 848. [Google Scholar] [CrossRef]
  34. Lee, T.S.; Chen, I.F.; Chang, T.J.; Lu, C.J. Forecasting Weekly Influenza Outpatient Visits Using a Two-Dimensional Hierarchical Decision Tree Scheme. Int. J. Environ. Res. Public Health 2020, 17, 4743. [Google Scholar] [CrossRef] [PubMed]
  35. Chang, C.C.; Yeh, J.H.; Chen, Y.M.; Jhou, M.J.; Lu, C.J. Clinical Predictors of Prolonged Hospital Stay in Patients with Myasthenia Gravis: A Study Using Machine Learning Algorithms. J. Clin. Med. 2021, 10, 4393. [Google Scholar] [CrossRef] [PubMed]
  36. Chiu, Y.L.; Jhou, M.J.; Lee, T.S.; Lu, C.J.; Chen, M.S. Health Data-Driven Machine Learning Algorithms Applied to Risk Indicators Assessment for Chronic Kidney Disease. Risk Manag. Healthc Policy 2021, 14, 4401–4412. [Google Scholar] [CrossRef] [PubMed]
  37. Wu, C.W.; Shen, H.L.; Lu, C.J.; Chen, S.H.; Chen, H.Y. Comparison of Different Machine Learning Classifiers for Glaucoma Diagnosis Based on Spectralis OCT. Diagnostics 2021, 11, 1718. [Google Scholar] [CrossRef]
  38. Wu, T.E.; Chen, H.A.; Jhou, M.J.; Chen, Y.N.; Chang, T.J.; Lu, C.J. Evaluating the Effect of Topical Atropine Use for Myopia Control on Intraocular Pressure by Using Machine Learning. J. Clin. Med. 2020, 10, 111. [Google Scholar] [CrossRef]
  39. Chang, C.C.; Yeh, J.H.; Chiu, H.C.; Chen, Y.M.; Jhou, M.J.; Liu, T.C.; Lu, C.J. Utilization of Decision Tree Algorithms for Supporting the Prediction of Intensive Care Unit Admission of Myasthenia Gravis: A Machine Learning-Based Approach. J. Pers. Med. 2022, 12, 32. [Google Scholar] [CrossRef]
  40. Breiman, L.F.J.; Olshen, R.A.; Stone, C.J. Classification and Regression Trees; Wadsworth, Champman & Hall/CRC: New York, NY, USA, 1984. [Google Scholar]
  41. Patel, N. US: Study of various decision tree pruning methods with their empirical comparison in WEKA. Int. J. Comp. Appl. 2012, 60, 20–25. [Google Scholar]
  42. Tierney, N.J.; Harden, F.A.; Harden, M.J.; Mengersen, K.L. Using decision trees to understand structure in missing data. BMJ Open 2015, 5, e007450. [Google Scholar] [CrossRef] [Green Version]
  43. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  44. Calle, M.L.; Urrea, V. Letter to the editor: Stability of Random Forest importance measures. Brief Bioinform. 2011, 12, 86–89. [Google Scholar] [CrossRef] [Green Version]
  45. Friedman, J.H. Greedy function approximation: A gradient boosting machine. Ann. Stat. 2001, 29, 1189–1232. [Google Scholar] [CrossRef]
  46. Friedman, J.H. Stochastic gradient boosting. Comput. Stat. Data Anal. 2002, 38, 367–378. [Google Scholar] [CrossRef]
  47. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; ACM: New York, NY, USA, 2016. [Google Scholar]
  48. Torlay, L.; Perrone-Bertolotti, M.; Thomas, E.; Baciu, M. Machine learning-XGBoost analysis of language networks to classify patients with epilepsy. Brain Inform. 2017, 4, 159–169. [Google Scholar] [CrossRef] [PubMed]
  49. Breiman, L.C.A.; Liaw, A.; Wiener, M. Randomforest: Breiman and Cutler’s Random Forests for Classification and Regression. R Package Version 4.6-14. 2022. Available online: https://cran.r-project.org/web/packages/randomForest/randomForest.pdf (accessed on 1 May 2022).
  50. Gbm: Generalized Boosted Regression Models. R Package Version 2.1.8. Available online: https://CRAN.R-project.org/package=gbm (accessed on 1 May 2022).
  51. Therneau, T.A.B. Rpart: Recursive Partitioning and Regression Trees. R Package Version 4.1-15. 2022. Available online: https://rdrr.io/cran/rpart/ (accessed on 1 May 2022).
  52. Chen, T.H.T.; Benesty, M.; Benesty, M.; Khotilovich, V.; Tang, Y.; Cho, H.; Chen, K.; Mitchell, R.; Cano, I.; Zhou, T.; et al. Xgboost: Ex-treme Gradient Boosting. R Package Version 1.5.0.2. 2022. Available online: https://oa.mg/author/A2126135973 (accessed on 1 May 2022).
  53. Kuhn, M. Caret: Classification and Regression Training. R Package Version 6.0-90. 2022. Available online: https://webcache.googleusercontent.com/search?q=cache:dFJOj8ytZqYJ:https://rdrr.io/cran/caret/+&cd=3&hl=zh-CN&ct=clnk&client=firefox-b-d (accessed on 1 May 2022).
  54. Alkhawam, H.; Nguyen, J.; Sayanlar, J.; Sogomonian, R.; Desai, R.; Jolly, J.; Vyas, N.; Syed, U.; Homsi, M.; Rubinstein, D. Coronary artery disease in patients with body mass index >/=30 kg/m(2): A retrospective chart analysis. J. Community Hosp. Intern. Med. Perspect. 2016, 6, 31483. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Wolk, R.; Berger, P.; Lennon, R.J.; Brilakis, E.S.; Somers, V.K. Body mass index: A risk factor for unstable angina and myocardial infarction in patients with angiographically confirmed coronary artery disease. Circulation 2003, 108, 2206–2211. [Google Scholar] [CrossRef]
  56. Katzel, L.I.; Sorkin, K.D.; Colman, E.; Goldberg, A.P.; Busby-Whitehead, M.J.; Lakatta, L.E.; Becker, L.C.; Lakatta, E.G.; Fleg, J.L. Risk factors for exercise-induced silent myocardial ischemia in healthy volunteers. Am. J. Cardiol. 1994, 74, 869–874. [Google Scholar] [CrossRef]
  57. Ades, P.A.; Savage, P.D. Obesity in coronary heart disease: An unaddressed behavioral risk factor. Circulation 2007, 104, 117–119. [Google Scholar]
  58. Colombo, M.G.; Kirchberger, I.; Amann, U.; Heier, M.; Thilo, C.; Kuch, B.; Peters, A.; Meisinger, C. Association between admission anemia and long-term mortality in patients with acute myocardial infarction: Results from the MONICA/KORA myocardial infarction registry. BMC Cardiovasc. Disord. 2018, 18, 50. [Google Scholar] [CrossRef]
  59. Kaul, S.; Alladi, S.; Mridula, K.R.; Bandaru, V.C.; Umamashesh, M.; Anjanikumar, D.; Lalitha, P.; Chandrasekhar, R. Prevalence and risk factors of asymptomatic carotid artery stenosis in Indian population: An 8-year follow-up study. Neurol. India 2017, 65, 279–285. [Google Scholar] [CrossRef]
  60. Ducrocq, G.; Simon, T.; Steg, P.G.; Investigators, R. Effect of Restrictive or Liberal Blood Transfusion on Major Cardiovascular Events in Patients With Acute Myocardial Infarction and Anemia-Reply. JAMA 2021, 325, 2506–2507. [Google Scholar] [CrossRef]
  61. Cook, J.R.; Dillie, K.S.; Hakeem, A.; Bhatti, S.; Chang, S.M. Effectiveness of anemia and chronic kidney disease as predictors for presence and severity of coronary artery disease in patients undergoing stress myocardial perfusion study. Am. J. Cardiol. 2008, 102, 266–271. [Google Scholar] [CrossRef] [PubMed]
  62. Al-Ahmad, A.; Rand, W.M.; Manjunath, G.; Konstam, M.A.; Salem, D.N.; Levey, A.S.; Sarnak, M.J. Reduced kidney function and anemia as risk factors for mortality in patients with left ventricular dysfunction. J. Am. Coll. Cardiol. 2001, 38, 955–962. [Google Scholar] [CrossRef] [Green Version]
  63. Metivier, F.; Marchais, S.J.; Guerin, A.P.; Pannier, B.; London, G.M. Pathophysiology of anaemia: Focus on the heart and blood vessels. Nephrol. Dial. Transplant. 2000, 15 (Suppl. S3), 14–18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Curtis, A.B.; Karki, R.; Hattoum, A.; Sharma, U.C. Arrhythmias in Patients >/=80 Years of Age: Pathophysiology, Management, and Outcomes. J. Am. Coll. Cardiol. 2018, 71, 2041–2057. [Google Scholar] [CrossRef]
  65. Paneni, F.; Diaz Canestro, C.; Libby, P.; Luscher, T.F.; Camici, G.G. The Aging Cardiovascular System: Understanding It at the Cellular and Clinical Levels. J. Am. Coll. Cardiol. 2017, 69, 1952–1967. [Google Scholar] [CrossRef]
  66. Badimon, L.; Bugiardini, R.; Cubedo, J. Pathophysiology of acute coronary syndromes in the elderly. Int. J. Cardiol. 2016, 222, 1105–1109. [Google Scholar] [CrossRef]
  67. Srinivasan, M.P.; Kamath, P.K.; Bhat, N.M.; Pai, N.D.; Bhat, R.U.; Shah, T.D.; Singhal, A.; Mahabala, C. Severity of coronary artery disease in type 2 diabetes mellitus: Does the timing matter? Indian Heart J. 2016, 68, 158–163. [Google Scholar] [CrossRef] [Green Version]
  68. van Wijngaarden, R.P.T.; Overbeek, J.A.; Heintjes, E.M.; Schubert, A.; Diels, J.; Straatman, H.; Steyerberg, E.W.; Herings, R.M.C. Relation Between Different Measures of Glycemic Exposure and Microvascular and Macrovascular Complications in Patients with Type 2 Diabetes Mellitus: An Observational Cohort Study. Diabetes Ther. 2017, 8, 1097–1109. [Google Scholar] [CrossRef]
  69. Zhao, W.; Katzmarzyk, P.T.; Horswell, R.; Wang, Y.; Johnson, J.; Hu, G. HbA1c and coronary heart disease risk among diabetic patients. Diabetes Care 2014, 37, 428–435. [Google Scholar] [CrossRef] [Green Version]
  70. Holman, R.R.; Paul, S.K.; Bethel, M.A.; Matthews, D.R.; Neil, H.A. 10-year follow-up of intensive glucose control in type 2 diabetes. N. Engl. J. Med. 2008, 359, 1577–1589. [Google Scholar] [CrossRef] [Green Version]
  71. Fox, C.S.; Larson, M.G.; Leip, E.P.; Culleton, B.; Wilson, P.W.; Levy, D. Predictors of new-onset kidney disease in a community-based population. JAMA 2004, 291, 844–850. [Google Scholar] [CrossRef] [Green Version]
  72. Go, A.S.; Chertow, G.M.; Fan, D.; McCulloch, C.E.; Hsu, C.Y. Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization. N. Engl. J. Med. 2004, 351, 1296–1305. [Google Scholar] [CrossRef]
  73. Rosendorff, C.; Lackland, D.T.; Allison, M.; Aronow, W.S.; Black, H.R.; Blumenthal, R.S.; Cannon, C.P.; de Lemos, J.A.; Elliott, W.J.; Findeiss, L.; et al. Treatment of hypertension in patients with coronary artery disease: A scientific statement from the American Heart Association, American College of Cardiology, and American Society of Hypertension. Hypertension 2015, 65, 1372–1407. [Google Scholar] [CrossRef] [PubMed]
  74. Escobar, E. Hypertension and coronary heart disease. J. Hum. Hypertens 2002, 16 (Suppl. S1), S61–S63. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  75. Chen, I.; Lu, C.J. Sales forecasting by combining clustering and machine-learning techniques for computer retailing. Neural. Comput. Applic. 2017, 28, 2633–2647. [Google Scholar] [CrossRef]
  76. Jiang, F.; Jiang, Y.; Zhi, H.; Dong, Y.; Li, H.; Ma, S.; Wang, Y.; Dong, Q.; Shen, H.; Wang, Y. Artificial intelligence in healthcare: Past, present and future. Stroke Vasc. Neurol. 2017, 2, 230–243. [Google Scholar] [CrossRef]
  77. Koteluk, O.; Wartecki, A.; Mazurek, S.; Kolodziejczak, I.; Mackiewicz, A. How Do Machines Learn? Artificial Intelligence as a New Era in Medicine. J. Pers. Med. 2021, 11, 32. [Google Scholar] [CrossRef]
Figure 1. Flowchart of sample selection from the Cardinal Tien Hospital Diabetes Study Cohort.
Figure 1. Flowchart of sample selection from the Cardinal Tien Hospital Diabetes Study Cohort.
Diagnostics 12 01619 g001
Figure 2. Proposed scheme in the study.
Figure 2. Proposed scheme in the study.
Diagnostics 12 01619 g002
Figure 3. Integrated importance ranking of all risk factors.
Figure 3. Integrated importance ranking of all risk factors.
Diagnostics 12 01619 g003
Table 1. Variable definition.
Table 1. Variable definition.
Variables DescriptionUnit
V1: SexMale/Female-
V2: AgePatient ageyear
V3: Body mass indexBody mass indexKg/m2
V4: Duration of diabetesDuration of diabetesyear
V5: SmokingNo/Yes-
V9: Glycated hemoglobinHbA1c (Glycated hemoglobin) %
V10: TriglycerideTriglyceride baselinemg/dL
V11:High density lipoprotein cholesterolHigh-Density Lipoprotein Cholesterolmg/dL
V12: Low density lipoprotein cholesterolLow-Density Lipoprotein Cholesterol mg/dL
V13: Alanine aminotransferase baselineAlanine aminotransferase U/L
V14: CreatinineCreatinine mg/dL
V6: Systolic blood pressureSystolic blood pressure mmHg
V7: Diastolic blood pressureDiastolic blood pressure bmmHg
V8: HemoglobinHb
V15: MicroalbuminuriaUrine albumin to creatinine ratio = microalbumin (mg/dL)/urine creatinine(mg/dL) mg/g
Table 2. The Equation of Performance Metrics.
Table 2. The Equation of Performance Metrics.
MetricsCalculation *
SMAPE S M A P E = 1 m j = 1 m | p j q j | ( | p j | + | q j | ) / 2
RAE R A E = j = 1 m | p j q j | j = 1 m | q j q ¯ |
RRSE R R S E = j = 1 m ( p j q j ) 2 j = 1 m ( q j q ¯ ) 2
RMSE R M S E = 1 m j = 1 m ( p j q j ) 2
SMAPE, Symmetric Mean Absolute Percentage Error; RAE, Relative Absolute Error; RRSE, Root- Relative Squared Error; RMSE, Root Mean Squared Error. * p and q represent predicted and actual values, respectively; m is the total number of data.
Table 3. The demographics of enrolled type 2 diabetes patients.
Table 3. The demographics of enrolled type 2 diabetes patients.
VariablesMean ± SDN
Age68.09 ± 10.07796
Body mass index26.17 ± 3.89588
Duration of diabetes13.81 ± 8.02589
Fasting plasma glucose150.09 ± 46.05591
Glycated hemoglobin7.68 ± 1.39590
Triglyceride123.65 ± 79.32586
High-density lipoprotein cholesterol49.53 ± 14.98524
Low-density lipoprotein cholesterol95.52 ± 26.18588
Alanine aminotransferase baseline23.66 ± 13.60588
Creatinine1.16 ± 0.99587
Systolic blood pressure131.08± 15.36514
Diastolic blood pressure73.35 ± 10.09514
Microalbuminuria 196.53± 723.55551
N (%)N
Sex 796
Male369 (53.64%)
Female427 (46.36%)
Smoking 329
No212 (64.44%)
Yes117 (35.56%)
SD, standard deviation.
Table 4. The performance of multiple linear regression (MLR) and different machine learning methods.
Table 4. The performance of multiple linear regression (MLR) and different machine learning methods.
Mean (SD)SMAPERAERRSERMSE
MLR1.120(0.04)1.049(0.06)1.054(0.03)7.760(0.39)
RF1.070(0.03)1.043(0.05)1.042(0.02)7.683(0.48)
SGB1.074(0.03)1.026(0.05)1.039(0.03)7.661(0.45)
CART1.055(0.04)1.031(0.06)1.049(0.03)7.736(0.56)
XGBoost1.058(0.04)1.017(0.05)1.032(0.02)7.613(0.58)
RF, random forest; SGB, stochastic gradient boosting; CART, classification and regression tree; XGBoost, eXtreme gradient boosting; SMAPE, symmetric mean absolute percentage error; RAE, relative absolute error; RRSE, root relative square error; RMSE, root mean square error. The numbers in the parentheses are standard errors.
Table 5. Importance ranking of each risk factor using the four convincing methods.
Table 5. Importance ranking of each risk factor using the four convincing methods.
VariablesRFSGBCARTXGBoostAverage
Sex5146149.75
Age243156
Body mass index41163
Duration of diabetes1131188.25
Smoking6151519.25
Hemoglobin86425
Glycated hemoglobin925106.5
Triglyceride101081210
High density lipoprotein cholesterol1171058.25
Low density lipoprotein cholesterol125121110
Alanine aminotransferase baseline138131311.75
Creatinine143297
Systolic blood pressure711947.75
Diastolic blood pressure3121438
Microalbuminuria159999.5
RF, random forest; SGB, stochastic gradient boosting; CART, classification and regression tree; XGBoost, eXtreme gradient boosting.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lin, J.-D.; Pei, D.; Chen, F.-Y.; Wu, C.-Z.; Lu, C.-H.; Huang, L.-Y.; Kuo, C.-H.; Kuo, S.-W.; Chen, Y.-L. Comparison between Machine Learning and Multiple Linear Regression to Identify Abnormal Thallium Myocardial Perfusion Scan in Chinese Type 2 Diabetes. Diagnostics 2022, 12, 1619. https://doi.org/10.3390/diagnostics12071619

AMA Style

Lin J-D, Pei D, Chen F-Y, Wu C-Z, Lu C-H, Huang L-Y, Kuo C-H, Kuo S-W, Chen Y-L. Comparison between Machine Learning and Multiple Linear Regression to Identify Abnormal Thallium Myocardial Perfusion Scan in Chinese Type 2 Diabetes. Diagnostics. 2022; 12(7):1619. https://doi.org/10.3390/diagnostics12071619

Chicago/Turabian Style

Lin, Jiunn-Diann, Dee Pei, Fang-Yu Chen, Chung-Ze Wu, Chieh-Hua Lu, Li-Ying Huang, Chun-Heng Kuo, Shi-Wen Kuo, and Yen-Lin Chen. 2022. "Comparison between Machine Learning and Multiple Linear Regression to Identify Abnormal Thallium Myocardial Perfusion Scan in Chinese Type 2 Diabetes" Diagnostics 12, no. 7: 1619. https://doi.org/10.3390/diagnostics12071619

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop