Next Article in Journal
3D Visualization System in Descemet Membrane Endothelial Keratoplasty (DMEK): A Six-Month Comparison with Conventional Microscope
Next Article in Special Issue
A Robustness Evaluation of Machine Learning Algorithms for ECG Myocardial Infarction Detection
Previous Article in Journal
Clinical Management of Hemodialyzed Patients: From Pharmacological Interventions to Advanced Technologies
Previous Article in Special Issue
Traumatology: Adoption of the Sm@rtEven Application for the Remote Evaluation of Patients and Possible Medico-Legal Implications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identifying Patients with Familial Chylomicronemia Syndrome Using FCS Score-Based Data Mining Methods

1
Division of Metabolic Disorders, Department of Internal Medicine, Faculty of Medicine, University of Debrecen, H-4032 Debrecen, Hungary
2
Doctoral School of Health Sciences, University of Debrecen, H-4032 Debrecen, Hungary
3
Aesculab Medical Solutions, Black Horse Group Ltd., H-4029 Debrecen, Hungary
4
Institute for Computer Science and Control (SZTAKI), Eötvös Loránd Research Network, H-1111 Budapest, Hungary
5
Department of Mathematical Engineering (INMA/ICTEAM), Université Catholique de Louvain, 1348 Louvain-la-Neuve, Belgium
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(15), 4311; https://doi.org/10.3390/jcm11154311
Submission received: 7 June 2022 / Revised: 14 July 2022 / Accepted: 22 July 2022 / Published: 25 July 2022
(This article belongs to the Special Issue Ehealth, Telemedicine and AI in Clinical Medicine)

Abstract

:
Background: There are no exact data about the prevalence of familial chylomicronemia syndrome (FCS) in Central Europe. We aimed to identify FCS patients using either the FCS score proposed by Moulin et al. or with data mining, and assessed the diagnostic applicability of the FCS score. Methods: Analyzing medical records of 1,342,124 patients, the FCS score of each patient was calculated. Based on the data of previously diagnosed FCS patients, we trained machine learning models to identify other features that may improve FCS score calculation. Results: We identified 26 patients with an FCS score of ≥10. From the trained models, boosting tree models and support vector machines performed the best for patient recognition with overall AUC above 0.95, while artificial neural networks accomplished above 0.8, indicating less efficacy. We identified laboratory features that can be considered as additions to the FCS score calculation. Conclusions: The estimated prevalence of FCS was 19.4 per million in our region, which exceeds the prevalence data of other European countries. Analysis of larger regional and country-wide data might increase the number of FCS cases. Although FCS score is an excellent tool in identifying potential FCS patients, consideration of some other features may improve its accuracy.

1. Introduction

Fasting chylomicronemia may rarely be due to a monogenic disorder that markedly reduces the activity of lipoprotein lipase (LPL), resulting in a decreased clearance of the triglyceride-rich lipoproteins from plasma [1]. This condition, referred to as familial chylomicronemia syndrome (FCS), is characterized by severe hypertriglyceridemia and sustained fasting chylomicronemia, thus predisposing affected individuals to recurrent episodes of pancreatitis. With an estimated frequency of one per million in the population, FCS is usually due to the homozygous or compound heterozygous mutations of the LPL gene, leading to a severe lack of functioning LPL protein [2]. Although, the majority of the FCS patients are carriers of loss-of-function mutations in the LPL gene, similar mutations are found to be causal in FCS, including apolipoproteins C2 and A5 (APOC2 and APOA5, respectively), lipase maturation factor 1 (LMF1), glycosylphosphatidylinositol-anchored high-density lipoprotein-binding protein 1 (GPIHBP1) and glycerol-3-phosphate dehydrogenase 1 (G3PDH1) [3,4,5,6].
Compared to those with multifactorial chylomicronemia syndrome (MFCS), patients with FCS are usually younger and less likely to possess any of the aggravating factors of hypertriglyceridemia; however, they are more prone to develop pancreatitis on the basis of the sustained chylomicronemia [7]. Interestingly, FCS patients are less likely to have cardiovascular disease (CVD), probably because of the severe reduction in LPL activity reducing the formation and accumulation of the atherogenic chylomicron and very low density lipoprotein (VLDL) remnants [2]. With a mortality rate of 2–5%, acute pancreatitis is the most dangerous consequence of hypertriglyceridemia [8]. Recently, an international expert panel proposed an excellent and easy-to-use diagnostic tool named the FCS score (Table 1) for the better identification of FCS patients [6]. According to Moulin et al., the FCS score turned out to have a sensitivity of 88% and specificity of 85% in identifying individuals with “very likely FCS”.
Although the disease represents a great health burden, exact data are lacking about the frequency of the disease in Hungary and other European countries as well [6]. Therefore, we aimed to identify FCS patients using the above mentioned FCS score with data mining methods in two major hospitals of the Northern Great Plain region of Hungary. We also tried to assess the usability of the FCS score using various machine learning methods that were trained on the data of previously identified FCS patients, individuals likely to have FCS based on their FCS score and the total clinical population in Debrecen (n = 590,500).

2. Materials and Methods

2.1. Patients and Methods

We obtained raw data from the hospital record system of the two leading medical centers of the Northern Great Plain region of Hungary including University of Debrecen Clinical Center (UDCC) and the County Hospital of Szabolcs-Szatmár-Bereg (CHSSB). Summing up eight total years, the data source contained all medical records from these two centers between 1 January, 2007 and 31 December, 2014. Through the servers of Aesculab Medical Solutions (Black Horse Group Ltd., Debrecen, Hungary), we accessed, cleaned, preprocessed and structured anonymous data that contained all medical records from these healthcare providers. As discussed previously [9], the studied population was considered to be representative for the regional population, therefore, the calculated prevalence may precisely estimate the regional prevalence of FCS. The information processed for the study contained three data sources as (i) laboratory data, (ii) diagnostic data using, and transforming to, the International Statistical Classification of Diseases and Related Health Problems (ICD)-10 convention and (iii) textual data including all hospital appointments. Data cleaning, preprocessing steps, detailed methodologies and software used were described previously [9]. The feature set (feature space) for the training included (i) all available nominal laboratory data during the medical history with nominal values calculated for the same units (e.g., triglycerides above 1.7 mmol/L) and (ii) the medical history either available from the diagnosis or mined from the textual data and calculated to 5 characters of the ICD-10, (e.g., E7800). The FCS score calculations and chart generation were performed with open-source software solutions on the textual data (Appendix A).
From the mined data, we calculated the previously proposed FCS score for each patient and grouped them according to the likelihood of FCS. Following data selection and screening, the medically evaluated data were trained with multiple machine learning techniques, including rectified linear unit neural networks (ReLU), adaptive boosting (AdaBoost), gradient boosting (XGBoost) and support vector machines (SVM). The training was carried out with an open source software (Appendix A) using the UDCC site clinical data. Tests were performed both on the trained data (with a 50–50 split) and on the CHSSB data as well. Labelling previously identified FCS patients as “positive” and individuals with no previous diagnosis of FCS as “negative”, we trained binary classification models on a dataset, which contained all previously identified FCS patients labeled as “positive”, and randomly selected patients from the remaining part of the clinical population labelled as “negative”. We also experimented with models trained on a dataset where we treated individuals likely to have FCS based on their FCS score as patients belonging to the “positive” label.

2.2. About Machine Learning

We may define the problem as a traditional binary classification as we have a finite, real valued descriptor and a binary label for each patient. Thus, a patient may either have FCS, thus labelled as “1”, or lack FCS and labeled as “0”. Based on the annotated dataset, several ways exist to identify relations between the features (including the elements of the descriptors that contain the ICD-10 diagnosis, as well as laboratory test values) and the known labels. In order to determine the best method for FCS classification and to approximate the performance of the models over the whole population, we built models using subsets of patients with known true labels as clinically diagnosed FCS, and evaluated the performance of the learned models on an independent dataset with known true labels. Our reasoning was based on the fundamental theory of generalization introduced by Vapnik and Chervonenkis in 1971 [10] and as a set of consequences of the theorem, which apply to all methods but a set of special neural networks. For the latter, we refer to Nagarajan and Kolter [11] and Devroye et al. [12]. Therefore, even if the bounds in the Vapnik–Chervonenkis generalization are not informative about deep neural networks on the first hand, there may be an underlying structure for which the theorem is meaningful in practice, too. There are three key rules based on the theorem, which are in shape with the fundamentals of data mining and machine learning: (i) prefer models with low complexity to provide capacity to learn any labeling [13], (ii) evaluate on an independent test set and (iii) use a training set as large as possible.
To cover different but the most efficient methods, we selected three widely used machine learning frameworks, including tree ensembles (AdaBoost and XGBoost) [13,14], “shallow” neural networks with kernel functions (SVM) [15] and fully connected “deep” neural networks with ReLU activations [16]. In comparison to ReLU networks, tree ensembles methods are less powerful as a function approximation technique, while the smaller capacity helps in the case of small datasets like ours or non-spatiotemporal structural variables, when there are no previously known reoccurring structures over the features. The order of the features is arbitrary in our study as they do not form rigid structures, hence, we used the only viable option and adopted fully connected artificial neural networks. Tree ensembles and kernel-based methods are not sensitive to the order of the features.
Tree ensembles build a set of “weak” classifiers from small, almost random decision trees. There are several methods to determine the set of decision trees and their importance e.g., random forest [17], adaptive boosting [13] or gradient boosting machines [14]. In the case of the neural networks, we built fully connected deep networks with ANN (artificial neural network) that were trained using ReLU as activations, and the parameters were optimized with adaptive momentum [18]. Finally, SVM models were trained with various kernel functions, including linear, polynomial or radial basis functions. Table 2 indicates the best performing methods per class.
Besides sensitivity, specificity and accuracy, the most important metric is area under the receiver operating characteristic curve (ROC AUC) as an evaluation method for our binary classification method. Sensitivity is measured as the proportion of true positives in patients with FCS, while specificity describes the proportion of true negatives in patients without FCS. Accuracy is the proportion of the total number of patients that are correctly identified in the studied population. ROC curve is defined by the point pairs of true positive rates (sensitivity) and false positive rates (1 minus specificity) at different threshold settings. AUC can be interpreted as the probability of classifying a positive sample with higher confidence than a negative sample.
It is important to note that, based on the trees learned by a gradient boosted tree model, it is possible to rank the features using their position in the trees. There are multiple methods ranging from the simple count of occurrence to a complex subset identification that may yield a generously good ranking of the features. We relied on a weighted version of the former, most commonly used method [19]. Additionally, the order of the trees learned during the boosting phase is of utmost importance, thus, we decided to investigate the learnings of the first couple of trees learned by the model.

3. Results

Based upon the features of the previously proposed FCS score, we calculated the score of each individual that visited the two major healthcare providers in our region during the study period (n = 1.341.722; mean age: 38.12 ± 23.37 years, male/female: 602.258/739.464; 45/55%). Patient characteristics and their calculated FCS score are listed on Table 3. We identified a total of 26 patients very likely with FCS (score ≥ 10). These data suggest that FCS might be more frequent, at least in our region, with an estimated prevalence of 19.4 per million.
For a rapid estimation of FCS scores, we gradually cut down data based on some strong key features of the score system to estimate the number of the patients that fell into the three major categories of “highly unlikely FCS”, “unlikely FCS” and “likely FCS”. As FCS is a disease characterized by serum triglyceride (TG) levels, we chose features which contributed markedly to the FCS score and were easily measurable with less subjectivity (Figure 1).
Therefore, we took patients with fasting TG levels exceeding 10 mmol/L for three consecutive cases (+5 points) and those who never had TG levels less than 2 mmol/L (thus avoiding the −5 points), and added those patients who had no secondary causes such as diabetes mellitus, metabolic syndrome, hypothyroidism, corticosteroid therapy or alcohol abuse (+2 points). To further enhance this estimation of FCS scores and find those that potentially live with undiagnosed FCS, we added key features of fasting TG levels exceeding 20 mmol/L at least once (+1 point), symptoms below 40 years (+1 point) and positive history of pancreatitis (+1 point). Key features in the two major healthcare providers (UDCC and CHSSB) for FCS score estimation and the number of the patients falling into the score categories are represented on Table 4, respectively. Some intra-regional difference was detectable as we estimated the prevalence of “likely FCS” to be 8.47 per million in UDCC and 5.32 in CHSSB, respectively.
As with the total population, we also calculated FCS score for every single patient available in the hospital database, separately in the two medical centers (Table 5, respectively). Based on our results, the calculated prevalence of FCS is 27.11 per million in the Debrecen (UDCC) region and 13.3 per million in the Nyíregyháza (CHSSB) region. Overall, male patients had a 4 to 5 times increased chance for a “likely FCS” than females. The magnitude of the number of patients with a calculated FCS score of 10+ (“likely FCS”) was comparable with the estimated prevalence when checking the patients individually.
As our estimated prevalence turned out to be one order of magnitude higher than the literature data, we decided to evaluate thoroughly those patients of UDCC with an estimated 7+ score (n = 275, see Table 3). Therefore, all patients of this medical center with an estimated score falling into “unlikely FCS” and “likely FCS” diagnoses underwent a detailed evaluation of their medical history, TG levels and clinical signs in order to find those with undiagnosed FCS. During this data revision, we identified 7 patients with FCS and, without genetic testing, marked an additional 14 individuals with potential FCS. These data indicate an estimated prevalence of 11.8–35.6 FCS patients per million, which is a similar magnitude to our calculation detailed above.
Then we utilized machine learning, which was trained and tested on the UDCC dataset to identify those FCS patients who had ever been hospitalized. As trained data, we used the above mentioned 7 confirmed and 14 potential FCS patients against those who scored 7+ in the FCS score system and against random individuals. The results of the mathematical modeling are depicted on Table 2, while model parameters are detailed in Appendix B. During classification, boosting models (i.e., AdaBoost and XGBoost) performed most successfully in terms of ROC/AUC measures, tightly followed by support vector machines. Deep neural networks lagged behind, notably in terms of overall performance.
Table 6 shows the summarized importance of conditions of the history in defining FCS, using all model trainings. To evaluate the accuracy of the FCS score, we trained these confirmed and potential FCS patients vs. patients with 7+ FCS score. Individual laboratory measurements were mined from the medical histories of the patients with no absolute values assigned to them. The parameters were ranked by the mathematical models from 0 to 100, where the value of 100 indicates the most important condition in decision making. Our results confirmed the foundational importance of the TG levels, as (i) the highest TG level and (ii) the average TG level were found to be the most important features, while (iii) conditions characterizing deviations in the TG concentrations (i.e., TG fluctuation, as well as highest and lowest TG levels) were also among the top conditions of the history. Cholesterol level also turned out to be a substantial feature in defining FCS. These conditions are the most important ones to distinguish FCS patients from those with no FCS but high FCS score.
To find the most important conditions and decisive laboratory cut values that can be used for population screening, we also trained machine learning using the data of the confirmed and potential FCS patients vs. all patients (Table 7). The cut values do not make distinction between their absolute importance but help the clinicians to get closer or away from the likelihood of FCS. Altogether, we found that patients may be identified based upon their highest and lowest TG levels, average TG levels and TG level deviations, as well as the highest and lowest total cholesterol concentrations and the deviations of the total cholesterol level. We also identified other parameters that may help to find individuals with potential FCS, as increasing hemoglobin, MCHC, basophil granulocyte, lymphocyte, or amylase above the cut levels raised the probability of FCS. On the other hand, elevated GPT, GGT, glucose, sodium and creatinine measurement cut levels decreased the chance of FCS. Interestingly, we also found that inflammatory markers as WBC and CRP, as well as the amylase activity had a negative impact on the probability of FCS.

4. Discussion

We suspected the regional frequency of FCS to be 19.4 per million among hospital goers, which exceeds the estimated worldwide prevalence of 1 per million [20]. As FCS is considered to be a rare disease, recent data indicate higher frequency of the disease when using larger cohorts. Indeed, reviewing the data of more than 1.5 million patients, Pallazola et al. found an FCS prevalence of 13 per million among the patients of a quaternary medical center [21]. On a smaller dataset of thirty thousand children, the prevalence of type 1 hyperlipoproteinemia (i.e., familial chylomicronemia syndrome) was estimated to be about 1 in 300,000 [22]. It is important to emphasize that we studied a population that was treated or checked in a hospital, which might have contributed to the variance of the disease prevalence. Though falling into the same magnitude, we also found the FCS prevalence to be different between the medical providers, either estimated with using key features of the disease or calculated individually in each patient. These discrepancies are presumably due to the different levels of care and the covered territories of the medical providers (university hospital vs. county hospital). Indeed, with its various lipid/metabolic disease outpatient clinics, our university hospital accepts patients from the county hospital, as well. More targeted history taking, wider diagnostic and laboratory availabilities may also explain our prevalence results after revisiting the university hospital data. Besides indicating the usability of our methods in distinct populations, our findings highlight the need of the specialist’s expertise in recognizing FCS.
The diagnosis of FCS is largely based upon genetic analysis and post-heparin LPL activity assay [7]. Recently, an expert panel of lipidologists proposed a very practical FCS scoring system for the better identification of patients with this rare, inherited disease [6]. A solid advantage of the FCS score is the strong reliance on the exact serum triglyceride measurements. Indeed, the selection of the potential patients can be reduced to 1–2‰, if studying those with TG levels exceeding 10 mmol/L for three consecutive occasions and never below 2 mmol/L (as indicated on Table 4). Adding the other strong and measurable condition (TG levels exceeding 20 mmol/L at least once) cut down the patient selection to the zone of ten thousandths (‱).
On the other hand, we realized that patients with the highest FCS scores are not necessarily the similar ones that we diagnosed. That can be due to incomplete history taking (e.g., missing targeted questions on conditions aggravating hypertriglyceridemia), which can hamper proper diagnosis [23]; therefore, FCS scoring seems to be perfect when all such secondary factors can be excluded by the dedicated physician, while there could be an area for improvement when approaching FCS score on a larger, automatized level.
Machine learning, however, may serve as a helpful tool to better identify rare diseases when using larger datasets [9,24]. Trained and tested on the UDCC data, we also tried to find those FCS patients who, with any diagnosis, had ever been hospitalized in our university hospital. We found gradient boosting and SVM to be the most successful in terms of ROC/AUC measures. Contrary to neural networks, these boosting-based models were more useful to find those with FCS. Our investigations on laboratories indicated that mild-to-moderate or very high TG concentration cuts further improve identifying potential FCS patients, even when peaking above 20 mmol/L. Interestingly, total cholesterol level may also be a promising asset to improve identification. The role of cholesterol, however, seems to be more complex, as the likelihood of FCS decreases below 4 mmol/L and above 11 mmol/L. In other words, patients with low or with very high cholesterol levels should not be considered to have FCS, which indicates the importance the triglyceride-rich lipoprotein cholesterol and the intimate interplay between cholesterol and triglyceride metabolism [25].
On the other hand, we found several metabolic parameters including liver transaminases and serum glucose, whose increased activities or concentrations affected negatively the probability of FCS. These findings might be due to the common presence of insulin resistant conditions as obesity, type 2 diabetes mellitus and non-alcoholic fatty liver disease (NAFLD) among hospital goers and are concordant with the recent report of Paquette et al., who found higher activities of gamma-glutamyl transferase (GGT) in MFCS compared to FCS [7]. Of note, although occurring in both FCS and MFCS patients, NAFLD was observed to be significantly less frequent in patients with familial chylomicronemia syndrome [26].
Interestingly, we found that elevated amylase activity had a negative impact on FCS probability, which indicates a high prevalence of such laboratory findings in the studied population. Longitudinal studies on well-characterized patient populations, however, confirmed the higher incidence of acute pancreatitis in FCS patients [27]. These investigations may also shed light on cardiovascular outcomes in these subjects, as well. Nevertheless, besides indicating the potential existence of multifactorial backgrounds, our findings may also help to increase FCS awareness, as higher glucose levels or transaminase activities decrease the probability of FCS.
Limitations also exist in our study. Hospital goers represent a population that differs from the normal population; therefore, our calculations might overestimate the frequency of the disease. Although we could study a relatively large cohort of patients, it did not directly represent the total population in our region, as not 100% of the population goes to hospital each year. Also, we were unable to assess the data about family history and did not perform genetic testing to diagnose FCS. Verifying the existence of confirmed or potentially pathogenic mutations in LPL or other genes modulating lipoprotein lipase activity would have contributed to improve identification of potential FCS patients in the studied population. Genetic analysis of gene variants with triglyceride-lowering effect would also have modified our results. In addition, hospital goers tended to be older and checked more frequently. On the contrary, younger patients usually had less thorough laboratory examinations and their history was less detailed and asked less frequently. Such tendencies bias the identification of FCS patients towards the elderly. Additionally, a larger population is needed to define those exact cuts in cholesterol levels that could improve FCS scoring. Although our machine learning models found their impact on the likelihood of FCS, the real-life importance of the other laboratory parameters should also be addressed in future studies. While machine learning may overestimate the incidence of FCS, it also may help to reduce the number of those individuals that would require expensive and time-consuming genetic analysis.

5. Conclusions

Using the previously proposed FCS scoring based on a large hospital database, we found an increased prevalence of familial chylomicronemia syndrome in our region. Data mining and machine learning seem to be promising tools in screening for FCS; however, further studies on larger, national or international datasets are of major importance to prove their accuracy and usefulness. Also, an analysis of larger populations might increase the number of discovered FCS cases.
Although FCS scoring is an easy-to-use tool to set FCS and MFCS apart, “fine tuning” of the features and inclusion of the total cholesterol levels may be considered to better identify FCS patients. Although the weight of cholesterol levels in the score has to be determined, this may alleviate the need for systematic genotyping in patients with severe hypertriglyceridemia and would also help identify the high-priority candidates for genetic analysis. Furthermore, early and accurate diagnosis is essential for effective treatment to avoid severe, life-threatening complications of FCS.

Author Contributions

Conceptualization, M.H. and P.F.; methodology, Á.N. and B.D.; software, Á.N. and B.D.; data curation, L.J.; writing—original draft preparation, Á.N., M.H. and P.F.; writing—review and editing, G.P.; supervision, M.H and P.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Bridging Fund to MH (Faculty of Medicine, University of Debrecen) and GINOP-2.3.2-15-2016-00005 project. The project is co-financed by the European Union under the European Regional Development Fund. B.D. was supported by MIS “Learning from Pairwise Comparisons” of the F.R.S.- FNRS and by MTA Premium Postdoctoral Grant 2018.

Institutional Review Board Statement

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Patients gave informed written consent. The laboratory is approved by the National Public Health and Medical Officer Service (approval number: 094025024). The study approved by the Regional Ethics Committee of the University of Debrecen (DE RKEB/IKEB 4775-2017, date obtained: 3 April 2020) and the Medical Research Council (ETT TUKEB 34952-1/2017/EKU, date obtained: 30 June 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data generated or analyzed during this study are included in this published article. All data generated or analyzed during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

Ákos Németh is a co-worker of Aesculab Medical Solutions (Black Horse Group Ltd.), while also on staff at University Debrecen Department of Internal Medicine as a PhD candidate. As stated in the article, the company is a contractual partner of the university who provided cleaned, anonymized data for the research. The authors declared they do not have anything to disclose regarding conflict of interest with respect to this manuscript.

Appendix A

For the analysis of the textual data, we utilized Python 3.8.x (https://www.python.org, Python Software Foundation, Beaverton, OR, USA, accessed on 12 February 2022) packages: Pandas 1.2.x (https://pandas.pydata.org, open sourced, accessed on 12 February 2022), Numpy 1.18 (https://numpy.org, open sourced, accessed on 12 February 2022), cython 0.29 (https://cython.org, open source, accessed on 12 February 2022), Natural Language Toolkit (NLTK) 3.4.5 (https://www.nltk.org, open source, accessed on 12 February 2022) and scikit-learn 0.23 (https://scikit-learn.org, open source, accessed on 12 February 2022).

Appendix B

For AdaBoost, SVM we used the implementations in scikit-learn 0.23 (https://scikit-learn.org, open source, accessed on 12 February 2022), while for ReLU networks we used PyTorch 1.6 (https://pytorch.org, open source, accessed on 12 February 2022) and XGBoost 1.2.1 (https://xgboost.readthedocs.io/en/latest/, open source, accessed on 12 February 2022) to train gradient boosted trees. We report the best results we found during the parameter search.

References

  1. Goldberg, R.B.; Chait, A. A Comprehensive Update on the Chylomicronemia Syndrome. Front. Endocrinol. (Lausanne) 2020, 11, 593931. [Google Scholar] [CrossRef]
  2. Hegele, R.A.; Berberich, A.J.; Ban, M.R.; Wang, J.; Digenio, A.; Alexander, V.J.; D’Erasmo, L.; Arca, M.; Jones, A.; Bruckert, E.; et al. Clinical and biochemical features of different molecular etiologies of familial chylomicronemia. J. Clin. Lipidol. 2018, 12, 920–927.e4. [Google Scholar] [CrossRef] [Green Version]
  3. Beigneux, A.P.; Miyashita, K.; Ploug, M.; Blom, D.J.; Ai, M.; Linton, M.F.; Khovidhunkit, W.; Dufour, R.; Garg, A.; McMahon, M.A.; et al. Autoantibodies against GPIHBP1 as a Cause of Hypertriglyceridemia. N. Engl. J. Med. 2017, 376, 1647–1658. [Google Scholar] [CrossRef]
  4. Dionisi-Vici, C.; Shteyer, E.; Niceta, M.; Rizzo, C.; Pode-Shakked, B.; Chillemi, G.; Bruselles, A.; Semeraro, M.; Barel, O.; Eyal, E.; et al. Expanding the molecular diversity and phenotypic spectrum of glycerol 3-phosphate dehydrogenase 1 deficiency. J. Inherit. Metab. Dis. 2016, 39, 689–695. [Google Scholar] [CrossRef]
  5. Hegele, R.A.; Ginsberg, H.N.; Chapman, M.J.; Nordestgaard, B.G.; Kuivenhoven, J.A.; Averna, M.; Borén, J.; Bruckert, E.; Catapano, A.L.; Descamps, O.S.; et al. The polygenic nature of hypertriglyceridaemia: Implications for definition, diagnosis, and management. Lancet Diabetes Endocrinol. 2014, 2, 655–666. [Google Scholar] [CrossRef] [Green Version]
  6. Moulin, P.; Dufour, R.; Averna, M.; Arca, M.; Cefalù, A.B.; Noto, D.; D’Erasmo, L.; Di Costanzo, A.; Marçais, C.; Alvarez-Sala Walther, L.A.; et al. Identification and diagnosis of patients with familial chylomicronaemia syndrome (FCS): Expert panel recommendations and proposal of an “FCS score”. Atherosclerosis 2018, 275, 265–272. [Google Scholar] [CrossRef]
  7. Paquette, M.; Bernard, S.; Hegele, R.A.; Baass, A. Chylomicronemia: Differences between familial chylomicronemia syndrome and multifactorial chylomicronemia. Atherosclerosis 2019, 283, 137–142. [Google Scholar] [CrossRef] [PubMed]
  8. Chait, A.; Eckel, R.H. The Chylomicronemia Syndrome Is Most Often Multifactorial: A Narrative Review of Causes and Treatment. Ann. Intern. Med. 2019, 170, 626–634. [Google Scholar] [CrossRef]
  9. Paragh, G.; Harangi, M.; Karányi, Z.; Daróczy, B.; Németh, Á.; Fülöp, P. Identifying patients with familial hypercholesterolemia using data mining methods in the Northern Great Plain region of Hungary. Atherosclerosis 2018, 277, 262–266. [Google Scholar] [CrossRef] [Green Version]
  10. Vapnik, V.; Chervonenkis, A. On the uniform convergence of realtive frequencies of events to their probabilities. Theory Probab. Its Appl. 1971, 16, 264–280. [Google Scholar] [CrossRef]
  11. Nagarajan, V.; Kotler, J. Uniform convergence may be unable to explain generalization in deep learning. In Proceedings of the 32nd Advances in Neural Information Processing Systems (NeurIPS ’19), Vancouver, BC, Canada, 8–14 December 2019; pp. 11615–11626. [Google Scholar]
  12. Devroye, L.; Győrfi, L.; Lugosi, G. A Probabilistic Theory of Pattern Recognition; Springer: New York, NY, USA, 1996; Volume 31. [Google Scholar]
  13. Freund, Y.; Schapire, R. A decision-theoretic generalisation of on-line learing and application to boosting. J. Comput. Syst. Sci. 1997, 55, 119–139. [Google Scholar] [CrossRef] [Green Version]
  14. Friedman, J. Greedy function approximation: A gradient boosting machine. Adv. Neural Inf. Process. Syst. 2001, 29, 1189–1232. [Google Scholar] [CrossRef]
  15. Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  16. Montufar, G.F.; Pascanu, R.; Cho, K.; Bengio, Y. On the number of linear regions of deep neural networks. Adv. Neural Inf. Process. Syst. 2014, 27, 1–17. [Google Scholar]
  17. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  18. Kingma, D.; Ba, J. Adam: A method for stochastic optimalization. In Proceedings of the 3nd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA, 7–9 May 2015. [Google Scholar]
  19. Chen, T.; Guestrin, C. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016. [Google Scholar]
  20. Brahm, A.J.; Hegele, R.A. Chylomicronaemia—Current diagnosis and future therapies. Nat. Rev. Endocrinol. 2015, 11, 352–362. [Google Scholar] [CrossRef]
  21. Pallazola, V.A.; Sajja, A.; Derenbecker, R.; Ogunmoroti, O.; Park, J.; Sathiyakumar, V.; Martin, S.S. Prevalence of familial chylomicronemia syndrome in a quaternary care center. Eur. J. Prev. Cardiol. 2020, 27, 2276–2278. [Google Scholar] [CrossRef]
  22. Patni, N.; Li, X.; Adams-Huet, B.; Garg, A. The prevalence and etiology of extreme hypertriglyceridemia in children: Data from a tertiary children’s hospital. J. Clin. Lipidol. 2018, 12, 305–310. [Google Scholar] [CrossRef]
  23. Ohm, F.; Vogel, D.; Sehner, S.; Wijnen-Meijer, M.; Harendza, S. Details acquired from medical history and patients’ experience of empathy--two sides of the same coin. BMC Med. Educ. 2013, 13, 67. [Google Scholar] [CrossRef] [Green Version]
  24. Németh, Á.; Daróczy, B.; Juhász, L.; Fülöp, P.; Harangi, M.; Paragh, G. Assessment of Associations Between Serum Lipoprotein (a) Levels and Atherosclerotic Vascular Diseases in Hungarian Patients With Familial Hypercholesterolemia Using Data Mining and Machine Learning. Front. Genet. 2022, 13, 849197. [Google Scholar] [CrossRef]
  25. Dallinga-Thie, G.M.; Kroon, J.; Borén, J.; Chapman, M.J. Triglyceride-Rich Lipoproteins and Remnants: Targets for Therapy? Curr. Cardiol. Rep. 2016, 18, 67. [Google Scholar] [CrossRef] [Green Version]
  26. Maltais, M.; Brisson, D.; Gaudet, D. Non-Alcoholic Fatty Liver in Patients with Chylomicronemia. J. Clin. Med. 2021, 10, 669. [Google Scholar] [CrossRef] [PubMed]
  27. Belhassen, M.; Van Ganse, E.; Nolin, M.; Bérard, M.; Bada, H.; Bruckert, E.; Krempf, M.; Rebours, V.; Valero, R.; Moulin, P. 10-Year Comparative Follow-up of Familial versus Multifactorial Chylomicronemia Syndromes. J. Clin. Endocrinol. Metab. 2021, 106, e1332–e1342. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the rapid estimation of familial chylomicronemia (FCS) score.
Figure 1. Flowchart of the rapid estimation of familial chylomicronemia (FCS) score.
Jcm 11 04311 g001
Table 1. Familial chylomicronemia syndrome scoring, according to Moulin et al.
Table 1. Familial chylomicronemia syndrome scoring, according to Moulin et al.
Score
1. Fasting TGs > 10 mmol/L for three consecutive blood analyses+5
    Fasting TGs > 20 mmol/L at least once +1
2. Previous TGs < 2 mmol/L−5
3. No secondary factor (except pregnancy and ethinylestradiol)+2
4. History of pancreatitis+1
5. Unexplained recurrent abdominal pain+1
6. No history of familial combined hyperlipidemia+1
7. No response (TG decrease <20%) to hypolipidemic treatment+1
8. Onset of symptoms at age:
-
<40 years
-
<20 years
-
<10 years

+1
+2
+3
Score > 10: FCS very likely; Score < 9: FCS unlikely; Score < 8: FCS very unlikely.
Table 2. Classification performance of models trained on FCS.
Table 2. Classification performance of models trained on FCS.
Training SetTest SetMethodExp.Mean AUCStd AUCMean ACCStd ACCMean Sens.Std Sens.Mean Spec.Std Spec.
50% Exam.Ind. 50% Exam.ReLU300.7350.0640.8950.0240.2120.1600.9500.029
SVM300.7920.0540.9270.0130.00.00.9990.001
ADA300.7700.0530.9020.0140.1100.1210.9700.023
XGB300.8100.0420.9090.0180.0700.1040.9760.025
50% Exam.Ind. 50% Exam. UDCC 5000 patients w/o FCSReLU300.5990.0880.8570.1120.2370.1840.8590.113
SVM300.8720.0570.9980.0010.00.00.9990.001
ADA300.8240.0920.9960.0020.1100.1210.9990.002
XGB300.8710.0740.9970.0010.0700.1040.9990.001
50% Exam. & UDCC 1000 patients w/o FCSInd. 50% Exam. UDCC 5000 patients w/o FCSReLU300.9060.0410.9970.0010.2450.1420.9990.011
SVM300.9550.0240.9990.0010.00.00.9990.001
ADA300.9230.0510.9960.0020.1100.1210.9990.001
XGB300.9820.0150.9970.0010.0910.0960.9990.001
XGBoost (XGB) and AdaBoost (ADA) were trained with the default setup for every tree. For SVM, the chosen kernel was normalized Radial Basis Function (RBF) [14]. ReLU networks were optimized with Adam [18]. The networks contained five hidden layers, each with default units.
Table 3. Calculated familial chylomicronemia (FCS) scores of patients visiting medical providers in the Northern Great Plain area of Hungary (pcm = 1:100,000; ppm = 1:1,000,000).
Table 3. Calculated familial chylomicronemia (FCS) scores of patients visiting medical providers in the Northern Great Plain area of Hungary (pcm = 1:100,000; ppm = 1:1,000,000).
ClusterFCS ScoreMale PatientsFemale PatientsTotal PatientsPercentage of Patients
Highly unlikely FCS0+602.258 (45%)739.464 (55%)1.341.722100%
1+5.612 (56%)4.334 (44%)9.9467.41‰
2+1.659 (75%)558 (25%)2.2171.65‰
3+1.441 (75%)493 (25%)1.9341.44‰
4+1.307 (74%)461 (26%)1.7681.32‰
5+1.272 (74%)453 (26%)1.7251.29‰
6+909 (78%)254 (22%)1.1638.67‱
7+705 (79%)182 (21%)8876.61‱
Unlikely FCS8+298 (82%)67 (18%)3652.72‱
9+56 (81%)13 (19%)695.14 pcm
Likely FCS10+17 (77%)5 (23%)221.64 pcm
11+3 (75%)1 (25%)42.98 ppm
Table 4. Familial chylomicronemia (FCS) score estimation on key features.
Table 4. Familial chylomicronemia (FCS) score estimation on key features.
A. FCS score estimation on key features (UDCC, all patients *)
ClusterFeatureFCS ScoreNumber of PatientsPercentage of Patients
Highly unlikely FCSClinical site patients0+590.500100%
TG 10+ mmol/L and TG never 2- mmol/L5+6651.13‰
No secondary medical factors **7+2754.67‱
Unlikely FCSTG 20+ mmol/L at least once8+851.44‱
Symptoms below age 409+244.06 pcm
Likely FCSTreated with acute pancreatitis10+58.47 ppm
B. FCS score estimation on key features (CHSSB, all patients *)
ClusterKey ConditionFCS ScoreNumber of PatientsPercentage of Patients
Highly unlikely FCSClinical site patients0+751.624100%
TG 10+ mmol/L and TG never 2− mmol/L5+1.0461.39 ‰
No secondary medical factors **7+5016.67‱
Unlikely FCSTG 20+ mmol/L at least once8+931.23‱
Symptoms below age 409+202.66 pcm
Likely FCSTreated with acute pancreatitis10+45.32 ppm
(A): * Patients who visited University of Debrecen Clinical Center (UDCC) at least once between 2007–2014; ** diabetes, metabolic syndrome, hypothyroidism, corticosteroid therapy, alcohol abuse. (B) * Patients who visited County Hospital of Szabolcs-Szatmár-Bereg (CHSSB) at least once between 2007–2014; ** diabetes, metabolic syndrome, hypothyroidism, corticosteroid therapy, alcohol abuse.
Table 5. Familial chylomicronemia (FCS) score calculation of individual patients.
Table 5. Familial chylomicronemia (FCS) score calculation of individual patients.
ClusterFCS ScoreMales (n)Females (n)Total (n)Percentage
A. FCS score calculation of individual patients (UDCC, all patients *)
Highly unlikely FCS0+251.949 (43%)338.149 (57%)590.098100%
1+2368 (53%)2.108 (47%)4.4767.59‰
2+589 (74%)208 (26%)7971.35‰
3+538 (73%)198 (27%)7361.25‰
4+506 (73%)188 (27%)6941.18‰
5+490 (73%)183 (27%)6731.14‰
6+340 (76%)107 (24%)4477.58‱
7+250 (78%)71 (22%)3215.44‱
Unlikely FCS8+110 (77%)32 (23%)1422.41‱
9+31 (82%)7 (18%)386.44 pcm
Likely FCS10+10 (77%)3 (23%)132.20 pcm
11+2 (67%)1 (33%)35.08 ppm
B. FCS score calculation of individual patients (CHSSB, all patients *)
Highly unlikely FCS0+350.309 (47%)401.315 (53%)751.624100%
1+3.244 (59%)2.226 (41%)5.4707.28‰
2+1070 (75%)350 (25%)1.4201.89‰
3+903 (75%)295 (25%)1.1981.59‰
4+801 (75%)273 (25%)1.0741.42‰
5+782 (74%)270 (26%)1.0521.40‰
6+569 (79%)147 (21%)7169.53‱
7+455 (80%)111 (20%)5667.53‱
Unlikely FCS8+188 (84%)35 (16%)2232.97‱
9+25 (81%)6 (19%)314.12 pcm
Likely FCS10+7 (78%)2 (22%)91.19 pcm
11+1(100%)0 (0%)11.33 ppm
(A) * Patients who visited University of Debrecen Clinical Center (UDCC) at least once between 2007–2014. (B) * Patients who visited County Hospital of Szabolcs-Szatmár-Bereg (CHSSB) at least once between 2007–2014.
Table 6. Importance of conditions of the history in defining FCS, using all model trainings (expressed in relative importance scores, in the fractions of the most important features).
Table 6. Importance of conditions of the history in defining FCS, using all model trainings (expressed in relative importance scores, in the fractions of the most important features).
Confirmed and Potential FCS Patients
vs. Patients with FCS Score of 7+
Confirmed and Potential FCS Patients
vs. Random Individuals
ConditionImportanceConditionImportance
Highest triglyceride100Average triglyceride100
Average triglyceride50Highest triglyceride70
Average cholesterol25Lowest triglyceride40
Triglyceride fluctuation20Triglyceride fluctuation35
Lowest triglyceride17Average cholesterol30
Lowest carbamide16Highest cholesterol25
Highest cholesterol15Lowest cholesterol15
Average hemoglobin14Cholesterol fluctuation15
Lowest glucose12Average hemoglobin10
Average alkaline phosphatase10Glucose fluctuation10
Table 7. Summary of the most decisive laboratory value cuts in machine learning models and their impact on getting closer to (+) or away (−) from likelihood of FCS.
Table 7. Summary of the most decisive laboratory value cuts in machine learning models and their impact on getting closer to (+) or away (−) from likelihood of FCS.
Laboratory ParameterCut (>)Impact
Triglyceride30 mmol/L+
Triglyceride18 mmol/L+
Triglyceride6.5 mmol/L+
Cholesterol11 mmol/L
Cholesterol6.5 mmol/L+
Cholesterol4.0 mmol/L+
Hemoglobin95 g/L+
MCHC330 (g/L)+
Amylase20 U/L+
Basophile granulocyte0.6%+
Lymphocyte20%+
Sodium145 mmol/L
White Blood Cell6.5 G/L
Neutrophile granulocyte65%
GPT15 U/L
GPT200 U/L
GGT35 U/L
GGT350 U/L
Creatinine68 µmol/L
CRP5.0 mg/L
Glucose (fasting)6.0 mmol/L
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Németh, Á.; Harangi, M.; Daróczy, B.; Juhász, L.; Paragh, G.; Fülöp, P. Identifying Patients with Familial Chylomicronemia Syndrome Using FCS Score-Based Data Mining Methods. J. Clin. Med. 2022, 11, 4311. https://doi.org/10.3390/jcm11154311

AMA Style

Németh Á, Harangi M, Daróczy B, Juhász L, Paragh G, Fülöp P. Identifying Patients with Familial Chylomicronemia Syndrome Using FCS Score-Based Data Mining Methods. Journal of Clinical Medicine. 2022; 11(15):4311. https://doi.org/10.3390/jcm11154311

Chicago/Turabian Style

Németh, Ákos, Mariann Harangi, Bálint Daróczy, Lilla Juhász, György Paragh, and Péter Fülöp. 2022. "Identifying Patients with Familial Chylomicronemia Syndrome Using FCS Score-Based Data Mining Methods" Journal of Clinical Medicine 11, no. 15: 4311. https://doi.org/10.3390/jcm11154311

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop