You are currently viewing a new version of our website. To view the old version click .
MDPIMDPI
Search all articles
Medicina
Download PDF
  • Article
  • Open Access

22 January 2021

A Machine Learning-Based Investigation of Gender-Specific Prognosis of Lung Cancers

,
,
,
,
,
,
,
,
and
1
Department of Epidemiology and Biostatistics, School of Public Health, Jilin University, Changchun 130012, China
2
College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
*
Authors to whom correspondence should be addressed.
Medicina2021, 57(2), 99;https://doi.org/10.3390/medicina57020099
This article belongs to the Section Oncology
Version Notes
Order Reprints

Abstract

Background and Objective: Primary lung cancer is a lethal and rapidly-developing cancer type and is one of the most leading causes of cancer deaths. Materials and Methods: Statistical methods such as Cox regression are usually used to detect the prognosis factors of a disease. This study investigated survival prediction using machine learning algorithms. The clinical data of 28,458 patients with primary lung cancers were collected from the Surveillance, Epidemiology, and End Results (SEER) database. Results: This study indicated that the survival rate of women with primary lung cancer was often higher than that of men (p < 0.001). Seven popular machine learning algorithms were utilized to evaluate one-year, three-year, and five-year survival prediction The two classifiers extreme gradient boosting (XGB) and logistic regression (LR) achieved the best prediction accuracies. The importance variable of the trained XGB models suggested that surgical removal (feature “Surgery”) made the largest contribution to the one-year survival prediction models, while the metastatic status (feature “N” stage) of the regional lymph nodes was the most important contributor to three-year and five-year survival prediction. The female patients’ three-year prognosis model achieved a prediction accuracy of 0.8297 on the independent future samples, while the male model only achieved the accuracy 0.7329. Conclusions: This data suggested that male patients may have more complicated factors in lung cancer than females, and it is necessary to develop gender-specific diagnosis and prognosis models.

1. Introduction

Lung cancer is one of the leading causes of cancer deaths, and it is estimated to have caused 142,670 deaths in 2019 alone []. The incidence rate of lung cancer in females is higher than in males [,,]. The worldwide incidence rate of female lung cancers is still increasing []. However, the mortality rate of male lung cancer patients is almost twice that of females [,].
Inherent genetic factors and living environments induce apparent gender-specific biological mechanisms and prognostic responses []. Non-small cell lung cancers (NSCLC) patients demonstrate large gender-specific survival differences []. Zang et al. suggested that the gender variation cannot be explained by the differences in the factors of baseline exposure, smoking history, or body size, but may be caused by the higher susceptibility to tobacco carcinogens in females []. That is to say, females are more susceptible to tobacco-induced carcinogenesis than males []. Gasperino’s study showed that after taking into account the number of cigarettes smoked, females have a three-times higher risk of lung cancer than males []. Another study suggested that females have a better survival rate than males after considering confounders like smoking []. Many studies observed the gender differences in urothelial carcinoma of the bladder (UCB), where males had a higher incidence of UCB, but females tended to have worse outcomes []. Gender was also found to be a risk factor for the prognosis of head and neck cancer (HNC), and females had a better prognosis than males []. So, the gender specificity of lung cancers is attracting more researchers to work on this interesting topic.
Cancer prognosis is mainly predicted based on the clinician’s professional experience or the nomogram calculation. The corresponding scores on the upper dots of each variable graph in the nomogram are added up to obtain the total score, and then a straight line is drawn at the bottom of the chart to estimate the probability of death [,]. The nomogram becomes very complicated if multiple variables are included [].A nomogram is a statistical model for the probability calculation of a single event like death or recurrence and has been widely used to predict the probabilities of cancer metastasis and prognosis [,,,,]. The non-negligible proportions of the available nomograms shared similar end-points and intrinsic complexity, which may limit their applications [].Both nomogram and machine learning techniques can be used to estimate the overall survival rate of cancer patients. However, studies have shown that machine learning models outperformed the nomograms in estimating the individual patient’s prognosis []. The machine learning model may provide complementary information for this challenge by fully utilizing the inter-variable interactions [].
This study hypothesizes that the gender disparity should be taken into account when a prognosis model is optimized. Multiple classification algorithms were utilized to build binary classification models of whether a patient may survive one year, three years, or five years after the clinical data were collected. In this case, we used the Cox regression model to analyze the prognosis of lung cancer patients. The classification models were built for females and males separately.

2. Materials and Methods

2.1. Data Sources

The clinical data used in this study were retrieved from the Surveillance, Epidemiology, and End Results (SEER) database (AYA site recode/WHO 2008 8.3 Carcinoma of trachea, bronchus, and lung) [,]. AYA is a site/histology recode used to analyze data on adolescent and young adults. The recode was applied to all cases no matter the age in order that age comparisons can be made with these groupings. For more information, see http://www.seer.cancer.gov/ayarecode/index.html. The SEER database is an authoritative cancer statistical database in the United States, and global cancer researchers may obtain data through application. A signed SEER data usage agreement is required to obtain the fields and variables in the SEER database. Researchers may make scientific investigations into the SEER data and publish research articles based on the analysis of this data. The database is available at https://seer.cancer.gov/. This study included patients diagnosed from 2010 to 2015 and followed up until December 2016 with primary lung cancer. Only the cases with primary tumors and which were positively followed (excluding “necropsy only” and “death certificate only”) were used. The cases with a follow-up time of 0 may indicate in-hospital deaths and were also excluded. All the objective characteristics of the included patients were collected, including marital status, race, gender, age, histological type, tumor-specific death status, survival time, primary site surgery, tumor grade, lymph node examined, lymph node positive, tumor grade, laterality, year of diagnosis, T stage, M stage, and N stage.
This study collected a cohort of 28,458 patients with primary lung cancers from the SEER database, and most of the patients were women (15,000, 52.71%). Table 1 summarized the baseline characteristics of the primary cancer patients. Statistical significances were observed for gender-specific features, including histological type, marital status, race, primary site surgery, grade, T stage, N stage, and M stage.
Table 1. Baseline characteristics of the study population. The variable t refers to the test statistics of the T-test, and the variable χ2 refers to the chi-square value of the chi-square test.
This dataset consisted mostly of the white population, and the observations of this study may serve as a good reflection of the gender-disparity in white lung cancer patients. Table 1 showed that 83.20% of male and 82.50% of female patients were white.
It is also interesting to observe that female lung cancer patients tended to be diagnosed at an earlier stage than male patients, since more female patients were diagnosed at the smallest T (Tumor)/N (Node)/M(Metastasis) stages than male patients. 45.30% of the female patients were diagnosed at the T1 stage, compared with 36.60% of the male patients. The female lung cancer patients contained percentages of 74.20% and 95.20% with diagnosis at the N0 and M0 stages, while the male patients contained 68.90% and 94.00%, respectively. Moreover, all the T/N/M stages demonstrated statistically significant differences between females and males.
Diagnosed numbers of lung cancer patients were on the rise between 2010 and 2015. However, the relative percentages of females and males were similar and the differential analysis did not show a statistical significance (p-value = 0.682).

2.2. Preprocessing of the SEER Database

A preprocessing step was carried out on the lung cancer dataset from the SEER database. This study excluded the unknown data entries from the patients’ clinical measurements. The T/N/M stages were annotated and extracted from the SEER database [,]. The log odds of the positive lymph nodes (LODDS) were defined as the logarithm of the ratio between the probability of being a positive lymph node and the probability of being a negative lymph node. The formula is: LODDS is equal to log (P + 0.5)/(T − P + 0.5), where T is the number of total nodes and P is the number of positive nodes []. Marital status was grouped as married and unmarried, where unmarried persons consisted of single, separated, divorced, widowed, and other cases. The differentiation grading codes of 1–4 were defined by the International Classification of Diseases-O-2 (ICD-O-2), where grades I/II/III/IV corresponded to the statuses of well-differentiated, moderately differentiated, poorly differentiated, and undifferentiated, respectively. The histological groups of lung cancers were defined using the ICD-O-3, consisting of adenocarcinoma(8050, 8140-1, 8144, 8201, 8250-5, 8260, 8290, 8310, 8323, 8333, 8470, 8480-1, 8490, 8503, 8507, 8550, 8570, 8574, 8576), squamous cell carcinoma (8051-2, 8070-4, 8083-4, 8123), large cell carcinoma (8012-4, 8021, 8034, 8082), small cell carcinoma (8041-5), and other (8000-1, 8003-4, 8010-1, 8020, 8022, 8030-3, 8035, 8046, 8200, 8230, 8240-1, 8243-6, 8249, 8430, 8525, 8560, 8562, 8575) [].
Before the data were loaded to the machine learning algorithms, the unordered features were encoded by the one-hot encoding strategy, and the ordered features and numerical features were normalized. One-hot encoding converts categorical variables into numeric variables, e.g., encoding the categorical variable {A, B, C} as the binary variable {100, 010, 001} []. Patients were excluded if they had died from causes other than lung cancer, in order to ensure that the predicted survival focused on lung cancers. A supervised classification study needs to know the category labels of the samples, so this study chose to investigate whether the lung cancer patients survived one year, three years, and five years, respectively. For the one-year survival prediction problem, patients were excluded from the dataset if their follow-up lengths were shorter than one year and they were still alive, since we could not know whether such patients died or were still alive one year after the diagnosis. Similar exclusion rules were carried out for the three-year and five-year survival prediction problems.

2.3. Binary Classification Algorithms

Seven popular classification algorithms were utilized to build the binary classification models for the one-year, three-year, and five-year survival prediction problems.
Naïve Bayes (NBayes) assumed inter-feature independence and calculated the class-specific prediction model using the Bayes’ theorem. Although NBayes makes a strong assumption of inter-feature independence, it has been widely used to build accurate prediction models [,].
Three tree-based classifiers were evaluated for the survival prediction problems in this study. The decision tree (DTree) is a fast and popular classifier, and its trained tree structure is easy to be interpreted []. Random forest (RF) is an ensemble algorithm based on multiple random trees as the base classifiers, and has demonstrated its efficiency for biomedical prediction problems []. XGBoost is a popular fast classifier to handle various biomedical data types, including the spectroscopy spectrum and bioelectrical data [,].
The simple but effective classifier k-nearest neighbor (KNN) is a supervised learning algorithm based on the voting results of the training samples most similar to the query sample [].
Logistic regression (LR) calculates the probability of a specific event such as the survival of a lung cancer patient, and is popular for building biomedical prediction models [,].
Support vector machine (SVM) tries to find a hyperplane with the largest distance or margin to the two classes of samples in the multi-dimensional space [].

2.4. Evaluation Metrics of Binary Classification Algorithms

The machine learning models were evaluated by four binary classification performance metrics, i.e., sensitivity (Sn), specificity (Sp), accuracy (Acc), and F1 score (F1). Sn and Sp are defined as the percentages of positive and negative samples that were predicted correctly, respectively. Acc refers to the ratio of the number of correctly predicted samples to the total number of all the samples. F1 is an index used to measure the accuracy of a binary classification model in statistics. It takes into account both the accuracy and recall of the classification model. All the four performance metrics are from 0 to 1, with higher values indicating better classification performance.

2.5. Data Analysis Procedure

The data analysis process is shown in Figure 1. The baseline data analysis formulated the categorical data as percentages and the continuous data as averaged values and standard deviations. Two statistical tests, Chi-squared test (Chi2test) and t-test (Ttest), were used to evaluate the associations between the category or continuous features and gender information. The log-rank test was used on the two genders with the clinical data from the KM chart, which is a letter chart based on the Monoyer standard []. The Cox regression was used to perform univariate survival analysis of the individual features. All the prognostic factors derived from the univariate analysis were collected for the multivariate analysis. We also used the nomogram analysis method based on the COX risk ratio model to make predictions. This study defined a survival probability of 1 year, 3 years, and 5 years score less than 0.5 as death, and more than 0.5 as alive.
Figure 1. Flow chart of this study. The male and female samples were grouped as the datasets “Male” and “Female”, respectively. All the samples constitute the overall dataset “All”. The sample numbers are provided in parenthesis.
The classification model was evaluated by the stratified three-fold cross-validation strategy (S3FCV). S3FCV means that the positive and negative samples were randomly split into three equally-sized sub-groups, respectively. One positive subset and one negative subset were used as the test dataset and the other samples were used to train the classification model. This process was iteratively conducted until no sample subset was used as the test dataset. The overall prediction performance metrics were calculated for this iteration []. The parameters of all the utilized machine learning models are shown in Supplementary Table S3. All the calculations and experiments were performed using SPSS software version 24.0 and Python version 3.6. The machine learning algorithms were implemented in the Python module scikit-learn version 0.19.1. The multivariate survival analysis was conducted using the Cox regression model.

3. Results

3.1. Gender Disparities in the Prognosis of Primary Lung Cancers

The experimental data suggested that lung cancer patients’ survival probabilities are significantly different between the two genders. We used the log-rank test to measure the difference in survival rates between female and male patients with primary lung cancer (p < 0.001). The female patients with primary lung cancer tended to have a better survival rate than male patients (Figure 2). The one-year survival rate of male patients was 85.9%, while the female patients had a survival rate of 92.4%. The female patients had better survival rates 79.1% and 70.5% at 3 years and 5 years, compared with 68.0% and 59.0% for the male lung cancer patients.
Figure 2. KM (Kaplan-Meier) chart illustration of gender disparity in the survival curves for primary lung cancers. The horizontal axis is the number of months. The vertical axis is the cumulative survival percentage (%). Female is in black, and male is in gray. The numbers of survived patients are given in the table under the plot.
The Cox regression was used to evaluate the prognosis of the investigated features, as shown in Table 2. The univariate analysis suggested that gender, age, and race had significant effects on prognosis. For clinicopathological factors, LOODS, histological type, grade, T, N, M, and primary site surgery are all prognostic factors affecting lung cancer (Table 2). Laterality has no effect on the prognosis of lung cancer patients (HR (Hazard Ratio) = 1.023, p-value = 0.322). The above-mentioned prognostic-related factors are included in the multivariate analysis. Gender was identified as an independent prognostic factor with an adjusted hazard ratio of 0.698 (95%CI 0.666,0.731). The risk of death without surgery in the primary site was 1.631 times higher than for surgery (p-value < 0.001). On the contrary, marriage is a protective factor for primary lung cancer (HR = 0.865, p-value < 0.001). T stage, N stage and M stage were independent risk factors for prognosis, among which M = 1 was 2.137 times higher than that of M = 0 (p-value < 0.001).
Table 2. prognosis of primary lung cancer of different genders.

3.2. Machine Learning-Based Prediction of Survival Status

Seven popular binary classifiers were utilized to predict whether a lung cancer patient survived for one, three, and five years, as shown in Figure 3. Figure 3A illustrates the machine learning models of the survival prediction problems for all the samples. The classifier XGB achieved the highest Acc for the one-year survival prediction problem (Acc = 0.9075). Another classifier LR achieved the highest Acc values for the three-year (Acc = 0.7565) and five-year (Acc = 0.7179) survival prediction problems.
Figure 3. Predictions of the survival status of primary lung cancer patients using machine learning models. The horizontal axis listed the prediction results of the seven binary classifiers for the one-year, three-year and five-year survival prediction problems, which were denoted as 1, 3 and 5, respectively. The four classification performance measurements Acc/Sn/Sp/F1 were calculated for (A) all the samples, (B) female samples, and (C) male samples. (D) The detailed data are also provided in this table. The best values for the one-year, three-year, and five-year prediction problems are highlighted in bold, respectively.
The machine learning models performed slightly differently on the gender-specific datasets, as shown in Figure 3B,C. The classifier XGB achieved the highest Acc = 0.8786 for the one-year survival prediction problem for the male samples. Similar to the above, the classifier LR achieved the highest Acc for the three- (Acc = 0.7243) and five-year (Acc = 0.7352) survival prediction problems, as shown in Figure 3C. The classifier XGB achieved the highest Acc for the one- (Acc = 0.9300) and three-year (Acc = 0.0.7849) survival prediction problems. Similarly, the classifier LR achieved the highest Acc for the five-year (Acc = 0.7212) survival prediction problems, as shown in Figure 3B.
The nomogram in the survival analysis was based on the COX risk ratio model. Therefore, we used the COX risk ratio model to predict survival at one, three, and five years. In experimental data for all the samples (denoted as “Total”), compared with the COX-based nomogram model, XGB achieved better results in one-year and three-year survival predictions, and LR has a higher accuracy rate in five-years, as shown in Figure 3 and Supplementary Table S1.

3.3. Feature Contributions of the XGB Models

The feature contribution was measured by the importance of each feature returned by the trained XGB models for the one-year, three-year, and five-year survival prediction models (Table 3). Except for the feature “Gender” for the dataset of all the samples (denoted as “All”), all the features were ranked in the descendent order of their XGB model importance measurements. The results for the datasets of male and female samples were denoted as “Male” and “Female”.
Table 3. Contributions of the investigated features to the extreme gradient boosting (XGB) models.
We further evaluated how importantly each feature contributed to the classification models, as shown in Figure 4. The above sections demonstrated that the two classifiers XGB and LR usually performed best on the one-year, three-year and five-year survival prediction problems. However, the classifier LR did not generate a measurement of feature importance, so the measurement of feature importance from the trained XGB models was used to describe each feature’s contribution to the prediction models.
Figure 4. Accuracies (Acc) of the best-performing logistic regression (LR) classifier for the survival prediction problems. The vertical axis listed the feature ranks, which varied for different datasets. Each number k gave the prediction accuracies of the top-k ranked features. The vertical axis gave the prediction accuracies for (A) the one-year, (B) three-year and (C) five-year survival prediction problems.
Figure 4A suggests that the feature “Surgery” is the most important factor for one-year survival, while the spreading of the lung cancers to the regional lymph nodes (the N stage) played an essential role in determining whether a lung cancer patient may survive for three and five years, as shown in Figure 4B,C. The T/N/M stages (features “T”, “N” and “M”) and the grade (feature “Grade”) were consistently ranked after the feature “Surgery” for all the three datasets “All”, “Male” and “Female” for the one-year survival prediction problem. The top-five ranked features were the same for the three-year and five-year survival prediction problems, as shown in Figure 4B,C. The XGB models were constructed to predict the survival status of patients with primary lung cancers and visualized for easy inspection by the reader (Supplementary Figure S1).
The LR classifier was used to calculate the accuracies of the one-year, three-year, and five-year survival prediction problems, as shown in Figure 5. The features were incrementally added to the feature subsets by their ranks calculated in the previous section. Since the datasets did not have consistent ranks for the features, Figure 5 only gives the feature ranks in the horizontal axis.
Figure 5. Accuracies (Acc) of the best-performing classifier LR for the survival prediction problems. The vertical axis lists the element level of the random forest (RF) model arrangement, which varied for different datasets. Each number k gave the prediction accuracies of the top-k ranked features. The vertical axis gave the prediction accuracies of (A) the one-year, (B) three-year and (C) five-year survival prediction problems.
We may observe the overall trend that more features may achieve better prediction accuracies, as shown in Figure 5. However, the inclusions of some features may decrease the model performance in some cases. For example, the best LR-Female model achieved Acc = 0.9309 using only six features, and the model accuracy was decreased to Acc = 0.9296 by using five more features. The survival prediction model usually achieved a very good prediction accuracy using about six features, and the inclusions of more features only achieve minor accuracy improvements.

3.4. Feature Contributions to the RF Models

The machine learning algorithm RF also calculated the importance measurement of each feature in the one-year, three-year, and five-year survival prediction models to measure feature contribution, as shown in Table 4. At the same time, we use the RF model to describe each feature’s contribution to the prediction model for feature importance. The results showed that LOODS and Age were always the most important factors for survival status in one, three, and five years. This observation was slightly different to those features with large contributions in the XGB models. We added the features incrementally to the feature subsets. We also found that the best LR-Female model can reach Acc = 0.9315 using only nine features and adding two features reduces the accuracy of the model to Acc = 0.9296 (Figure 5). Studies have shown that there are multiple optimal solutions for the same problem []. In the future, when we are looking for cancer markers, we can consider different combinations of features.
Table 4. Contributions of the investigated features to the RF models.

3.5. Independent Validation of the Models Using Future Samples

This study validated only the three-year survival prediction models due to the limited numbers of diagnosis years in the SEER database. The samples from the diagnosis years 2010–2011 were used as the training samples. Moreover, the samples from 2012–2013 were the independent validation samples. The survival statuses of the samples diagnosed in 2013 were determined by the follow-up data in the years 2014–2016, where the 2016 data were also retrieved from the SEER database. It is interesting to observe that the LR model was trained on the 2010–2011 samples and achieved Acc = 0.7841 on the “All” dataset from the diagnosis years 2012–2013. The female samples demonstrated an even better consistency in the three-year survival prediction by the independent validation with Acc = 0.8297. The male samples received a slightly worse model with Acc = 0.7329. We found that most pairs of investigated baseline characteristics did not have statistically significant and strong correlations (correlation coefficient > 0.300 and p < 0.05), except for a few cases. The variables N and LOODS were observed to have a correlation coefficient of 0.630 and p < 0.001. The variable Surgery was correlated with N (correlation coefficient = 0.323, p < 0.001) and M (correlation coefficient = 0.348, p < 0.001). The variable Stage was correlated with T (correlation coefficient = 0.653, p < 0.001), LOODS (correlation coefficient = 0.371, p < 0.001), N (correlation coefficient = 0.579, p < 0.001), and M (correlation coefficient = 0.415, p < 0.001). The other pairs of these baseline characteristics were either not or were weakly correlated (Supplementary Table S2). The machine learning models developed in the above sections suggested that some features’ removal may improve the prognosis prediction models.

4. Discussion

Gender disparity was observed in lung cancer incidence, mortality, prognosis and treatment responses, etc. The prognosis analysis in this study suggested that female lung cancer patients had a better prognosis than male patients. Radkiewicz et al. found that the prognosis of male patients with non-small cell lung cancers (NSCLC) was poor, even after careful adjustments for various prognostic factors []. This study confirmed this observation and observed the gender-specific developmental T/N/M stages on diagnosis. Biological differences may justify female’s better treatment responses and improved survival rates []. Kinoshita et al. also pointed out that gender differences in the histological types and developmental stages on diagnosis may partially explain the better prognosis of female lung cancer patients []. Studies of both surgery and systemic therapeutic treatments suggested that, besides the never smokers, female lung cancer patients overall experienced a better prognosis than males [].
Both inherent genetic factors and gene-environment interactions play important roles in regulating the prognosis of lung cancers [,,]. Various factors may induce the poor prognosis of male lung cancer patients. Firstly, female lung cancer patients benefited more from the anti-programmed cell death-1programmed death ligand-1 (anti-PD-1/PD-L1) chemotherapy than male patients []. Immune checkpoint inhibitors were more effective in male patients than female patients, while immune checkpoint inhibitors combined with chemotherapy were often more effective in female patients []. Secondly, male lung cancer patients tended to have more aggressive tumor developmental behaviors, e.g., faster growth and higher metastatic potentials [].
Machine learning algorithms are becoming a popular technique to predict survival status. Compared with nomograms, machine learning models are not easy to be interpreted, but clinical doctors do not have to manually calculate the risk scores as with nomograms. A machine learning model may deliver prediction results rapidly and conveniently to the users once the input variables are loaded. The survival prediction results in this study showed better prediction performances for female patients with primary lung cancers than male patients. The two classifiers XGB and LR performed similarly well on the binary classifications of the one-year, three-year, and five-year survival prediction problems.
The feature contributions to the prediction models were evaluated by the importance variables of the trained XGB models. One-year survival status heavily relied on the variable “Surgery” for both genders and their mixture, while the most important contributions came from the variable “N” stage for the three-year and five-year survival prediction problems. So, a surgical removal is important for the one-year survival of primary lung cancer patients. Then, a long-term goal for primary lung cancer patient is to pay special attention to monitoring the regional lymph nodes for possible metastatic tumor development.
This study has the following limitations, which may be overcome by more comprehensive data sources. The SEER database provides a limited set of clinical variables for the patient and it is anticipated that more clinical data, e.g., on smoking and drinking, will improve the model performances. The imaging and molecular data of the patient’s mental health, genetic information, and living environment will definitely increase the models’ prediction performance. This study selected seven commonly-used machine learning algorithms to investigate the gender-specific prognosis of lung cancers. This gender disparity may be further evaluated by more machine learning algorithms. Novel machine learning algorithms may also be developed in future studies to deliver gender-independent prognosis models with similar prediction performances to the gender-specific models. For example, a combination of nomogram and machine learning prediction models can be considered for analysis. Recently, multiple instance learning has demonstrated its superiority in various applications including tumor imaging analysis [,,,]. The deployment of the multiple instances learning method may significantly improve prognosis prediction for cancer patients. Spherical separation surface-based approaches were observed to perform better than classifiers based on linear separation surfaces on the binary classification problems of two similar class labels, and may be utilized in future investigations [,]. Gender-specific prognosis may be investigated using biomedical imaging data and other data types in future studies.

5. Conclusions

In conclusion, this study provided an exploratory investigation of gender disparity in the prognosis of primary lung cancers using regular statistical methods and machine learning prediction models. Both techniques consistently supported the prognosis observations derived from each other. Due to the limited availability of the primary lung cancer dataset with long-term follow-ups, the observations were not validated by an independent dataset.

Supplementary Materials

The following are available online at https://www.mdpi.com/1648-9144/57/2/99/s1, Figure S1: Visualization of using XGB model to predict the survival status of patients with primary lung cancer, Table S1: The nomogram predicts the prediction results of 1 year, 3 years, and 5 years of survival, Table S2: Correlation coefficient analysis on the pairs of baseline characteristics, Table S3: Parameters of the 7 machine learning methods.

Author Contributions

Specifically, Y.W., Q.Y. and Z.W. did the study conception and design. Y.W., S.L., Z.W and Y.F. did the acquisition of data. Y.W., J.H., L.H., X.L. and Z.L. did the analysis and/or interpretation of data. Finally, Y.W., M.J., Q.Y., and F.Z. drafted the manuscript and critical revision of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Jilin Provincial Key Laboratory of Big Data Intelligent Computing [20180622002JC], the Education Department of Jilin Province [JJKH20180145KJ], and the startup grant of the Jilin University. This work was also partially supported by the Bioknow MedAI Institute [BMCPP-2018-001], the High Performance Computing Center of Jilin University, and by the Fundamental Research Funds for the Central Universities, JLU.

Institutional Review Board Statement

Patient consent was waived due to the data is from the publicly available SEER database. A SEER Research Data Agreement was obtained to enable access to the SEER data. This study required no additional ethical approval as it involved no interaction with human participants or personal identification of participants.

Data Availability Statement

The data is from SEER database. A SEER Research Data Agreement was obtained to enable access to the SEER data. The database is available at https://seer.cancer.gov/.

Acknowledgments

There was no outside funding for the preparation, design, or writing of this article. The constructive comments from the three anonymous reviewers are greatly appreciated.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Siegel, R.L.; Miller, K.D.; Jemal, A. Cancer statistics, 2019. CA Cancer J. Clin. 2019, 69, 7–34. [Google Scholar] [CrossRef] [PubMed]
  2. Jemal, A.; Miller, K.D.; Ma, J.; Siegel, R.L.; Fedewa, S.A.; Islami, F.; Devesa, S.S.; Thun, M.J. Higher Lung Cancer Incidence in Young Women Than Young Men in the United States. N. Engl. J. Med. 2018, 378, 1999–2009. [Google Scholar] [CrossRef] [PubMed]
  3. Sagerup, C.M.; Smastuen, M.; Johannesen, T.B.; Helland, A.; Brustugun, O.T. Sex-specific trends in lung cancer incidence and survival: A population study of 40,118 cases. Thorax 2011, 66, 301–307. [Google Scholar] [CrossRef] [PubMed]
  4. Nakamura, H.; Ando, K.; Shinmyo, T.; Morita, K.; Mochizuki, A.; Kurimoto, N.; Tatsunami, S. Female gender is an independent prognostic factor in non-small-cell lung cancer: A meta-analysis. Ann. Thorac. Cardiovasc. Surg. 2011, 17, 469–480. [Google Scholar] [CrossRef]
  5. Rivera, M.P. Lung cancer in women: Differences in epidemiology, biology, histology, and treatment outcomes. Semin. Respir. Crit. Care Med. 2013, 34, 792–801. [Google Scholar] [CrossRef]
  6. Liu, Y.; Shen, J.; Liu, L.; Shan, L.; He, J.; He, Q.; Jiang, L.; Guo, M.; Chen, X.; Pan, H.; et al. Impact of examined lymph node counts on survival of patients with stage IA non-small cell lung cancer undergoing sublobar resection. J. Thorac. Dis. 2018, 10, 6569–6577. [Google Scholar] [CrossRef]
  7. Wang, C.; Qiao, W.; Jiang, Y.; Zhu, M.; Shao, J.; Ren, P.; Liu, D.; Li, W. Effect of sex on the efficacy of patients receiving immune checkpoint inhibitors in advanced non-small cell lung cancer. Cancer Med. 2019, 8, 4023–4031. [Google Scholar] [CrossRef]
  8. Donington, J.S.; Colson, Y.L. Sex and gender differences in non-small cell lung cancer. Semin. Thorac. Cardiovasc. Surg. 2011, 23, 137–145. [Google Scholar] [CrossRef]
  9. Moore, R.; Doherty, D.; Chamberlain, R.; Khuri, F. Sex differences in survival in non-small cell lung cancer patients 1974–1998. Acta Oncol. 2004, 43, 57–64. [Google Scholar] [CrossRef]
  10. Zang, E.A.; Wynder, E.L. Differences in lung cancer risk between men and women: Examination of the evidence. J. Natl. Cancer Inst. 1996, 88, 183–192. [Google Scholar] [CrossRef]
  11. Stabile, L.P.; Siegfried, J.M. Sex and gender differences in lung cancer. J. Gend. Specif. Med. 2003, 6, 37–48. [Google Scholar] [PubMed]
  12. Gasperino, J. Gender is a risk factor for lung cancer. Med. Hypotheses 2011, 76, 328–331. [Google Scholar] [CrossRef] [PubMed]
  13. Wisnivesky, J.P.; Halm, E.A. Sex differences in lung cancer survival: Do tumors behave differently in elderly women? J. Clin. Oncol. 2007, 25, 1705–1712. [Google Scholar] [CrossRef] [PubMed]
  14. Viswambaram, P.; Hayne, D. Gender discrepancies in bladder cancer: Potential explanations. Expert Rev. Anticancer. Ther. 2020, 20, 841–849. [Google Scholar] [CrossRef]
  15. Dittberner, A.; Friedl, B.; Wittig, A.; Buentzel, J.; Kaftan, H.; Boeger, D.; Mueller, A.H.; Schultze-Mosgau, S.; Schlattmann, P.; Ernst, T.; et al. Gender Disparities in Epidemiology, Treatment, and Outcome for Head and Neck Cancer in Germany: A Population-Based Long-Term Analysis from 1996 to 2016 of the Thuringian Cancer Registry. Cancers 2020, 12, 3418. [Google Scholar] [CrossRef]
  16. Li, J.; Zheng, Q.; Zhao, X.; Zhao, J.; An, T.; Wu, M.; Wang, Y.; Zhuo, M.; Zhong, J.; Yang, X.; et al. Nomogram model for predicting cause-specific mortality in patients with stage I small-cell lung cancer: A competing risk analysis. BMC Cancer 2020, 20, 793. [Google Scholar] [CrossRef]
  17. Xu, Y.; Liang, F.; Chen, Y.; Wang, Z.; Zhong, H.; Tang, W. Novel Model to Predict the Prognosis of Patients with Stage II-III Colon Cancer. BioMed Res. Int. 2020, 2020, 8812974. [Google Scholar] [CrossRef]
  18. Karakiewicz, P.I.; Shariat, S.F.; Palapattu, G.S.; Perrotte, P.; Lotan, Y.; Rogers, C.G.; Amiel, G.E.; Vazina, A.; Gupta, A.; Bastian, P.J.; et al. Precystectomy nomogram for prediction of advanced bladder cancer stage. Eur. Urol. 2006, 50, 1254–1260; discussion 1261–1262. [Google Scholar] [CrossRef]
  19. Iasonos, A.; Schrag, D.; Raj, G.V.; Panageas, K.S. How to build and interpret a nomogram for cancer prognosis. J. Clin. Oncol. 2008, 26, 1364–1370. [Google Scholar] [CrossRef]
  20. Deng, J.; Ren, Z.; Wen, J.; Wang, B.; Hou, X.; Xue, Z.; Chu, X. Construction of a nomogram predicting the overall survival of patients with distantly metastatic non-small-cell lung cancer. Cancer Manag. Res. 2018, 10, 6143–6156. [Google Scholar] [CrossRef] [PubMed]
  21. Wang, Y.; Pang, Z.; Chen, X.; Bie, F.; Wang, Y.; Wang, G.; Liu, Q.; Du, J. Survival nomogram for patients with initially diagnosed metastatic non-small-cell lung cancer: A SEER-based study. Futur. Oncol. 2019, 15, 3395–3409. [Google Scholar] [CrossRef] [PubMed]
  22. Liang, W.; Zhang, L.; Jiang, G.; Wang, Q.; Liu, L.; Liu, D.; Wang, Z.; Zhu, Z.; Deng, Q.; Xiong, X.; et al. Development and validation of a nomogram for predicting survival in patients with resected non-small-cell lung cancer. J. Clin. Oncol. 2015, 33, 861–869. [Google Scholar] [CrossRef] [PubMed]
  23. Yap, W.K.; Shih, M.C.; Kuo, C.; Pai, P.C.; Chou, W.C.; Chang, K.P.; Tsai, M.H.; Tsang, N.M. Development and Validation of a Nomogram for Assessing Survival in Patients With Metastatic Lung Cancer Referred for Radiotherapy for Bone Metastases. JAMA Netw. Open 2018, 1, e183242. [Google Scholar] [CrossRef] [PubMed]
  24. Bandini, M.; Fossati, N.; Briganti, A. Nomograms in urologic oncology, advantages and disadvantages. Curr. Opin. Urol. 2019, 29, 42–51. [Google Scholar] [CrossRef]
  25. Alabi, R.O.; Mäkitie, A.A.; Pirinen, M.; Elmusrati, M.; Leivo, I.; Almangush, A. Comparison of nomogram with machine learning techniques for prediction of overall survival in patients with tongue cancer. Int. J. Med Inform. 2021, 145, 104313. [Google Scholar] [CrossRef]
  26. Marrogi, A.J.; Mechanic, L.E.; Welsh, J.A.; Bowman, E.D.; Khan, M.A.; Enewold, L.; Shields, P.G.; Harris, C.C. TP53 mutation spectrum in lung cancer is not different in women and men. Cancer Epidemiol. Biomark. Prev. 2005, 14, 1031–1033. [Google Scholar] [CrossRef]
  27. Delisle, M.; Singh, S.; Howard, J.; Panda, N.; Weppler, A.M.; Wang, Y. Refusal of colorectal cancer surgery in the United States: Predictors and associated cancer-specific mortality in a Surveillance, Epidemiology, and End Results (SEER) cohort. Surg. Open Sci. 2020, 2, 12–18. [Google Scholar] [CrossRef]
  28. Thompson, A.B.; Quinn, T.J.; Siddiqui, Z.A.; Almahariq, M.F.; Grills, I.S.; Stevens, C.W. Addition of radiotherapy to surgery and chemotherapy improves survival in localized malignant pleural mesothelioma: A Surveillance, Epidemiology, and End Results (SEER) study. Lung Cancer 2020, 146, 120–126. [Google Scholar] [CrossRef]
  29. Goldstraw, P.; Crowley, J.; Chansky, K.; Giroux, D.J.; Groome, P.A.; Rami-Porta, R.; Postmus, P.E.; Rusch, V.; Sobin, L. The IASLC Lung Cancer Staging Project: Proposals for the revision of the TNM stage groupings in the forthcoming (seventh) edition of the TNM Classification of malignant tumours. J. Thorac. Oncol. 2007, 2, 706–714. [Google Scholar] [CrossRef]
  30. Gao, Y.; Zhou, X. Analysis of clinical features and prognostic factors of lung cancer patients: A population-based cohort study. Clin. Respir. J. 2020. [Google Scholar] [CrossRef]
  31. Deng, W.; Xu, T.; Wang, Y.; Xu, Y.; Yang, P.; Gomez, D.; Liao, Z. Log odds of positive lymph nodes may predict survival benefit in patients with node-positive non-small cell lung cancer. Lung Cancer 2018, 122, 60–66. [Google Scholar] [CrossRef] [PubMed]
  32. Wu, J.; Zhang, Q.; Zhao, Y.; Liu, Y.; Chen, A.; Li, X.; Wu, T.; Li, J.; Guo, Y.; Liu, A. Radiomics Analysis of Iodine-Based Material Decomposition Images With Dual-Energy Computed Tomography Imaging for Preoperatively Predicting Microsatellite Instability Status in Colorectal Cancer. Front. Oncol. 2019, 9, 1250. [Google Scholar] [CrossRef] [PubMed]
  33. Cui, S.; Zhao, L.; Wang, Y.; Dong, Q.; Ma, J.; Wang, Y.; Zhao, W.; Ma, X. Using Naive Bayes Classifier to predict osteonecrosis of the femoral head with cannulated screw fixation. Injury 2018, 49, 1865–1870. [Google Scholar] [CrossRef] [PubMed]
  34. Wood, A.; Shpilrain, V.; Najarian, K.; Kahrobaei, D. Private naive bayes classification of personal biomedical data: Application in cancer data analysis. Comput. Biol. Med. 2019, 105, 144–150. [Google Scholar] [CrossRef] [PubMed]
  35. Ferraz, P.F.P.; Julio, Y.H.F.; Ferraz, G.; Moura, R.S.; Rossi, G.; Saraz, J.A.O.; Barbari, M. Decision Trees for Predicting the Physiological Responses of Rabbits. Animals 2019, 9, 994. [Google Scholar] [CrossRef]
  36. Sarica, A.; Cerasa, A.; Quattrone, A. Random Forest Algorithm for the Classification of Neuroimaging Data in Alzheimer's Disease: A Systematic Review. Front. Aging Neurosci. 2017, 9, 329. [Google Scholar] [CrossRef]
  37. Guang, P.; Huang, W.; Guo, L.; Yang, X.; Huang, F.; Yang, M.; Wen, W.; Li, L. Blood-based FTIR-ATR spectroscopy coupled with extreme gradient boosting for the diagnosis of type 2 diabetes: A STARD compliant diagnosis research. Medicine 2020, 99, e19657. [Google Scholar] [CrossRef]
  38. Fang, W.H.; Yang, J.R.; Lin, C.Y.; Hsiao, P.J.; Tu, M.Y.; Chen, C.F.; Tsai, D.J.; Su, W.; Huang, G.S.; Chang, H.; et al. Accuracy augmentation of body composition measurement by bioelectrical impedance analyzer in elderly population. Medicine 2020, 99, e19103. [Google Scholar] [CrossRef] [PubMed]
  39. Zhang, S.; Li, X.; Zong, M.; Zhu, X.; Wang, R. Efficient kNN Classification With Different Numbers of Nearest Neighbors. IEEE Trans. Neural Netw. Learn. Syst. 2018, 29, 1774–1785. [Google Scholar] [CrossRef]
  40. Jang, S.K.; Chang, J.Y.; Lee, J.S.; Lee, E.J.; Kim, Y.H.; Han, J.H.; Chang, D.I.; Cho, H.J.; Cha, J.K.; Yu, K.H.; et al. Reliability and Clinical Utility of Machine Learning to Predict Stroke Prognosis: Comparison with Logistic Regression. J. Stroke 2020, 22, 403–406. [Google Scholar] [CrossRef]
  41. Doubilet, P.M.; Phillips, C.H.; Durfee, S.M.; Benson, C.B. First-Trimester Prognosis When an Early Gestational Sac is Seen on Ultrasound Imaging: Logistic Regression Prediction Model. J. Ultrasound Med. 2020. [Google Scholar] [CrossRef] [PubMed]
  42. Quitadamo, L.R.; Cavrini, F.; Sbernini, L.; Riillo, F.; Bianchi, L.; Seri, S.; Saggio, G. Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction: A review. J. Neural Eng. 2017, 14, 011001. [Google Scholar] [CrossRef] [PubMed]
  43. Claesson, L.; Blomstrand, J.; Eklund, K.; Eriksson, K.; Dahlin-Ivanoff, S. Comparison of visual acuity charts identifying visual impairment among older people outside the eye clinic. Disabil. Rehabil. 2013, 35, 1394–1400. [Google Scholar] [CrossRef] [PubMed]
  44. Dixit, A.; Yohannan, J.; Boland, M.V. Assessing Glaucoma Progression Using Machine Learning Trained on Longitudinal Visual Field and Clinical Data. Ophthalmology 2020. [Google Scholar] [CrossRef] [PubMed]
  45. Liu, J.; Xu, C.; Yang, W.; Shu, Y.; Zheng, W.; Zhou, F. Multiple similarly effective solutions exist for biomedical feature selection and classification problems. Sci. Rep. 2017, 7, 12830. [Google Scholar] [CrossRef]
  46. Radkiewicz, C.; Dickman, P.W.; Johansson, A.L.V.; Wagenius, G.; Edgren, G.; Lambe, M. Sex and survival in non-small cell lung cancer: A nationwide cohort study. PLoS ONE 2019, 14, e0219206. [Google Scholar] [CrossRef]
  47. Berardi, R.; Verdecchia, L.; Paolo, M.D.; Giampieri, R.; Scartozzi, M.; Pierantoni, C.; Bianconi, M.; Mazzanti, P.; Cascinu, S. Women and lung cancer: Clinical and molecular profiling as a determinate for treatment decisions: A literature review. Crit. Rev. Oncol. 2009, 69, 223–236. [Google Scholar] [CrossRef] [PubMed]
  48. Kinoshita, F.L.; Ito, Y.; Morishima, T.; Miyashiro, I.; Nakayama, T. Sex differences in lung cancer survival: Long-term trends using population-based cancer registry data in Osaka, Japan. Jpn. J. Clin. Oncol. 2017, 47, 863–869. [Google Scholar] [CrossRef]
  49. Graham, P.D.; Thigpen, S.C.; Geraci, S.A. Lung cancer in women. South. Med. J. 2013, 106, 582–587. [Google Scholar] [CrossRef]
  50. Rodriguez-Lara, V.; Ramirez-Tirado, L.A.; Barron, F.; Zatarain-Barron, Z.L.; Flores-Estrada, D.; Arrieta, O. Characteristics of non-small cell lung cancer: Differences by sex and hormonal status in a Mexican population. Salud Publica Mexico 2019, 61, 265–275. [Google Scholar] [CrossRef]
  51. Song, Y.; Gao, S.; Tan, W.; Qiu, Z.; Zhou, H.; Zhao, Y. Multiple Machine Learnings Revealed Similar Predictive Accuracy for Prognosis of PNETs from the Surveillance, Epidemiology, and End Result Database. J. Cancer 2018, 9, 3971–3978. [Google Scholar] [CrossRef] [PubMed]
  52. Conforti, F.; Pala, L.; Bagnardi, V.; Viale, G.; De Pas, T.; Pagan, E.; Pennacchioli, E.; Cocorocchio, E.; Ferrucci, P.F.; De Marinis, F.; et al. Sex-based heterogeneity in response to lung cancer immunotherapy: A systematic review and meta-analysis. J. Nat. Cancer Inst. 2019. [Google Scholar] [CrossRef] [PubMed]
  53. Wang, S.; Cowley, L.A.; Liu, X.S. Sex Differences in Cancer Immunotherapy Efficacy, Biomarkers, and Therapeutic Strategy. Molecules 2019, 24, 3214. [Google Scholar] [CrossRef] [PubMed]
  54. Pino Peña, I.; Cheplygina, V.; Paschaloudi, S.; Vuust, M.; Carl, J.; Weinreich, U.M.; Østergaard, L.R.; de Bruijne, M. Automatic emphysema detection using weakly labeled HRCT lung images. PLoS ONE 2018, 13, e0205397. [Google Scholar] [CrossRef]
  55. Safta, W.; Frigui, H. Multiple Instance Learning for Benign vs. Malignant Classification of Lung Nodules in CT Scans. In Proceedings of the 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Louisville, KY, USA, 6–8 December 2018; pp. 490–494. [Google Scholar]
  56. Astorino, A.; Fuduli, A.; Veltri, P.; Vocaturo, E. Melanoma Detection by Means of Multiple Instance Learning. Interdiscip. Sci. Comput. Life Sci. 2020, 12, 24–31. [Google Scholar] [CrossRef]
  57. Fuduli, A.; Veltri, P.; Vocaturo, E.; Zumpano, E. Melanoma detection using color and texture features in computer vision systems. Adv. Sci. Technol. Eng. Syst. J. 2019, 4, 16–22. [Google Scholar] [CrossRef]
  58. Gaudioso, M.; Giallombardo, G.; Miglionico, G.; Vocaturo, E. Classification in the multiple instance learning framework via spherical separation. Soft Comput. 2020, 24, 5071–5077. [Google Scholar] [CrossRef]
  59. Vocaturo, E.; Zumpano, E.; Giallombardo, G.; Miglionico, G. DC-SMIL: A multiple instance learning solution via spherical separation for automated detection of displastyc nevi. In Proceedings of the 24th Symposium on International Database Engineering & Applications, Seoul, Korea, 12–18 August 2020. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Article Metrics

Citations

Article Access Statistics

Journal Statistics
Multiple requests from the same IP address are counted as one view.
Download PDF
Three-Dimensional Gait Analysis in Children Undergoing Gastrocsoleus Lengthening for Equinus Secondary to Cerebral Palsy
Previous
An Update to the WISP-1/CCN4 Role in Obesity, Insulin Resistance and Diabetes
Next