Abstract
The risk for suicide in patients with cancer is higher compared to the general population. However, little is known about patients with lung cancer specifically. We therefore implemented a systematic review and random-effects meta-analysis of retrospective cohort studies on suicide in patients with lung cancer. We searched a high number of common databases up to 02/2021. For the systematic review, a total of 23 studies was included. To exclude bias due to patient sample overlap, the meta-analysis was performed on 12 studies. The pooled standardized mortality ratio (SMR) for suicide was 2.95 (95% Confidence Interval (CI) = 2.42–3.60) for patients with lung cancer as compared to the general population. Subgroups with a pronouncedly higher risk for suicide compared to the general population were found for patients living in the USA (SMR = 4.17, 95% CI = 3.88–4.48), with tumors of late stage (SMR = 4.68, 95% CI = 1.28–17.14), and within one year after diagnosis (SMR = 5.00, 95% CI = 4.11–6.08). An increased risk for suicide was found in patients with lung cancer, with subgroups at particular risk. Patients at increased risk should be monitored more closely for suicidality and should receive specialized psycho-oncological and psychiatric care. Further studies should clarify the role of smoking and depressive symptoms on suicidality among lung cancer patients.
1. Introduction
Patients with cancer are exposed to massive psychosocial distress [1]. Correspondingly, depressive symptoms occur more frequently in patients with malignant diseases [2,3], and several studies claimed increased suicide rates in cancer patients (summarized in [4]). Lung cancer has been shown to be associated with particularly severe psychological distress [5]. Recent population-based studies indicated that lung cancer is associated with an increased risk of suicide compared to the general population [6,7,8,9,10]. Furthermore, suicide mortality risk in lung cancer patients ranked among the highest of all cancer types in several studies [11,12]. Meanwhile, cancers of the respiratory tract are considered the most frequent cause of cancer-related death worldwide [13], linked to an overall five-year survival rate of around 16%, even in highly industrialized countries such as the USA [14]. There are several different types of lung cancer with distinct etiologies, treatment options and prognoses [15]. Therefore, we believe that an in-depth analysis of suicide risks and risk factors specifically for patients with lung cancer is warranted.
By identifying individuals at highest risk for suicide, specific screening tools for suicidality can be established and implemented into the clinical routine to decrease suicide-associated mortality. This is highly relevant considering a cancer-associated suicide rate of 27.5 per 100,000 person years [16].
2. Materials and Methods
2.1. Eligibility Criteria, Systematic Literature Search, and Data Extraction
In analogy to our previous study [4], we included observational longitudinal cohort studies for our systematic review on lung cancer and suicide. Studies had to be based on cancer patients as cases and non-cancer patients as the control group. The primary outcome of studies to be included was the incidence of suicide, quantified as suicide rates, observed numbers of deaths or standardized mortality ratios (SMRs). Secondary outcomes included subgroup analyses on risk factors for suicide in lung cancer patients. Lung cancer was defined according to the International Classification of Disease (ICD-10-C34.), coded in national cancer registries. Studies had to comprise 95% confidence intervals (CI). Articles in non-English language, editorials, letters and conference abstracts were excluded.
We performed a systematic literature search according to the PRESS [17] and MOOSE [18] as well as the PRISMA guidelines [19]. The protocol of the study on overall suicide mortality among patients with cancer has been registered to PROSPERO under CRD42021265254. Briefly, the databases EMBASE (Ovid, from 1974), MEDLINE (Ovid, from 1946), PsycINFO (EBSCOhost, from 1884), Science Citation Index Expanded and Social Sciences Citation Index (Web of Science, from 1965 and1990, respectively), CINAHL (EBSCOhost, from 1981) and Google Scholar were searched from the date of inception until February 2021. In addition, we screened reference lists of the included studies for additional relevant reports. Full details of the search, including search strategies and a PRISMA-S checklist [20], are published elsewhere [4]. An update of the literature search up to December 2022 retrieved no additional studies to be considered in the meta-analysis.
Records retrieved from the database searches were collected using the reference management software Endnote (version X9) and de-duplicated according to the method described by Bramer et al. [21].
Two authors (M.H., L.H.) performed the study selection independently, according to the PRISMA flowchart (Figure 1) by first screening titles and abstracts, then full texts. A third researcher acted as consultant for disagreements.
Figure 1.
PRISMA Flow Diagram for study selection. Abbreviations: n, number of studies.
Subsequently, M.H. and L.H. extracted study data, including first author, year of publication, study population size, number of suicide cases, geographic region, type of study, length of follow-up, tumor type, further subgroups, relative risk estimates, CIs and all available adjustment factors.
For missing SMRs, we calculated those values based on indicated observed and expected patient numbers.
Quality assessment followed the Newcastle–Ottawa scale (NOS) [22], classifying studies with ≥7 points as high quality studies.
For the systematic review, we used all 23 studies. However, facing the risk of potential patient overlap due to studies from the same cancer registries with overlapping recruiting time periods [23], in an additional analysis we excluded 11 studies, prioritizing studies with larger amounts of different subgroup stratifications and arrived at 12 studies for the meta-analysis.
The final set of extracted data were organized in Microsoft Excel (Version 16) worksheets.
2.2. Statistical Analyses
Using a random-effects model, we calculated the log(RRi) with its standard error of si = di/1.96 (di as the maximum of [log(upper 95% CI bound of RRi) − log(RRi)] and [log(RRi) − log(lower 95% CI bound of RRi)]).
Overall CIs were calculated using the Mid-P exact method by R-Studio [24]. Overall effects were estimated using random-effects models with estimated between-study variance by restricted maximum-likelihood estimate (REML) [25].
To investigate suicide rates among lung cancer patients according to risk factors such as sex, age, geographic region, ethnicity, marital status, histology, time after diagnosis, and stage, we carried out subgroup analyses and random effects meta-regression. For multiple test correction, we applied the false discovery rate (FDR) method, and corrected results are presented as q-values [26].
We calculated potential study heterogeneity using Q-statistics and I2 statistics and we examined possible publication bias by funnel plots, Begg’s [27] and Egger’s tests [28].
All statistical analyses were carried out using the packages ‘metafor’ in R (version 4.1.1) [29].
3. Results
3.1. Study Selection and Characteristics
We retrieved 12,188 records from the electronic databases, with five studies being added through other sources. After deduplication, we screened 7565 publications for titles and abstracts. In a second step, full texts were screened. Among 62 studies on suicide in cancer patients, we found 23 studies that presented specific data on patients with lung cancer [6,7,8,9,10,11,12,16,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44]. Whereas 12 studies provided data on 1,790,027 patients with lung cancer, 11 studies gave only numbers of lung cancer patients who committed suicide, or risk estimates for suicide, but not the total number of patients with lung cancer. During follow-up, 5498 patients with lung cancer committed suicide.
Most studies (n = 12) used data from Europe, followed by the US (n = 7) and Asia (n = 4). Further characteristics are summarized in Table 1.
Table 1.
Characteristics of included studies.
3.2. Main Analysis
In all 23 studies, we found a significantly elevated risk of suicide in lung cancer patients compared to the general population (SMR = 3.54, 95% CI = 2.95–4.26, p-value < 0.0001; Figure 2A). After exclusion of studies with potential patient overlap, the suicide mortality risk was increased 2.95-fold compared to the general population (SMR = 2.95, 95% CI = 2.42–3.60, p-value < 0.0001; Figure 2B). Both analyses showed considerable heterogeneity among studies (I2 = 97.65% and 90.46%, both p-values for heterogeneity < 0.0001).
Figure 2.
Forest plot of random effects meta-analysis of cohort studies of suicide in patients with lung cancer compared to the general population. (A) All 23 cohort studies (of suicide in lung cancer patients), I2 = 97.76%, P-heterogeneity < 0.0001. (B) 12 non-overlapping cohort studies (of suicide in lung cancer patients), I2 = 90.46%, P-heterogeneity < 0.0001. All studies were sorted by risk estimate and weighted for their contribution to the summary risk estimate. Abbreviations: SMR, standardized mortality ratio; CI, confidence interval [6,7,8,9,10,11,12,16,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44].
To identify potential causes of heterogeneity, we carried out stratified analyses. In addition to the suicide mortality risk analysis of patients with lung cancer compared to the general population, we compared the SMR of patients with lung cancer to the SMR of pooled cancer sites [4] to capture potential lung-cancer-specific differences across population subgroups. Across all subgroups, in patients with lung cancer, suicide mortality risk was increased compared to other pooled cancer sites (2.95, 95% CI = 2.42–3.60 vs. 1.85, 95% CI = 1.55–2.20) (Figure 3).
Figure 3.
Comparison of overall and subgroup SMR of lung vs. all other cancer sites. Abbreviations: SMR, standardized mortality ratio; CI, confidence interval. Exact values of SMR and CI are indicated separately.
We also explored subgroups of lung cancer patients at particular risk for suicide. Figure 4 shows a summary of specific subgroups based on data obtained from at least two independent studies.
Figure 4.
Summary forest plot of subgroup analyses of suicide in patients with lung-cancer. (A) All 23 studies sorted by risk estimate. I2 = 85.70%, P-heterogeneity = 0.0000. (B) 12 studies sorted by risk estimate. I2 = 90.29%, P-heterogeneity = 0.0000. Abbreviations: SMR, standardized mortality ratio; CI, confidence interval; n, number of studies included in the analysis.
3.3. Subgroup Analyses
After exclusion of studies with potential patient overlap, the risk of suicide according to time after diagnosis was analyzed, showing a significantly higher (p-value < 0.001) suicide risk within one year after diagnosis (SMR = 5.00, 95% CI = 4.11–6.08) as compared to more than one year after diagnosis (SMR = 1.52, 95% CI = 1.21–1.91).
In further subgroup analyses, no statistically significant differences in suicide risk were observed (Figure 4B and Appendix B, Table 1). In all nine studies that stratified by gender, both men and women with lung cancer showed an elevated SMR for suicide compared to the general population (SMR for women = 3.32, 95% CI = 2.92–3.78; SMR for men = 3.27, 95% CI = 2.71–3.95). Age-specific differences were investigated in two studies [16,42]. Risk for suicide in patients with lung cancer was slightly increased across different ages at diagnosis (SMR for <60 years of age = 3.09, 95% CI = 2.46–3.88, SMR for 60–69 years of age = 3.23, 95% CI = 2.89–3.61, SMR for ≥70 years of age = 3.40, 95% CI = 1.70–6.79). For patients with lung cancer living in the USA, the most accentuated risk of suicide (SMR = 4.17, 95% CI = 3.88–4.48) was observed compared to those in Asia (SMR = 3.31, 95% CI = 2.50–4.39) or Europe (SMR = 2.67, 95% CI = 2.05–3.47). Patients with metastasized tumors were at elevated risk (SMR = 4.68, 95% CI = 1.28–17.14), whereas patients with a regional cancer stage showed a non-significantly lower SMR of 1.36 (95% CI = 0.24–7.76).
Further meta-regression analyses are shown in Appendix B Table A1.
We performed additional subgroup analyses with the full set of 23 studies, considering the risk of potential patient sample overlap (Figure 4A). Two studies with potential patient overlap investigated marital status, histological subtype, and ethnicity. Married cancer patients tended to have a lower risk of suicide (SMR = 4.10, 95% CI = 3.07–5.48) compared to unmarried patients (SMR = 5.42, 95% CI = 4.70–6.25).
Patients with small-cell lung cancer were at a higher risk of committing suicide (SCLC; SMR = 7.50, 95% CI = 6.59–8.54) than patients with non-small-cell lung cancer (NSCLC; SMR = 4.33, 95% CI = 3.62–5.18), adenocarcinoma (SMR = 4.23, 95% CI = 3.74–4.78), large cell carcinoma (SMR = 4.92, 95% CI = 3.78–6.40) and squamous cell carcinoma (SMR = 4.53, 95% CI = 3.29–6.24).
Regarding ethnicity, in African American lung cancer patients, a tendency to lower risk of suicide was observed (SMR = 3.94, 95% CI = 2.90–5.35) compared to Caucasians (SMR = 4.52, 95% CI = 3.87–5.28) or other ethnicities (SMR = 5.81, 95% CI = 4.67–7.23).
3.4. Assessment of Publication Bias and Study Quality
The funnel plot (Appendix A Figure A1a) showed some asymmetry around the pooled SMR estimate of all 23 studies, regardless of their potential sample overlap. While formal testing using Begg’s correlation test revealed no significant deviation from symmetry (p-value for Begg’s test = 0.7147), Egger’s regression test suggested significant asymmetry (p-value for Egger’s test = 0.0214). Restricting the analyses to studies with no overlapping samples, neither Begg’s correlation (p-value = 0.6384) nor Egger’s regression test (p-value = 0.3328) nor visual inspection (Appendix A Figure A1b) indicated publication bias. All 23 studies were considered high quality according to the Newcastle–Ottawa scale (NOS) by three independent researchers [4].
4. Discussion
The aim of this study was to examine SMRs for suicide in patients with lung cancer and to identify subgroups with a particularly high risk. We found an overall elevated suicide rate among lung cancer patients compared to the general population, but also almost twice as high as for other cancer sites combined [4]. The increased suicide risk in lung cancer patients was also explored in subgroups defined by sex, age, geographic region, ethnicity, marital status, tumor type and stage, and time since diagnosis.
In most cases, lung cancer is associated with a fatal prognosis [45] and it is often diagnosed at a late stage [46]. Common symptoms of lung cancer are dyspnea, fatigue, pain and nausea [47]. Those symptoms may lead not only to physical but also psychological and social restrictions, which may be more severe than for other cancer sites [48,49]. It becomes increasingly difficult to follow usual habits and take part in everyday social life, as normal functions such as eating and talking and eventually breathing become impaired or painful. Therefore, the severity of the disease and its symptoms likely contribute to increased risk for suicidality [50]. However, suicide rates are also elevated among lung cancer patients with a fair prognosis [16].
Altogether, there is only limited knowledge about the reasons, that contribute to the increased risk for suicide among lung cancer patients [51]. One might speculate that reasons for increased suicidality in lung cancer patients include a lack of psychological support and lack of empathic communication by healthcare teams, possibly due to time restrictions and staff shortages in clinical settings [52]. Furthermore, there may be a lack of knowledge on specific risk factors for suicide [53]. In addition, patients with lung cancer often suffer from stigmatization. A qualitative research study postulated that fear of stigmatization and exclusion precluded lung cancer patients from utilizing screening options, seeking support, or informing doctors, families and friends [54]. Even if healthcare standards are high, there could be a lack of social support [55]. Lung cancer patients, especially former or current smokers, but also never-smokers, may also feel a sense of shame [54] given the fact that campaigns to quit smoking in the media have become more and more popular, while lung cancer awareness strategies show minimal effects when compared to breast cancer [56]. Moreover, smokers may feel themselves responsible for all nicotine-associated damage. Facing the fear of being judged, but also self-blaming by this unplanned ‘side-effect’ leads to a notably increased stress response [51,57].
The data presented in our study are derived from three different parts of the world, each of which has a different suicide prevalence rate and factors leading to suicide. By prioritizing SMRs over other types of risk estimates, we sought to minimize bias from country-specific preexisting differences in suicidality in general.
In general, tumors of the respiratory system are more common in men, who—independently from a cancer diagnosis—bear a higher risk for suicide than women [58]. In our analysis, which was based on age and gender-adjusted SMRs, we observed an equally elevated risk for committing suicide in both men and women. In addition, the lung cancer subtype SCLC, which has the worst prognosis of all subtypes, is more often seen in men than women [59].
Apart from exploring gender-associated risks, we also explored further subgroups of lung cancer patients to identify patients at particular risk.
Time after diagnosis has previously been a strong risk factor for suicide in general cancer patients according to earlier investigations [4]. Within the first year after diagnosis, suicide rates were pronouncedly high. This could be explained by the acute stress and anxiety reaction caused by being diagnosed with a potentially fatal cancer [60]. Furthermore, the change from “normal life” to “life with lung cancer” is associated with various adaptations which may appear overwhelming when coping strategies have not been sufficiently established.
In terms of geography, a particularly high SMR was observed in the USA. Patients in the USA lack universal health insurance care. The for-profit industry leads to higher health care costs, especially for cancer treatment [61,62,63], but does not necessarily result in equal outcomes [64,65,66]. Thus, it may be more difficult for US patients to receive adequate support for their physical and mental needs. In particular, lung cancer patients who often have additional severe pre-existing conditions, such as chronic obstructive pulmonary disease, could be concerned about the economic burden imposed on themselves and their families. Notably, in the first phase after diagnosis, treatment for lung cancer is associated with pronouncedly high therapeutic costs [67,68].
The strongest variation in risk (although based on analyses with potential patient overlap) was detected in subgroups defined by lung cancer stage and histology. Metastatic disease was a prominent risk factor for suicidality in lung cancer patients. Lung cancer most often spreads to the bones, kidneys and the CNS, which leads to pain and dysfunction of the musculoskeletal and neurological systems [69]. Tumor-associated pain at baseline was found to be significantly associated with suicidal intentions [70]. In addition, metastatic growth is known to lower therapeutic options, implicating a worse prognosis, which may lead to feelings of hopelessness, depression and eventually suicidality.
Patients with small-cell-lung-cancer (SCLC) had a more than seven-fold elevated risk of committing suicide compared to the general population, which was also significantly increased when compared to patients with non-small-cell-lung-cancer, adenocarcinoma, large cell carcinoma and squamous cell carcinoma. One possible explanation is the exceptionally poor prognosis, with more limitations in everyday and social life due to the frequent occurrence of paraneoplastic and organic brain syndromes (e.g., limbic encephalitis) in patients with SCLC [71], which are often associated with psychopathologic symptoms [72]. By comparison, in patients with other lung cancer subtypes with poor prognosis, such as adenocarcinoma, lower suicide rates were observed. Adenocarcinoma more often occurs in females and non-smokers [73,74,75,76]. This suggests that smoking status may play a more crucial role. SCLC is associated with the use of tobacco [77], which is linked to higher levels of depression and anxiety [78]. Previous investigations claimed associations of tobacco smoking with both depression and schizophrenic psychosis [79,80,81], and both disorders are related to an increased risk of suicide [82]. In addition, there is an increased suicidality in smokers independently from depression [83]. Since smoking is considered the number one cause of lung cancer [84], it is conceivable that there is an increased chance for suicide among these patients caused not only by the cancer itself, but also based on personal predisposition. Comparing the SMRs of other smoking-related cancers (i.e., oral cavity, larynx, esophagus) to sites without specific associations with tobacco use (i.e., skin, thyroid, brain), smoking-associated cancer patients have an elevated risk for suicide, although some cancer types without a clear association with smoking often share a uniformly fatal prognosis [4]. Most likely, both the strong association with smoking and the particularly poor prognosis, even when compared to other histological lung cancer subtypes [85,86] contribute to the high risk of suicide among patients with SCLC.
Moreover, apart from tumor type and stage, performance status in everyday living is the most important factor when it comes to prognosis, independent from histological subtype, which often happens to be decreased in (ex-)smokers from the onset [87].
Our study has several limitations. Data collection may have varied according to the respective registry. However, suicides are most likely reliably documented. Suicide as a “private issue” may also be culturally charged (i.e., partly regarded as a heroic act in the Japanese culture whereas seen as immoral in areas influenced by Christian religion), which may have influenced registration across different registries. Furthermore, data are unavailable from the continents of Africa and Australia.
In addition, we had to deal with various adjustment factors. However, we were able to ensure at least age-adjusted data as part of our inclusion criteria. We were not able to perform stratified analyses according to smoking status and the presence of depressive symptoms. Furthermore, other well-known risk factors for suicide, such as previous suicide attempts, psychiatric comorbidities, psychiatric treatment or a positive family history for suicide could not be explored as they were not recorded in the primary studies.
The downside of excluding studies because of potential patient data overlap was a restriction of analyzable risk subgroups as shown in Figure 2 and Figure 3. While the dilemma of potential data overlap was handled inconsistently among previous meta-analyses [88,89,90,91], our aim was to assess suicidality in lung cancer patients using the most conservative statistical methodology, in awareness of the consequences mentioned above.
Our study has several important strengths. To date, no other meta-analysis has explored suicidal behaviors specifically in patients with lung cancer. By performing an extensive systematic literature research in five different high-standard databases with broad periods of time, chances of missing further relevant data have been kept small. Our study features objectivity by engaging two different researchers and a third researcher for any disagreements, all acting independently. Additionally, the analyzing process followed a highly standardized procedure. The results of our study are based on a large patient population and numerous subgroup analyses, as well as a sizeable number of different original papers performed in diverse countries.
Furthermore, we followed highly established standards, starting with a structured literature search according to well-founded guidelines and reaching far back in the past, ensuring proper quantitative and qualitative analysis.
5. Conclusions
In conclusion, the risk for committing suicide among patients with lung cancer is highly elevated by nearly three- and twofold in comparison to both the general population and to many other cancer entities. The highest risk was observed among patients within the first year after diagnosis. Caregivers should be aware of patients at risk and take individualized clinical decisions when and how to implement specialized psycho-oncologic and psychotherapeutic/psychiatric care. The prompt implementation of a standardized suicidality screening following diagnosis should be considered, particularly if the affected individuals present with any of the aforementioned risk factors.
Further studies should focus on the role of smoking and depressive symptoms on suicidality among lung cancer patients.
Author Contributions
L.H. was responsible for conceptualization, data curation, formal analysis, project administration, investigation, methodology, resources, validation, visualization and writing (original draft and writing, review and editing). M.H. was responsible for conceptualization, data curation, formal analysis, investigation, methodology, resources, visualization, software and writing (review and editing). H.B. was responsible for conceptualization, data curation, formal analysis, investigation, methodology, resources, software, supervision, validation, visualization and writing (review and editing). P.M.K. was responsible for conceptualization and writing (review and editing). B.L. was responsible for conceptualization and writing (review and editing). H.K. performed conceptualization, investigation, resources and writing (review and editing). M.F.L. was responsible for conceptualization, methodology, supervision and writing (review and editing). C.S. performed conceptualization, investigation, methodology, resources, project administration, supervision, validation and writing (review and editing). All authors have read and agreed to the published version of the manuscript.
Funding
For the publication fee we acknowledge financial support by Deutsche Forschungsgemeinschaft within the funding program “Open Access Publicationskosten” as well as by Heidelberg University.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
Figure A1.
(a) Funnel plot for random effects meta-analysis including 23 risk estimates of suicide in lung cancer patients. p-value for Begg’s test = 0.7147; p-value for Egger’s test = 0.0214. (b) Funnel plot for random effects meta-analysis including 12 risk estimates of suicide in lung cancer patients. p-value for Begg’s test = 0.6384; p-value for Egger’s test = 0.3328.
Appendix B
Table A1.
Summary table of meta-regression tests.
Table A1.
Summary table of meta-regression tests.
| Co-Variable | SMR | 95% CI | p-Value | q-Value | |
|---|---|---|---|---|---|
| Sex | 0.03 | 0.38 | |||
| women | 3.32 | 2.92–3.78 | 0.61 | ||
| men | 3.27 | 2.71–3.95 | - | ||
| Stage | 0.027 | 0.38 | |||
| early stage cancer | 1.36 | 0.24–7.76 | 0.67 | ||
| late stage cancer | 4.68 | 1.28–17.14 | 0.27 | ||
| Region | 0.03 | 0.38 | |||
| USA | 4.17 | 3.88–4.48 | 0.15 | ||
| Europe | 2.67 | 2.05–3.47 | - | ||
| Asia | 3.31 | 2.50–4.39 | 0.38 | ||
| Time after diagnosis | <0.001 | <0.001 | |||
| Within 1 year after diagnosis | 5.00 | 4.11–6.08 | <0.001 | ||
| Later than 1 year after diagnosis | 1.52 | 1.21–1.91 | - | ||
| Age | 0.09 | 0.91 | |||
| >70 | 3.40 | 1.70–6.79 | 0.68 | ||
| 60–69 | 3.23 | 2.89–3.61 | 0.89 | ||
| <60 | 3.09 | 2.46–3.88 | - |
Results are presented for the overall test as well as the comparison of each category compared with the reference category (depicted by a dash ‘–’). p value is the summary effect of each subgroup in the meta-analysis; the q value is the false discovery rate-adjusted p value of the overall test corrected for multiple testing.
References
- Carlson, L.E.; Zelinski, E.L.; Toivonen, K.I.; Sundstrom, L.; Jobin, C.T.; Damaskos, P.; Zebrack, B. Prevalence of psychosocial distress in cancer patients across 55 North American cancer centers. J. Psychosoc. Oncol. 2019, 37, 5–21. [Google Scholar] [CrossRef] [PubMed]
- Krebber, A.M.; Buffart, L.M.; Kleijn, G.; Riepma, I.C.; de Bree, R.; Leemans, C.R.; Becker, A.; Brug, J.; van Straten, A.; Cuijpers, P.; et al. Prevalence of depression in cancer patients: A meta-analysis of diagnostic interviews and self-report instruments. Psychooncology 2014, 23, 121–130. [Google Scholar] [CrossRef] [PubMed]
- Mitchell, A.J.; Chan, M.; Bhatti, H.; Halton, M.; Grassi, L.; Johansen, C.; Meader, N. Prevalence of depression, anxiety, and adjustment disorder in oncological, haematological, and palliative-care settings: A meta-analysis of 94 interview-based studies. Lancet Oncol. 2011, 12, 160–174. [Google Scholar] [CrossRef] [PubMed]
- Heinrich, M.; Hofmann, L.; Baurecht, H.; Kreuzer, P.M.; Knüttel, H.; Leitzmann, M.F.; Seliger, C. Suicide risk and mortality among patients with cancer. Nat. Med. 2022, 28, 852–859. [Google Scholar] [CrossRef]
- Zabora, J.; Brintzenhofeszoc, K.; Curbow, B.; Hooker, C.; Piantadosi, S. The Prevalence of Psychological Distress by Cancer Site. Psycho-Oncol. 2001, 10, 19–28. [Google Scholar] [CrossRef]
- Ahn, E.; Shin, D.W.; Cho, S.I.; Park, S.; Won, Y.J.; Yun, Y.H. Suicide rates and risk factors among Korean cancer patients, 1993-2005. Cancer Epidemiol. Biomark. Prev. 2010, 19, 2097–2105. [Google Scholar] [CrossRef] [PubMed]
- Innos, K.; Rahu, K.; Rahu, M.; Baburin, A. Suicides among cancer patients in Estonia: A population-based study. Eur. J. Cancer 2003, 39, 2223–2228. [Google Scholar] [CrossRef]
- Oberaigner, W.; Sperner-Unterweger, B.; Fiegl, M.; Geiger-Gritsch, S.; Haring, C. Increased suicide risk in cancer patients in Tyrol/Austria. Gen. Hosp. Psychiatry 2014, 36, 483–487. [Google Scholar] [CrossRef]
- Saad, A.M.; Gad, M.M.; Al-Husseini, M.J.; AlKhayat, M.A.; Rachid, A.; Alfaar, A.S.; Hamoda, H.M. Suicidal death within a year of a cancer diagnosis: A population-based study. Cancer 2019, 125, 972–979. [Google Scholar] [CrossRef]
- Levi, F.; Bulliard, J.L.; La Vecchia, C. Suicide risk among incident cases of cancer in the Swiss Canton of Vaud. Oncology 1991, 48, 44–47. [Google Scholar] [CrossRef]
- Allebeck, P.; Bolund, C.; Ringback, G. Increased suicide rate in cancer patients. A cohort study based on the Swedish Cancer-Environment Register. J. Clin. Epidemiol. 1989, 42, 611–616. [Google Scholar] [CrossRef] [PubMed]
- Misono, S.; Weiss, N.S.; Fann, J.R.; Redman, M.; Yueh, B. Incidence of suicide in persons with cancer. J. Clin. Oncol. 2008, 26, 4731–4738. [Google Scholar] [CrossRef] [PubMed]
- Torre, L.A.; Bray, F.; Siegel, R.L.; Ferlay, J.; Lortet-Tieulent, J.; Jemal, A. Global cancer statistics, 2012. CA Cancer J. Clin. 2015, 65, 87–108. [Google Scholar] [CrossRef] [PubMed]
- Noone, A.M.H.N.; Krapcho, M.; Miller, D.; Brest, A.; Yu, M.; Ruhl, J.; Tatalovich, Z.; Mariotto, A.; Lewis, D.R.; Chen, H.S.; et al. SEER Cancer Statistics Review, 1975–2015; National Cancer Institute: Bethesda, MD, USA, 2017.
- Latimer, K.; Mott, T. Lung cancer: Diagnosis, treatment principles, and screening. Am. Fam. Phys. 2015, 91, 250–256. [Google Scholar]
- Rahouma, M.; Kamel, M.; Abouarab, A.; Eldessouki, I.; Nasar, A.; Harrison, S.; Lee, B.; Shostak, E.; Morris, J.; Stiles, B.; et al. Lung cancer patients have the highest malignancy-associated suicide rate in USA: A population-based analysis. Ecancermedicalscience 2018, 12, 859. [Google Scholar] [CrossRef] [PubMed]
- McGowan, J.; Sampson, M.; Salzwedel, D.M.; Cogo, E.; Foerster, V.; Lefebvre, C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J. Clin. Epidemiol. 2016, 75, 40–46. [Google Scholar] [CrossRef]
- Stroup, D.F.; Berlin, J.A.; Morton, S.C.; Olkin, I.; Williamson, G.D.; Rennie, D.; Moher, D.; Becker, B.J.; Sipe, T.A.; Thacker, S.B. Meta-analysis of observational studies in epidemiology: A proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. Jama 2000, 283, 2008–2012. [Google Scholar] [CrossRef] [PubMed]
- Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef]
- Rethlefsen, M.L.; Kirtley, S.; Waffenschmidt, S.; Ayala, A.P.; Moher, D.; Page, M.J.; Koffel, J.B. PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst. Rev. 2021, 10, 1–19. [Google Scholar] [CrossRef]
- Bramer, W.M.; Giustini, D.; de Jonge, G.B.; Holland, L.; Bekhuis, T. De-duplication of database search results for systematic reviews in EndNote. J. Med. Libr. Assoc. JMLA 2016, 104, 240–243. [Google Scholar] [CrossRef]
- Wells, G.; Shea, B.; OConnell, D.L.; Peterson, J.; Welch Losos, M.; Tugwell, P. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses. 2014. Available online: https://www.semanticscholar.org/paper/The-Newcastle-Ottawa-Scale-(NOS)-for-Assessing-the-Wells-Wells/c293fb316b6176154c3fdbb8340a107d9c8c82bf (accessed on 1 August 2022).
- Lunny, C.; Pieper, D.; Thabet, P.; Kanji, S. Managing overlap of primary study results across systematic reviews: Practical considerations for authors of overviews of reviews. BMC Med. Res. Methodol. 2021, 21, 140. [Google Scholar] [CrossRef]
- Cohen, G.R.; Yang, S.Y. Mid-P confidence intervals for the Poisson expectation. Stat. Med. 1994, 13, 2189–2203. [Google Scholar] [CrossRef] [PubMed]
- Viechtbauer, W. Conducting Meta-Analyses in R with the metafor Package. J. Stat. Softw. 2010, 36, 1–48. [Google Scholar] [CrossRef]
- Benjamini, Y.; Hochberg, Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J. R. Stat. Soc. Ser. B (Methodol.) 1995, 57, 289–300. [Google Scholar] [CrossRef]
- Begg, C.B.; Mazumdar, M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994, 50, 1088–1101. [Google Scholar] [CrossRef] [PubMed]
- Egger, M.; Davey Smith, G.; Schneider, M.; Minder, C. Bias in meta-analysis detected by a simple, graphical test. Bmj 1997, 315, 629–634. [Google Scholar] [CrossRef]
- R Development Core Team, R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2018.
- Allebeck, P.; Bolund, C. Suicides and suicide attempts in cancer patients. Psychol. Med. 1991, 21, 979–984. [Google Scholar] [CrossRef]
- Hem, E.; Loge, J.H.; Haldorsen, T.; Ekeberg, O. Suicide risk in cancer patients from 1960 to 1999. J. Clin. Oncol. 2004, 22, 4209–4216. [Google Scholar] [CrossRef]
- Kaceniene, A.; Krilaviciute, A.; Kazlauskiene, J.; Bulotiene, G.; Smailyte, G. Increasing suicide risk among cancer patients in Lithuania from 1993 to 2012, a cancer registry-based study. Eur. J. Cancer Prev. 2017, 26, S197–S203. [Google Scholar] [CrossRef]
- Lin, P.H.; Liao, S.C.; Chen, I.M.; Kuo, P.H.; Shan, J.C.; Lee, M.B.; Chen, W.J. Impact of universal health coverage on suicide risk in newly diagnosed cancer patients: Population-based cohort study from 1985 to 2007 in Taiwan. Psycho-Oncol. 2017, 26, 1852–1859. [Google Scholar] [CrossRef]
- Louhivuori, K.A.; Hakama, M. Risk of suicide among cancer patients. Am. J. Epidemiol. 1979, 109, 59–65. [Google Scholar] [CrossRef]
- Smailyte, G.; Jasilionis, D.; Kaceniene, A.; Krilaviciute, A.; Ambrozaitiene, D.; Stankuniene, V. Suicides among cancer patients in Lithuania: A population-based census-linked study. Cancer Epidemiol. 2013, 37, 714–718. [Google Scholar] [CrossRef]
- Urban, D.; Rao, A.; Bressel, M.; Neiger, D.; Solomon, B.; Mileshkin, L. Suicide in lung cancer: Who is at risk? Chest 2013, 144, 1245–1252. [Google Scholar] [CrossRef]
- Vyssoki, B.; Gleiss, A.; Rockett, I.R.; Hackl, M.; Leitner, B.; Sonneck, G.; Kapusta, N.D. Suicide among 915,303 Austrian cancer patients: Who is at risk? J. Affect. Disord. 2015, 175, 287–291. [Google Scholar] [CrossRef] [PubMed]
- Zaorsky, N.G.; Zhang, Y.; Tuanquin, L.; Bluethmann, S.M.; Park, H.S.; Chinchilli, V.M. Suicide among cancer patients. Nat. Commun. 2019, 10, 207. [Google Scholar] [CrossRef] [PubMed]
- Abdel-Rahman, O. Socioeconomic predictors of suicide risk among cancer patients in the United States: A population-based study. Cancer Epidemiol. 2019, 63, 101601. [Google Scholar] [CrossRef] [PubMed]
- Kumar, V.; Chaudhary, N.; Soni, P.; Jha, P. Suicide rates in cancer patients in the current era in United States. Am. J. Psychiatry Resid. J. 2017, 12, 11–14. [Google Scholar] [CrossRef]
- Oh, C.M.; Lee, D.; Kong, H.J.; Lee, S.; Won, Y.J.; Jung, K.W.; Cho, H. Causes of death among cancer patients in the era of cancer survivorship in Korea: Attention to the suicide and cardiovascular mortality. Cancer Med. 2020, 9, 1741–1752. [Google Scholar] [CrossRef]
- Henson, K.E.; Brock, R.; Charnock, J.; Wickramasinghe, B.; Will, O.; Pitman, A. Risk of Suicide After Cancer Diagnosis in England. JAMA Psychiatry 2019, 76, 51–60. [Google Scholar] [CrossRef]
- Tanaka, H.; Tsukuma, H.; Masaoka, T.; Ajiki, W.; Koyama, Y.; Kinoshita, N.; Hasuo, S.; Oshima, A. Suicide risk among cancer patients: Experience at one medical center in Japan, 1978–1994. Jpn. J. Cancer Res. 1999, 90, 812–817. [Google Scholar] [CrossRef]
- Kaceniene, A.; Danila, E.; Cicenas, S.; Smailyte, G. Suicide risk among lung cancer patients in Lithuania. Clin. Respir. J. 2018, 12, 2455–2456. [Google Scholar] [CrossRef]
- De Angelis, R.; Sant, M.; Coleman, M.P.; Francisci, S.; Baili, P.; Pierannunzio, D.; Trama, A.; Visser, O.; Brenner, H.; Ardanaz, E.; et al. Cancer survival in Europe 1999–2007 by country and age: Results of EUROCARE--5-a population-based study. Lancet Oncol. 2014, 15, 23–34. [Google Scholar] [CrossRef] [PubMed]
- Haas, M. Contemporary Issues in Lung Cancer; Jones & Bartlett Learning: Burlington, MA, USA, 2010. [Google Scholar]
- Beckles, M.A.; Spiro, S.G.; Colice, G.L.; Rudd, R.M. Initial evaluation of the patient with lung cancer: Symptoms, signs, laboratory tests, and paraneoplastic syndromes. Chest 2003, 123, 97s–104s. [Google Scholar] [CrossRef]
- Schag, C.A.C.; Ganz, P.A.; Wing, D.S.; Sim, M.S.; Lee, J.J. Quality of life in adult survivors of lung, colon and prostate cancer. Qual. Life Res. 1994, 3, 127–141. [Google Scholar] [CrossRef] [PubMed]
- Hewitt, M.; Rowland, J.H.; Yancik, R. Cancer survivors in the United States: Age, health, and disability. J. Gerontol. A Biol. Sci. Med. Sci. 2003, 58, 82–91. [Google Scholar] [CrossRef] [PubMed]
- Spoletini, I.; Gianni, W.; Caltagirone, C.; Madaio, R.; Repetto, L.; Spalletta, G. Suicide and cancer: Where do we go from here? Crit. Rev. Oncol. Hematol. 2011, 78, 206–219. [Google Scholar] [CrossRef] [PubMed]
- LoConte, N.K.; Else-Quest, N.M.; Eickhoff, J.; Hyde, J.; Schiller, J.H. Assessment of guilt and shame in patients with non-small-cell lung cancer compared with patients with breast and prostate cancer. Clin. Lung Cancer 2008, 9, 171–178. [Google Scholar] [CrossRef]
- West, E.; Barron, D.N.; Reeves, R. Overcoming the barriers to patient-centred care: Time, tools and training. J. Clin. Nurs. 2005, 14, 435–443. [Google Scholar] [CrossRef]
- Valente, S.M. Oncology nurses’ knowledge of suicide evaluation and prevention. Cancer Nurs. 2010, 33, 290–295. [Google Scholar] [CrossRef] [PubMed]
- Chapple, A.; Ziebland, S.; McPherson, A. Stigma, shame, and blame experienced by patients with lung cancer: Qualitative study. Bmj 2004, 328, 1470. [Google Scholar] [CrossRef]
- Weiss, J.; Yang, H.; Weiss, S.; Rigney, M.; Copeland, A.; King, J.C.; Deal, A. Stigma, self-blame, and satisfaction with care among patients with lung cancer. J. Psychosoc. Oncol. 2017, 35, 166–179. [Google Scholar] [CrossRef]
- Glynn, R.W.; Kelly, J.C.; Coffey, N.; Sweeney, K.J.; Kerin, M.J. The effect of breast cancer awareness month on internet search activity--a comparison with awareness campaigns for lung and prostate cancer. BMC Cancer 2011, 11, 442. [Google Scholar] [CrossRef]
- Cataldo, J.K.; Brodsky, J.L. Lung cancer stigma, anxiety, depression and symptom severity. Oncology 2013, 85, 33–40. [Google Scholar] [CrossRef] [PubMed]
- Kapusta, N.; Sonneck, G. Suicides in Austria: Update on present state and recent trends. Neuropsychiatrie 2012, 26, 103–105. [Google Scholar] [CrossRef]
- Liu, N.S.; Spitz, M.R.; Kemp, B.L.; Cooksley, C.; Fossella, F.V.; Lee, J.S.; Hong, W.K.; Khuri, F.R. Adenocarcinoma of the lung in young patients: The MD Anderson experience. Cancer Interdiscip. Int. J. Am. Cancer Soc. 2000, 88, 1837–1841. [Google Scholar] [CrossRef]
- Akechi, T.; Okuyama, T.; Akizuki, N.; Azuma, H.; Sagawa, R.; Furukawa, T.A.; Uchitomi, Y. Course of psychological distress and its predictors in advanced non-small cell lung cancer patients. Psycho-Oncol. 2006, 15, 463–473. [Google Scholar] [CrossRef] [PubMed]
- Kantarjian, H.; Steensma, D.; Rius Sanjuan, J.; Elshaug, A.; Light, D. High cancer drug prices in the United States: Reasons and proposed solutions. J. Oncol. Pract. 2014, 10, e208–e211. [Google Scholar] [CrossRef]
- Kantarjian, H. Does the United States have the best health-care system in the world? ASCO Post 2014, 5, 1. [Google Scholar]
- Light, D.W.; Lexchin, J. Foreign free riders and the high price of US medicines. Bmj 2005, 331, 958–960. [Google Scholar] [CrossRef]
- Davis, K.; Stremikis, K.; Schoen, C.; Squires, D. Mirror, mirror on the wall, 2014 update: How the US health care system compares internationally. Commonw. Fund 2014, 16, 1–15. [Google Scholar] [CrossRef]
- Nolte, E.; McKee, M. Variations in amenable mortality—Trends in 16 high-income nations. Health Policy 2011, 103, 47–52. [Google Scholar] [CrossRef] [PubMed]
- Hillner, B.E.; Smith, T.J. Efficacy does not necessarily translate to cost effectiveness: A case study in the challenges associated with 21st-century cancer drug pricing. J. Clin. Oncol. 2009, 27. [Google Scholar] [CrossRef] [PubMed]
- Riley, G.F.; Potosky, A.L.; Lubitz, J.D.; Kessler, L.G. Medicare Payments from Diagnosis to Death for Elderly Cancer Patients by Stage at Diagnosis. Med. Care 1995, 33, 828–841. [Google Scholar] [CrossRef] [PubMed]
- Lang, H.-C.; Wu, S.-L. Lifetime costs of the top five cancers in Taiwan. Eur. J. Health Econ. 2012, 13, 347–353. [Google Scholar] [CrossRef]
- Popper, H.H. Progression and metastasis of lung cancer. Cancer Metastasis Rev. 2016, 35, 75–91. [Google Scholar] [CrossRef]
- Akechi, T.; Okamura, H.; Nishiwaki, Y.; Uchitomi, Y. Predictive factors for suicidal ideation in patients with unresectable lung carcinoma. Cancer 2002, 95, 1085–1093. [Google Scholar] [CrossRef]
- Shen, K.; Xu, Y.; Guan, H.; Zhong, W.; Chen, M.; Zhao, J.; Li, L.; Wang, M. Paraneoplastic limbic encephalitis associated with lung cancer. Sci. Rep. 2018, 8, 6792. [Google Scholar] [CrossRef]
- Tüzün, E.; Dalmau, J. Limbic Encephalitis and Variants: Classification, Diagnosis and Treatment. Neurol. 2007, 13, 261–271. [Google Scholar] [CrossRef]
- Radzikowska, E.; Głaz, P.; Roszkowski, K. Lung cancer in women: Age, smoking, histology, performance status, stage, initial treatment and survival. Population-based study of 20 561 cases. Ann. Oncol. 2002, 13, 1087–1093. [Google Scholar] [CrossRef]
- Sobue, T.; Yamamoto, S.; Hara, M.; Sasazuki, S.; Sasaki, S.; Tsugane, S.; JPHC Study Group; Japanese Public Health Center. Cigarette smoking and subsequent risk of lung cancer by histologic type in middle-aged Japanese men and women: The JPHC study. Int. J. Cancer 2002, 99, 245–251. [Google Scholar] [CrossRef]
- Sun, S.; Schiller, J.H.; Gazdar, A.F. Lung cancer in never smokers—A different disease. Nat. Rev. Cancer 2007, 7, 778–790. [Google Scholar] [CrossRef] [PubMed]
- Toh, C.K.; Gao, F.; Lim, W.T.; Leong, S.S.; Fong, K.W.; Yap, S.P.; Hsu, A.A.; Eng, P.; Koong, H.N.; Thirugnanam, A.; et al. Never-smokers with lung cancer: Epidemiologic evidence of a distinct disease entity. J. Clin. Oncol. 2006, 24, 2245–2251. [Google Scholar] [CrossRef]
- Khuder, S.A. Effect of cigarette smoking on major histological types of lung cancer: A meta-analysis. Lung Cancer 2001, 31, 139–148. [Google Scholar] [CrossRef] [PubMed]
- Milic, M.; Gazibara, T.; Pekmezovic, T.; Kisic Tepavcevic, D.; Maric, G.; Popovic, A.; Stevanovic, J.; Patil, K.H.; Levine, H. Tobacco smoking and health-related quality of life among university students: Mediating effect of depression. PLoS ONE 2020, 15, e0227042. [Google Scholar] [CrossRef] [PubMed]
- Farrell, M.; Howes, S.; Taylor, C.; Lewis, G.; Jenkins, R.; Bebbington, P.; Jarvis, M.; Brugha, T.; Gill, B.; Meltzer, H. Substance misuse and psychiatric comorbidity: An overview of the OPCS National Psychiatric Morbidity Survey. Addict. Behav. 1998, 23, 909–918. [Google Scholar] [CrossRef]
- McNeill, A. (Ed.) Symposium Report: Smoking and Mental Health Smoke-Fee London; 2001: Citeseer. Available online: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=54e6f90d69b2e3dd768c40600bac0f526f3a2b01 (accessed on 1 August 2022).
- de Leon, J.; Diaz, F.J. A meta-analysis of worldwide studies demonstrates an association between schizophrenia and tobacco smoking behaviors. Schizophr. Res. 2005, 76, 135–157. [Google Scholar] [CrossRef]
- Caldwell, C.B.; Gottesman, I.I. Schizophrenics kill themselves too: A review of risk factors for suicide. Schizophr. Bull 1990, 16, 571–589. [Google Scholar] [CrossRef]
- Bronisch, T.; Höfler, M.; Lieb, R. Smoking predicts suicidality: Findings from a prospective community study. J. Affect. Disord. 2008, 108, 135–145. [Google Scholar] [CrossRef]
- Gandini, S.; Botteri, E.; Iodice, S.; Boniol, M.; Lowenfels, A.B.; Maisonneuve, P.; Boyle, P. Tobacco smoking and cancer: A meta-analysis. Int. J. Cancer 2008, 122, 155–164. [Google Scholar] [CrossRef]
- Carter, B.W.; Glisson, B.S.; Truong, M.T.; Erasmus, J.J. Small Cell Lung Carcinoma: Staging, Imaging, and Treatment Considerations. Radio Graph. 2014, 34, 1707–1721. [Google Scholar] [CrossRef]
- Hodkinson, P.S.; Mackinnon, A.C.; Sethi, T. Extracellular matrix regulation of drug resistance in small-cell lung cancer. Int. J. Radiat. Biol. 2007, 83, 733–741. [Google Scholar] [CrossRef]
- Sculier, J.-P.; Chansky, K.; Crowley, J.J.; Van Meerbeeck, J.; Goldstraw, P. The Impact of Additional Prognostic Factors on Survival and their Relationship with the Anatomical Extent of Disease Expressed by the 6th Edition of the TNM Classification of Malignant Tumors and the Proposals for the 7th Edition. J. Thorac. Oncol. 2008, 3, 457–466. [Google Scholar] [CrossRef] [PubMed]
- Van der Sluis, J.; Van Praag, M.; Vijverberg, W. Entrepreneurship selection and performance: A meta-analysis of the impact of education in developing economies. World Bank Econ. Rev. 2005, 19, 225–261. [Google Scholar] [CrossRef]
- Havránek, T. Measuring intertemporal substitution: The importance of method choices and selective reporting. J. Eur. Econ. Assoc. 2015, 13, 1180–1204. [Google Scholar] [CrossRef]
- Stanley, T.D. New wine in old bottles: A meta-analysis of Ricardian equivalence. South. Econ. J. 1998, 64, 713–727. [Google Scholar] [CrossRef]
- Van den Noortgate, W.; López-López, J.A.; Marín-Martínez, F.; Sánchez-Meca, J. Meta-analysis of multiple outcomes: A multilevel approach. Behav. Res. Methods 2015, 47, 1274–1294. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).