Abstract
Background: Atrial fibrillation (AF) significantly contributes to acute ischemic stroke, with undetected AF being a common culprit in cryptogenic strokes. N-terminal pro-B-type natriuretic peptide (NT-proBNP), indicative of myocardial stress, has been proposed as a biomarker for AF detection, aiding in the selection of patients for extended cardiac monitoring. However, the diagnostic accuracy of NT-proBNP remains uncertain. Methods: We conducted a meta-analysis to evaluate the diagnostic accuracy of NT-proBNP in detecting AF among cryptogenic stroke patients. A comprehensive literature search was conducted across PubMed, Embase, and Cochrane databases to identify relevant studies. Studies reporting NT-proBNP levels in stroke patients and data on the proportion of patients with AF above a specified cut-off were included. Meta-analyses were performed using the midas command in STATA. Results: Seven studies encompassing 2171 patients were included in the analysis, of which five studies contained cohorts with cryptogenic strokes. Among patients with cryptogenic stroke, NT-proBNP demonstrated a diagnostic accuracy of 80% (Area Under the Receiver Operating Curve 0.80 [95% CI 0.76–0.83]), with a sensitivity of 81% (95% CI 0.68–0.89) and a specificity of 68% (95% CI 0.60–0.75). Conclusion: Our meta-analysis indicates that NT-proBNP exhibits a good-to-very-good diagnostic accuracy for detecting AF in patients with cryptogenic stroke. These findings suggest potential implications for utilizing NT-proBNP in guiding the selection of patients for prolonged cardiac monitoring, thereby aiding in the management of cryptogenic stroke cases.
1. Introduction
Atrial fibrillation (AF) stands as a prevalent cardiac arrhythmia globally, significantly contributing to both morbidity and mortality [1]. It manifests as an irregularly irregular heart rhythm, categorized as paroxysmal, persistent, or permanent [2]. The pathophysiology of AF is multifaceted, involving cardiac remodeling leading to structural and electrical changes [3]. Additionally, AF correlates with various cardiovascular conditions, such as hypertension, valvular heart disease, and coronary heart disease, alongside risk factors like diabetes and smoking [3,4].
Among the primary concerns in AF patients lies the risk of acute ischemic stroke, attributed to vascular stasis potentially culminating in left atrial thrombus formation and subsequent embolization to the brain [5]. Ischemic stroke is a major cause of disability and is a prominent contributor to the global burden of disease [6]. As part of routine assessment, ischemic stroke patients undergo electrocardiography (ECG) to detect underlying AF [7]. In cases where AF is identified, oral anticoagulant therapy is recommended to mitigate stroke recurrence [8]. This recommendation holds particular relevance for patients with cryptogenic stroke, a subset of ischemic stroke where the stroke’s cause remains unidentified despite investigation [9]. In this subset, studies utilizing implantable cardiac monitors (ICMs) have revealed AF detection rates ranging from 26 to 36% after at least a year of monitoring [10,11]. However, the logistical and economic challenges of long-term ICM monitoring pose limitations in its widespread application among cryptogenic stroke patients [12]. Consequently, there is considerable interest in biomarkers capable of predicting AF post-stroke, facilitating patient stratification for prolonged cardiac monitoring [13].
One such potential biomarker is the N-terminal pro-B-type natriuretic peptide (NT-proBNP), released by atrial and ventricular cardiomyocytes in response to various stimuli such as myocardial wall stress, ischemia, and volume overload [14,15]. Upon cleavage into the biologically active B-type natriuretic peptide (BNP), it induces vasodilation, increased fluid excretion, and inhibition of the renin-angiotensin-aldosterone system (RAAS) [14]. While NT-proBNP and BNP biomarkers are currently employed to assess heart failure, particularly in emergency settings, to rule out cardiac cause of dyspnea [14], there is growing interest in their utility for AF diagnosis, especially in the context of stroke [16].
Though several studies have explored the efficacy of these biomarkers in detecting AF post-stroke [13,17,18,19,20,21,22], results have been variable, leaving the true accuracy uncertain. A meta-analysis presents a valuable opportunity to combine these studies, thereby examining diagnostic accuracy comprehensively. Given NT-proBNP’s longer half-life compared to BNP (120 min vs. 20 min) [14,15], coupled with reported higher diagnostic accuracy for AF [16], our study focuses on NT-proBNP.
This meta-analysis aims to investigate the diagnostic accuracy of NT-proBNP in detecting AF following stroke, particularly in cryptogenic stroke patients. Diagnostic accuracy parameters such as sensitivity, specificity, and the Area Under the Receiver Operating Curve (AUROC) will be analyzed. Additionally, we will compare NT-proBNP accuracy in cohorts where the stroke’s etiology is known, serving as a comparative measure. Our primary research questions are the following:
- What is the diagnostic accuracy of NT-proBNP in detecting AF in patients with cryptogenic stroke? (As a secondary aim, we will investigate NT-proBNP accuracy in cohorts where the stroke’s etiology is established, thus formulating our secondary research question).
- What is the diagnostic accuracy of NT-proBNP in detecting AF in patients with stroke of known etiology?
2. Methods
2.1. Literature Search: Identification and Selection of Studies
We selected studies from the databases of PubMed, Embase, and Cochrane. We obtained additional studies from Google Scholar and conducted hand searching within the references of other studies. The PRISMA flowchart illustrates the process of study identification and screening, providing the number of studies at each stage and the reasons for study exclusion (Figure 1). Details of the keywords and filters used can be found in Supplemental Information (Search Strategy). We conducted this study following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and adhered to the Meta-analysis of Observational Studies in Epidemiology (MOOSE) checklist (Supplemental Tables S1 and S2), as well as the Standards for Reporting Diagnostic Accuracy Studies (STARD) 2015 guidelines (Supplementary Table S3). This study was registered in Open Science, registration number “pn27u” (https://osf.io/pn27u/ (accessed on 24 March 2024).
Figure 1.
PRISMA flowchart depicting the process of study identification, screening, and inclusion. Abbreviations: N = number of studies, n = total number of patients, AF = atrial fibrillation, NT-proBNP = N-terminal pro-B-type natriuretic peptide.
2.2. Inclusion and Exclusion Criteria
The study’s inclusion criteria encompassed (1) patients diagnosed with acute ischemic stroke; (2) patients aged 18 years and above; (3) a defined cut-off value for high NT-proBNP levels; (4) availability of data on the number of AF and non-AF patients with NT-proBNP levels above and below the cut-off; and (5) studies with robust methodological design, requiring a minimum sample size of 20 patients. Studies meeting these criteria were included, while those failing to meet these conditions were excluded. Criteria for exclusion included (1) animal studies; (2) inaccessible studies where the complete report could not be retrieved; (3) studies published in languages other than English; and (4) studies sourced from the same database as another included study in the meta-analysis.
2.3. Data Extraction
Data extraction involved screening the titles and abstracts of identified studies using EndNote 20.6 (Clarivate, Philadelphia, PA, USA). Studies that did not align with the specified inclusion and exclusion criteria were excluded at this stage. From studies passing this initial screening, full texts were retrieved when feasible, and eligibility was further assessed. This screening process was conducted independently by two authors, with any disagreements resolved through discussion until consensus was achieved.
From the studies included in the meta-analysis, data were extracted and organized into a comprehensive spreadsheet. This spreadsheet documented the following information: (1) study characteristics (author, title, year, country, study type); (2) stroke cohort (cryptogenic stroke or stroke of known origin); (3) basic patient characteristics (number of means, mean age, proportion of male sex); (4) prevalence of comorbidities (hypertension, diabetes, dyslipidemia, smoking); (5) NT-proBNP cut-off level; and (6) number of AF and non-AF patients with NT-proBNP levels above and below the cut-off, necessary for sensitivity and specificity calculations. In instances where age was reported using the median and interquartile range (with a clearly stated value for the upper and lower quartile), the mean age and standard deviation were estimated using the method described by Wan et al. [23].
2.4. Methodological Quality Assessment of Included Studies
To assess the methodological quality of the studies in the meta-analysis, we evaluated each study using the criteria outlined in the modified Jadad scale [24]. This included considering factors such as randomization and blinding, as well as clear descriptions of the inclusion and exclusion criteria and the statistical analysis method. The complete criteria and evaluation for each study are detailed in Supplementary Table S4. Additionally, we investigated the potential for funding bias by examining the presence of industry funding and conflicts of interest among authors. The evaluation of funding bias is also provided in Supplementary Table S4.
2.5. Statistical Analyses
We utilized STATA (Version 13.0, StataCorp, College Station, TX, USA) for statistical analyses. We analyzed the diagnostic accuracy of NT-proBNP in identifying AF following stroke through meta-analyses. These meta-analyses were conducted when at least four studies were available for a given analysis. We employed the midas package in STATA for these analyses. The required data for this command included (1) true positives or “tp” (number of patients with NT-proBNP levels above the cut-off diagnosed with AF); (2) false positives for “fp” (number of patients with NT-proBNP levels above the cut-off but without AF); (3) false negatives or “fn” (number of patients with NT-proBNP levels below the cut-off but with AF); and (4) true negatives or “tn” (number of patients with NT-proBNP levels below the cut-off without AF).
With these data, the midas package in STATA calculated the sensitivity and specificity of each study. It also combined these data to provide pooled sensitivity and specificity and constructed forest plots. We generated summary receiver operating characteristic (SROC) curves and assessed the AUROC as an overall measure of diagnostic accuracy. A well-established definition was used to describe the relationship between AUROC, and diagnostic accuracy, whereby an AUROC of 0.9–1 represents excellent diagnostic accuracy, an AUROC of 0.8–0.9 is very good diagnostic accuracy, an AUROC of 0.7–0.8 is good, an AUROC of 0.6–0.7 is sufficient, an AUROC 0.5–0.6 is bad diagnostic accuracy, and an AUROC less than 0.5 suggests that a diagnostic accuracy test is not useful [25]. The STATA output additionally provided information regarding positive and negative likelihood ratios alongside graphs representing the likelihood matrix. For all analyses in this study, we considered p-values less than 0.05 as statistically significant. Heterogeneity was assessed using the I2 statistic, where values of 0–40%, 30–60%, 50–90%, and 75–100% represented low, moderate, substantial, and considerable heterogeneity, respectively [26].
3. Results
3.1. Results of the Search
The search across PubMed, Embase, and Cochrane databases yielded 431 studies, as outlined in the PRISMA flowchart (Figure 1). Additionally, 29 studies were sourced from Google Scholar, and 9 were identified through manual citation searching within previous studies. Following the removal of duplicates, titles, and abstracts, 332 studies were screened using EndNote. Among these, 23 were found to approximately align with our study criteria, and full-text reports of 21 studies were obtained. These 21 studies underwent rigorous screening to assess their alignment with our study’s inclusion and exclusion criteria. Fourteen studies were excluded, with reasons detailed in the PRISMA flowchart (Figure 1). Consequently, seven studies met the criteria for inclusion in our systematic review and meta-analysis.
3.2. Description of the Included Studies
This meta-analysis comprised seven studies [13,17,18,19,20,21,22], encompassing a total of 2171 patients. Of these, five studies [13,17,19,20,21] focused on assessing the diagnostic accuracy of NT-proBNP in detecting AF among patients with cryptogenic stroke, while four studies [13,18,19,22] evaluated its diagnostic accuracy in patients with stroke of known origin. Table 1 presents the baseline characteristics of the studies within the meta-analysis, encompassing study type, country, sex distribution, mean age, and the AF detection method employed in each study. Table 2 provides additional information on the prevalence of various comorbidities within each cohort. A summary of the sensitivities and specificities observed in each individual study cohort is provided in Table 3. Additionally, Table 4 provides a detailed overview of the outcomes derived from the diagnostic accuracy meta-analyses conducted for cohorts of patients with cryptogenic stroke and those with stroke of known origin.
Table 1.
Baseline Characteristics of Studies Included in the Meta-analysis.
Table 2.
Prevalence Rates of Comorbidities among Studies Included in the Meta-analysis.
Table 3.
Sensitivity and Specificity of NT-proBNP in Detecting AF within Each Individual Study Cohort.
Table 4.
Meta-analysis Summary of NT-proBNP Diagnostic Accuracy in AF Detection Post-stroke.
3.3. Diagnostic Accuracy of NT-proBNP in Detecting Atrial Fibrillation in Patients with Cryptogenic Stroke
Five studies investigated the diagnostic accuracy of NT-proBNP in detecting AF in patients with cryptogenic stroke [13,17,19,20,21], encompassing 1097 patients (Figure 2). The meta-analysis revealed a good-to-very-good diagnostic accuracy of 80% (AUROC 0.80 [95% CI 0.76–0.83]). NT-proBNP demonstrated a pooled diagnostic sensitivity of 81% (Sensitivity 0.81 [95% CI 0.68–0.89]) and a pooled diagnostic specificity of 68% (Specificity 0.68 [95% CI 0.60–0.75]). The SROC curve can be found in Supplementary Figure S1. Moderate heterogeneity was observed for the test of sensitivity (I2 = 47.99, [95% CI 0.00–100.00]), and substantial-to-considerable heterogeneity for the test of specificity (I2 = 83.02, [95% CI 69.03–97.01]).
Figure 2.
Pooled diagnostic sensitivity and specificity of NT-proBNP in detecting AF in patients with cryptogenic stroke [13,17,19,20,21]. Abbreviations: NT-proBNP = N-terminal pro-B-type natriuretic peptide, CI = confidence interval.
3.4. Diagnostic Accuracy of NT-proBNP in Detecting Atrial Fibrillation in Patients with Stroke of Known Etiology
In patients with stroke of known etiology, four studies involving 1074 patients (Figure 3) explored the diagnostic accuracy of NT-proBNP in detecting AF [13,18,19,22]. The meta-analysis indicated an excellent diagnostic accuracy of 91% (AUROC 0.91 [95% CI 0.88–0.93]). NT-proBNP exhibited a pooled diagnostic sensitivity of 95% (Sensitivity 0.95 [95% CI 0.90–0.97]) and a pooled diagnostic specificity of 75% (Specificity 0.75 [95% CI 0.69–0.80]). The SROC curve, likelihood ratio matrix, and goodness of fit plots can be found in Supplementary Figures S1, S2, and S3, respectively. Moderate heterogeneity was observed for the test of sensitivity (I2 = 40.67, [95% CI 0.00–100.00]), and moderate-to-substantial heterogeneity for the test of specificity (I2 = 57.99, [95% CI 11.72–100.00]).
Figure 3.
Pooled diagnostic sensitivity and specificity of NT-proBNP in detecting AF in patients with stroke of known etiology [13,18,19,22]. Abbreviations: NT-proBNP = N-terminal pro-B-type natriuretic peptide, CI = confidence interval.
4. Discussion
Pooling the current data, our study revealed that NT proBNP had a good-to-very-good diagnostic accuracy for detecting AF following cryptogenic stroke. This may have promising applications in stratifying patients for cardiac monitoring. The sensitivity and specificity of NT-proBNP for AF detection were comparatively higher in patients with stroke of known etiology, possibly due to variations in AF subtypes among different patient groups.
Our investigation builds upon the findings of a previous meta-analysis by Zhang et al. [16], which reported NT-proBNP’s sensitivity at 91% and specificity at 77% in detecting covert AF following stroke. However, our meta-analysis on cryptogenic stroke yielded lower sensitivity and specificity values, likely attributable to differences in the composition of included studies. Notably, our study incorporated three additional datasets concerning cryptogenic stroke [13,17,20], and one dataset from Fonseca et al. [19], previously analyzed within Zhang et al. [16]), was reassigned to the section focusing on stroke of known etiology. Additionally, we excluded the study by Sanak et al. [29] due to its restriction to patients under 50. Although investigating biomarker accuracy in younger patients holds importance, our inclusion criteria aimed to encompass all adults aged 18 and above without imposing additional age limits.
Our study contributes to the expanding body of evidence suggesting NT-proBNP holds potential as a biomarker for AF following cryptogenic stroke [16,19,30]. Offering a straightforward test, NT-proBNP empowers clinicians to evaluate each cryptogenic stroke patient’s likelihood of having underlying AF more precisely [21]. This capability proves invaluable in resource allocation, as those cryptogenic stroke patients deemed at a high risk of AF stand as prime candidates for extended cardiac monitoring, such as implantable loop recorders [21,31]. Recent findings from a randomized controlled trial further underscore the advantages of NT-proBNP, revealing that implantable loop-recorder screening correlates with a greater reduction in stroke risk among patients exhibiting higher NT-proBNP levels [31]. Ensuring thorough diagnostic investigation is imperative, given that detecting AF typically prompts a shift in secondary stroke-prevention strategy from antiplatelets to oral anticoagulants [19], known for their favorable efficacy and safety profile in AF patients [32]. A limitation of our meta-analysis is that there were inconsistencies in the timing of AF diagnosis post-enrolment in each study, and the duration of cardiac monitoring varied. The most common approach to AF detection was an ECG on admission and 24-h Holter monitoring; however, prolonged ECG monitoring outside the hospital was not always conducted. As a result, AF may have been underdiagnosed in some cases. Specific information on the AF detection strategies employed in each study is described in Table 1. In the era of reperfusion therapy, AF is an important clinical consideration as it mediates outcomes in acute ischemic stroke patients treated with intravenous thrombolysis [33]. This adds weight to the importance of NT-proBNP assessment, indicating that it may even be crucial in acutely prognosticating patients treated with reperfusion therapy.
Our study observed a higher diagnostic accuracy of NT-proBNP in patients with known etiology strokes than in those with cryptogenic strokes. This discrepancy likely stems from differences in AF subtypes between the two groups. Paroxysmal AF, known for its elusive detection compared to persistent or permanent AF [34], is presumed to be more prevalent in the cryptogenic stroke cohort than in patients with known etiology strokes [35]. Consequently, it is plausible that a larger proportion of patients in the cryptogenic stroke cohorts harbor undiagnosed paroxysmal AF. These patients may manifest as false positives in our analysis, potentially accounting for the comparatively lower specificity of 68%. To provide a more accurate assessment of NT-proBNP’s efficacy in cryptogenic stroke, future studies should extend the duration of cardiac monitoring to capture paroxysmal AF episodes better [36]. Moreover, a limitation lies in the variation in AF subtypes among different cohorts and inconsistent reporting of the number of patients with each subtype. Furthermore, the definition of cryptogenic stroke in each cohort (as described in Table 1) was not entirely consistent with the studies. Addressing these factors would enhance the precision and generalizability of our findings.
The elevation of NT-proBNP in AF patients primarily stems from increased stretching and stress on the myocardial wall [14]. Particularly, NT-proBNP levels are notably raised in AF patients with left atrial enlargement [37]. However, even in AF patients without left atrial enlargement, NT-proBNP levels remain higher than in non-AF patients, suggesting that the asynchronous myocardial stretches inherent in AF also contribute to NT-proBNP release [37]. Furthermore, NT-proBNP levels tend to decrease as the heart returns to sinus rhythm, resulting in lower levels in patients with paroxysmal AF compared to those with persistent or permanent AF [38]. This dynamic pattern reduces the effectiveness of NT-proBNP in cryptogenic stroke, where its primary potential lies in the risk stratification of patients with paroxysmal AF. A clinically significant entity is atrial cardiopathy, characterized by an elevated NT-proBNP and an increased stroke risk, often in the absence of AF [30,39]. In our study, these patients may have appeared as false positives, leading to an underestimation of specificity. Given that atrial cardiopathy frequently precedes AF, there remains uncertainty regarding the potential benefits of anticoagulation in these patients [30,39].
To improve the accuracy of NT-proBNP in clinical practice, researchers have explored several other biomarkers and clinical factors that can complement its diagnostic potential [30]. For instance, Kneihsl et al. [20] demonstrated that while NT-proBNP alone had a sensitivity of 58.3% in detecting AF following cryptogenic stroke, this sensitivity increased to 92% when integrating a risk score combining NT-proBNP with age and various indicators from brain imaging and echocardiography. Advanced machine learning algorithms may also aid in the prognostication of patients with suspected AF [40]. In addition to NT-proBNP, other biomarkers have been traditionally used; however, their efficacy in detecting AF has been variable and comparatively suboptimal for clinical use [41]. A detailed overview of these biomarkers is provided in Table 5.
Table 5.
Various Biomarkers and their Diagnostic Accuracy, Sensitivity, and Specificity in Identifying Atrial Fibrillation Following Cryptogenic Stroke.
Alongside blood-based biomarkers, growing evidence supports the role of clot morphology in determining the etiology of cryptogenic stroke [51,52,53]. Furthermore, standard cardiovascular laboratory parameters such as triglycerides and total cholesterol have also been shown to enhance the ability of NT-proBNP to distinguish between stroke of cardioembolic or large-artery atherosclerotic origin [54]. A recent prospective study also identified several biomarkers associated with AF in cryptogenic stroke patients [41]. Notably, NT-proBNP emerged as the robust predictor of AF at baseline and after 12-month follow-up [41]. Despite numerous proposals for tools or scores to assess the likelihood of AF post-stroke [17,20,55,56], a standardized system remains elusive. Similar to the CHA2DS2-VASc score’s role in guiding AF treatment [57], future research efforts could aim at developing a tool for AF detection. Our findings corroborate existing literature [20,39,41], suggesting that NT-proBNP could play a significant role in such a tool.
Limitations
Our study had several limitations. Primarily, we identified only five studies meeting the inclusion criteria for our analysis on cryptogenic stroke [13,17,19,20,21] and four studies for the analysis on stroke of known etiology [13,18,19,22]. The main reason for this limitation was the necessity to exclude studies where we could not precisely determine the number of AF and non-AF patients with NT-proBNP levels above and below the cut-offs. Some of these studies reported rounded-off values for sensitivity and specificity [41,58], which were not compatible with the raw numbers required as inputs for the midas command in STATA. Additionally, one study utilized the lower and upper NT-proBNP quartiles as cut-offs to create high-sensitivity and high-specificity models instead of opting for a cut-off that balanced both [44].
The variations in NT-proBNP cut-offs emerged as a major limitation of this study. There were considerable variations in NT-proBNP cut-offs in our study, ranging from 250 pg/mL to 505 pg/mL (Table 3). Theoretically, a lower cut-off (such as 250 pg/mL) would yield higher sensitivity for AF diagnosis but lower specificity, and vice versa for a higher cut-off (such as 505 pg/mL). Unfortunately, there were insufficient studies at these data points for us to conduct subgroup analyses, and determining the ideal cut-off remains an area for future primary research. It is also possible that there is no single “ideal” cut-off, as clinicians may benefit from considering patient demographics and resource availability to decide if a higher-specificity or higher-sensitivity approach is more suitable for their circumstances. Nevertheless, our data suggest that any NT-proBNP value within the range of 250 to 505 pg/mL provides reasonable sensitivity and specificity for AF detection post-stroke.
While we initially planned to conduct a meta-analysis to evaluate differences in the mean NT-proBNP levels between AF and non-AF patients in these studies, the necessary data for this analysis were often unavailable and occasionally reported as the median and interquartile range without providing the first and third quartiles. Unfortunately, the software required mean and standard deviation values. Another limitation is that our study only utilized a single measurement of NT-proBNP rather than tracking changes over time. This is crucial, as the stroke itself may influence NT-proBNP levels due to the release of pro-inflammatory cytokines [30]. Lastly, our analysis focused on diagnostic accuracy. Therefore, while we suggested that NT-proBNP may be useful in stratifying patients for prolonged cardiac monitoring, further research is necessary to investigate which cardiac monitoring forms are most suitable for these patients, considering patient outcomes and resource allocation.
5. Conclusions
In conclusion, our study emphasizes the rapid increase in NT-proBNP concentration following the onset of atrial fibrillation, reinforcing the utility of this biomarker in early detection and diagnosis. Our meta-analysis found that NT-proBNP demonstrates good-to-very-good diagnostic accuracy in detecting AF following cryptogenic stroke, with excellent accuracy observed in patients with stroke of known etiology. This meta-analysis updates and consolidates the data to assess the diagnostic accuracy of NT-proBNP in detecting AF in the context of stroke. An integrated approach combining NT-proBNP measurements with ECG telemetry, clinical factors, and imaging tests like transthoracic and transesophageal echocardiography is critical in identifying the cause of stroke and enhancing diagnostic accuracy. Although consensus on a standardized risk tool is still pending, from a clinical perspective, NT-proBNP holds promise in identifying cryptogenic stroke patients who would benefit from extended cardiac monitoring. Further primary research is warranted to determine the optimal cut-off for NT-proBNP and to identify the most effective form of cardiac monitoring for these patients.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/pathophysiology31030024/s1, Figure S1: Summary receiver operating character (SROC) for A (patients with cryptogenic stroke) and B (patients with stroke of known etiology); Figure S2: Likelihood ratio matrix for A (patients with cryptogenic stroke) and B (patients with stroke of known etiology); Figure S3: Goodness of fit for A (patients with cryptogenic stroke) and B (patients with stroke of known etiology); Table S1: Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 checklist; Table S2: Meta-analysis of Observational Studies in Epidemiology (MOOSE) checklist; Table S3: STARD-2015 Checklist for Diagnostic Accuracy Studies; Table S4: Methodological quality assessment of included studies using the modified Jadad scale and assessment of funding bias.
Author Contributions
S.M.M.B. conceived the study, contributed to the planning, draft, and revision of the manuscript, and supervision of the students. S.M.M.B. encouraged J.P. to investigate, and supervised the findings of this work. J.P. and S.M.M.B. wrote the first draft of this paper. All authors contributed to the revision of the manuscript. All authors have read and agreed to the published version of the manuscript.
Funding
No funding was received for organizing and conducting this study.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The original contributions presented in the study are included in the article and online Supplementary Information, and further inquiries can be directed to the corresponding author.
Acknowledgments
The author acknowledges the financial support received from the Grant-in-Aid for Scientific Research (KAKENHI) (PI: SMMB) by the Japan Society for the Promotion of Science (JSPS), Japanese Ministry of Education, Culture, Sports, Science, and Technology (MEXT). Additionally, we extend our gratitude to the JSPS International Fellowship, supported by MEXT and the Australian Academy of Science, awarded to SMMB for 2023-25. The author reports leadership or fiduciary roles on other boards or with societies, committees, or advocacy groups, paid or unpaid, including serving as Chair of Diversity, Equity, and Inclusion at Rotary District 9675 (Sydney, Australia), as a Founding Member, Chair, and Co-manager of the Global Health and Migration Hub Community at Global Health Hub Germany (Berlin, Germany), and Editorial Board Memberships of PLOS One, BMC Neurology, BMC Medical Research Methodology, Frontiers in Stroke, Frontiers in Neurology, Frontiers in Public Health, and Frontiers in Aging, all outside the submitted work. The funding body has no role in the study design, data collection, analysis, interpretation of findings, and manuscript preparation. The content is solely the responsibility of the authors and does not necessarily represent the official views of the affiliated/funding organization/s.
Conflicts of Interest
The authors have no relevant financial or non-financial interests to disclose.
Abbreviations
| AF | Atrial fibrillation |
| ECG | Electrocardiography |
| ICM | Implantable cardiac monitor |
| NT-proBNP | N-terminal pro-B-type natriuretic peptide |
| BNP | B-type natriuretic peptide |
| RAAS | Renin-angiotensin-aldosterone system |
| AUROC | Area Under the Receiver Operating Curve |
| PRISMA | Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
| MOOSE | Meta-analysis of Observational Studies in Epidemiology |
| STARD | Standards for Reporting Diagnostic Accuracy Studies |
| SROC | Summary receiver operating characteristic |
References
- Lippi, G.; Sanchis-Gomar, F.; Cervellin, G. Global epidemiology of atrial fibrillation: An increasing epidemic and public health challenge. Int. J. Stroke 2021, 16, 217–221. [Google Scholar] [CrossRef] [PubMed]
- Hindricks, G.; Potpara, T.; Dagres, N.; Arbelo, E.; Bax, J.J.; Blomström-Lundqvist, C.; Boriani, G.; Castella, M.; Dan, G.A.; Dilaveris, P.E.; et al. 2020 ESC Guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS): The Task Force for the diagnosis and management of atrial fibrillation of the European Society of Cardiology (ESC) Developed with the special contribution of the European Heart Rhythm Association (EHRA) of the ESC. Eur. Heart J. 2021, 42, 373–498. [Google Scholar] [CrossRef]
- Nesheiwat, Z.; Goyal, A.; Jagtap, M. Atrial Fibrillation. StatPearls 2023. Available online: https://www.ncbi.nlm.nih.gov/books/NBK568719/ (accessed on 24 March 2024).
- Chamberlain, A.M.; Agarwal, S.K.; Folsom, A.R.; Duval, S.; Soliman, E.Z.; Ambrose, M.; Eberly, L.E.; Alonso, A. Smoking and incidence of atrial fibrillation: Results from the Atherosclerosis Risk in Communities (ARIC) study. Heart Rhythm. 2011, 8, 1160–1166. [Google Scholar] [CrossRef]
- Kamel, H.; Okin, P.M.; Elkind, M.S.; Iadecola, C. Atrial Fibrillation and Mechanisms of Stroke: Time for a New Model. Stroke 2016, 47, 895–900. [Google Scholar] [CrossRef] [PubMed]
- Steinmetz, J.D.; Seeher, K.M.; Schiess, N.; Nichols, E.; Cao, B.; Servili, C.; Cavallera, V.; Cousin, E.; Hagins, H.; Moberg, M.E.; et al. Global, regional, and national burden of disorders affecting the nervous system, 1990–2021: A systematic analysis for the Global Burden of Disease Study 2021. Lancet Neurol. 2024, 23, 344–381. [Google Scholar] [CrossRef] [PubMed]
- Wasser, K.; Weber-Krüger, M.; Jürries, F.; Liman, J.; Hamann, G.F.; Kermer, P.; Uphaus, T.; Protsenko, E.; Seegers, J.; Mende, M.; et al. The cardiac diagnostic work-up in stroke patients-A subanalysis of the Find-AFRANDOMISED trial. PLoS ONE 2019, 14, e0216530. [Google Scholar] [CrossRef]
- Kleindorfer, D.O.; Towfighi, A.; Chaturvedi, S.; Cockroft, K.M.; Gutierrez, J.; Lombardi-Hill, D.; Kamel, H.; Kernan, W.N.; Kittner, S.J.; Leira, E.C.; et al. 2021 Guideline for the Prevention of Stroke in Patients With Stroke and Transient Ischemic Attack: A Guideline From the American Heart Association/American Stroke Association. Stroke 2021, 52, e364–e467. [Google Scholar] [CrossRef] [PubMed]
- Mac Grory, B.; Flood, S.P.; Apostolidou, E.; Yaghi, S. Cryptogenic Stroke: Diagnostic Workup and Management. Curr. Treat. Options Cardiovasc. Med. 2019, 21, 77. [Google Scholar] [CrossRef]
- Xu, J.; Sethi, P.; Biby, S.; Allred, J.; Seiler, A.; Sabir, R. Predictors of atrial fibrillation detection and features of recurrent strokes in patients after cryptogenic stroke. J. Stroke Cerebrovasc. Dis. 2020, 29, 104934. [Google Scholar] [CrossRef]
- Skrebelyte-Strøm, L.; Rønning, O.M.; Dahl, F.A.; Steine, K.; Kjekshus, H. Prediction of occult atrial fibrillation in patients after cryptogenic stroke and transient ischaemic attack: PROACTIA. Europace 2022, 24, 1881–1888. [Google Scholar] [CrossRef]
- Acampa, M.; Lazzerini, P.E.; Lattanzi, S.; Rubiera, M. Cryptogenic stroke as a working diagnosis: The need for an early and comprehensive diagnostic work-up. BMC Neurol. 2023, 23, 153. [Google Scholar] [CrossRef] [PubMed]
- Kneihsl, M.; Gattringer, T.; Bisping, E.; Scherr, D.; Raggam, R.; Mangge, H.; Enzinger, C.; Fandler-Höfler, S.; Eppinger, S.; Hermetter, C.; et al. Blood Biomarkers of Heart Failure and Hypercoagulation to Identify Atrial Fibrillation–Related Stroke. Stroke 2019, 50, 2223–2226. [Google Scholar] [CrossRef]
- Novack, M.L.; Zubair, M. Natriuretic Peptide B Type Test. StatPearls 2023. Available online: https://www.ncbi.nlm.nih.gov/books/NBK556136/ (accessed on 24 March 2024).
- Weber, M.; Hamm, C. Role of B-type natriuretic peptide (BNP) and NT-proBNP in clinical routine. Heart 2006, 92, 843–849. [Google Scholar] [CrossRef]
- Zhang, K.; Kamtchum-Tatuene, J.; Li, M.; Jickling, G.C. Cardiac natriuretic peptides for diagnosis of covert atrial fibrillation after acute ischaemic stroke: A meta-analysis of diagnostic accuracy studies. Stroke Vasc. Neurol. 2021, 6, 128–132. [Google Scholar] [CrossRef] [PubMed]
- Amaya Pascasio, L.; Quesada Lopez, M.; Garcia-Torrecillas, J.M.; Arjona-Padillo, A.; Martinez Sanchez, P. Development of a Score to Predict the Paroxysmal Atrial Fibrillation in Stroke Patients: The Screening for Atrial Fibrillation Scale. Front. Neurol. 2022, 13, 900582. [Google Scholar] [CrossRef]
- Fonseca, A.C.; Matias, J.S.; Pinho e Melo, T.; Falcao, F.; Canhao, P.; Ferro, J.M. N-terminal probrain natriuretic peptide as a biomarker of cardioembolic stroke. Int. J. Stroke 2011, 6, 398–403. [Google Scholar] [CrossRef]
- Fonseca, A.C.; Brito, D.; Pinho e Melo, T.; Geraldes, R.; Canhao, P.; Caplan, L.R.; Ferro, J.M. N-terminal pro-brain natriuretic peptide shows diagnostic accuracy for detecting atrial fibrillation in cryptogenic stroke patients. Int. J. Stroke 2014, 9, 419–425. [Google Scholar] [CrossRef] [PubMed]
- Kneihsl, M.; Bisping, E.; Scherr, D.; Mangge, H.; Fandler-Hofler, S.; Colonna, I.; Haidegger, M.; Eppinger, S.; Hofer, E.; Fazekas, F.; et al. Predicting atrial fibrillation after cryptogenic stroke via a clinical risk score-a prospective observational study. Eur. J. Neurol. 2022, 29, 149–157. [Google Scholar] [CrossRef]
- Rodriguez-Yanez, M.; Arias-Rivas, S.; Santamaria-Cadavid, M.; Sobrino, T.; Castillo, J.; Blanco, M. High pro-BNP levels predict the occurrence of atrial fibrillation after cryptogenic stroke. Neurology 2013, 81, 444–447. [Google Scholar] [CrossRef]
- Zhao, J.; Zhang, Y.; Yuan, F.; Song, C.; Jiang, Y.; Gao, Q.; Leng, X.; Jiang, W. Diagnostic value of N-terminal pro B-type natriuretic peptide for nonvalvular atrial fibrillation in acute ischemic stroke patients: A retrospective multicenter case-control study. J. Neurol. Sci. 2020, 414, 116822. [Google Scholar] [CrossRef] [PubMed]
- Wan, X.; Wang, W.; Liu, J.; Tong, T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med. Res. Methodol. 2014, 14, 135. [Google Scholar] [CrossRef] [PubMed]
- Jadad, A.R.; Moore, R.A.; Carroll, D.; Jenkinson, C.; Reynolds, D.J.; Gavaghan, D.J.; McQuay, H.J. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin. Trials 1996, 17, 1–12. [Google Scholar] [CrossRef] [PubMed]
- Simundic, A.-M. Measures of Diagnostic Accuracy: Basic Definitions. Med. Biol. Sci. 2008, 22. Available online: https://www.researchgate.net/publication/267722807_Measures_of_Diagnostic_Accuracy_Basic_Definitions (accessed on 24 March 2024).
- Higgins, J.P.T.T.J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions Version 6.3 (updated February 2022). 2022. Available online: https://training.cochrane.org/handbook/archive/v6.3 (accessed on 24 March 2024).
- Adams, H.P.; Bendixen, B.H.; Kappelle, L.J.; Biller, J.; Love, B.B.; Gordon, D.L.; Marsh, E.E. Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment. Stroke 1993, 24, 35–41. [Google Scholar] [CrossRef] [PubMed]
- Suissa, L.; Bertora, D.; Lachaud, S.; Mahagne, M.H. Score for the targeting of atrial fibrillation (STAF): A new approach to the detection of atrial fibrillation in the secondary prevention of ischemic stroke. Stroke 2009, 40, 2866–2868. [Google Scholar] [CrossRef] [PubMed]
- Sanak, D.; Hutyra, M.; Kral, M.; Bartkova, A.; Zapletalova, J.; Fedorco, M.; Veverka, T.; Vindis, D.; Dornak, T.; Skala, T.; et al. Paroxysmal atrial fibrillation in young cryptogenic ischemic stroke: A 3-week ECG Holter monitoring study. Biomed. Pap. Med. Fac. Univ. Palacky. Olomouc Czech Repub. 2015, 159, 283–287. [Google Scholar] [CrossRef] [PubMed]
- Ward, K.; Vail, A.; Cameron, A.; Katan, M.; Lip, G.Y.; Dawson, J.; Smith, C.J.; Kishore, A.K. Molecular biomarkers predicting newly detected atrial fibrillation after ischaemic stroke or TIA: A systematic review. Eur. Stroke J. 2022, 8, 125–131. [Google Scholar] [CrossRef] [PubMed]
- Xing, L.Y.; Diederichsen, S.Z.; Højberg, S.; Krieger, D.W.; Graff, C.; Frikke-Schmidt, R.; Olesen, M.S.; Brandes, A.; Køber, L.; Haugan, K.J.; et al. Effects of Atrial Fibrillation Screening According to N-Terminal Pro-B-Type Natriuretic Peptide: A Secondary Analysis of the Randomized LOOP Study. Circulation 2023, 147, 1788–1797. [Google Scholar] [CrossRef]
- Shi, M.; Liu, L.; Wafa, H.; Curcin, V.; Wang, Y. Effectiveness and safety of non-vitamin K oral anticoagulants versus warfarin in patients with atrial fibrillation and previous stroke: A systematic review and meta-analysis. Neuroepidemiology 2023, 58, 1–14. [Google Scholar] [CrossRef]
- Patel, J.; Bhaskar, S. Atrial Fibrillation and Reperfusion Therapy in Acute Ischaemic Stroke Patients: Prevalence and Outcomes-A Comprehensive Systematic Review and Meta-Analysis. Neurol. Int. 2023, 15, 1014–1043. [Google Scholar] [CrossRef] [PubMed]
- Ludhwani, D.; Wieters, J.S. Paroxysmal Atrial Fibrillation. StatPearls 2023. Available online: https://www.ncbi.nlm.nih.gov/books/NBK535439/ (accessed on 24 March 2024).
- Ratajczak-Tretel, B.; Lambert, A.T.; Al-Ani, R.; Arntzen, K.; Bakkejord, G.K.; Bekkeseth, H.M.O.; Bjerkeli, V.; Eldøen, G.; Gulsvik, A.K.; Halvorsen, B.; et al. Underlying causes of cryptogenic stroke and TIA in the nordic atrial fibrillation and stroke (NOR-FIB) study—The importance of comprehensive clinical evaluation. BMC Neurol. 2023, 23, 115. [Google Scholar] [CrossRef] [PubMed]
- Hariri, E.; Hachem, A.; Sarkis, G.; Nasr, S. Optimal Duration of Monitoring for Atrial Fibrillation in Cryptogenic Stroke: A Nonsystematic Review. Biomed. Res. Int. 2016, 2016, 5704963. [Google Scholar] [CrossRef] [PubMed]
- Zhao, X.; Li, H.; Liu, C.; Ren, Y.; Sun, C. NT Pro-BNP can be used as a risk predictor of clinical atrial fibrillation with or without left atrial enlargement. Clin. Cardiol. 2022, 45, 68–74. [Google Scholar] [CrossRef] [PubMed]
- Nasab Mehrabi, E.; Toupchi-Khosroshahi, V.; Athari, S.S. Relationship of atrial fibrillation and N terminal pro brain natriuretic peptide in heart failure patients. ESC Heart Fail. 2023, 10, 3250–3257. [Google Scholar] [CrossRef] [PubMed]
- Didier, R.; Garnier, L.; Duloquin, G.; Meloux, A.; Sagnard, A.; Graber, M.; Dogon, G.; Benali, K.; Pommier, T.; Laurent, G.; et al. Distribution of atrial cardiomyopathy markers and association with atrial fibrillation detected after ischaemic stroke in the SAFAS study. Stroke Vasc. Neurol. 2023, 9, 165–173. [Google Scholar] [CrossRef] [PubMed]
- Armoundas, A.A.; Narayan, S.M.; Arnett, D.K.; Spector-Bagdady, K.; Bennett, D.A.; Celi, L.A.; Friedman, P.A.; Gollob, M.H.; Hall, J.L.; Kwitek, A.E.; et al. Use of Artificial Intelligence in Improving Outcomes in Heart Disease: A Scientific Statement From the American Heart Association. Circulation 2024, 149, e1028–e1050. [Google Scholar] [CrossRef]
- Tancin Lambert, A.; Ratajczak-Tretel, B.; Al-Ani, R.; Arntzen, K.; Bakkejord, G.K.; Bekkeseth, H.M.O.; Bjerkeli, V.; Eldøen, G.; Gulsvik, A.K.; Halvorsen, B.; et al. Biomarkers predictive of atrial fibrillation in patients with cryptogenic stroke. Insights from the Nordic Atrial Fibrillation and Stroke (NOR-FIB) study. Eur. J. Neurol. 2023, 30, 1352–1363. [Google Scholar] [CrossRef]
- Costabel, J.; Burgos, L.; Trivi, M. The Significance Of Troponin Elevation in Atrial Fibrillation. J. Atr. Fibrillation 2017, 9, 1530. [Google Scholar] [CrossRef]
- Ward, F.; McGovern, R.; Cotter, P. Troponin-I Is a Predictor of a Delayed Diagnosis of Atrial Fibrillation in Acute Ischemic Stroke and Transient Ischemic Attack. J. Stroke Cerebrovasc. Dis. 2014, 24, 66–72. [Google Scholar] [CrossRef] [PubMed]
- Palà, E.; Pagola, J.; Juega, J.; Francisco-Pascual, J.; Bustamante, A.; Penalba, A.; Comas, I.; Rodriguez, M.; De Lera Alfonso, M.; Arenillas, J.F.; et al. B-type natriuretic peptide over N-terminal pro-brain natriuretic peptide to predict incident atrial fibrillation after cryptogenic stroke. Eur. J. Neurol. 2021, 28, 540–547. [Google Scholar] [CrossRef] [PubMed]
- Cohen, A.; Ederhy, S.; Meuleman, C.; Di Angelantonio, E.; Dufaitre, G.; Boccara, F. d-dimers in atrial fibrillation: A further step in risk stratification of thrombo-embolism? Eur. Heart J. 2007, 28, 2179–2180. [Google Scholar] [CrossRef]
- Li, X.; Peng, S.; Wu, X.; Guan, B.; Tse, G.; Chen, S.; Zhou, G.; Wei, Y.; Gong, C.; Lu, X.; et al. C-reactive protein and atrial fibrillation: Insights from epidemiological and Mendelian randomization studies. Nutr. Metab. Cardiovasc. Dis. 2022, 32, 1519–1527. [Google Scholar] [CrossRef] [PubMed]
- Gong, M.; Cheung, A.; Wang, Q.S.; Li, G.; Goudis, C.; Bazoukis, G.; Lip, G.; Baranchuk, A.; Korantzopoulos, P.; Letsas, K.; et al. Galectin-3 and risk of atrial fibrillation: A systematic review and meta-analysis. J. Clin. Lab. Anal. 2020, 34, e23104. [Google Scholar] [CrossRef] [PubMed]
- Garnier, L.; Duloquin, G.; Meloux, A.; Benali, K.; Sagnard, A.; Graber, M.; Dogon, G.; Didier, R.; Pommier, T.; Vergely, C.; et al. Multimodal Approach for the Prediction of Atrial Fibrillation Detected After Stroke: SAFAS Study. Front. Cardiovasc. Med. 2022, 9, 949213. [Google Scholar] [CrossRef] [PubMed]
- Pauklin, P.; Zilmer, M.; Eha, J.; Tootsi, K.; Kals, M.; Kampus, P. Markers of Inflammation, Oxidative Stress, and Fibrosis in Patients with Atrial Fibrillation. Oxid. Med. Cell Longev. 2022, 2022, 4556671. [Google Scholar] [CrossRef] [PubMed]
- Wu, Y.; Zhang, K.; Zhao, L.; Guo, J.; Hu, X.; Chen, Z. Increased serum HMGB1 is related to oxidative stress in patients with atrial fibrillation. J. Int. Med. Res. 2013, 41, 1796–1802. [Google Scholar] [CrossRef] [PubMed]
- Huang, J.; Killingsworth, M.; Bhaskar, S. Is Composition of Brain Clot Retrieved by Mechanical Thrombectomy Associated with Stroke Aetiology and Clinical Outcomes in Acute Ischemic Stroke?—A Systematic Review and Meta-Analysis. Neurol. Int. 2022, 14, 748–770. [Google Scholar] [CrossRef]
- Bhaskar, S.; Cordato, D.; Cappelen-Smith, C.; Cheung, A.; Ledingham, D.; Celermajer, D.; Levi, C. Clarion call for histopathological clot analysis in “cryptogenic” ischemic stroke: Implications for diagnosis and treatment. Ann. Clin. Transl. Neurol. 2017, 4, 926–930. [Google Scholar] [CrossRef]
- Bhaskar, S.; Saab, J.; Cappelen-Smith, C.; Killingsworth, M.; Wu, X.; Cheung, A.; Manning, N.; Aouad, P.; McDougall, A.; Hodgkinson, S.; et al. Clot Histopathology in Ischemic Stroke with Infective Endocarditis. Can. J. Neurol. Sci. J. Can. Des. Sci. Neurol. 2019, 46, 1–6. [Google Scholar] [CrossRef] [PubMed]
- Harpaz, D.; Bajpai, R.; Ng, G.J.L.; Soljak, M.; Marks, R.S.; Cheung, C.; Arumugam, T.V.; Quek, A.M.L.; Tok, A.I.Y.; Seet, R.C.S. Blood biomarkers to detect new-onset atrial fibrillation and cardioembolism in ischemic stroke patients. Heart Rhythm. 2021, 18, 855–861. [Google Scholar] [CrossRef] [PubMed]
- Yoshioka, K.; Watanabe, K.; Zeniya, S.; Ito, Y.; Hizume, M.; Kanazawa, T.; Tomita, M.; Ishibashi, S.; Miake, H.; Tanaka, H.; et al. A Score for Predicting Paroxysmal Atrial Fibrillation in Acute Stroke Patients: iPAB Score. J. Stroke Cerebrovasc. Dis. 2015, 24, 2263–2269. [Google Scholar] [CrossRef] [PubMed]
- Kishore, A.K.; Hossain, M.J.; Cameron, A.; Dawson, J.; Vail, A.; Smith, C.J. Use of risk scores for predicting new atrial fibrillation after ischemic stroke or transient ischemic attack-A systematic review. Int. J. Stroke 2022, 17, 608–617. [Google Scholar] [CrossRef] [PubMed]
- January, C.T.; Wann, L.S.; Calkins, H.; Chen, L.Y.; Cigarroa, J.E.; Cleveland, J.C.; Ellinor, P.T.; Ezekowitz, M.D.; Field, M.E.; Furie, K.L.; et al. 2019 AHA/ACC/HRS Focused Update of the 2014 AHA/ACC/HRS Guideline for the Management of Patients With Atrial Fibrillation: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society in Collaboration With the Society of Thoracic Surgeons. Circulation 2019, 140, e125–e151. [Google Scholar] [CrossRef]
- Pagola, J.; Juega, J.; Francisco-Pascual, J.; Bustamante, A.; Penalba, A.; Pala, E.; Rodriguez, M.; De Lera-Alfonso, M.; Arenillas, J.F.; Cabezas, J.A.; et al. Predicting Atrial Fibrillation with High Risk of Embolization with Atrial Strain and NT-proBNP. Transl. Stroke Res. 2021, 12, 735–741. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).