Next Article in Journal
Forty-Year Biomonitoring of Environmental Contaminants in Russian Arctic: Progress, Gaps and Perspectives
Next Article in Special Issue
A Successful Heart Transplantation Coupled with Temporary Right Ventricular Assist Device Implantation in a Patient with (ir)Reversible Pulmonary Hypertension
Previous Article in Journal
The Influence of Framing Plant-Based Products in Terms of Their Health vs. Environmental Benefits: Interactions with Individual Wellbeing
Previous Article in Special Issue
Cluster Analysis to Distinguish Patients Most Likely to Benefit from Outpatient Cardiac Rehabilitation—A Prospective, Multicenter Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nine-Year Trends in Prevention of Thromboembolic Complications in Elderly Patients with Atrial Fibrillation Treated with NOACs

by
Bernadetta Bielecka
1,
Iwona Gorczyca-Głowacka
2,* and
Beata Wożakowska-Kapłon
1,2
1
1st Clinic of Cardiology and Electrotherapy, Swietokrzyskie Cardiology Centre, 25-736 Kielce, Poland
2
Collegium Medicum, Jan Kochanowski University, 25-369 Kielce, Poland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(19), 11938; https://doi.org/10.3390/ijerph191911938
Submission received: 26 August 2022 / Revised: 16 September 2022 / Accepted: 18 September 2022 / Published: 21 September 2022
(This article belongs to the Special Issue Advances in Cardiology and Vascular Health)

Abstract

:
Background: Atrial fibrillation (AF) is the most common disease in elderly patients and thromboembolic complication prophylaxis significantly improves the prognosis in these patients. The study assessed the frequency of individual non-vitamin K antagonist oral anticoagulant (NOAC) use among patients ≥75 years and attempted to identify factors predisposing to their prescription. Methods: The data of patients with non-valvular AF hospitalized in the reference cardiology center between 2011 and 2019 were analyzed. Results: Out of 1443 analyzed patients, 329 (22.8%) received apixaban, 618 (42.8%) dabigatran, and 496 (34.4%) rivaroxaban. The entire population mean age was 82.3 ± 5 years, and 57.9% were females. Independent predictors of apixaban use were age, and bleeding history. Hospitalization for the implantation/reimplantation of a cardiac implantable electronic device (CIED) reduced the chance of apixaban use. Hypertension was a predictor of dabigatran prescription. The chance of using dabigatran decreased with age. Hypertension and bleeding history decreased the chance of rivaroxaban application. Conclusions: In hospitalized AF patients ≥75 years, dabigatran was the most frequently used NOAC. Age, comorbidities and bleeding risk determined the selection of individual NOACs.

1. Introduction

Atrial fibrillation (AF) is the most common disease in elderly patients and occurs in approximately 9 to 17% of people over 80 years of age [1,2]. Age is a risk factor not only for stroke, but also for bleeding, especially in patients with multiple factors which alter drug kinetics and the toxicity of standard doses of oral anticoagulants (OACs) [3]. Elderly patients (defined as those ≥ 75 years of age) usually have a low body mass index, changed muscle and fat composition, and age-related decline in kidney function [4]. In view of the projected increase in the incidence of AF in the world in the nearest future, there is an urgent need for effective stroke prevention strategies, especially in the elderly [5,6]. There is a clear need to optimize the use of anticoagulants in these patients, especially when they receive a full dose of the anticoagulant [7]. Long-term use of OACs in elderly patients with AF is recommended to reduce the risk of stroke. Until recently, the only oral anticoagulants available were vitamin K antagonists (VKAs) (e.g., warfarin). The new oral anticoagulants (NOACs) offer significant benefits and greater convenience to elderly patients as they have predictable pharmacological profiles, a rapid onset of action, a wide therapeutic window, no requirement for routine coagulation monitoring, and a smaller and better-defined number of food-drug interactions compared to warfarin [8]. Despite the benefits of anticoagulation shown in clinical trials, NOACs are underused in the elderly population [9]. Therefore, it is crucial to weigh the risks and benefits of anticoagulation strategies in this population [4].
The aim of our study was to assess the frequency of using individual non-vitamin K antagonist oral anticoagulants (NOACs) among elderly patients (≥75 years) and to try to identify factors that predispose to their recommendation.

2. Materials and Methods

2.1. Study Group

The presented registry is a retrospective study of patients hospitalized in Świętokrzyskie Cardiology Center, which is the largest reference center in Świętokrzyskie Voivodeship, located in Kielce. It provides specialist medical care for the population of approximately 1,230,000 people in south-eastern Poland. Patients from both the Świętokrzyskie region and neighboring provinces are hospitalized there. Patients were included if they were at least 18 years of age and had a history of AF documented by electrocardiography or in their medical history. The study included patients with AF hospitalized between 2004 and 2019. Among all of the patients with AF hospitalized in the years 2004–2019, the first patient treated with NOAC was recorded in our registry in 2011.
The data of 6588 patients with AF hospitalized from 2011 to 2019 were analyzed. The registry excluded those ones with incomplete treatment data, patients with valvular disease, patients who died during hospitalization, patients under 75 years of age, and patients treated with VKAs, antiplatelet drugs (APT), low molecular weight heparin (LMWH) as well as patients without anticoagulant treatment (Figure 1). The presented study evaluated 1443 AF patients aged 75 and over treated with NOACs.

2.2. Assessed Parameters

Data were collected on gender, age, comorbidities, type of atrial fibrillation, laboratory and echocardiographic parameters, treatment method, and the reason for patients’ hospitalization. AF was diagnosed on the basis of the definition of the European Society of Cardiology, according to which arrhythmia can be identified using an electrocardiogram showing irregular atrial rhythm lasting longer than 30 s [10].
The glomerular filtration rate (GFR), which was used to assess the patients’ renal function, was calculated using the CKD-EPI (Chronic Kidney Disease Epidemiology Collaboration) equation. kLKThe study was approved by the Ethics Committee of the Świętokrzyska Medical Chamber in Kielce (Approval No. 12/2012). The Ethics Committee waived the requirement to obtain informed consent from patients.

2.3. Assessment of the Thromboembolic Risk and Bleeding Risk

Thromboembolic risk was assessed using the CHA2DS2-VASc score including congestive heart failure, hypertension, age ≥75 years, diabetes, stroke/transient ischemic attack (TIA)/thromboembolic event, vascular disease, age 65–74 years, female gender.
The risk of bleeding was assessed on the basis of the HAS-BLED score including arterial hypertension, abnormal kidney/liver function, stroke, bleeding predisposition, unstable INR (international normalized ratio), the elderly (>65 years old), drug/alcohol consumption [11].

2.4. Prophylaxis of Thromboembolic Complications

Patients treated with apixaban, dabigatran and rivaroxaban were compared. Edoxaban has been approved in Europe as a drug preventing thromboembolic complications in patients with AF, however, it is not available in Poland.

2.5. Statistical Analysis

In order to answer the research questions and test the hypotheses, statistical analyses were carried out using the IBM SPSS Statistics version 25 package. It was used to analyze basic descriptive statistics, chi square tests of independence, Fisher’s exact test, one-way ANOVA, Kruskal-Wallis tests and univariate logistic regression analyses. The classic threshold α = 0.05 was adopted as the level of statistical significance. In the first step of the analysis, the distributions of quantitative variables were checked. For this purpose, the basic descriptive statistics were calculated together with the Kolmogorov-Smirnow test examining the normality of the distribution. The differences among apixaban, dabigatran and rivaroxaban treated patients in terms of variables related to their general and clinical characteristics were tested sequentially. For this purpose, Kruskal-Wallis tests, chi-square tests of independence, Fisher’s exact test, and one-way ANOVA were performed. In order to deepen the analyses, a multivariate logistic regression analysis was performed.

3. Results

3.1. Characteristics of the Study Group

Of the 1443 patients included in the analysis, 329 (22.8%) were treated with apixaban, 618 (42.8%) with dabigatran, and 496 (34.4%) with rivaroxaban. The reduced dose of the drug was administered to 920 (63.7%) patients, most frequently to patients taking dabigatran (78.8%) and least frequently to patients receiving apixaban (41.6%) (p < 0.001).
The mean age of the entire population was 82.3 ± 5 years, and 57.9% of patients were women. Patients receiving apixaban were older (83.8 ± 5.3 years) compared to patients receiving dabigatran (81.7 ± 4.8 years) and rivaroxaban (81.9 ± 4.7 years) (p < 0.001).
Among the oldest patients aged 96–100 years, apixaban accounted for 60% of prescribed NOACs, dabigatran 20%, rivaroxaban 20%. Among patients aged 75–80 years, the greatest number of patients received dabigatran—46.2%, and the lowest number of patients apixaban—17.8%. The distribution of individual NOACs in specific age groups is presented in Figure 2.
Figure 3 shows the use of NOACs in particular years.
The most common comorbidities in the study population were: arterial hypertension —1174 (81.3%) patients, heart failure—992 (68.7%) patients, vascular disease—693 (48%) patients and diabetes—439 (30.4%) patients. The mean CHA2DS2-VASc score was 5.2 ± 1.4 points. Figure 4 shows the division into individual NOACs depending on the score in the CHA2DS2-VASc score.
The mean HAS-BLED score was 2.2 ± 0.8 points. The result of ≥ 3 points was obtained by 466 (32.3%) people; moreover, higher values of the HAS-BLED score were observed among the respondents using dabigatran (34.6%) than with apixaban (26.7%) (p = 0.043). The most common reasons for hospitalization in the study group were as follows: heart failure—414 (28.7%) patients and cardiac implantable electronic device (CIED) implantation/reimplantation—301 (20.8%) patients.
Among the patients receiving apixaban, heart failure was a significantly more frequent cause of hospitalization (36.5%) than among patients receiving dabigatran (27.7%) and rivaroxaban (24.8%) (p = 0.001). On the other hand, implantation and reimplantation of CIEDs as a reason for hospitalization are more common among patients using rivaroxaban (23.4%) than apixaban (15.5%) (p = 0.017). The characteristics of the study population are summarized in Table 1.

3.2. Predictors of the Use of Individual NOACs

A series of univariate logistic regression analyses were performed for the use of apixaban, dabigatran and rivaroxaban. The variables included in the clinical characteristics of the group were included in the analyses. Numerous predictors of a specific NOAC selection were found in the univariate logistic regression analysis. (Table 2).
In order to deepen the analyses, a multivariate logistic regression analysis was performed. The analyses were performed separately for the selection of the following drugs: apixaban, dabigatran and rivaroxaban. The model simultaneously included: age, gender, arterial hypertension, peripheral arterial disease (PAD) and history of bleeding, heart failure, ablation and CIED as the reason for hospitalization, and eGFR. The results of these analyses are included in Table 3.
The independent predictors of apixaban use were age (OR 1.08, 95% CI, 1.05–1.11; p < 0.001) and history of bleeding (OR 2.94, 95% CI, 1.71–5.06; p < 0.001). Hospitalization for CIED decreased the chance of apixaban use (OR 0.63, 95% Cl, 0.44–0.90; p = 0.011). Hypertension was a predictor of the use of dabigatran (OR 1.56, 95% Cl, 1.18–2.06; p = 0.022). With age, the chance of using dabigatran decreased (OR 0.96, 95% Cl, 0.94–0.98; p < 0.001). Hypertension (OR 0.74, 95% Cl, 0.56–0.98; p = 0.034) and history of bleeding (OR 0.50, 95% Cl, 0.26–0.95; p = 0.034) decreased the chance of receiving rivaroxaban.

4. Discussion

The present study has several major findings. Firstly, the most frequently chosen non-vitamin K antagonist oral anticoagulant (NOAC) in elderly patients was dabigatran. Secondly, age, comorbidities, and risk of bleeding complications were predictors for the selection of individual NOACs.
The use of individual NOACs in our population varied depending on the patient profile. The choice of NOACs was also influenced by the patient’s comorbidities, the risk of bleeding and the current safety studies available. Physicians prescribing a given drug were guided by evidence-based medicine and clinical experience. Our study population consists of elderly patients at higher risk of complications and potential risks. After approval of apixaban, which can also be used in advanced kidney disease, it was more likely to be prescribed to older patients.
In the presented registry, the most frequently chosen drug was dabigatran. It was the first NOAC registered in the world. Our study was conducted between 2011 and 2019, hence probably the greatest popularity of dabigatran. Similarly, in the Adeboyeje study [12] conducted in 2010–2015, where dabigatran was in the first place in terms of prevalence among NOACs, and rivaroxaban was in the second place. On the other hand, the data from the PINNACLE NCDR registry showed that rivaroxaban was used more often than dabigatran and apixaban [13]. The highest percentage of patients treated with apixaban was reported in the Norwegian patient registry [14]. In Poland, apixaban has been approved as the third NOAC, which is why it is the lowest in our registry in terms of quantity. It should be said that despite the lowest popularity of apixaban in our study, the number of prescriptions is steadily increasing, and it is likely to overtake the number of prescriptions in relation to dabigatran and rivaroxaban in the future.
In our registry, it was also observed that a large percentage of patients received the reduced dose of the drug; it was as much as 63.7% of people, which was the most among patients using dabigatran. This reduction in NOAC dose is mainly due to limitations of renal functions that occur with increasing age. The dose reduction was also the result of a triple anticoagulant treatment in patients with acute coronary syndromes (ACS) and after percutaneous coronary intervention (PCI). Drug dosing depends primarily on estimated creatinine clearance, mainly calculated using the Cockroft-Gault formula. The medical records in our registry were based on the assessment of kidney function in accordance with MDRD (Modification of Diet in Renal Disease). Although the methods are similar, there are differences between them that may have been reflected in the use of the correct dose of the drug. However, we cannot exclude a dose reduction based on other features, such as history of bleeding, peptic ulcer disease, low blood counts, and the preferences of physicians directly assessing the patient’s clinical condition.
In our study, the mean eGFR value for the study population was only 49.9 mL/min/1.73 m2. In the study by Rutheford et al. [15] also the highest number of patients ≥75 years using dabigatran received a reduced dose. This is probably due to the fact that dabigatran was the first and best-studied NOAC available, and therefore doctors had fewer concerns when prescribing it to the oldest and most heavily burdened group of patients requiring a lower dose of the drug. We assessed elderly patients with multiple comorbidities who had usually a low body mass index, which explains the above conclusions.
One of the conclusions of the study is that the older the patients are, the higher the chance of prescribing apixaban. A study by Zeitouni et al. confirms effectiveness and safety also of a reduced dose, which is especially important for seniors [16]. Elderly patients are at increased risk of stroke and systemic embolism, as well as bleeding, hence the need for effective anticoagulation. In the OBIT-AF II study, advanced age predisposed the choice of apixaban compared to rivaroxaban [17]. This is confirmed by the study by Rutheford et al. [14], in which patients using dabigatran were younger and had fewer comorbidities. Similarly, in the study by Yao et al. patients using dabigatran were younger than those using apixaban and rivaroxaban [18].
In our study, hospitalization for the implantation/reimplantation of a cardiac implantable electronic device (CIED) decreased the chance of using apixaban compared to dabigatran and rivaroxaban. It is probably related to the insufficient follow-up and results regarding this drug. In the registry of Black-Maier et al. [19], people undergoing CIED implantation who used NOACs were younger and had fewer comorbidities, compared to patients using warfarin, which proves the need for caution when using these drugs. Apixaban, on the other hand, is more willingly prescribed to elderly people with multiple comorbidities. In the ESS-PREDI study, in patients who underwent CIED implantation/surgical revision as a part of long-lasting anticoagulant therapy [20], minor pocket hematomas and bleeding complications were significantly less frequent in patients treated with NOACs compared to those treated with vitamin K antagonists (VKAs) and antiplatelet drugs. In the study by Chuan-Tsai et al., where NOACs were used in patients with AF and high thromboembolic risk during CIED implantation, no cases of major bleeding were reported; moreover, no periprocedural mortality or strokes were observed [21]. In the retrospective study comparing the occurrence of bleeding and thromboembolic complications after CIED implantation in 176 patients treated with rivaroxaban or dabigatran, no differences in 30-day bleeding complications between groups were found, but it should be emphasized that only discontinued therapy was analyzed [22]. Therefore, more research is needed to prove the direct effectiveness of NOACs in patients undergoing implantation and reimplantation of implantable devices.
In our registry, arterial hypertension predisposed patients to the choice of dabigatran. In the Canadian registry, among patients over 65 years of age in long-term care facilities, patients with arterial hypertension were more likely to be prescribed NOACs [23]. In patients with AF, arterial hypertension is not only a risk factor for stroke, but it is also associated with an increased risk of bleeding in people receiving anticoagulants [24,25]. Ishii et al. write about the correlation between the occurrence of bleeding and arterial hypertension in patients with AF, and thus using anticoagulants [26]. Due to the higher risk of bleeding among patients taking rivaroxaban, hypertension was a factor which probably decreased the chances of prescribing this drug, and dabigatran was the preferred and recommended choice. On the other hand, in another study, in a subgroup of Japanese patients in the ROCKET-AF study [27] which compared patients with AF and hypertension taking warfarin or rivaroxaban, it was observed that the safety and efficacy profile of rivaroxaban was similar to that of warfarin, regardless of baseline hypertension. Diener et al. write that when comparing NOACs, no differences were found in terms of safety or efficacy in patients with AF and arterial hypertension [28]. The results of the research depend on the selection of the test group and the time of the research.
History of bleeding was a factor which predisposed the choice of apixaban but decreased the chance of rivaroxaban prescription.
In the ARISTOTLE study [29], the use of apixaban in the elderly reduced the incidence of stroke or systemic embolism by 29% and major bleeding by 36%. In the meta-analysis by Malik et al. [30], apixaban was the only oral anticoagulant that significantly reduced all 3 results i.e., systemic embolism, major bleeding and intracranial hemorrhage compared to warfarin. In the meta-analysis by Sharm et al. comparing NOACs and warfarin in the group of patients >75 years of age, dabigatran in particular was associated with a higher risk of gastrointestinal bleeding compared to VKAs [31], which suggests its greater safety in younger patients. Analyses of the RE-LY data suggested a lower risk of major bleeding in patients <75 years of age, but a trend to a higher risk in patients ≥75 years of age [32]. Our analysis is based on patients at high risk of thromboembolism, and includes patients over 75 years of age, which is consistent with the results of the cited studies. In contrast, Noseworthy et al. [33] found no significant differences in efficacy between NOACs, and both dabigatran and apixaban were associated with a significantly lower risk of bleeding compared to rivaroxaban. This registry, created in the United States between 2010 and 2015, shows that rivaroxaban may be associated with an increased risk of major bleeding and intracranial bleeding. Graham et al. [34] conducted a retrospective cohort study of new users including 118,891 patients with non-valvular AF (NVAF), which showed that the standard dose of rivaroxaban was associated with more frequent cases of serious bleeding events than the standard dose of dabigatran, which is also consistent with our research.
Concerns related to bleeding are still the main reason for refraining from prescribing new oral anticoagulants, but the studies mentioned partially resolve these doubts. Depending on a given clinical situation, administration of a specific NOAC is preferable, therefore the factors that predisposed to the use of a specific drug were investigated.

5. Study Strengths and Limitations

Our study was conducted on the basis of documentation collected in one centre, a reference clinic in the voivodeship city. The registry includes patients from a vast geographical region, it contains a significant number of people both from Świętokrzyskie Voivodeship and the surrounding voivodeships. It includes only patients at high thromboembolic risk who therefore need anticoagulant therapy. Due to the long observation period, it is not possible to clearly determine the starting point for the application of a specific NOAC, as they were introduced in Poland at different times. Nevertheless, patients were treated according to the latest reliable medical knowledge in correlation to the successively published guidelines for atrial fibrillation. This provides a consistent and clear picture of the management of patients at high thromboembolic risk, as well as a complete overview of medical management and practice.

6. Conclusions

The presented study demonstrates an up-to-date picture of the use of NOACs in elderly patients with AF. This study extends the knowledge of contemporary AF management and demonstrates good implementation of clinical guidelines for stroke prevention. Factors influencing the selection of NOACs were identified: age, comorbidities and risk of bleeding. In the elderly population, it is particularly important to individualize anticoagulant therapy due to the increased risk of thromboembolic and hemorrhagic complications.

Author Contributions

Conceptualization, B.B. and I.G.-G.; methodology, B.B., I.G.-G. and B.W.-K.; software, B.B. and I.G.-G.; validation, B.B. and I.G.-G.; formal analysis, B.B.; I.G.-G.; investigation, B.B., I.G.-G.; resources, B.B., I.G.-G.; data curation, B.B., I.G.-G. and B.W.-K.; writing—original draft preparation, B.B. and I.G.-G.; writing— review and editing, B.B., I.G.-G. and B.W.-K.; visualization, B.B., I.G.-G.; supervision, B.W.-K.; project administration, B.B., I.G.-G.; All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the Ethics Committee of the Świętokrzyska Medical Chamber in Kielce (Approval No. 12/2012). The Ethics Committee waived the requirement to obtain informed consent from patients.

Informed Consent Statement

Written informed consent has been obtained from the patient(s) to publish this paper.

Data Availability Statement

Data is available on request for the first author.

Conflicts of Interest

B.B.: no conflict of interest. I.G.-G.: research grant from Boehringer-Ingelheim and speaker for Boehringer-Ingelheim and Bayer. B.W.-K.: speaker for Boehringer-Ingelheim, Bayer, Pfizer.

References

  1. Go, A.S.; Mozaffarian, D.; Roger, V.L.; Benjamin, E.J.; Berry, J.D.; Borden, W.B.; Bravata, D.M.; Dai, S.; Ford, E.S.; Fox, C.S.; et al. Heart disease and stroke statistics—2013 update: A report from the American Heart Association. Circulation 2013, 127, e6–e245. [Google Scholar] [CrossRef] [PubMed]
  2. Wolf, P.A.; Abbott, R.D.; Kannel, W.B. Atrial fibrillation as an independent risk factor for stroke: The Framingham Study. Stroke 1991, 22, 938–983. [Google Scholar] [CrossRef] [PubMed]
  3. Bauersachs, R.M.; Herold, J. Oral Anticoagulation in the Elderly and Frail. Hamostaseologie 2020, 40, 74–83. [Google Scholar] [CrossRef]
  4. Tayaa, S.; Berrut, G.; de Decker, L.; Chevalet, P. Direct oral anticoagulants in non-valvular atrial fibrillation in elderly: For a treatment adapted to patient profile. Geriatr. Psychol. Neuropsychiatr. Vieil. 2018, 16, 229–240. [Google Scholar] [CrossRef] [PubMed]
  5. Miyasaka, Y.; Barnes, M.E.; Gersh, B.J.; Cha, S.S.; Bailey, K.R.; Abhayaratna, W.P.; Seward, J.B.; Tsang, T.S.M. Secular trends in the prevalence of atrial fibrillation in Olmsted County, Minnesota 1980–2000 and implications for prognosis of future prevalence. Circulation 2006, 114, 119–125. [Google Scholar] [CrossRef]
  6. Lee, H.; Kim, T.H.; Baek, Y.S.; Uhm, J.S.; Pak, H.N.; Lee, M.H.; Joung, B. Inpatient visit trends for atrial fibrillation and their cost, treatment regimens and mortality in Korea: 10-year national cohort data. Korean Circ. J. 2017, 47, 56–64. [Google Scholar] [CrossRef]
  7. Siguret, V.; Gouin-Thibault, I.; Gaussem, P.; Pautas, E. Optimizing the use of anticoagulants (heparins and oral anticoagulants) in the elderly. Drugs Aging 2013, 30, 687–699. [Google Scholar] [CrossRef]
  8. Deedwania, P.C. New oral anticoagulants in elderly patients with atrial fibrillation. Am. J. Med. 2013, 126, 289–296. [Google Scholar] [CrossRef]
  9. Debray, M.; Pautas, E.; Couturier, P.; Franco, A.; Siguret, V. Oral anticoagulants in the elderly. Rev. Med. Interne 2003, 24, 107–117. [Google Scholar] [CrossRef]
  10. Camm, A.J.; Kirchhof, P.; Camm, A.J.; Schotten, U.; Savelieva, I.; Ernst, S.; Van Gelder, I.C.; Al-Attar, N.; Hindricks, G.; Prendergast, B.; et al. Guidelines for the management of atrial fibrillation: The task force for the management of atrial fibrillation of the European society of cardiology (ESC). Eur. Heart J. 2010, 31, 2369–2429. [Google Scholar] [CrossRef]
  11. Huiart, L.; Ferdynus, C.; Renoux, C.; Beaugrand, A.; Lafarge, S.; Bruneau, L.; Suissa, S.; Maillard, O.; Ranouil, X. Trends in initiation of direct oral anticoagulant therapies for atrial fibrillation in a national population- based cross-sectional study in the French health insurance databases. BMJ Open 2018, 8, e018180. [Google Scholar] [CrossRef] [PubMed]
  12. Adeboyeje, G.; Sylwestrzak, G.; Barron, J.J.; White, J.; Rosenberg, A.; Abarca, J.; Crawford, G.; Redberg, R. Major Bleeding Risk During Anticoagulation with Warfarin, Dabigatran, Apixaban, or Rivaroxaban in Patients with Nonvalvular Atrial Fibrillation. J. Manag. Care Spec. Pharm. 2017, 23, 968–978. [Google Scholar] [CrossRef] [PubMed]
  13. Yong, C.M.; Liu, Y.; Apruzzese, P.; Doros, G.; Cannon, C.P.; Maddox, T.M.; Gehi, A.; Hsu, J.C.; Lubitz, S.A.; Virani, S.; et al. Association of insurance type with receipt of oral anticoagulation in insured patients with atrial fibrillation: A report from the American College of Cardiology NCDR PINNACLE registry. Am. Heart J. 2018, 195, 50–59. [Google Scholar] [CrossRef] [PubMed]
  14. Rutherford, O.C.W.; Jonasson, C.; Ghanima, W.; Söderdahl, F.; Halvorsen, S. Comparison of dabigatran, rivaroxaban, and apixaban for effectiveness and safety in atrial fibrillation: A nationwide cohort study. Eur. Heart J. Cardiovasc. Pharmacother. 2020, 6, 75–85. [Google Scholar] [CrossRef] [PubMed]
  15. Rutherford, O.C.W.; Jonasson, C.; Ghanima, W.; Söderdahl, F.; Halvorsen, S. Effectiveness and safety of oral anticoagulants in elderly patients with atrial fibrillation. Heart 2022, 108, 345–352. [Google Scholar] [CrossRef]
  16. Zeitouni, M.; Giczewska, A.; Lopes, R.D.; Wojdyla, D.M.; Christersson, C.; Siegbahn, A.; De Caterina, R.; Steg, P.G.; Granger, C.B.; Wallentin, L.; et al. Clinical and Pharmacological Effects of Apixaban Dose Adjustment in the ARISTOTLE Trial. J. Am. Coll. Cardiol. 2020, 75, 1145–1155. [Google Scholar] [CrossRef]
  17. Steinberg, B.A.; Shrader, P.; Thomas, L.; Ansell, J.; Fonarow, G.C.; Gersh, B.J.; Hylek, E.; Kowey, P.R.; Mahaffey, K.W.; O’Brien, E.C.; et al. Factors associated with non-vitamin K antagonist oral anticoagulants for stroke prevention in patients with new-onset atrial fibrillation: Results from the Outcomes Registry for Better Informed Treatment of Atrial Fibrillation II (ORBIT-AF II). Am. Heart J. 2017, 189, 40–47. [Google Scholar] [CrossRef]
  18. Yao, X.; Abraham, N.S.; Sangaralingham, L.R.; Bellolio, M.F.; McBane, R.D.; Shah, N.D.; Noseworthy, P.A. Effectiveness and Safety of Dabigatran, Rivaroxaban, and Apixaban Versus Warfarin in Nonvalvular Atrial Fibrillation. J. Am. Heart Assoc. 2016, 5, e003725. [Google Scholar] [CrossRef]
  19. Black-Maier, E.; Kim, S.; Steinberg, B.A.; Fonarow, G.C.; Freeman, J.V.; Kowey, P.R.; Ansell, J.; Gersh, B.J.; Mahaffey, K.W.; Naccarelli, G.; et al. Oral anticoagulation management in patients with atrial fibrillation undergoing cardiac implantable electronic device implantation. Clin. Cardiol. 2017, 40, 746–751. [Google Scholar] [CrossRef]
  20. Deharo, J.C.; Sciaraffia, E.; Leclercq, C.; Amara, W.; Doering, M.; Bongiorni, M.G.; Chen, J.; Dagres, M.; Estner, H.; Larsen, T.B.; et al. Perioperative management of antithrombotic treatment during implantation or revision of cardiac implantable electronic devices: The European Snapshot Survey on Procedural Routines for Electronic Device Implantation (ESS-PREDI). Europace 2016, 18, 778–784. [Google Scholar] [CrossRef]
  21. Tsai, C.T.; Liao, J.N.; Chao, T.F.; Lin, Y.J.; Chang, S.L.; Lo, L.W.; Hu, Y.F.; Chung, F.P.; Tuan, T.C.; Chen, S.A. Uninterrupted non-vitamin K antagonist oral anticoagulants during implantation of cardiac implantable electronic devices in patients with atrial fibrillation. J. Chin. Med. Assoc. 2019, 82, 256–259. [Google Scholar] [CrossRef] [PubMed]
  22. Kosiuk, J.; Koutalas, E.; Doering, M.; Sommer, P.; Rolf, S.; Breithardt, O.; Nedios, S.; Dinov, B.; Hindricks, G.; Richter, S.; et al. Treatment with novel oral anticoagulants in a real-world cohort of patients undergoing cardiac rhythm device implantations. Europace 2014, 16, 1028–1032. [Google Scholar] [CrossRef] [PubMed]
  23. Shurrab, M.; Dennis, T.K.; McElhaney, J.; Henderson, M.; Danon, A.; Quinn, K.L.; O’Donnell, D.; Crystal, E.; Newman, D. Identifying Factors That Predict the Prescription of Non-vitamin K Antagonist Oral Anticoagulants in Older Individuals with Atrial Fibrillation. J. Am. Med. Dir. Assoc. 2019, 20, 984–987. [Google Scholar] [CrossRef] [PubMed]
  24. Pisters, R.; Lane, D.A.; Nieuwlaat, R.; de Vos, C.B.; Crijns, H.J.G.M.; Lip, G.Y.H. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: The Euro Heart Survey. Chest 2010, 138, 1093–1100. [Google Scholar] [CrossRef]
  25. Lip, G.Y.H.; Nieuwlaat, R.; Pisters, R.; Lane, D.A.; Crijns, H.J.G.M. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: The euro heart survey on atrial fibrillation. Chest 2010, 137, 263–272. [Google Scholar] [CrossRef]
  26. Ishii, M.; Ogawa, H.; Unoki, T.; An, Y.; Iguchi, M.; Masunaga, N.; Esato, M.; Chun, Y.H.; Tsuji, H.; Wada, H.; et al. Relationship of Hypertension and Systolic Blood Pressure with the Risk of Stroke or Bleeding in Patients with Atrial Fibrillation: The Fushimi AF Registry. Am. J. Hypertens. 2017, 30, 1073–1082. [Google Scholar] [CrossRef]
  27. Matsumoto, M.; Hori, M.; Tanahashi, N.; Momomura, S.I.; Uchiyama, S.; Goto, S.; Izumi, T.; Koretsune, Y.; Kajikawa, M.; Kato, M.; et al. Rivaroxaban versus warfarin in Japanese patients with non-valvular atrial fibrillation in relation to hypertension: A subgroup analysis of the J-ROCKET AF trial. Hypertens. Res. 2014, 37, 457–462. [Google Scholar] [CrossRef]
  28. Diener, H.C.; Aisenberg, J.; Ansell, J.; Atar, D.; Breithardt, G.; Eikelboom, J.; Ezekowitz, M.D.; Granger, C.B.; Halperin, J.L.; Hohnloser, S.H.; et al. Choosing a particular oral anticoagulant and dose for stroke prevention in individual patients with non-valvular atrial fibrillation: Part 2. Eur. Heart J. 2017, 38, 860–868. [Google Scholar] [CrossRef]
  29. Granger, C.B.; Alexander, J.H.; McMurray, J.J.V.; Lopes, R.D.; Hylek, E.M.; Hanna, M.; Al-Khalidi, H.R.; Ansell, J.; Atar, D.; Avezum, A.; et al. Apixaban versus warfarin in patients with atrial fibrillation. N. Engl. J. Med. 2011, 365, 981–992. [Google Scholar] [CrossRef]
  30. Malik, A.H.; Yandrapalli, S.; Aronow, W.S.; Panza, J.A.; Cooper, H.A. Meta-Analysis of Direct-Acting Oral Anticoagulants Compared with Warfarin in Patients >75 Years of Age. Am. J. Cardiol. 2019, 123, 2051–2057. [Google Scholar] [CrossRef]
  31. Sharma, M.; Cornelius, V.R.; Patel, J.P.; Davies, J.G.; Molokhia, M. Efficacy and Harms of Direct Oral Anticoagulants in the Elderly for Stroke Prevention in Atrial Fibrillation and Secondary Prevention of Venous Thromboembolism: Systematic Review and Meta-Analysis. Circulation 2015, 132, 194–204. [Google Scholar] [CrossRef] [PubMed]
  32. Hijazi, Z.; Hohnloser, S.H.; Oldgren, J.; Andersson, U.; Connolly, S.J.; Eikelboom, J.W.; Ezekowitz, M.D.; Reilly, P.A.; Siegbahn, A.; Yusuf, S.; et al. Efficacy and safety of dabigatran compared with warfarin in relation to baseline renal function in patients with atrial fibrillation: A RE-LY (Randomized Evaluation of Long-term Anticoagulation Therapy) trial analysis. Circulation 2014, 129, 961–970. [Google Scholar] [CrossRef]
  33. Noseworthy, P.A.; Yao, X.; Abraham, N.S.; Sangaralingham, L.R.; McBane, R.D.; Shah, N.D. Direct Comparison of Dabigatran, Rivaroxaban, and Apixaban for Effectiveness and Safety in Nonvalvular Atrial Fibrillation. Chest 2016, 150, 1302–1312. [Google Scholar] [CrossRef] [PubMed]
  34. Graham, D.J.; Reichman, M.E.; Wernecke, M.; Hsueh, Y.H.; Izem, R.; Southworth, M.R.; Wei, Y.; Liao, J.; Goulding, M.G.; Mottet, K.; et al. Stroke, bleeding, and mortality risks in elderly Medicare beneficiaries treated with dabigatran or rivaroxaban for nonvalvular atrial fibrillation. JAMA Intern. Med. 2016, 176, 1662–1671. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The flow chart of the study. Abbreviation: APT, antiplatelet drug; LMWH, low mass weight heparin; VKA, vitamin K antagonists.
Figure 1. The flow chart of the study. Abbreviation: APT, antiplatelet drug; LMWH, low mass weight heparin; VKA, vitamin K antagonists.
Ijerph 19 11938 g001
Figure 2. Division into individual NOACs depending on the age.
Figure 2. Division into individual NOACs depending on the age.
Ijerph 19 11938 g002
Figure 3. Temporal trends of anticoagulant therapy in all study patients treated with NOACs.
Figure 3. Temporal trends of anticoagulant therapy in all study patients treated with NOACs.
Ijerph 19 11938 g003
Figure 4. Division into individual NOACs depending on the CHA2DS2- VASc score.
Figure 4. Division into individual NOACs depending on the CHA2DS2- VASc score.
Ijerph 19 11938 g004
Table 1. Clinical characteristics of patients treated with apixaban, dabigatran and rivaroxaban. Results of the laboratory test and echocardiographic examinations of patients treated with apixaban, dabigatran and rivaroxaban.
Table 1. Clinical characteristics of patients treated with apixaban, dabigatran and rivaroxaban. Results of the laboratory test and echocardiographic examinations of patients treated with apixaban, dabigatran and rivaroxaban.
Clinical CharacteristicAll NOAC
n = 1443
Apixaban
n = 329
Dabigatran
n = 618
Rivaroxaban
n = 496
p
Age
Mean (SD), years82.3 (5)83.8 (5.3)81.7 (4.8)81.9 (4.8)<0.001
Median (IQR)82 (8)84 (8) a81 (7) b82 (7) b
Gender
Female, n (%)836 (57.9)193 (58.7)338 (54.7)305 (61.5)0.070
Type of atrial fibrillation n(%)
Paroxysmal657 (45.5)148 (45)295 (47.7)214 (43.1)0.303
Persistent154 (10.7)35 (10.6)57 (9.2)62 (12.5)0.212
Permanent632 (43.8)146 (44.4)266 (43)220 (44.4)0.882
Non-permanent811 (56.2)183 (55.6)352 (57)276 (55.6)0.882
Medical history n(%)
Hypertension1174 (81.3)259 (78.7) ab524 (84.8) b391 (78.8) a0.015
Heart failure992 (68.7)237 (72)419 (67.8)336 (67.7)0.342
Vascular disease693 (48)164 (49.8)301 (48.7)228 (46)0.498
Previous myocardial infarction351 (24.3)93 (28.3)149 (24.1)109 (22)0.118
PAD159 (11)45 (13.7)71 (11.5)43 (8.7)0.071
Previous stroke/TIA/peripheral embolism 244 (16.9)55 (16.7)111 (18)78 (15.7)0.610
Diabetes mellitus439 (30.4)106 (32.2)183 (29.6)150 (30.2)0.704
Any previous bleeding59 (4.1)27 (8.2) a20 (3.2) b12 (2.4) b<0.001
Ulcer36 (2.5)4 (1.2)15 (2.4)17 (3.4)0.136
Malignancy81 (5.6)22 (6.7)31 (5)28 (5.6)0.568
Thromboembolic risk
CHA2DS2-VASC score
Mean (SD)5.2 (1.4)5.3 (1.5)5.2 (1.4)5.2 (1.4)0.644
Bleeding risk
HAS-BLED score
Mean (SD)2.2 (0.8)2.2 (0.7)2.3 (0.7)2.2 (0.8)0.026
Median (IQR)2 (1)2 (1) a2 (1) b2 (1) ab
≥3, n (%)466 (32.3)88 (26.7) a214 (34.6) b164 (33.1) ab0.043
Reason for hospitalisation, n(%)
Electrical cardioversion96 (6.6)18 (5.5)42 (6.8)36 (7.3)0.591
Planned coronarography/PCI/ACS115 (8)31 (9.4)44 (7.1)40 (8.1)0.458
Heart failure414 (28.7)120 (36.5) a171 (27.7) b123 (24.8) b0.001
Ablation17 (1.2)2 (0.6)5 (0.8)10 (2)0.122
CIED301 (20.8)51 (15.5) a133 (21.5) ab116 (23.4) b0.017
AF attack157 (10.9)32 (9.7)78 (12.6)47 (9.5)0.183
Other343 (23.8)75 (22.8)145 (23.5)123 (24.8)0.781
Laboratory tests
Haemoglobin
Mean (SD), g/dl12.9 (3.3)
n = 1418
12.5 (1.7)
n = 319
13.1 (4.7)
n = 609
12.8 (1.6)
n = 490
<0.001
Median (IQR)12.8 (2.1)12.4 (2.2) a12.9 (2.1) b12.9 (2) b
Platelet
Mean (SD), K/uL209.9 (75.3)
n = 1410
207.6 (79.5)
n = 318
207.2 (72.6)
n = 604
214.6 (75.7)
n = 488
0.113
Median (IQR)198 (78)197.5 (93.8)194 (72)202.5 (76)
eGFR
Mean (SD), mL/min/1.73 m249.9 (14.8)
n = 1438
45.8 (17.3)
n = 327
52.3 (12.6)
n = 616
49.7 (14.9)
n = 495
<0.001
Median (IQR)49.3 (19.3)43 (24.8) a51.2 (17.2) b49.2 (19.6) c
<60 mL/min/1.73 m2, n (%)1107 (77)
n = 1438
264 (80.7)
N = 327
458 (74.4)
n = 616
385 (77.8)
n = 495
0.088
Echocardiographic findings
Ejection fraction, mm
Mean (SD)49.2 (20.3)
n = 1185
47 (12.5)
n = 269
50.3 (27.4)
n = 516
49.4 (12)
n = 400
0.021
Median (IQR)50 (18)50 (17) a52 (17) b50 (15) ab
Left ventricular systolic diameter, mm
Mean (SD)36.3 (9.5)
n = 1160
36.1 (9.2)
n = 263
37 (10)
n = 509
35.7 (8.8)
n = 388
0.352
Median (IQR)35 (11)35 (12)35 (12)34 (10)
Left ventricular diastolic diameter, mm
Mean (SD)50.2 (8)
n = 1168
49.2 (8.5)
n = 268
50.9 (8)
n = 511
49.9 (7.6)
n = 389
0.016
Median (IQR)49 (10)48.5 (12) a50 (11) b49 (10) ab
Reduced dose, n (%)920 (63.7)137 (41.6) a487 (78.8) b296 (59.7) c<0.001
Antiplatelet with NOAC, n (%) 104 (7.2)31 (9.4)39 (6.3)34 (6.9)0.197
Different letters between the scores indicate significant differences at the level p < 0.05; p < 0.05 corresponds to the comparison between the 2 drugs with the same letter. Data are presented as number (percentage) or mean (standard deviation) (SD)) or median (interquartile range) (IQR). Abbreviations: ACS, acute coronary syndromes; AF, atrial fibrillation; CI, confidence interval; CIED, cardiac implantable electronic device; eGFR, estimated Glomerular Filtration Rate; PAD, peripheral artery disease; PCI, percutaneous coronary interventions; TIA, transient ischaemic attack.
Table 2. Results of univariate regression analyses for the use of apixaban, dabigatran and rivaroxaban, respectively.
Table 2. Results of univariate regression analyses for the use of apixaban, dabigatran and rivaroxaban, respectively.
ApixabanDabigatranRivaroxaban
FactorsOR95% CIpOR95% CIpOR95% CIp
Age1.081.06–1.11<0.0010.960.94–0.98<0.0010.980.96–1.000.078
Gender1.040.81–1.330.7610.790.64–0.980.0311.251.00–1.560.048
Type of atrial fibrillation
Paroxysmal0.970.76–1.240.8211.170.95–1.440.1460.860.69–1.080.188
Persistent1.000.67–1.480.9820.760.54–1.080.1241.330.94–1.870.104
Permanent1.030.81–1.320.8100.950.77–1.170.6171.040.83–1.290.758
Non-permanent0.970.76–1.240.8101.060.86–1.300.6170.970.78–1.200.758
Medical history
Hypertension0.810.59–1.090.8051.501.14–1.980.0040.780.59–1.030.075
Heart failure1.230.93–1.610.1430.930.74–1.160.5020.930.74–1.180.552
Vascular disease1.100.86–1.410.4511.050.85–1.290.6540.880.71–1.100.258
Previous myocardial infarction1.310.99–1.730.0580.980.77–1.250.8700.820.63–1.060.133
PAD1.390.96–2.010.0811.090.78–1.520.6220.680.47–0.980.040
Previous stroke/TIA/peripheral embolism 0.980.71–1.370.9161.140.86–1.500.3560.580.26–1.290.183
Diabetes mellitus1.160.86–1.450.4200.940.75–1.170.5620.990.78–1.250.914
Any previous bleeding3.031.78–5.13<0.0010.670.39–1.170.1590.480.25–0.900.023
Ulcer0.420.15–1.190.1010.950.49–1.860.8871.730.89–3.370.104
Malignancy1.280.77–2.130.3370.820.52–1.300.3941.010.63–1.620.970
Thromboembolic risk
CHA2DS2-VASC score1.030.94–1.120.5391.010.94–1.090.7360.970.89–1.040.372
Bleeding risk
HAS-BLED score0.910.78–1.080.2831.211.05–1.390.0080.870.76–1.010.068
≥3, n (%)0.710.54–0.940.0151.200.96–1.500.1011.060.84–1.330.650
Reason for hospitalisation
Electrical cardioversion0.770.45–1.300.3291.040.69–1.580.8501.160.75–1.780.505
Planned coronarography/PCI/ACS 1.280.83–1.960.2690.810.55–1.200.3031.020.68–1.520.923
Heart failure1.601.23–2.08<0.0010.920.73–1.160.4580.740.58–0.950.018
Ablation0.450.10–1.970.2880.550.19–1.580.2682.761.05–7.300.040
CIED0.630.46–0.880.0071.070.83–1.390.5921.280.99–1.660.065
AF attack0.850.57–1.280.4451.360.98–1.900.0670.800.56–1.140.216
Laboratory test
Haemoglobin0.860.79–0.93<0.0011.101.03–1.170.0060.990.96–1.030.749
Platelet1.001.00–1.000.9991.001.00–1.000.2491.001.00–1.000.085
eGFR0.970.97–0.98<0.0011.101.01–1.03<0.0011.000.99–1.010.724
eGFR < 60 mL/min/1.73 m21.310.96–1.770.0850.780.61–0.990.0431.080.83–1.400.556
Echocardiographic findings
Ejection fraction0.990.98–1.000.0071.011.00–1.010.1661.001.00–1.010.857
Left ventricular systolic diameter1.000.98–1.010.6331.011.00–1.030.0480.990.98–1.000.097
Left ventricular diastolic diameter0.980.96–1.000.0151.021.01–1.040.0050.990.98–1.010.440
Reduced dose0.300.23–0.39<0.0013.372.66–4.26<0.0010.770.61–0.960.020
Antiplatelet with NOAC1.480.96–2.300.0790.790.52–1.190.2550.920.60–1.410.708
Abbreviations: ACS, acute coronary syndromes; AF, atrial fibrillation; CI, confidence interval; CIED, cardiac implantable electronic device; eGFR, estimated Glomerular Filtration Rate; NOAC, novel oral anticoagulants; PAD, peripheral artery disease; PCI, percutaneous coronary interventions; TIA, transient ischaemic attack; OR, odds ratio.
Table 3. Predictors of drug selection in the multivariate logistic regression analysis.
Table 3. Predictors of drug selection in the multivariate logistic regression analysis.
Apixaban 1Dabigatran 2Rivaroxaban 3
FactorsOR95% CIpOR95% CIpOR95% CIp
Age1.081.05–1.11<0.0010.960.94–0.98<0.0010.980.96–1.000.094
Gender0.990.76–1.290.9160.820.65–1.020.0711.250.99–1.580.058
Hypertension0.800.58–1.100.1681.561.18–2.060.0220.740.56–0.980.034
PAD1.200.82–1.760.3511.170.83–1.640.3730.720.49–1.040.081
Any previous bleeding2.941.71–5.06<0.0010.680.39–1.180.1670.500.26–0.950.034
Heart failure1.280.96–1.710.0930.980.76–1.260.8730.830.63–1.080.157
Ablation0.590.13–2.640.4910.520.18–1.510.2282.390.89–6.410.084
CIED0.630.44–0.900.0111.110.84–1.460.4701.250.94–1.660.126
eGFR < 60 mL/min/1.73 m21.200.87–1.660.2660.830.65–1.080.1641.070.82–1.410.604
1: χ2(9) = 74.39; p < 0.001; Nagelkerke R2 = 0.08; 2: χ2(9) = 33.98; p < 0.001; Nagelkerke R2 = 0.03, 3: χ2(9) = 30.51; p < 0.001; Nagelkerke R2 = 0.03. Abbreviations: CIED, cardiac implantable electronic device; eGFR, estimated Glomerular Filtration Rate; PAD, peripheral artery disease; OR, odds ratio.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bielecka, B.; Gorczyca-Głowacka, I.; Wożakowska-Kapłon, B. Nine-Year Trends in Prevention of Thromboembolic Complications in Elderly Patients with Atrial Fibrillation Treated with NOACs. Int. J. Environ. Res. Public Health 2022, 19, 11938. https://doi.org/10.3390/ijerph191911938

AMA Style

Bielecka B, Gorczyca-Głowacka I, Wożakowska-Kapłon B. Nine-Year Trends in Prevention of Thromboembolic Complications in Elderly Patients with Atrial Fibrillation Treated with NOACs. International Journal of Environmental Research and Public Health. 2022; 19(19):11938. https://doi.org/10.3390/ijerph191911938

Chicago/Turabian Style

Bielecka, Bernadetta, Iwona Gorczyca-Głowacka, and Beata Wożakowska-Kapłon. 2022. "Nine-Year Trends in Prevention of Thromboembolic Complications in Elderly Patients with Atrial Fibrillation Treated with NOACs" International Journal of Environmental Research and Public Health 19, no. 19: 11938. https://doi.org/10.3390/ijerph191911938

APA Style

Bielecka, B., Gorczyca-Głowacka, I., & Wożakowska-Kapłon, B. (2022). Nine-Year Trends in Prevention of Thromboembolic Complications in Elderly Patients with Atrial Fibrillation Treated with NOACs. International Journal of Environmental Research and Public Health, 19(19), 11938. https://doi.org/10.3390/ijerph191911938

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop