Next Article in Journal
Precision Dosing of Meropenem in Adults with Normal Renal Function: Insights from a Population Pharmacokinetic and Monte Carlo Simulation Study
Previous Article in Journal
Unveiling a New Antimicrobial Peptide with Efficacy against P. aeruginosa and K. pneumoniae from Mangrove-Derived Paenibacillus thiaminolyticus NNS5-6 and Genomic Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Returned Rate and Changed Patterns of Systemic Antibiotic Use in Ambulatory Care in Hungary after the Pandemic—A Longitudinal Ecological Study

1
Institute of Clinical Pharmacy, Faculty of Pharmacy, University of Szeged, 6725 Szeged, Hungary
2
University Pharmacy Department, Albert Szent-Györgyi Health Center, University of Szeged, 6725 Szeged, Hungary
3
Department of Internal Medicine Infectiology Unit, Albert Szent-Györgyi Health Centre, University of Szeged, Állomás Street 1-3, 6725 Szeged, Hungary
4
Institute for Translational Medicine, Medical School, University of Pécs, 7624 Pécs, Hungary
5
Emergency Department, Albert Szent-Györgyi Health Centre, University of Szeged, Semmelweis Street 6, 6725 Szeged, Hungary
*
Authors to whom correspondence should be addressed.
Antibiotics 2024, 13(9), 848; https://doi.org/10.3390/antibiotics13090848
Submission received: 22 July 2024 / Revised: 21 August 2024 / Accepted: 3 September 2024 / Published: 5 September 2024

Abstract

:
The COVID-19 pandemic affected the epidemiology of infectious diseases and changed the operation of health care systems and health care seeking behavior. Our study aimed to analyze the utilization of systemic antibiotics in ambulatory care in Hungary after the COVID-19 pandemic and compare it to the period before COVID. We defined three periods (24 months each): Before COVID, COVID, and After COVID. Monthly trends in systemic antibiotic (J01) use were calculated using the WHO ATC-DDD index and expressed as DDD/1000 inhabitants/day (DID) and number of exposed patients per active agent. The data were further categorized by the WHO AWaRe classification. In the After COVID period, we detected almost the same (11.61 vs. 11.11 DID) mean monthly use of systemic antibiotics in ambulatory care compared to the Before COVID period. We observed a decrease in the seasonality index in the After COVID period (46.86% vs. 39.86%). In the After COVID period, the use of cephalosporins and quinolones decreased significantly, while in the case of macrolides, a significant increase was observed compared to the Before COVID period, with excessive azithromycin use (66,869 vs. 97,367 exposed patients). This study demonstrated significant changes in the pattern of ambulatory care antibiotic use in Hungary.

1. Introduction

Antimicrobial resistance (AMR) is one of the most significant public health problems. Its consequences are considered as devastating as climate change, the other, intertwined global challenge [1,2]. The development of AMR largely depends on the use of antibiotics, and we can consider inappropriate antibiotic use as one of the main drivers of AMR [3,4]. The COVID-19 pandemic and the consequent governmental restrictions influenced the epidemiology of other infectious diseases, changed the operation of health care systems, and affected health care seeking behavior [5,6]. During the pandemic, AMR silently increased further, and antibacterial stewardship activities were limited [7]. Several studies have addressed antibiotic utilization during the COVID pandemic, but to the best of our knowledge, very few publications have examined the antibiotic utilization pattern after the pandemic and compared it to preceding periods [8]. Hence, this study aimed to fill in this research gap and assess the trends and patterns in antibiotic utilization in the Hungarian outpatient sector before, during, and after the pandemic.

2. Results

During the entire study period of 72 months, 244 million DDDs of systemic antibiotics were used in the outpatient sector in Hungary. The national use of systemic antibiotics was 11.61 DDD/1000 inhabitants/day (DID) before the COVID period. During the COVID period, this decreased to 8.99 DID (22.57% decrease), and in the After COVID period, it returned to 11.11 DID.
Table 1 summarizes the monthly means of antibiotic use. The highest absolute use was observed for the penicillins group (WHO’s Anatomical Therapeutic Chemical Classification Index (ATC code: J01C)) across all three periods. However, the use of this antibiotic subgroup decreased during the COVID period, from 4.03 to 2.93 DID (27.3% decrease). After the pandemic, the level of use increased again, and even exceeded the Before COVID averages (4.12 DID). This trend was also observed for the most frequently used penicillin subgroup, the J01CR ATC subgroup. In contrast, in the use of other penicillin subgroups, we observed a continuous decrease during the study periods. In the case of beta-lactamase sensitive penicillins (ATC code: J01CE), we observed marginal use during all three periods. During the COVID period, there was a significant reduction in the use of cephalosporins (J01D), decreasing from 2.00 to 1.24 DID (38.0% decrease), and in the use of quinolones, which dropped from 1.98 to 1.36 DID (31.4% decrease). After the pandemic, a slight increase in the use of both groups was observed, but their utilization levels remained below those seen in the Before COVID period. Second-generation cephalosporins (J01DC) were the most used cephalosporins in all periods. During the pandemic, we observed a decrease in the use of the J01DC group, from 1.70 to 1.01 DID (40.59% decrease), and this scale of use stagnated in the After COVID period. However, in the use of third-generation cephalosporins (ATC code: J01DD), we observed a marked increase in the After COVID period. In the case of macrolides, lincosamides group (ATC code: J01F), we observed a significant increase in the After COVID period compared to the Before COVID period, from 2.40 to 2.89 DID.
Based on the WHO AWaRe classification, we observed a decrease in the use of Watch antibiotics during the pandemic, from 5.92 to 4.45 DID (a 24.83% decrease). However, after the COVID period, their use almost returned to Before COVID levels (5.70 DID). Regarding the percental share of Access group antibiotics (Access %) of the total systemic antibiotic use (J01), we observed a rate of ~50% in all three study periods (Table 1).
The top ten list of antibacterials is presented in Table 2. The same five active agents were at the top of the list before, during, and after the pandemic, with co-amoxiclav heading the list. However, some changes were detected: azithromycin became the second most frequently used antibacterial agent during the COVID period and maintained its position after the pandemic. Cefuroxime, which held the second position in the Before COVID period, dropped to fifth place in the list after the pandemic. Both amoxicillin and sulfamethoxazole with trimethoprim disappeared, while two new broad spectra cephalosporins appeared in the top ten list: cefixime (7th place) and cefprozil (10th place). Table 2 reveals that while the proportion of Access and Watch group agents in the top ten was equal before and during COVID (five agents each from Access and Watch groups), more Watch antibacterials were in the list after the pandemic (three agents from Access group, five agents from Watch group).
The changes in the top list were also reflected in the mean monthly number of exposed patients, summarized in Table 3. In the case of amoxicillin, clavulanic acid (co-amoxiclav), and azithromycin, we observed that the minimum mean monthly number of exposed patients doubled in the After COVID period compared to the pandemic period. However, for the other three antibacterial agents listed in the table, we noted a decrease in the number of exposed patients in the After COVID period (Supplementary Figures S1–S5).
The pattern of antibacterial use changed during the three periods. Figure 1 illustrates that the highest relative use was observed in the Beta-lactam antibacterials (ATC codes: J01C, J01D). In these groups, the combinations of penicillins, including beta-lactamase inhibitors (J01CR), had the largest relative share of use during all periods. The use of narrow-spectrum beta-lactamase sensitive penicillins (J01CE) had already been declining before the pandemic, and this downward trend continued both during and after the pandemic. In the relative use of second-generation cephalosporins (J01DC), we observed a slight decrease during all three periods. However, the relative use of third-generation cephalosporins (J01DD) increased markedly in the After COVID period. In the case of macrolides (J01FA), we observed a different trend: a continuous increase in the relative use during and after the pandemic. We noted a slight decrease in the relative use of quinolones (J01M) during the pandemic, which continued thereafter.
The seasonality indexes (J01_SV) for the three study periods are displayed in Table 4. For systemic antibacterials (J01), we observed a slight increase in the seasonality index during the pandemic (from 46.86% to 53.42%), which then decreased in the After COVID period (39.68%). Among the ATC subgroups, the most significant change was observed for the macrolides (J01FA); the seasonality index increased from 60.63% to 104.74% during the COVID period but returned to the Before COVID levels after the pandemic. In all other antibacterial subgroups, we detected a decrease in the seasonality index after the pandemic (see Table 4).
In Figure 2, we display the monthly use of systemic antibiotics (J01) during the COVID-19 period and the corresponding monthly values of the Before and After COVID periods, while in Supplementary Figures S6–S9 we display the monthly use of the main antibiotic subgroups.
In the After COVID period, we observed no significant changes in the monthly systemic antibiotic use compared to the Before COVID period. In both periods, there was a winter peak, but it was slightly lower in the After COVID period.

3. Discussion

To our knowledge, except for the ESAC-NET annual epidemiological report and an ESAC-Net surveillance paper, this study is the first to analyze ambulatory care antibiotic use in a Central European country following the COVID pandemic [10,11]. Moreover, to the best of our knowledge, this is the first study to analyze antibiotic use including the 2 years after the pandemic. These facts significantly restrict our ability to make cross-national comparisons. During the pandemic, outpatient health care systems underwent reorganization, and multiple innovations were integrated into primary care, which persisted after the pandemic [6]. In particular, telemedicine was maintained during the After COVID period, which may have had a significant impact on the prescription of antibiotic treatments. In this study, we investigated whether antibiotic use and patterns returned to the pre-pandemic levels despite these changes.

3.1. Scale of Systemic Antibacterial (J01) Use

In Hungary, during the COVID period, there was a significant 22.57% decrease in the use of systemic antibiotics in ambulatory care compared to the Before COVID period. Similarly to in Hungary, a reduction in antibiotic use during the COVID was recorded in the United States (US) and Canada, and from Europe, in Portugal, Belgium, and the United Kingdom (UK) [8,12,13,14,15]. In 2020, in the first year of the COVID pandemic, the European Union (EU)/European Economic Area (EEA) experienced a significant reduction (from 18.00 to 15.00 DID between 2019 and 2020) in antibiotic consumption in the ambulatory sector. However, this decrease appeared to be temporary, as by 2022, the EU/EEA mean community (outpatient, ambulatory) consumption returned to pre-pandemic levels (an increase from 15.00 to 17.80 DID between 2021 and 2022) [10,11,16,17,18,19]. This may be explained by the fact that severe social limitations were loosened at the end of the pandemic, enabling life and infectious disease epidemiology to return to normal.
Regarding systemic antibacterial use in the community sector in Hungary, we observed that after antibacterial use decreased during the pandemic, utilization levels returned to the Before COVID levels (Before COVID: 11.61 DID–COVID: 8.99 DID–After COVID: 11.11 DID). In comparison, in the United Kingdom (UK), an increase of 0.40 DID in systemic antibiotic use was observed in the primary care sector, comparing March 2019 to March 2023. However, the use of a different study design and classification (the study used the British National Formulary to define systemic antibiotics) limits comparability [8]. Regarding antibacterial subgroups, we observed a slight increase in the absolute use of penicillins (J01C) in the After COVID period compared to the Before COVID period. In the UK, a similar trend was detected [8]. Regarding cephalosporins (J01D), the observed decline in absolute use during the COVID period persisted thereafter. In contrast, in the UK, there was a slight increase in the absolute use of this subgroup after the COVID period [8]. Again, different methodologies hinder comparison. The downward trend in the absolute use of quinolones observed in Hungary was also observed in the UK [8]. Regarding macrolide use, Hungary experienced a significant increase in use during the After COVID period. For individual countries, a heterogeneous pattern was observed. In addition to Hungary, 12 other countries reported higher consumption of macrolides in 2022 compared to 2019, whereas in the UK, a slight decrease was reported [8,10].
Analyzing systemic antibiotic use (J01) based on the WHO AWaRe classification, we observed that during the pandemic, the use of the Watch antibacterials decreased (from 5.92 to 4.45 DID). However, this reduction was not sustained in the After COVID period, as their use returned to 5.70 DID in Hungarian outpatient care.
The global use of Watch group antibiotics was on the rise, as they were prescribed for outpatients for symptoms such as fever, cough, and diarrhea [20]. Reducing the inappropriate use of Watch antibiotics is crucial for the global management of antibiotic resistance. At the same time, it is important to ensure that vulnerable populations continue to have or, where it is necessary, gain improved access to the Access group antibiotics [20,21,22].

3.2. Seasonal Variation

A previous Hungarian study showed significant seasonal variation in the use of systemic antibiotics in ambulatory care in Hungary, with markedly higher use during the winter months [3]. A study assessing the quality of antibiotic consumption in the community sector within the EU/EEA found that Hungary had one of the highest seasonality indexes in 2017 (J01_SV%: 51.31%). In contrast, the seasonality index was 10.56% in Denmark, 11.07% in the UK, and 12.73% in Finland [23]. In our study, we observed that the seasonality index for systemic antibacterials remained high in all three periods, with a slightly lower value in the After COVID period (Before COVID: 46.86%–COVID: 53.42%–After COVID: 39.68%). In comparison, we did not find any direct data (with seasonality index) from other countries regarding the impact of the pandemic. However, in Portugal, a nearly 40% decrease was detected in antibiotic use during the winter months of 2020, compared to the averages of the previous two years [14]. The high seasonal variation suggests that antibiotics are often prescribed for self-limiting viral respiratory tract infections (RTIs) [24].

3.3. Pattern of Systemic Antibacterial (J01) Use

Previous Hungarian studies have indicated that beta-lactam antibiotics (penicillins, cephalosporins) consistently played a significant role in outpatient antibiotic use in Hungary [3,25]. In our study, we observed that the beta-lactam antibacterials were still the most commonly used antibacterials. These groups represented nearly 50% of outpatient antibiotic use in all three study periods. Within the penicillins group, the use of combinations of penicillins, including beta-lactamase inhibitors (J01CR), was the most significant: this subgroup had the highest absolute use in all three study periods. From the J01CR group, amoxicillin and clavulanic acid (co-amoxiclav) led the top lists, with more than 150,000 exposed patients per month in the After COVID period (more than 1.5% of the country’s population). The dominance of co-amoxiclav is suboptimal, as it has very limited indication in the Hungarian guidelines (e.g., in acute bacterial rhinosinusitis if the first-line therapy is ineffective). In contrast, in the use of penicillins with extended spectrum (J01CA), we observed a low and constantly decreasing use, despite national resistance data and guideline suggestions. The latest national resistance data from ambulatory care samples confirmed that pneumococci, the most frequent pathogen in bacterial respiratory tract infections were sensitive to aminopenicillins in 93.2%, enabling empirical use of aminopenicillins. Consequently, amoxicillin is the first-line empiric antibiotic therapy recommended in Hungarian guidelines for acute otitis media, bacterial sinusitis, and bacterial pneumonia [26,27,28,29]. In the WHO 2023 23rd Model List of Essential Medicines, amoxicillin is also the first-line therapy for many bacterial infections [30]. The use of beta-lactamase sensitive penicillins (J01CE) became marginal in Hungary during the COVID period and continued to decline in the After COVID period. This decrease was also attributed to the limited availability of these products in Hungary. Phenoxymethylpenicillin used to be available in many products, but only one pharmaceutical company’s product remained on the market, often impacted by shortages. This marginal use is suboptimal, as phenoxymethylpenicillin is still the first-line therapy in Hungary for tonsillopharyngitis caused by Streptococcus pyogenes, due to national resistance surveillance data which showed 100% sensitivity of Streptococcus pyogenes to penicillin [29,31]. According to WHO, phenoxymethylpenicillin is the first choice therapy for community-acquired pneumonia (mild to moderate), pharyngitis, and progressive apical dental abscess, and is present on the WHO’s Essential Medicine list and guideline [30]. Regarding cephalosporins, second-generation was the most commonly used subgroup. Cefuroxim use decreased, while cefprozil appeared in the top list in the After COVID period (10th place). This may have been due to the uncertain availability (i.e., shortages) of the most commonly prescribed strength of cefuroxime (500 mg) after the pandemic. However, we detected an increase in the use of third-generation cephalosporins (J01DD), and cefixime appeared in the top 10 list. As cefixime has very limited indication in primary care (recommended as first-line agent for acute uncomplicated pyelonephritis if patient can be treated as outpatient), its increased use is worrisome [32].
During this study, the use of quinolones (J01M) increased slightly in the After COVID period compared to the pandemic years, but it remained below the Before COVID levels. A positive observation is that quinolone consumption continued to decrease in the outpatient sector in Hungary. We also observed a continuous and significant decrease in the relative use of quinolones, with the smallest relative usage occurring in the After COVID period. This is in line with the European Medicines Agency (EMA)’s recommendations from 2018 to limit quinolone use, after completing a review of severe, disabling, and potentially permanent side effects associated with quinolone prescribing [33,34,35]. As in Hungary, the sensitivity of the two common uropathogens, Escherichia coli and Klebsiella pneumonia, to fluoroquinolones was below 80%, beside safety issues, national resistance data also do not support the empirical use of fluoroquinolones [29].
The relative share of macrolide (J01FA) use has shown a significant increase since the pandemic. From the macrolide subgroup (J01FA), azithromycin emerged as the second most commonly used antibacterial agent in Hungary during the pandemic, and maintained this position thereafter. This is surprising, as in Hungarian guidelines, azithromycin is recommended as the first-line empiric therapy only for atypical pneumonia or in other infections in the case of severe penicillin allergy [28,31,36]. We presume that convenient and safe use of this agent (i.e., the once-daily dose and the short, 3-day therapy duration, and the low interaction potential) make its use favorable. Moreover, the higher incidence of pertussis cases in the country might generate azithromycin use in patients with long-term coughing [36].
The WHO 13th General Programme of Work 2019–2023 set the target that at least 60% of total systemic antibiotic consumption should be “Access” group antibiotics. In Hungary, this target was not achieved in any of the periods (Before COVID: 49.51%, COVID: 51.63%, After COVID: 50.80%) [20,21,22]. Based on the ESAC-Net 2022 report, many countries, such as Denmark, Finland, and the Netherlands, achieved this target level of relative Access antibiotic use [11].

3.4. Strengths and Limitations

The main strengths of this research are the longitudinal nature of the dataset and the coverage of two entire years after the pandemic. Additionally, we used a population-level dataset with excellent coverage, both in terms of inhabitants and systemic antibiotic use.
We must also acknowledge the limitations of this research. Firstly, the results may not be generalizable to other countries. Secondly, we lacked access to weekly antibiotic use data and indication-linked data, which prevented us from conducting interrupted time-series analysis and analyzing infection types. Thirdly, we could not differentiate prescriptions based on face-to-face or telemedicine consultations. Lastly, we did not have data on individual prescribers or patients, so we could not compare prescribing trends and pattern changes at the individual level.

4. Materials and Methods

Hungary initially declared a state of COVID pandemic emergency on 11 March 2020; hence, we defined the COVID pandemic period from March 2020 to February 2022. Then, we defined two more periods: the Before COVID period (from March 2018 to February 2020), and the After COVID period (from March 2022 to February 2024). Each period involved 24 months (see Table 5).
We conducted a population-based, longitudinal ecological study. The data were obtained from the public database of the National Health Insurance Fund (NEAK) in Hungary [37]. NEAK is the sole and mandatory insurance fund in the country, covering nearly the entire population. The NEAK database includes every reimbursed antibiotic prescription filled at community pharmacies throughout Hungary. Antibiotics are prescription-only medicines in Hungary and, with few exceptions, they are all reimbursed, meaning that the NEAK database has a ~95% drug coverage for systemic antibiotics. Package-level data of redeemed prescriptions were collected at monthly intervals. This study focused on antibiotics for systemic use, as classified by the WHO’s Anatomical Therapeutic Chemical (ATC group J01) Classification Index (version 2023) [38]. The data were further categorized by ATC antibiotic subgroups and the WHO defined AWARE classification (version 2023) [20,21,22]. The package-level utilization data were converted and expressed as defined daily doses (DDD) per 1000 inhabitants and per day (DID) [39]. In each period, we calculated the monthly means of systemic antibiotic use and compared it to the corresponding monthly means of the other two periods. We also obtained data on the number of patients exposed to different antibacterial agents. Patient-level data on antibiotic use are not available in Hungary from public resources; however, the NEAK published the number of individuals who obtained an antibiotic product at least once during a given month. Annual population data were obtained from the Hungarian Central Statistical Office [40].
To assess the quality of ambulatory care antibiotic use, we used the drug-specific quality indicators developed by the European Surveillance of Antimicrobial Consumption (ESAC). Among these indicators are the seasonal variation in systemic antibiotic use “J01_SV”. This quality indicator might reflect increased systematic antibiotic use in the “winter” quarters (October–December and January–March) compared to the “summer” quarters (July–September and April–June) within a year starting in July and ending the next calendar year in June, and expressed as a percentage: [DDD (winter quarters)/DDD (summer quarters) − 1] × 100 [9,23,41,42].
Descriptive statistics were presented as the mean ± standard deviation of the mean (SD), maximum and minimum values for continuous variables, and as the count and percentage for categorical variables. Normality was tested by visual interpretations (histogram and density plot). Continuous variables were tested via the independent t-test. Statistical tests were performed using R statistical software version 4.2.3 (R Foundation, Vienna, Austria) and IBM SPSS software (IBM SPSS Statistics for Windows, Version 29.0, IBM Corp., Armonk, NY, USA).

5. Conclusions

Compared to the Before COVID levels in this population-level analysis, we detected the same scale of antibiotic use in the After COVID period in the Hungarian ambulantory care sector. However, regarding the quality of antibiotic use, we observed many negative changes: the use of broad spectra penicillin combinations (J01CR) increased and the use of narrow spectra beta-lacatamse sensitive penicillins (J01CE) decreased, the usage of second-generation cephalosporins (J01D) decreased, while the use of third-generation ones increased. The use of macrolides (J01F) also significantly increased compared to the Before COVID period. However, we also detected favourable changes: the decreased absolute and relative use of quinolone antibacterials, and the moderate but still high seasonality index. There is an urgent need to evaluate the pandemic’s effects on both the quantity and quality of antibiotic prescribing in primary care settings in other countries, in order to tailor necessary antimicrobial stewardship interventions.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/antibiotics13090848/s1, Figure S1: Time series of amoxicillin and clavulanate exposed patients; Figure S2: Time series of azithromycin exposed patients; Figure S3: Time series of cefuroxime exposed patients; Figure S4: Time series of levofloxacin exposed patients; Figure S5: Time series of doxycyline exposed patients; Figure S6: Time series of beta-lactam antibacterials, penicillins use expressed as DDD/1000 inhabitants/day; Figure S7: Time series of cephalosporins use expressed as DDD/1000 inhabitants/day; Figure S8: Time series of macrolides, lincosamides use expressed as DDD/1000 inhabitants/day; Figure S9: Time series of quinolone antibacterials use expressed as DDD/1000 inhabitants/day.

Author Contributions

Conceptualization, M.M. and R.B.; methodology, M.M., R.B. and H.H.; validation, H.H., M.M., R.R., E.P., R.N., Z.E., M.C., G.S., E.H., D.C. and R.B.; formal analysis, M.M. and H.H.; writing—original draft preparation, H.H., R.B. and M.M.; writing—review and editing H.H., M.M., R.R., E.P., R.N., Z.E., M.C., G.S., E.H., D.C. and R.B.; visualization M.M., H.H. and R.B.; supervision: M.M. and R.B.; funding acquisition, D.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was implemented with support provided by the Ministry of Innovation and Technology of Hungary from the National Research, Development and Innovation Fund, financed by ITM NKFIA TKP2021-EGA-32. Ria Benko was supported by The János Bolyai Research Scholarship of the Hungarian Academy of Science.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Cassini, A.; Högberg, L.D.; Plachouras, D.; Quattrocchi, A.; Hoxha, A.; Simonsen, G.S.; Colomb-Cotinat, M.; Kretzschmar, M.E.; Devleesschauwer, B.; Cecchini, M.; et al. Attributable Deaths and Disability-Adjusted Life-Years Caused by Infections with Antibiotic-Resistant Bacteria in the EU and the European Economic Area in 2015: A Population-Level Modelling Analysis. Lancet Infect. Dis. 2019, 19, 56–66. [Google Scholar] [CrossRef] [PubMed]
  2. Watts, N.; Amann, M.; Ayeb-Karlsson, S.; Belesova, K.; Bouley, T.; Boykoff, M.; Byass, P.; Cai, W.; Campbell-Lendrum, D.; Chambers, J.; et al. The Lancet Countdown on Health and Climate Change: From 25 Years of Inaction to a Global Transformation for Public Health. Lancet 2018, 391, 581–630. [Google Scholar] [CrossRef] [PubMed]
  3. Matuz, M.; Soós, G.; Hajdú, E.; Papfalvi, E.; Visnyovszki, Á.; Viola, R.; Benkő, R. The characteristics and trends of Hungarian outpatient antibiotic use (2010–2019). Orv. Hetil. 2022, 163, 140–149. [Google Scholar] [CrossRef] [PubMed]
  4. Watkins, R.R.; Bonomo, R.A. Overview: The Ongoing Threat of Antimicrobial Resistance. Infect. Dis. Clin. N. Am. 2020, 34, 649–658. [Google Scholar] [CrossRef] [PubMed]
  5. Lim, J.; Broughan, J.; Crowley, D.; O’Kelly, B.; Fawsitt, R.; Burke, M.C.; McCombe, G.; Lambert, J.S.; Cullen, W. COVID-19’s Impact on Primary Care and Related Mitigation Strategies: A Scoping Review. Eur. J. Gen. Pract. 2021, 27, 166–175. [Google Scholar] [CrossRef] [PubMed]
  6. Elden, N.M.K.; Mandil, A.M.A.; Hegazy, A.A.; Nagy, N.; Mabry, R.M.; Khairy, W.A. Health Innovations in Response to the COVID-19 Pandemic: Perspectives from the Eastern Mediterranean Region. J. Public Health 2023, 45, 470–480. [Google Scholar] [CrossRef] [PubMed]
  7. Walia, K.; Mendelson, M.; Kang, G.; Venkatasubramanian, R.; Sinha, R.; Vijay, S.; Veeraraghavan, B.; Basnyat, B.; Rodrigues, C.; Bansal, N.; et al. How Can Lessons from the COVID-19 Pandemic Enhance Antimicrobial Resistance Surveillance and Stewardship? Lancet Infect. Dis. 2023, 23, e301–e309. [Google Scholar] [CrossRef] [PubMed]
  8. Kurdi, A.; Al Mutairi, N.; Baker, K.; M-Amen, K.; Darweesh, O.; Karwi, H.; Seaton, A.; Sneddon, J.; Godman, B. Impact of COVID-19 Pandemic on the Utilization and Quality of Antibiotic Use in the Primary Care Setting in England, March 2019–March 2023: A Segmented Interrupted Time Series Analysis of over 53 Million Individuals. Expert Rev. Anti-Infect. Ther. 2024, 1–12. [Google Scholar] [CrossRef] [PubMed]
  9. Coenen, S.; Ferech, M.; Haaijer-Ruskamp, F.M.; Butler, C.C.; Vander Stichele, R.H.; Verheij, T.J.M.; Monnet, D.L.; Little, P.; Goossens, H. ESAC Project Group European Surveillance of Antimicrobial Consumption (ESAC): Quality Indicators for Outpatient Antibiotic Use in Europe. Qual. Saf. Health Care 2007, 16, 440–445. [Google Scholar] [CrossRef] [PubMed]
  10. Ventura-Gabarró, C.; Leung, V.H.; Vlahović-Palčevski, V.; Machowska, A.; Monnet, D.L.; Högberg, L.D.; Group, E.-N. study Rebound in Community Antibiotic Consumption after the Observed Decrease during the COVID-19 Pandemic, EU/EEA, 2022. Eurosurveillance 2023, 28, 2300604. [Google Scholar] [CrossRef]
  11. Antimicrobial Consumption in the EU/EEA (ESAC-Net)—Annual Epidemiological Report for 2022. Available online: https://www.ecdc.europa.eu/en/publications-data/surveillance-antimicrobial-consumption-europe-2022 (accessed on 4 July 2024).
  12. King, L.M.; Lovegrove, M.C.; Shehab, N.; Tsay, S.; Budnitz, D.S.; Geller, A.I.; Lind, J.N.; Roberts, R.M.; Hicks, L.A.; Kabbani, S. Trends in US Outpatient Antibiotic Prescriptions During the Coronavirus Disease 2019 Pandemic. Clin. Infect. Dis. 2021, 73, e652–e660. [Google Scholar] [CrossRef]
  13. Kitano, T.; Brown, K.A.; Daneman, N.; MacFadden, D.R.; Langford, B.J.; Leung, V.; So, M.; Leung, E.; Burrows, L.; Manuel, D.; et al. The Impact of COVID-19 on Outpatient Antibiotic Prescriptions in Ontario, Canada; An Interrupted Time Series Analysis. Open Forum Infect. Dis. 2021, 8, ofab533. [Google Scholar] [CrossRef] [PubMed]
  14. Silva, T.M.; Estrela, M.; Gomes, E.R.; Piñeiro-Lamas, M.; Figueiras, A.; Roque, F.; Herdeiro, M.T. The Impact of the COVID-19 Pandemic on Antibiotic Prescribing Trends in Outpatient Care: A Nationwide, Quasi-Experimental Approach. Antibiotics 2021, 10, 1040. [Google Scholar] [CrossRef]
  15. Colliers, A.; De Man, J.; Adriaenssens, N.; Verhoeven, V.; Anthierens, S.; De Loof, H.; Philips, H.; Coenen, S.; Morreel, S. Antibiotic Prescribing Trends in Belgian Out-of-Hours Primary Care during the COVID-19 Pandemic: Observational Study Using Routinely Collected Health Data. Antibiotics 2021, 10, 1488. [Google Scholar] [CrossRef]
  16. Högberg, L.D.; Vlahović-Palčevski, V.; Pereira, C.; Weist, K.; Monnet, D.L.; ESAC-Net study group. ESAC-Net study group participants Decrease in Community Antibiotic Consumption during the COVID-19 Pandemic, EU/EEA, 2020. Eurosurveillance 2021, 26, 2101020. [Google Scholar] [CrossRef]
  17. Antimicrobial Consumption—Annual Epidemiological Report for 2019. Available online: https://www.ecdc.europa.eu/en/publications-data/surveillance-antimicrobial-consumption-europe-2019 (accessed on 4 July 2024).
  18. Antimicrobial Consumption in the EU/EEA (ESAC-Net)—Annual Epidemiological Report for 2020. Available online: https://www.ecdc.europa.eu/en/publications-data/surveillance-antimicrobial-consumption-europe-2020 (accessed on 4 July 2024).
  19. Antimicrobial Consumption in the EU/EEA (ESAC-Net)—Annual Epidemiological Report for 2021. Available online: https://www.ecdc.europa.eu/en/publications-data/surveillance-antimicrobial-consumption-europe-2021 (accessed on 4 July 2024).
  20. The WHO AWaRe (Access, Watch, Reserve) Antibiotic Book; World Health Organization: Geneva, Switzerland, 2022; ISBN 978-92-4-006238-2.
  21. AWaRe Classification of Antibiotics for Evaluation and Monitoring of Use, 2023. Available online: https://www.who.int/publications/i/item/WHO-MHP-HPS-EML-2023.04 (accessed on 4 July 2024).
  22. WHO Antibiotics Portal. Available online: https://aware.essentialmeds.org/groups (accessed on 4 July 2024).
  23. Adriaenssens, N.; Bruyndonckx, R.; Versporten, A.; Hens, N.; Monnet, D.L.; Molenberghs, G.; Goossens, H.; Weist, K.; Coenen, S. Quality Appraisal of Antibiotic Consumption in the Community, European Union/European Economic Area, 2009 and 2017. J. Antimicrob. Chemother. 2021, 76, ii60–ii67. [Google Scholar] [CrossRef] [PubMed]
  24. The Correct Use of Antimicorbal Agents [Hungarian]. Available online: https://efop180.antsz.hu/tajekoztatok/modszertani-anyagok/144-antimikrobas-szerek-helyes-hasznalata.html (accessed on 7 July 2024).
  25. Hambalek, H.; Matuz, M.; Ruzsa, R.; Engi, Z.; Visnyovszki, Á.; Papfalvi, E.; Hajdú, E.; Doró, P.; Viola, R.; Soós, G.; et al. Impact of the COVID-19 Pandemic on Ambulatory Care Antibiotic Use in Hungary: A Population-Based Observational Study. Antibiotics 2023, 12, 970. [Google Scholar] [CrossRef] [PubMed]
  26. Vitális, E. Management of Otitis in Outpatient Care; Version 1; Prepared by the Methodological Development Working Group I. of the EFOP 1.8.0-VEKOP-17-2017-00001 Project “Professional Methodological Development of the Healthcare System”. [hungarian] 2020. Available online: https://info.nevesforum.hu/wp-content/uploads/2021/03/otitis.pdf (accessed on 4 July 2024).
  27. Vitális, E. Management of Sinusitis in Outpatient Care; Version 1; Prepared by the Methodological Development Working Group I. of the EFOP 1.8.0-VEKOP-17-2017-00001 Project “Professional Methodological Development of the Healthcare System” [hungarian] 2020. Available online: https://info.nevesforum.hu/wp-content/uploads/2021/03/sinusitis.pdf (accessed on 4 July 2024).
  28. Hajdú, E.; Szabó, É. Home-Acquired Pneumonia Antimicrobial Treatment in Outpatient Care; Version 1; Prepared by the Methodological Development Working Group I of the EFOP 1.8.0-VEKOP-17-2017-00001 Project “Professional Methodological Development of the Healthcare System”. [Hungarian] 2020. Available online: https://info.nevesforum.hu/wp-content/uploads/2021/03/pneumonia.pdf (accessed on 4 July 2024).
  29. National Bacteriological Surveillance 2022 (NBS). Available online: https://www.nnk.gov.hu/index.php/mikrobiologiai-referencia-laboratoriumi-foosztaly/nemzeti-bakteriologiai-surveillance-nbs/category/347-nemzeti-bakteriologiai-surveillance-2022.html (accessed on 14 August 2024).
  30. WHO Model List of Essential Medicines—23rd List, 2023. Available online: https://www.who.int/publications/i/item/WHO-MHP-HPS-EML-2023.02 (accessed on 4 July 2024).
  31. Benkő, R. Guidelines for the Antibacterial Treatment of Acute Sore Throat (Tonsillopharyngitis) in Outpatient Care; Version 1; Prepared by the Methodological Development Working Group I. of the EFOP 1.8.0-VEKOP-17-2017-00001 Project “Professional Methodological Development of the Healthcare System” [hungarian] 2020. Available online: https://info.nevesforum.hu/wp-content/uploads/2021/03/torokfajas.pdf (accessed on 4 July 2024).
  32. Szabó, B.G. Antibiotic Treatment of Uncomplicated Acute Pyelonephritis in Outpatient Care; Version 1; Prepared by the Methodological Development Working Group I of the EFOP 1.8.0-VEKOP-17-2017-00001 Project “Professional Methodological Development of the Healthcare System”. [hungarian] 2020. Available online: https://info.nevesforum.hu/wp-content/uploads/2021/03/cystitis.pdf (accessed on 4 July 2024).
  33. Fluoroquinolone and Quinolone Antibiotics: PRAC Recommends New Restrictions on Use Following Review of Disabling and Potentially Long-Lasting Side Effects|European Medicines Agency. Available online: https://www.ema.europa.eu/en/news/fluoroquinolone-quinolone-antibiotics-prac-recommends-new-restrictions-use-following-review-disabling-potentially-long-lasting-side-effects (accessed on 7 July 2024).
  34. Pharmacovigilance Risk Assessment Committee (PRAC): 10–12 May 2023|European Medicines Agency. Available online: https://www.ema.europa.eu/en/events/pharmacovigilance-risk-assessment-committee-prac-10-12-may-2023 (accessed on 4 July 2024).
  35. Fluoroquinolone Antibiotics: Reminder of Measures to Reduce the Risk of Long-Lasting, Disabling and Potentially Irreversible Side Effects|European Medicines Agency. Available online: https://www.ema.europa.eu/en/news/fluoroquinolone-antibiotics-reminder-measures-reduce-risk-long-lasting-disabling-potentially-irreversible-side-effects (accessed on 3 July 2024).
  36. Increase of Pertussis Cases in the EU/EEA. Available online: https://www.ecdc.europa.eu/en/publications-data/increase-pertussis-cases-eueea (accessed on 22 July 2024).
  37. Antibiotic Utilisation Data. Available online: https://www.neak.gov.hu/felso_menu/szakmai_oldalak/publikus_forgalmi_adatok/gyogyszer_forgalmi_adatok/gyogyszer_forgalmi_adatok (accessed on 3 July 2024).
  38. ATCDDD—ATC/DDD Index. Available online: https://atcddd.fhi.no/atc_ddd_index/?code=J01&showdescription=no (accessed on 4 July 2024).
  39. Hollingworth, S.; Kairuz, T. Measuring Medicine Use: Applying ATC/DDD Methodology to Real-World Data. Pharmacy 2021, 9, 60. [Google Scholar] [CrossRef] [PubMed]
  40. Hungarian Central Statistical Office. Information Data Base. Population. Population Movement. KSH. Main Indicators of Population and Vital Events (1941–2024). Available online: https://www.ksh.hu/stadat_eng?lang=en&theme=nep (accessed on 4 July 2024).
  41. Goossens, H.; Ferech, M.; Vander Stichele, R.; Elseviers, M. Outpatient Antibiotic Use in Europe and Association with Resistance: A Cross-National Database Study. Lancet 2005, 365, 579–587. [Google Scholar] [CrossRef] [PubMed]
  42. Adriaenssens, N.; Coenen, S.; Versporten, A.; Muller, A.; Vankerckhoven, V.; Goossens, H.; ESAC Project Group. European Surveillance of Antimicrobial Consumption (ESAC): Quality Appraisal of Antibiotic Use in Europe. J. Antimicrob. Chemother. 2011, 66 (Suppl. 6), vi71–vi77. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The proportional share of different antibacterial subgroups of the total systemic antibacterial use in ambulatory care during the study periods.
Figure 1. The proportional share of different antibacterial subgroups of the total systemic antibacterial use in ambulatory care during the study periods.
Antibiotics 13 00848 g001
Figure 2. The monthly use of systemic antibacterials during the three study periods. The red columns represent the monthly use of systemic antibacterials during the COVID period, the blue lines represent the Before COVID systemic antibacterial use, and the green lines represent the After COVID systemic antibacterial use.
Figure 2. The monthly use of systemic antibacterials during the three study periods. The red columns represent the monthly use of systemic antibacterials during the COVID period, the blue lines represent the Before COVID systemic antibacterial use, and the green lines represent the After COVID systemic antibacterial use.
Antibiotics 13 00848 g002
Table 1. The mean monthly antibiotic use in the three study periods expressed as DDD per 1000 inhabitants per day—DID).
Table 1. The mean monthly antibiotic use in the three study periods expressed as DDD per 1000 inhabitants per day—DID).
Before COVID PeriodCOVID PeriodAfter COVID Periodp *
DID (Mean) ± SDMin–MaxDID (Mean) ± SDMin–MaxDID (Mean) ± SDMin–Max
J01A Tetracyclines0.74 ± 0.150.45–1.050.77 ± 0.220.46–1.170.67 ± 0.110.49–0.920.157
  J01CA Penicillins with extended spectrum0.43 ± 0.100.27–0.680.27 ± 0.090.14–0.460.22 ± 0.170.01–0.43<0.001
  J01CE Beta-lactamase sensitive penicillins0.16 ± 0.040.08–0.240.05 ± 0.020.03–0.120.04 ± 0.030.04–0.03<0.001
  J01CR Combinations of penicillins, incl. beta-lactamase inhibitors3.44 ± 0.792.35–5.472.60 ± 0.791.44–4.213.87 ± 0.842.68–5.470.024
J01C Beta-lactam antibacterials, penicillins4.03 ± 0.942.70–6.392.93 ± 0.901.60–4.784.12 ± 0.803.03–5.770.443
  J01DC Second-generation cephalosporins1.70 ± 0.480.93–2.881.01 ± 0.330.53–1.861.05 ± 0.200.70–1.51<0.001
  J01DD Third-generation cephalosporins0.29 ± 0.100.16–0.500.23 ± 0.110.09–0.430.45 ± 0.120.25–0.66<0.001
J01D Cephalosporins2.00 ± 0.571.10–3.391.24 ± 0.410.63–2.201.50 ± 0.281.04–2.020.008
J01E Sulfonamides and trimethoprim0.42 ± 0.060.33–0.560.36 ± 0.070.24–0.510.39 ± 0.060.32–0.510.364
  J01FA Macrolides1.91 ± 0.730.93–3.641.84 ± 1.130.45–4.222.41 ± 0.831.09–4.060.007
  J01FF Lincosamides0.49 ± 0.020.44–0.530.47 ± 0.030.41–0.550.47 ± 0.020.44–0.530.004
J01F Macrolides, lincosamides2.40 ± 0.741.39–4.182.31 ± 1.150.87–4.712.89 ± 0.841.54–4.460.009
J01M Quinolone antibacterials1.98 ± 0.521.28–3.301.36 ± 0.340.86–2.061.52 ± 0.331.01–2.120.001
J01X Other antibacterials0.04 ± 0.040.00–0.110.01 ± 0.000.00–0.010.01 ± 0.000.01–0.020.006
J01 Antibacterials11.61 ± 2.907.41–18.888.99 ± 2.874.73–14.2811.11 ± 2.287.69–15.600.871
J01 Access antibacterials5.68 ± 1.144.09–8.544.53 ± 1.132.77–6.725.78 ± 0.914.37–7.580.740
J01 Watch antibacterials5.92 ± 1.783.32–10.334.45 ± 1.781.95–7.835.70 ± 1.403.31–8.010.628
J01 Access %49.51 ± 2.7943.58–55.2051.63 ± 4.6844.38–59.6250.80 ± 2.9346.11–57.130.124
* independent sample t test.
Table 2. The most used top 10 antibacterials in the three periods expressed in DDD per 1000 inhabitants and per day, and as the cumulative percentage of systemic antibacterial use. The green color represents the Access group antibacterials based on the WHO’s AWARE classification, 2023.
Table 2. The most used top 10 antibacterials in the three periods expressed in DDD per 1000 inhabitants and per day, and as the cumulative percentage of systemic antibacterial use. The green color represents the Access group antibacterials based on the WHO’s AWARE classification, 2023.
Before COVID PeriodCOVID PeriodAfter COVID Period
No.ATC CodeSubstanceDID 1%Cum% 2ATC CodeSubstanceDID 1%Cum% 2ATC CodeSubstanceDID%Cum%
1.J01CR02co-amoxiclav3.4329.5529.55J01CR02co-amoxiclav2.6028.9028.90J01CR02co-amoxiclav4.0034.7834.78
2.J01DC02cefuroxime1.3411.5241.06J01FA10azithromycin1.4015.5544.45J01FA10azithromycin1.9817.2051.98
3.J01FA10azithromycin1.2210.4751.54J01DC02cefuroxime0.708.8453.29J01MA12levofloxacin0.736.4058.38
4.J01MA12levofloxacin1.008.5960.13J01AA02doxycycline0.778.6161.90J01AA02doxycycline0.685.9564.33
5.J01AA02doxycycline0.746.3666.49J01MA12levofloxacin0.606.6968.58J01DC02cefuroxime0.645.5869.61
6.J01FA09clarithromycin0.665.6572.13J01FF01clindamycin0.475.2773.85J01FA09clarithromycin0.574.9974.91
7.J01MA02ciprofloxacin0.584.9777.11J01MA02ciprofloxacin0.465.1579.01J01DD08cefixime0.494.3079.20
8.J01FF01clindamycin0.494.2581.36J01FA09clarithromycin0.434.7483.75J01MA02ciprofloxacin0.484.2083.40
9.J01CA04amoxicillin0.433.7085.06J01EE01SMX-TMP 30.363.9687.71J01FF01clindamycin0.474.1387.53
10.J01EE01SMX-TMP 30.423.6288.68J01CA04amoxicillin0.272.9990.70J01DC10cefprozil0.453.9091.93
1 DID: DDD per 1000 inhabitants per day; 2 cum%: cumulative percentage; 3 SMX-TMP: sulfamethoxazole and trimethoprim.
Table 3. The mean monthly number of exposed patients for the five most used antibacterial agents across the three study periods.
Table 3. The mean monthly number of exposed patients for the five most used antibacterial agents across the three study periods.
Mean Monthly Number of Exposed Patients
Before COVID PeriodCOVID PeriodAfter COVID Period
J01CR02Amoxicillin and clavulanic acid (co-amoxiclav)mean140,49499,246156,208
min–max89,124–227,53351,685–166,90297,410–220,223
J01FA10Azithromycinmean66,86966,53897,367
min–max30,329–129,60413,831–160,36837,441–160,572
J01DC02Cefuroximmean41,89023,25118,391
min–max22,458–69,29012,828–44,58810,824–29,549
J01MA12Levofloxacinmean39,45022,90928,240
min–max17,716–82,6029642–44,43813,159–46,138
J01AA02Doxycylinemean829281856987
min–max4873–12,7324600–13,2084795–9914
Table 4. Seasonality index for the different antibiotic subgroups during the study periods.
Table 4. Seasonality index for the different antibiotic subgroups during the study periods.
Seasonality Index +
Before COVID PeriodCOVID PeriodAfter COVID Period
J01A Tetracyclines38.9260.2922.48
   J01CA Penicillins with extended spectrum *
   J01CE Beta-lactamase sensitive penicillins *
   J01CR Combinations of penicillins, incl. beta-lactamase inhibitors44.5237.9738.53
J01C Beta-lactam antibacterials, penicillins43.6335.6834.07
   J01DC Second-generation cephalosporins50.9227.9627.76
   J01DD Third-generation cephalosporins69.8282.1262.26
J01D Cephalosporins53.3936.2637.32
J01E Sulfomadies and trimethoprim28.1130.1722.54
J01F Macrolides, lincosamides60.63104.7459.74
J01M Quinolone antibacterials42.2242.7335.01
J01X Other antibacterials *
J01 Antibacterials46.8653.4239.68
* low consumption <0.5; reduced consumption; and/or a prolonged period with product shortages + Antibacterial overuse in the winter months (October–December and January–March) compared with the summer months (July–September and April–June) for a 2-year period starting in March and ending in February, expressed as percentage: [DDD (winter quarters)/DDD (summer quarters) − 1] × 100 [9].
Table 5. Visualization of the three study periods.
Table 5. Visualization of the three study periods.
Months
123456789101112
Years2018
2019
2020
2021
2022
2023
2024
Blue color: Before COVID period, red color: COVID pandemic period, green color: After COVID period.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hambalek, H.; Matuz, M.; Ruzsa, R.; Papfalvi, E.; Nacsa, R.; Engi, Z.; Csatordai, M.; Soós, G.; Hajdú, E.; Csupor, D.; et al. Returned Rate and Changed Patterns of Systemic Antibiotic Use in Ambulatory Care in Hungary after the Pandemic—A Longitudinal Ecological Study. Antibiotics 2024, 13, 848. https://doi.org/10.3390/antibiotics13090848

AMA Style

Hambalek H, Matuz M, Ruzsa R, Papfalvi E, Nacsa R, Engi Z, Csatordai M, Soós G, Hajdú E, Csupor D, et al. Returned Rate and Changed Patterns of Systemic Antibiotic Use in Ambulatory Care in Hungary after the Pandemic—A Longitudinal Ecological Study. Antibiotics. 2024; 13(9):848. https://doi.org/10.3390/antibiotics13090848

Chicago/Turabian Style

Hambalek, Helga, Mária Matuz, Roxána Ruzsa, Erika Papfalvi, Róbert Nacsa, Zsófia Engi, Márta Csatordai, Gyöngyvér Soós, Edit Hajdú, Dezső Csupor, and et al. 2024. "Returned Rate and Changed Patterns of Systemic Antibiotic Use in Ambulatory Care in Hungary after the Pandemic—A Longitudinal Ecological Study" Antibiotics 13, no. 9: 848. https://doi.org/10.3390/antibiotics13090848

APA Style

Hambalek, H., Matuz, M., Ruzsa, R., Papfalvi, E., Nacsa, R., Engi, Z., Csatordai, M., Soós, G., Hajdú, E., Csupor, D., & Benkő, R. (2024). Returned Rate and Changed Patterns of Systemic Antibiotic Use in Ambulatory Care in Hungary after the Pandemic—A Longitudinal Ecological Study. Antibiotics, 13(9), 848. https://doi.org/10.3390/antibiotics13090848

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop