Next Article in Journal
Effect of Imipenem and Amikacin Combination against Multi-Drug Resistant Pseudomonas aeruginosa
Next Article in Special Issue
Appropriateness of Outpatient Antibiotic Use in Seniors across Two Canadian Provinces
Previous Article in Journal
Effects of Bacillus amyloliquefaciens LFB112 on Growth Performance, Carcass Traits, Immune, and Serum Biochemical Response in Broiler Chickens
Previous Article in Special Issue
Piglet Gut and in-Barn Manure from Farms on a Raised without Antibiotics Program Display Reduced Antimicrobial Resistance but an Increased Prevalence of Pathogens
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Antibiotics
Volume 10
Issue 11
10.3390/antibiotics10111428
antibiotics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quantifying the Gap between Expected and Actual Rates of Antibiotic Prescribing in British Columbia, Canada

by
Ariana Saatchi
1,
Ji-Won Yoo
1,
Kevin L. Schwartz
2,3,
Michael Silverman
4,5,
Andrew M. Morris
6,
David M. Patrick
7,8,
James McCormack
1 and
Fawziah Marra
1,*
1
Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC V6T 1Z3, Canada
2
Public Health Ontario, Toronto, ON M5G 1V2, Canada
3
Dalla Lana School of Public Health, University of Toronto, Toronto, ON M5T 3M7, Canada
4
Lawson Health Research Institute, London, ON N6A 4V2, Canada
5
Faculty of Medicine, University of Western Ontario, London, ON N6A 5C1, Canada
6
Sinai Health System, University Health Network and University of Toronto, Toronto, ON M5G 1L7, Canada
7
British Columbia Centre for Disease Control, Vancouver, BC V5Z 4R4, Canada
8
School of Population and Public Health, University of British Columbia, Vancouver, BC V6T 1Z3, Canada
*
Author to whom correspondence should be addressed.
Antibiotics 2021, 10(11), 1428; https://doi.org/10.3390/antibiotics10111428
Submission received: 26 October 2021 / Revised: 13 November 2021 / Accepted: 19 November 2021 / Published: 22 November 2021
(This article belongs to the Special Issue Antibiotics Research in Canada)
Browse Figures
Versions Notes

Abstract

:
Despite decades of stewardship efforts to combat antimicrobial resistance and quantify changes in use, the quality of antibiotic use in British Columbia (BC) remains unknown. As the overuse and misuse of antibiotics drives antibiotic resistance, it is imperative to expand surveillance efforts to examine the quality of antibiotic prescriptions. In late 2019, Canadian expected rates of antibiotic prescribing were developed for common infections. These rates were utilized to quantify the gap between the observed rates of prescribing and Canadian expected rates for antibiotic use for the province of BC. The prescribing data were extracted and matched to physician billing systems using anonymized patient identifiers from 1 January 2000 to 31 December 2018. Outpatient prescribing was further subdivided into community and emergency department settings and stratified by the following age groups: <2 years, 2–18 years, and ≥19 years. The proportions of physician visits that received antibiotic prescription were compared against the Canadian expected rates to quantify the unnecessary use for 18 common indications. Respiratory tract infections (RTI), including acute bronchitis, acute sinusitis, and acute pharyngitis, reported significant levels of overprescribing. Across all ages and health care settings, prescribing for RTI indications occurred at rates 2–8 times higher than the expected rates recommended by a group of expert Canadian physicians. Understanding the magnitude of unnecessary prescribing is a first step in delineating the provincial prescribing quality. The quantification of antibiotic overuse offers concrete targets for provincial stewardship efforts to reduce unnecessary prescribing by an average of 30% across both outpatient and emergency care settings.

1. Introduction

The misuse of antibiotics is a global crisis. Over 30% of the antibiotic prescriptions in the United States were deemed inappropriate, and one third of the antibiotic prescriptions for upper respiratory tract infections (URTI) in Europe had no justification for their use [1,2]. There is an urgent need for antimicrobial stewardship: a study in the United Kingdom (UK) suggested a 50% reduction in inappropriate prescribing is required to quell the increasing rates of AMR [3]. In the UK, prescribing guidelines coupled with expert opinion have been used to quantify the gap between the current prescribing practices and the expected antibiotic use [4,5]. These rates offer a concrete benchmark against which to weigh indication-specific antibiotic use and characterize the quality of prescribing. The expected rates for UK primary care have been available since 2018 and have been utilized to quantify inappropriate and unnecessary antibiotic use across many common indications, including urinary tract as well as upper and lower respiratory tract infections [5].
Antibiotic use is ubiquitous globally, as well as within Canada, and, while effective for specific indications, the overuse and misuse of antibiotics has been strongly associated with the increasing rates of antimicrobial resistance (AMR) [6,7]. Antibiotic use in the outpatient or emergency setting is often contingent on patient factors not captured within administrative health data [8]. The establishment of expected, or maximal, prescribing rates offers a benchmark against which prescriptions issued may be contextualized. Although limitations, such as participant self-selection, physician biases to limited patient populations, and issues with reliability, sensitivity, and/or specificity, are inherent in their generation, benchmark rates offer valuable insight regarding the ongoing blackbox of prescribing quality [9,10]. In this regard, point prevalence surveys may be useful in delineating further data on the appropriateness of antimicrobial prescribing [11,12,13]. In late 2019, Canadian rates of expected antibiotic prescribing were developed for common infections in the outpatient setting [14]. We performed this retrospective cohort study to quantify the gap between the observed rates of prescribing and the Canadian expected rates for antibiotic use for the province of BC. Our objective was to uncover indication-specific rates of potential unnecessary prescribing as the data may direct specific stewardship efforts to reduce suboptimal antibiotic use and inhibit the development of AMR.

2. Results

Over the 19-year study period, we had a total of 3,490,585 unique patients, with an average of 447,107 unique patients per year prescribed an antibiotic for one of the 18 included indications across both community and emergency care (Table 1).
The data for 78,495,265 physician encounters were extracted between 1 January 2000 and 31 December 2018. Outpatient care was responsible for 77,754,597 of the cases over the 19-year study period, with 7,708,016 unique patients. Emergency care accounted for an additional 740,668 physician encounters between 2012 to 2018, attributed to 289,954 unique patients. Across both healthcare settings, 57% of all antibiotic dispensation records linked to an indication within the study scope. Antibiotics were more often prescribed for females in urban settings, particularly in the Fraser health authority, and a negative association was observed between increased antibiotic use and income quintile.
The most common diagnoses in outpatient care were the common cold, UTI, asthma, and purulent SSTI, making up 53% of the cases (Table 2). In contrast, purulent and non-purulent SSTI, UTI, and pneumonia made up 59% of the emergency cases. The overall antibiotic use was most elevated for the indications classified within tier 2c, followed by tier 2a, tier 1, and tier 3, with the least prescriptions issued for tier 2b diagnoses (Table 2; Figure 1).

Unnecessary Antibiotic Utilization

Table 2 shows that roughly 30 million antibiotics were prescribed over the 19-year study period, with 28,682,721 antibiotics prescribed in outpatient care and 419,602 antibiotics prescribed in emergency care. The overall antibiotic prescribing rate for all 18 indications was 37% in outpatient care, and 66% in emergency settings. The diagnoses involved with the most outpatient antibiotic prescriptions were UTI (23%), the common cold (13%), and bronchitis (12%). In emergency care, non-purulent SSTI (26%), UTI (22%), and pneumonia (14%) led the diagnoses.
The potential unnecessary antibiotic prescribing is shown in Table 3. In outpatient care, bronchitis (52%), dental conditions (50%), acute sinusitis (48%), and acute pharyngitis (42%) had the highest rates of unnecessary antibiotic prescribing. Similarly, emergency care reported overprescribing for dental conditions (75%), acute sinusitis (52%), and bronchitis (49%).
By age groups in outpatient care: patients <2 years of age were the most overprescribed for acute pharyngitis (59%), while bronchitis led overprescribing for those aged 2–18 years, with 49.8% unnecessary. For adult patients (≥19 years), dental infections (56%) received the highest rate of unnecessary antibiotic prescription. The trends by age in emergency care varied from the community prescribing patterns. The patients aged <2 years were overprescribed for AOM at the highest rate (45%), while dental infections (65%) were overprescribed the most in those aged 2–18 years. The highest rate of unnecessary antibiotic use in adults was 76%, for dental conditions. The magnitudes of unnecessary antibiotic use varied across healthcare settings with similar directional trends across indications. Figure 2 and Figure 3 show the breakdown of the percent of unnecessary prescribing for each indication by age category and healthcare setting.

3. Discussion

Elevated, unnecessary antibiotic use was most pronounced in respiratory tract indications (RTI) overall, including: acute bronchitis (53%), acute sinusitis (46%), and acute pharyngitis (46%), wherein all three age categories were prescribed in excess of at least 30%. Of these RTI conditions, children aged less than 2 years received the most unnecessary prescriptions for acute pharyngitis, while adult patients led bronchitis and sinusitis. Moreover, as respiratory tract infections accounted for over 60% of all the physician visits, and 55% of all the associated antibiotic use, the scale of unnecessary use for these indications translates to high levels of inappropriate prescription in both the community and emergency healthcare settings. Across all the indications and both healthcare settings, prescribing for adults was 29% unnecessary, with 28% unnecessary for children aged 2–18 years and 24% unnecessary for children aged less than 2 years.
Our study corroborates findings from several studies across jurisdictions operating under similar universal healthcare systems, such as the United Kingdom, and other provinces within Canada [15,16]. When compared against the expected prescribing rates, Pouwels et al. found that the outpatient antibiotic use in the UK was highly elevated for RTI [5]. This elevated trend is shared across two Canadian provinces: British Columbia and Ontario had comparable rates of overprescribing identified across both Canadian healthcare systems for RTI. In Ontario outpatient care, Schwartz et al. report a 53% rate of overprescribing for bronchitis, while, in BC, antibiotics were overprescribed by 52% and 49% in the outpatient and emergency care settings, respectively, for the same indication [16]. One possible explanation underlying these suboptimal prescriptions could be perceived patient expectations by physicians to prescribe in the outpatient setting despite self-limiting or non-bacterial etiologies [17]. Although clinical guidelines do not recommend the use of antibiotics for tier 2c (antibiotics rarely indicated) and/or tier 3 (antibiotics never indicated) URTI, physicians may still prescribe based on the symptoms and severity of clinical presentation [17].
Although dental conditions account for a minority of the total prescribing (1%), the elevated proportion of unnecessary prescribing in adults is concerning. BC emergency care had a 75% rate of overprescribing for dental conditions, far more than the 32% seen in ON outpatient care or the 50% in BC outpatient care. However, as dental conditions are a tier 2c indication, with a 4% expected rate of prescription across all ages, unnecessary antibiotic use is significant for this diagnosis regardless of the healthcare setting. While most medical care is publicly funded in BC and essentially universal in Canada, dental services remain a privately insured sector of healthcare. As such, dentists in BC do not bill MSP directly, nor were they explicitly identified within NACRS (emergency) analyses. The overprescribing reported is not related to dental practitioners but rather physicians treating dental conditions—as further indicated by the reduced number of overall physician visits for dental conditions in comparison to other indications. However, inappropriate antibiotic use in the treatment of dental conditions, in both community and emergency settings, has been well documented across BC, the United States, the United Kingdom, as well as Australia [18,19,20]. Patients with inadequate dental insurance coverage might disproportionately seek care from physicians to treat dental conditions, resulting in the overuse of antibiotics offsetting under-pursued surgical interventions. Although the elevated use of antibiotics in dentistry has been documented in the literature, the results reported here cannot be extrapolated to dental practice.
The expected Canadian rates of prescribing were engaged within this study as maximal rates throughout analyses—wherein only instances of excess prescribing were characterized as unnecessary. The decision to disregard the rates of prescribing below expected was founded in the principles of antimicrobial stewardship [21,22]. In the absence of reported patient harms, it would be misguided to interpret any gap between the expected and actual rates of antibiotic prescription as an issue of under-prescribing. Moreover, if lower rates of antibiotic use have not resulted in increased negative patient outcomes, then the current prescribing norms underlying the Canadian expected rates can be called into question. On that point, Gulliford et al. report no association between lower rates of antibiotic use and patient safety outcomes [23]. Of the 18 indications reviewed in this study, only 10 conditions were discussed with respect to unnecessary prescribing, with the majority of urinary tract and skin/soft tissue diagnoses ruled out of subsequent analyses as negative magnitudes of difference between the expected and observed prescribing were restricted to 0% unnecessary. With that said, the conclusions drawn are twofold: first, further research to confirm the incidence of adverse outcomes in the event of lower rates of antibiotic use is needed in BC, and, secondly, the expected rate generation dependent on expert opinion may be inherently elevated as a result of the current practice norms on which they are based.
Our limitations are similar to other retrospective studies conducted using administrative data. The linkage of PharmaNet dispensing records and physician billing data may exclude refill prescriptions as the patient would not visit the clinic. Further, our rates do not account for unfilled prescriptions issued, and the levels of compliance to the dispensed medications are unknown. Throughout the study period, 57% of all the antibiotic use was linked to an indication within the study scope, with an additional 22,193,615 antibiotic dispensations unlinked and excluded from further analyses. These prescriptions can be attributed to indications beyond the study scope, hospital discharge records, prescription refills, and/or non-physician healthcare providers (e.g., dentists, naturopaths). Moreover, the records of indications are reliant on accurate coding by billing physicians; in the absence of lab data to confirm the bacterial etiology, our use of ICD-9/10 codes may be subject to misclassification bias. Although it is notable that Canadian primary-care physician claims data have a high positive-predictive value for the diagnosis of some common infections, including acute non-bacterial upper-respiratory infections, concerns regarding the specificity of ICD-9/10 codes remain [24,25]. Furthermore, characterizations of unnecessary antibiotic use do not account for patient comorbidities, concurrent medications, allergies, or other relevant factors that might justify otherwise inappropriate antibiotic use; however, these patient factors do not explain the inter-physician variability in antibiotic prescribing [26]. The scope of the data available through the NACRS is also quite marginal in tandem with the reduced temporal period. The BC Ministry of Health mandated the introduction of NACRS data reporting in 2010, with 15 high-volume emergency departments (ED) included at inception. By 2013, 29 EDs in BC reported to NACRS; however, the index remains new within the province, and the rates reported are likely an under-estimate of the true ED rates of prescribing. Moreover, in comparing rates of unnecessary antibiotic use across healthcare settings, the NACRS and MSP do not encompass the same time periods as emergency department data in the NACRS started collection recently. This difference is notable as direct comparisons of prescribing across healthcare settings do not account for stewardship interventions, guideline, and/or formulary changes over time.
Research has identified a strong association between antibiotic overprescribing and subsequent antimicrobial resistance [27,28,29,30,31]. Recent data from the World Health Organization and the Centers for Disease Control show continued increasing resistance with Gram-positive pathogens, such as Streptococcus pneumoniae and Staphylococcus aureus. In addition, the resistance in Gram-negative pathogens, such as E. coli, Klebsiella spp., and other Enterobacteriae, continues to rise due to the acquisition of extended spectrum beta-lactamases (ESBL) and carbapenenases; interventions to protect the efficacy of these essential medications is paramount [32,33,34]. Moreover, antibiotics can lead to acute adverse patient events and outcomes, including drug allergies, and can lead to long-term complications associated with perturbed microbiota [35]. With these risks in mind, and to protect the efficacy of these essential medications, the DBND program in BC aims to reduce unnecessary prescribing and optimize antibiotic use [36,37]. High caliber stewardship efforts aim to ensure that antibiotics are available when medically necessary and reserved otherwise to protect against rising resistance. A recent study confirmed that the overall antibiotic prescribing rates are declining in BC [38]. As further reductions remain a target for provincial stewardship, this study offers the first concrete quantifications for the potential reduction in unnecessary antibiotic use within BC for 18 distinct indications across two healthcare settings.

4. Materials and Methods

4.1. Data Sources

The Ministry of Health in British Columbia houses several healthcare-related databases, which have comprehensive information on BC residents (population: 5 million) [39]. Antibiotic information was extracted from BC PharmaNet, a centralized data system that links all pharmacies with every prescription dispensed through community and hospital outpatient pharmacies [40]. All antimicrobials are recorded in this system except those used for treatment of sexually transmitted infections and HIV, as well as medications administered within the hospitals/emergency departments. The Medical Service Plan (MSP) billing system records all claims submitted by physicians for services provided to BC residents, including diagnostic codes [41]. The National Ambulatory Care Reporting System (NACRS) captures data from 29 high volume emergency departments across BC [42]. Established in 2012, NACRS data are included from index inception onwards. Patient demographics were supplied through a consolidation file containing age and sex information [43]. Data were extracted, anonymized, and made available to researchers by Population Data BC. All inferences, opinions, and conclusions drawn in this study are those of the authors and do not reflect the opinions or policies of the data steward(s).

4.2. Study Population

Our study included all BC residents from 1 January 2000 to 31 December 2018. Physician visit and indication data were pulled from both MSP (outpatient care) and NACRS (emergency care) indices, and then matched to antibiotic dispensations extracted from PharmaNet using anonymized patient identifiers. A prescription and diagnosis were linked using an algorithm that matched the date on which the medication was dispensed to a practitioner service date within 5 days prior. If a practitioner service date was associated with more than one diagnostic code, or multiple service dates fell within a single 5-day period of a prescription dispensing date, then a three-tiered hierarchy was applied to link only the most relevant diagnostic code to the prescription. If multiple diagnoses were listed from the same tier, the first physician code was selected for analysis. Multiple prescriptions per subject were permitted in our analyses. Antibiotic data that did not match to a physician visit record for an indication within study scope were not included in the analyses. All data outputs with n < 5 were excluded from subsequent analyses to preserve subject anonymity.

4.3. Canadian Expected Prescribing Rates

A study by Wu et al., published in 2020, presented Canadian expected rates of outpatient prescribing for the incidence of various common infections [14]. These rates were generated through expert opinion elicitation. In the absence of thorough clinical guidelines, the modified Delphi method has increasingly become a common tool in medical research to assist in delineating appropriate, or expected, markers for diagnosis and/or treatment [44]. The expected rates discussed within this paper are essentially the maximal (i.e., upper-limit) prescribing rates, stratified by three age groups (<2 years, 2–18 years, >19) for common clinical conditions.
We have mirrored their methodology to generate comparable rates of observed prescribing in BC. Furthermore, data were extracted for 18 of the same common clinical conditions they reviewed: acute otitis media (AOM), acute pharyngitis, acute sinusitis, asthma, bronchitis, chronic sinusitis, common cold, dental conditions, epididymo-orchitis, influenza, non-purulent soft tissue skin infections (SSTI), otitis externa, pneumonia, prostatitis, purulent SSTI, pyelonephritis, reproductive tract infections, and urinary tract infections (UTI); the exception was chronic obstructive pulmonary disease (COPD) as their expected prescribing rate is for acute exacerbations of COPD, which is not well-captured by billing codes. These indications were further organized into 5 tiers based on the proportion of expected prescribing. Tier 1 included diagnoses for which antibiotics are routinely used (i.e., expected prescribing rate of 100%). Tier 2 were diagnoses for which antibiotics are frequently indicated (tier 2a: 51–99% expected prescribing rate), sometimes indicated (tier 2b: 21–50% expected prescribing rate), or rarely indicated (tier 2c: 1–20% expected prescribing rate). Finally, tier 3 included diagnoses for which antibiotic use is never indicated (0% expected prescribing rate).

4.4. Outcomes and Statistical Analyses

Antibiotics were classified based on the Anatomical Therapeutic Chemical (ATC) classification system developed by WHO [45]. Consumption rates were calculated as prescriptions per 1000 population per year, using age- and gender-specific denominator estimates for the population from Statistics BC [39]. MSP diagnostic codes are ordered by the ninth revision of the International Classification of Diseases developed by WHO, commonly referred to as ICD-9, while NACRS reports ICD-10 billing codes [46,47,48].
Overall rates of total antibiotic use were examined and then stratified by age group (<2, 2–18, ≥19 years). Observed rates were compared against maximal references, extracted from Canadian expected rates, and the difference in prescribing rates were calculated for each indication across both outpatient and emergency department care. Unnecessary antibiotic use was identified using the magnitude of difference between expected and observed prescribing by indication, age, and healthcare setting. Prescribing below expected rates was not classified as inappropriate, and all negative magnitudes of difference were subsequently reported to be: 0% prescribing.

5. Conclusions

This study reports elevated levels of unnecessary antibiotic use for RTI indications across all ages and two distinct healthcare settings. These diagnoses, commonly of viral etiology, do not often warrant the use of antibiotic treatment (tier 2c and/or 3), yet antibiotics continue to be prescribed at rates far above the expert and guideline recommendations when compared to the expected rates. The magnitudes of the reported unnecessary prescribing offer new, actionable targets for provincial stewardship efforts.

Author Contributions

A.S. conceptualized the study under the guidance of F.M.; conducted the literature review, data cleaning, analysis, and interpretation; and composed the initial draft with J.-W.Y., M.S., D.M.P., A.M.M., J.M. and K.L.S. provided guidance on defining prescribing quality and analyses to compare expected and observed prescribing rates. All authors provided critical feedback on data interpretation and the final draft of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a Canadian Institutes of Health Research (CIHR) project grant (201809-408648). CIHR is the major federal agency responsible for funding health and medical research in Canada.

Institutional Review Board Statement

The study was approved by the Behavourial Research Ethics Board of the University of British Columbia (H19-00799).

Informed Consent Statement

Not applicable.

Data Availability Statement

Restrictions apply to the availability of these data. Data were obtained from Population Data BC.

Acknowledgments

We would like to acknowledge Population Data BC for providing all health administrative data for this project.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Fleming-Dutra, K.E.; Hersh, A.L.; Shapiro, D.J.; Bartoces, M.; Enns, E.A.; File, T.M.; Finkelstein, J.A.; Gerber, J.S.; Hyun, D.Y.; Linder, J.A.; et al. Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010–2011. JAMA 2016, 315, 1864–1873. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Dolk, F.C.K.; Pouwels, K.B.; Smith, D.R.M.; Robotham, J.V.; Smieszek, T. Antibiotics in primary care in England: Which antibiotics are prescribed and for which conditions? J. Antimicrob. Chemother. 2018, 73, ii2–ii10. [Google Scholar] [CrossRef] [PubMed]
  3. Davies, S.C. Reducing inappropriate prescribing of antibiotics in English primary care: Evidence and outlook. J. Antimicrob. Chemother. 2018, 73, 833–834. [Google Scholar] [CrossRef]
  4. Smith, D.R.M.; Dolk, F.C.K.; Pouwels, K.B.; Christie, M.; Robotham, J.V.; Smieszek, T. Defining the appropriateness and inappropriateness of antibiotic prescribing in primary care. J. Antimicrob. Chemother. 2018, 73, ii11–ii18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Pouwels, K.B.; Dolk, F.C.K.; Pouwels, K.B.; Christie, M.; Robotham, J.V.; Smieszek, T. Actual versus ‘ideal’ antibiotic prescribing for common conditions in English primary care. J. Antimicrob. Chemother. 2018, 73, 19–26. [Google Scholar] [CrossRef] [PubMed]
  6. Abushaheen, M.A.; Fatani, A.J.; Alosaimi, M.; Mansy, W.; George, M.; Acharya, S.; Rathod, S.; Divakar, D.D.; Jhugroo, C.; Vellappally, S.; et al. Antimicrobial resistance, mechanisms and its clinical significance. Dis. Mon. 2020, 66, 100971. [Google Scholar] [CrossRef] [PubMed]
  7. Pubic Health Agency of Canada. Canadian Antimicrobial Resistance Surveillance System 2017 Report—Executive Summary. Available online: https://www.canada.ca/en/public-health/services/publications/drugs-health-products/canadian-antimicrobial-resistance-surveillance-system-2017-report-executive-summary.html (accessed on 15 April 2020).
  8. Rodrigues, A.T.; Roque, F.; Falco, A.; Figueiras, A.; Herdeiro, M.T. Understanding physician antibiotic prescribing behaviour: A systematic review of qualitative studies. Int. J. Antimicrob. Agents 2013, 41, 203–212. [Google Scholar] [CrossRef] [PubMed]
  9. Boulkedid, R.; Abdoul, H.; Loustau, M.; Sibony, O.; Alberti, C. Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review. PLoS ONE 2011, 6, e20476. [Google Scholar] [CrossRef]
  10. Humphrey-Murto, S.; Varpio, L.; Wood, T.J.; Gonsalves, C.; Ufholz, L.-A.; Mascioli, K.; Wang, C.; Foth, T. The use of the Delphi and other consensus group methods in medical education research: A review. Acad. Med. 2017, 92, 1491–1498. [Google Scholar] [CrossRef]
  11. National Centre for Antimicrobial Stewardship and Australian Commission on Safety and Quality in Health Care. Antimicrobial Prescribing Practice in Australian Hospitals: Results of the 2018 Hospital National Antimicrobial Prescribing Survey; ACSQHC: Sydney, Australia, 2020.
  12. Ingram, P.R.; Seet, J.M.; Budgeon, C.A.; Murray, R. Point-prevalence study of inappropriate antibiotic use at a tertiary Australian hospital. Intern. Med. J. 2012, 42, 719–721. [Google Scholar] [CrossRef]
  13. Salzo, A.; Ripabelli, G.; Sammarco, M.L.; Mariano, A.; Niro, C.; Tamburro, M. Healthcare-Associated infections and antibiotics consumption: A comparison of point prevalence studies and intervention strategies. Hosp Top. 2021, 99, 140–150. [Google Scholar] [CrossRef] [PubMed]
  14. Wu, J.H.-C.; Langford, B.; Ha, R.; Garber, G.; Daneman, N.; Johnstone, J.; McIsaac, W.; Sharpe, S.; Tu, K.; Schwartz, K.L. Defining appropriate antibiotic prescribing in primary care: A modified Delphi panel approach. Off. J. Assoc. Med. Microbiol. Infect. Dis. Can. 2020, 5, 61–69. [Google Scholar] [CrossRef] [Green Version]
  15. O’Doherty, J.; Leader, L.F.W.; O’Regan, A.; Dunne, C.; Puthoopparambil, S.J.; O’Connor, R. Over prescribing of antibiotics for acute respiratory tract infections; a qualitative study to explore Irish general practitioners’ perspectives. BMC Fam. Pract. 2019, 20, 27. [Google Scholar] [CrossRef]
  16. Schwartz, K.L.; Langford, B.J.; Daneman, N.; Chen, B.; Brown, K.A.; McIsaac, W.; Tu, K.; Candido, E.; Johnstone, J.; Leung, V.; et al. Unnecessary antibiotic prescribing in a Canadian primary care setting: A descriptive analysis using routinely collected electronic medical record data. CMAJ Open 2020, 8, E360–E369. [Google Scholar] [CrossRef] [PubMed]
  17. Wade, T.; McCormack, S. Interventions to Influence the Use of Antibiotics for Acute Upper Respiratory Tract Infections; Canadian Agency for Drugs and Technologies in Health: Ottawa, ON, Canada, 2021. Available online: http://www.ncbi.nlm.nih.gov/books/NBK572012/ (accessed on 8 September 2021).
  18. Roberts, R.M.; Hersh, A.L.; Shapiro, D.J.; Fleming-Dutra, K.E.; Hicks, L.A. Antibiotic Prescriptions Associated with Dental-Related Emergency Department Visits. Ann. Emerg. Med. 2019, 74, 45–49. [Google Scholar] [CrossRef] [PubMed]
  19. Marra, F.; George, D.; Chong, M.; Sutherland, S.; Patrick, D.M. Antibiotic prescribing by dentists has increased. J. Am. Dent. Assoc. 2016, 147, 320–327. [Google Scholar] [CrossRef] [Green Version]
  20. Thompson, W.; Teoh, L.; Hubbard, C.C.; Marra, F.; Patrick, D.M.; Mamun, A.; Campbell, A.; Suda, K.J. Patterns of dental antibiotic prescribing in 2017: Australia, England, United States, and British Columbia (Canada). Infect. Control Hosp. Epidemiol. 2021, 5, 1–8. [Google Scholar] [CrossRef]
  21. Graber, C.J.; Goetz, M.B. Next steps for antimicrobial stewardship. Lancet Infect. Dis. 2016, 16, 764–765. [Google Scholar] [CrossRef] [Green Version]
  22. Majumder, M.A.A.; Rahman, S.; Cohall, D.; Bharatha, A.; Singh, K.; Haque, M.; Gittens-St Hilaire, M. Antimicrobial stewardship: Fighting antimicrobial resistance and protecting global public health. Infect. Drug Resist. 2020, 13, 4713–4738. [Google Scholar] [CrossRef]
  23. Gulliford, M.C.; Prevost, A.T.; Charlton, J.; Juszczyk, D.; Soames, J.; McDermott, L.; Sultana, K.; Wright, M.; Fox, R.; Hay, A.D.; et al. Effectiveness and safety of electronically delivered prescribing feedback and decision support on antibiotic use for respiratory illness in primary care: REDUCE cluster randomised trial. BMJ 2019, 364, l236. [Google Scholar] [CrossRef] [Green Version]
  24. Cadieux, G.; Tamblyn, R. Accuracy of physician billing claims for identifying acute respiratory infections in primary care. Health Serv. Res. 2008, 43, 2223–2238. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Tieder, J.S.; Hall, M.; Auger, K.A.; Hain, P.D.; Jerardi, K.E.; Myers, A.L.; Rahman, S.S.; Williams, D.J.; Shah, S.S. Accuracy of administrative billing codes to detect urinary tract infection hospitalizations. Pediatrics. 2011, 128, 323–330. [Google Scholar] [CrossRef] [PubMed]
  26. Schwartz, K.L.; Brown, K.A.; Etches, J.; Langford, B.J.; Daneman, N.; Tu, K.; Johnstone, J.; Achonu, C.; Garber, G. Predictors and variability of antibiotic prescribing amongst family physicians. J. Antimicrob. Chemother. 2019, 74, 2098–2105. [Google Scholar] [CrossRef] [PubMed]
  27. Llor, C.; Bjerrum, L. Antimicrobial resistance: Risk associated with antibiotic overuse and initiatives to reduce the problem. Ther. Adv. Drug Saf. 2014, 5, 229–241. [Google Scholar] [CrossRef] [Green Version]
  28. Singer, A.C.; Xu, Q.; Keller, V.D.J. Translating antibiotic prescribing into antibiotic resistance in the environment: A hazard characterisation case study. PLoS ONE 2019, 14, e0221568. [Google Scholar] [CrossRef] [Green Version]
  29. He, M.; Miyajima, F.; Roberts, P.; Ellison, L.; Pickard, D.J.; Martin, M.J.; Connor, T.R.; Harris, S.R.; Fairley, D.; Bamford, K.B.; et al. Emergence and global spread of epidemic healthcare—Associated Clostridium difficile. Nat. Genet. 2013, 45, 109–113. [Google Scholar] [CrossRef]
  30. European Centre for Disease Prevention and Control. Antimicrobial Resistance Surveillance in Europe 2014. Annual Report of The European Antimicrobial Resistance Surveillance Network (EARS-Net); ECDC: Stockholm, Sweden, 2015. [Google Scholar]
  31. Njoku, J.C.; Hermsen, E.D. Antimicrobial stewardship in the intensive care unit: A focus on potential pitfalls. J. Pharm. Pract. 2010, 23, 50–60. [Google Scholar] [CrossRef] [PubMed]
  32. di Tella, D.; Tamburro, M.; Guerrizio, G.; Fanelli, I.; Sammarco, M.L.; Ripabelli, G. Molecular epidemiological insights into colistin-resistant and carbapenemases-producing clinical Klebsiella pneumoniae isolates. Infect Drug Resist. 2019, 12, 3783–3795. [Google Scholar] [CrossRef] [Green Version]
  33. World Health Organization. Global Antimicrobial Resistance and Use Surveillance System (GLASS) Report 2021; World Health Organization: Geneva, Switzerland, 2021; Licence: CC BY-NC-SA 3.0 IGO. [Google Scholar]
  34. U.S. Department of Health and Human Services. CDC. Antibiotic Resistance Threats in The United States, 2019; CDC Atlanta: Atlanta, GA, USA, 2019.
  35. Mohsen, S.; Dickinson, J.A.; Somayaji, R. Update on the adverse effects of antimicrobial therapies in community practice. Can. Fam. Phys. 2020, 66, 651–659. [Google Scholar]
  36. Do Bugs Need Drugs? Do Bugs Need Drugs. 2021. Available online: http://www.dobugsneeddrugs.org (accessed on 27 August 2021).
  37. McKay, R.M.; Vrbova, L.; Fuertes, E.; Chong, M.; David, S.; Dreher, K.; Purych, D.; Blondel-Hill, E.; Henry, B.; Marra, F.; et al. Evaluation of the Do Bugs Need Drugs? program in British Columbia: Can we curb antibiotic prescribing? Can. J. Infect. Dis. Med. Microbiol. 2011, 22, 19–24. [Google Scholar] [CrossRef]
  38. Saatchi, A.; Morris, A.M.; Patrick, D.M.; Mccormack, J.; Reyes, R.C.; Morehouse, P.; Reid, J.; Shariff, S.; Povitz, M.; Silverman, M.; et al. Outpatient antibiotic use in British Columbia, Canada: Reviewing major trends since 2000. JAC-Antimicrob. Resist. 2021, 3, dlab116. [Google Scholar] [CrossRef] [PubMed]
  39. BC Stats. Population Estimates, Province of British Columbia. 2020. Available online: https://www2.gov.bc.ca/gov/content/data/statistics/people-population-community/population/population-estimates (accessed on 6 November 2020).
  40. BC Ministry of Health. PharmaNet. V2; BC Ministry of Health: BC, Canada, Data Extract. Data Stewardship Committee. 2020. Available online: http://www.popdata.bc.ca/data (accessed on 1 November 2021).
  41. British Columbia Ministry of Health. Medical Services Plan (MSP) Payment Information File. V2; Population Data BC: BC, Canada, Data Extract. MOH. 2011. Available online: http://www.popdata.bc.ca/data (accessed on 1 November 2021).
  42. Canadian Institute for Health Information. National Ambulatory Care Reporting System. V2; Population Data BC: BC, Canada, Data Extract. MOH. 2020; Available online: http://www.popdata.bc.ca/data (accessed on 1 November 2021).
  43. British Columbia Ministry of Health. Consolidation File (MSP Registration & Premium Billing). V2; Population Data BC: BC, Canada, Data Extract. MOH. 2020. Available online: http://www.popdata.bc.ca/data (accessed on 1 November 2021).
  44. Fitch, K.; Bernstein, S.J.; Aguilar, M.D.; Burnand, B.; LaCalle, J.R. The Rand/Ucla Appropriateness Method User’s Manual; Fitch, K., Ed.; Rand Corporation: Santa Monica, CA, USA, 2001. [Google Scholar]
  45. WHO Collaborating Centre for Drug Statistics Methodology and Folkehelseinstituttet (Noruega). Guidelines for ATC Classification and DDD Assignment 2011; Norwegian Institute of Public Health: Oslo, Norway, 2010; Available online: http://www.whocc.no/filearchive/publications/2011guidelines.pdf (accessed on 3 May 2019).
  46. CDC. International Classification of Diseases, Ninth Revision (ICD-9). 2019. Available online: https://www.cdc.gov/nchs/icd/icd9.html (accessed on 28 April 2019).
  47. Ministry of Health. Diagnostic Code Descriptions (ICD-9), Province of British Columbia. 2021. Available online: https://www2.gov.bc.ca/gov/content/health/practitionerprofessional-resources/msp/physicians/diagnostic-code-descriptions-icd-9 (accessed on 3 May 2019).
  48. Canadian Institute for Health Information. Canadian Coding Standards for Version 2018 ICD-10-CA and CCI; CIHI: Ottawa, ON, Canada, 2018. [Google Scholar]
Antibiotics 10 01428 g001 550
Figure 1. Proportion of all antibiotics prescribed for common infections according to tier classification. Tier 1 = antibiotics always indicated (maximal rate 100%); tier 2a = antibiotics frequently indicated (maximal rate: 51–99%); tier 2b = antibiotics sometimes indicated (maximal rate: 21–50%); tier 2c = antibiotics rarely indicated (maximal rate: 1–20%); tier 3 = antibiotics never indicated (maximal rate: 0%).
Figure 1. Proportion of all antibiotics prescribed for common infections according to tier classification. Tier 1 = antibiotics always indicated (maximal rate 100%); tier 2a = antibiotics frequently indicated (maximal rate: 51–99%); tier 2b = antibiotics sometimes indicated (maximal rate: 21–50%); tier 2c = antibiotics rarely indicated (maximal rate: 1–20%); tier 3 = antibiotics never indicated (maximal rate: 0%).
Antibiotics 10 01428 g001
Antibiotics 10 01428 g002 550
Figure 2. Overall percent unnecessary antibiotic use for common conditions, by age. Only those tier2a,2b,2c, 3 conditions prescribed at rates above the Canadian maximal were included in our classification of unnecessary prescribing. Tier 1 indications were restricted within analyses to an unnecessary prescribing rate of 0%.
Figure 2. Overall percent unnecessary antibiotic use for common conditions, by age. Only those tier2a,2b,2c, 3 conditions prescribed at rates above the Canadian maximal were included in our classification of unnecessary prescribing. Tier 1 indications were restricted within analyses to an unnecessary prescribing rate of 0%.
Antibiotics 10 01428 g002
Antibiotics 10 01428 g003 550
Figure 3. Percent unnecessary antibiotic use for common conditions, by age and healthcare setting.
Figure 3. Percent unnecessary antibiotic use for common conditions, by age and healthcare setting.
Antibiotics 10 01428 g003
Table
Table 1. Cohort characteristics.
Table 1. Cohort characteristics.
Outpatient Care Setting 2000–2018Emergency Care Setting 2012–2018
Total number of patients3,240,894249,691
Average patients per year405,68541,422
Age (years)
Mean41.6245.17
Standard Deviation25.4424.95
<2 Years378,927 (4.92%)14,600 (5.04%)
2–18 Years1,520,761 (19.73%)40,057 (13.81%)
≥19 Years5,808,328 (75.35%)235,297 (81.15%)
Sex
Female4,792,943 (62.18%)165,137 (56.95%)
Male2,914,119 (37.81%)124,807 (43.04%)
Income Quintile
Quintile 1 (lowest)1,644,735 (21.34%)71,376 (24.62%)
Quintile 21,589,201 (20.62%)61,103 (21.07%)
Quintile 31,516,110 (19.67%)56,650 (19.54%)
Quintile 41,465,429 (19.01%)52,771 (18.2%)
Quintile 5 (highest)1,349,927 (17.51%)43,419 (14.97%)
Missing133,309 (1.73%)3498 (1.21%)
Geographic Region
Rural1,274,318 (16.53%)10,800 (3.72%)
Urban6,139,403 (79.65%)268,037 (92.44%)
Missing294,295 (3.82%)11,117 (3.83%)
Health Authority
Interior1,259,910 (16.35%)4879 (1.68%)
Fraser2,968,609 (38.51%)164,177 (56.62%)
Vancouver Coastal1,648,260 (21.38%)88,229 (30.43%)
Vancouver Island1,314,339 (17.05%)21,634 (7.46%)
Northern493,305 (6.4%)9912 (3.42%)
Missing15,968 (0.21%)768 (0.26%)
Table
Table 2. Number of total cases and associated antibiotics dispensed per indication of interest, by healthcare setting.
Table 2. Number of total cases and associated antibiotics dispensed per indication of interest, by healthcare setting.
ClassificationDiagnosisOutpatient Care Setting 1Emergency Care Setting 2
Prescriptions Issued 3Total Physician Visits 4Prescriptions IssuedTotal Physician Visits
Tier 1:
Always indicated (100%)		Pneumonia1,048,153 (3.65%)2,525,744 (3.25%)69,424 (14.12%)97,538 (19.84%)
Pyelonephritis200,042 (0.70%)395,291 (0.51%)24,453 (4.97%)31,131 (6.33%)
Non-Purulent SSTI2,668,652 (9.30%)4,762,565 (6.13%)132,539 (26.96%)180,189 (36.65%)
Reproductive tract367,126 (1.28%)2,502,766 (3.22%)2576 (0.52%)2754 (0.56%)
Urinary tract infections (aged ≤18 y)560,958 (1.96%)957,393 (1.23%)13,388 (2.72%)16,034 (3.26%)
Tier 2a:
Frequently indicated
(51–99%)		Urinary tract infections (aged >18 y)6,140,403 (21.41%)9,724,013 (12.51%)99,168 (20.17%)118,149 (24.03%)
Prostatitis110,482 (0.39%)381,996 (0.49%)1713 (0.35%)2312 (0.47%)
Epididymo-orchitis73,955 (0.26%)173,088 (0.22%)5268 (1.07%)6947 (1.41%)
Tier 2b:
Sometimes indicated
(21–50%)		Purulent SSTI1,443,819 (5.03%)6,964,320 (8.96%)33,650 (6.84%)51,538 (10.48%)
Acute Otitis Media2,343,863 (8.17%)3,899,643 (5.02%)23,823 (4.85%)31,265 (6.36%)
Pharyngitis (aged ≤2 y)81,486 (0.28%)105,334 (0.14%)619 (0.13%)1267 (0.26%)
Tier 2c:
Rarely indicated
(1–20%)		Acute sinusitis2,635,709 (9.19%)3,990,765 (5.13%)6281 (1.28%)8949 (1.82%)
Chronic sinusitis404,106 (1.41%)1,883,735 (2.42%)535 (0.11%)1068 (0.22%)
Bronchitis3,406,425 (11.88%)5,746,837 (7.39%)14,981 (3.05%)26,263 (5.34%)
Dental Conditions353,089 (1.23%)649,259 (0.84%)19,911 (4.05%)25,275 (5.14%)
Otitis Externa (aged >18 y)210,929 (0.74%)2,121,058 (2.73%)2874 (0.58%)6707 (1.36%)
Pharyngitis (aged >2 y)1,696,442 (5.91%)2,264,601 (2.91%)20,718 (4.21%)36,475 (7.42%)
Tier 3:
Never indicated
(0%)		Asthma837,508 (2.92%)7,493,929 (9.64%)7875 (1.6%)45,529 (9.26%)
Common Cold3,746,608 (13.06%)18,788,085 (24.16%)6685 (1.36%)27,361 (5.57%)
Influenza218,802 (0.76%)1,803,191 (2.32%)4150 (0.84%)21,578 (4.39%)
Otitis Externa (aged ≤18 y)134,164 (0.47%)620,984 (0.80%)971 (0.20%)2339 (0.48%)
OverallAll Indications 528,682,72177,754,597491,602740,668
1 Community care data extracted from Medical Services Plan database from 2000–2018; 2 ambulatory care data extracted from National Ambulatory Care Reporting System database from 2012–2018; 3 refers to the total number of physician visits linked to a record of antibiotic dispensation ±5 days; 4 refers to the total number of physician visits per indication; 5 refers to the sum total of 18 indications of interest within study scope.
Table
Table 3. Rate of antibiotic prescribing between outpatient and emergency care, stratified by age.
Table 3. Rate of antibiotic prescribing between outpatient and emergency care, stratified by age.
DiagnosesAge (yr); Number of Outpatient Care VisitsAge (yr); Number of Emergency Care VisitsAge (yr); Outpatient Prescribing rate/% Unnecessary 1Age (yr); Emergency Prescribing rate/% Unnecessary
<22–18≥19All Ages<22–18≥19All Ages<22–18≥19All Ages<22–18≥19All Ages
Acute otitis media731,5301,797,583-2,529,113654616,367-31,26568.8/28.666.0/36.0-60.1/33.984.6/44.673.4/43.3-76.2/43.6
Acute pharyngitis105,3341,047,4671,217,1342,369,935126710,95025,52537,74277.4/59.477.3/37.372.8/44.875.0/42.248.9/30.958.6/18.656.0/28.056.5/25.4
Acute sinusitis57,725435,4093,497,6313,990,765865848279894949.7/29.762.7/44.766.7/48.766.0/47.838.9/18.972.8/52.870.5/52.570.3/52.2
Asthma306,3491,873,9755,313,6057,493,929414814,62926,75245,52914.0/14.010.2/10.211.3/11.311.2/11.212.0/12.011.3/11.321.4/21.417.3/17.3
Bronchitis380,898946,0264,419,9135,746,8371665235022,24826,26337.5/32.557.8/49.861.5/53.559.3/51.530.8/25.853.2/45.259.4/51.457.0/49.2
Chronic sinusitis305573,9521,806,7281,883,735-421031107329.5/15.525.4/11.421.3/7.321.5/7.5-42.9/28.951.9/37.951.5/37.5
Common cold1,572,3573,501,57513,714,15318,788,0853550565418,15727,36115.8/15.822.5/22.519.7/19.719.9/19.914.3/14.318.9/18.928.1/28.124.4/24.4
Dental Conditions18,44493,420537,395649,259234247322,56825,2758.5/4.532.3/28.359.8/55.858.4/50.434.2/30.268.5/64.580.4/76.478.8/74.8
Epididymo-orchitis-11,874159,596171,470-65862746932-33.3/0.043.8/0.042.3/0.0-62.5/0.077.3/0.075.8/0.0
Influenza94,316382,9181,325,9571,803,191789349717,29221,57811.0/11.012.3/12.312.2/12.212.1/12.116.3/16.315.7/15.720.1/20.119.2/19.2
Non-purulent SSTI72,825443,7304,246,0104,762,56514268698170,065180,18944.2/0.058.4/0.056.0/0.056.0/0.081.5/0.083.7/0.073.0/0.073.6/0.0
Otitis externa--2,121,0582,121,058--67076707--9.9/8.99.9/8.9--42.9/41.942.9/41.9
Pneumonia99,460215,4022,210,8822,525,744721912,90977,41097,53857.2/0.064.9/0.038.5/0.041.5/0.084.7/0.092.3/0.066.4/0.071.2/0.0
Prostatitis--379,608379,608--23122312--34.0/0.034.0/0.0--74.1/0.074.1/0.0
Purulent SSTI106,928571,7446,285,6486,964,3201145525745,13651,53833.0/0.039.4/0.018.8/0.020.7/0.064.3/14.363.6/13.665.5/35.565.3/32.8
Pyelonephritis15,82631,366348,099395,291157174229,23231,13143.8/0.054.1/0.050.6/0.050.6/0.089.8/0.087.9/0.077.9/0.078.5/0.0
Reproductive tract infections6443126,4752,369,8482,502,766-169258527546.5/0.016.1/0.014.6/0.014.7/0.0-93.9/0.093.6/0.093.5/0.0
Urinary tract infections98,858858,5359,724,01310,681,406452811,506118,149134,18342.8/0.060.4/0.063.1/0.062.7/0.080.8/0.084.6/0.083.9/0.083.9/0.0
1 Expected rates of prescribing (Wu et al., 2020) are: prescribing rate % minus unnecessary rate %; dashed lines [-] included in cells where not applicable.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Saatchi, A.; Yoo, J.-W.; Schwartz, K.L.; Silverman, M.; Morris, A.M.; Patrick, D.M.; McCormack, J.; Marra, F. Quantifying the Gap between Expected and Actual Rates of Antibiotic Prescribing in British Columbia, Canada. Antibiotics 2021, 10, 1428. https://doi.org/10.3390/antibiotics10111428

AMA Style

Saatchi A, Yoo J-W, Schwartz KL, Silverman M, Morris AM, Patrick DM, McCormack J, Marra F. Quantifying the Gap between Expected and Actual Rates of Antibiotic Prescribing in British Columbia, Canada. Antibiotics. 2021; 10(11):1428. https://doi.org/10.3390/antibiotics10111428

Chicago/Turabian Style

Saatchi, Ariana, Ji-Won Yoo, Kevin L. Schwartz, Michael Silverman, Andrew M. Morris, David M. Patrick, James McCormack, and Fawziah Marra. 2021. "Quantifying the Gap between Expected and Actual Rates of Antibiotic Prescribing in British Columbia, Canada" Antibiotics 10, no. 11: 1428. https://doi.org/10.3390/antibiotics10111428

APA Style

Saatchi, A., Yoo, J. -W., Schwartz, K. L., Silverman, M., Morris, A. M., Patrick, D. M., McCormack, J., & Marra, F. (2021). Quantifying the Gap between Expected and Actual Rates of Antibiotic Prescribing in British Columbia, Canada. Antibiotics, 10(11), 1428. https://doi.org/10.3390/antibiotics10111428

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop