Next Article in Journal
Efficacy and Tolerance of Antipsychotics Used for the Treatment of Patients Newly Diagnosed with Schizophrenia: A Systematic Review and Meta-Analysis
Previous Article in Journal
Factors Influencing the Implementation of a New Pharmacist Prescribing Service in Community Pharmacies
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Pharmacy
Volume 11
Issue 6
10.3390/pharmacy11060174
pharmacy-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Off-Label and Unlicenced Medicine Use among Hospitalised Children in South Africa: Practice and Policy Implications

by
Hlayiseka Mathevula
1,*,
Natalie Schellack
2,
Samuel Orubu
3,4,
Brian Godman
1,5 and
Moliehi Matlala
1
1
School of Pharmacy, Sefako Makgatho Health Sciences University, Molotlegi Street, Pretoria 0204, South Africa
2
Department of Pharmacology, University of Pretoria, Pretoria 0084, South Africa
3
Pharmacy Department, Niger Delta University, Yenagoa P.O. BOX 72, Nigeria
4
Global Strategy Lab, York University, Toronto, ON 4700, Canada
5
Department of Pharmacoepidemiology, Strathclyde Institute of Pharmacy and Biomedical Science (SIPBS), University of Strathclyde, Glasgow G4 0RE, UK
*
Author to whom correspondence should be addressed.
Pharmacy 2023, 11(6), 174; https://doi.org/10.3390/pharmacy11060174
Submission received: 14 September 2023 / Revised: 25 October 2023 / Accepted: 5 November 2023 / Published: 9 November 2023
Browse Figure
Review Reports Versions Notes

Abstract

:
Background: Information regarding off-label and unlicensed medicine use among South African children is limited. This is a concern as the prescribing of off-label and unlicensed medicines can lead to issues of effectiveness and safety as well as raise liability issues in the event of adverse events. This potentially exposes physicians to legal penalties. Consequently, we sought to determine the prevalence of off-label and unlicensed medicine use among paediatric patients in South Africa to provide future direction. Methods: This study retrospectively examined the use of medicine in a point-prevalence survey study (PPS) involving paediatric patients aged (0–2 years) admitted to selected public hospitals in Gauteng Province, South Africa. Data were collected per hospital over two days between February 2022 and July 2022. Demographics, duration of treatment, diagnosis, and medicines prescribed were collected from patient medical records using a mobile application. Prescribed medicines were reviewed against the medicine formularies and other databases to assess their appropriateness. Results: From three academic hospitals, 184 patient records were reviewed. A total of 592 medicines were dispensed, of which 379 (64.0%) were licensed and 213 (36.0%) were used off-label/unlicensed for paediatric patients 0–2 years of age. The most prevalent off-label and unlicensed medicines were multivitamins (n = 32, 15.0%) and ampicillin injections (n = 15, 7.0%). Conclusion: The frequency of unlicensed and off-label medicine prescribing shown in this study is consistent with the literature and can be considered high. This practice can pose a risk because it adversely affects patients if not properly regulated. Attention is needed to ensure future high-quality, safe, and effective use of medicines.

1. Introduction

Medicine prescribing and the use of medicines in paediatric patient care have been a global issue for a number of years, with high rates of off-label prescribing seen in paediatric patients in a number of studies [1,2,3,4,5,6]. In general, studies indicate that the global level of off-label or unlicensed use of medicines among hospitalised children ranges from 12 to 70% for prescriptions and can reach up to 100% in some studies [7,8]. Recent reviews also suggest that the unlicensed use of medicines can account for up to 75% of medicine use among hospitalised children in some studies [8]. Having said this, Oshikoya et al. (2017) reported off-label prescriptions of only 7.7% among children with chronic diseases attending specialty paediatric clinics in Nigeria [9]. However, the potential for drug–drug interactions was higher among paediatric patients in an earlier study [10]. In addition, there were considerable concerns with the off-label use of pentazocine among paediatric surgical patients in Nigeria, and most children experienced between two and seven adverse events [11]. Developing countries, including South Africa, are acutely affected by off-label and unlicensed use of medicines because people aged between 0 and 18 years constitute an appreciable proportion of the population, and they are more prone to infectious diseases [12,13,14,15]. For instance, Southern Africa has a high proportion of children born to mothers with HIV, which is very different from higher-income countries [16].
The high rates of both off-label and unlicensed use of medicines globally are mainly due to the paucity of clinical trials in children [4,6,17]. The absence of thorough and careful medicine regulatory registration evaluation in paediatrics has also been cited as contributing to off-label prescribing; however, the WHO’s Vigi-Base system is being increasingly used to identify paediatric safety signals [18,19]. The absence of clinical trials in paediatric patients due to economic and ethical concerns further complicates the medicine approval process for this vulnerable population [6,20,21]. Encouragingly, we are now seeing an increase in paediatric biobanks to enhance research, including translational research, for children [22]. Since the recognition of paediatrics as “therapeutic orphans” in the late 1960s and continuing [23,24], there has been global acceptance of the requirement to undertake clinical trials in infants and children to improve their health [25]. Encouragingly, following the promulgation of the Paediatric Research Equity Act of 2003 (PREA) and the Best Pharmaceutical for Children Act (BPCA) of 2003—updated in 2022 to develop age-appropriate medicines—there have been significant changes in paediatric labelling, with these acts addressing previous laws restricting pharmaceutical companies from marketing medicines for children without research data to prove safety for use in children.
Prescribing off-label and unlicensed medicines can be unavoidable when there is no other option, with off-label use regularly included in paediatric guidelines [26]. This includes managing children with tuberculosis (TB), where there are currently no age-appropriate formulations suitable for preventing and treating tuberculosis among the paediatric population in South Africa, despite several such formulations now being commercially available in other parts of the world [27]. Here, the benefit of treating TB using adult formulations appears to outweigh the risks; however, paediatric formulations are preferable, although these are currently unavailable in South Africa [27,28]. However, potential issues with the acceptability/swallowability of adult formulations, their dosing, and their side effects can adversely affect subsequent efficacy and safety.
However, despite changes in these acts, providing high-quality, safe, and efficacious medicine remains a problem for children. This is because paediatric patients cannot be compared with adult patients because their pharmacokinetics and pharmacodynamics change throughout infancy. The continued use of medicines approved only for prescribing in adults and their subsequent use in children leaves considerable uncertainty about their relative efficacy and safety [2,29,30]. Consequently, there is an urgent need for accelerated research and development of age-appropriate medicines to ensure their safe and effective use in paediatric patients.
While such off-label/unlicensed practices are well-characterised in several developed countries and regions, there are concerns about limited studies in developing countries, including South Africa [2,30]. The lack of studies in developing countries is a concern, especially with, for instance, an appreciably greater prevalence of infectious diseases, including HIV and TB, in developing versus developed countries. Consequently, we sought to start addressing this information gap by providing information on the use of medicines in paediatric patients aged 0–2 years of age in the public sector of South Africa. The findings can be used to guide key stakeholder groups in South Africa and other developing countries on suggested ways to improve the management of these young children in South Africa and beyond.

2. Methods

2.1. Study Design and Setting

This was a retrospective, multicentre, quantitative data review of medicine used in children (0–2 years of age) using a point-prevalence survey (PPS) study approach designed to determine the type and extent of medicines (off-label and unlicensed) prescribed to children (0–2 years) in academic hospitals in South Africa. Initially, the intention was to conduct this research in four academic hospitals in Gauteng Province, South Africa. However, whilst permission was obtained for all four hospitals, access was ultimately granted to only three. Gauteng Province was selected for this initial study because of the ease of access. Academic hospitals were selected because they provide specialised care, e.g., paediatric, neonatal intensive care, oncology, and paediatric surgery. The combined bed capacity of the four conveniently selected academic hospitals for the survey was 927. As per PPS study designs, the total number of beds was used as the population size determinant for this study.

2.2. Sample Size and Strategy

Files of paediatric patients aged 0–2 years hospitalised and available in the ward during the study period were included. The required sample size of 234 was calculated using a 95% confidence interval with a 50% proportion and a margin of error of 3%. A systematic sampling strategy was used whereby a patient in the ward was selected for every file of 0–2-year-olds until the sample size was achieved.

2.3. Data Collection

The data collected were all the medicines prescribed among paediatric patients aged 0–2 years who were admitted and available in the ward on the day of data collection from 08:00–17:00 h. Data were collected from patient medical records with the aid of a skilled data HM collector. Patient information was recorded on the PPS information sheet, accessible as a mobile application. The following information was collected from the patients’ files: their age, weight, and gender; length of therapy; diagnosis; route of administration (oral, intravenous, inhalation, topical, and rectal); and prescribed medications.
The following definitions were used in the PPS forms [31]:
  • Off Label use: Defined as the administration of a drug/medicine in a manner that differs from that recommended in marketing authorisation with respect to age, dose, frequency of administration, route of administration, formulation, and/or indication. Similarly, an approved medicinal product is a medicinal product prescribed and administered in accordance with its marketing authorisation.
  • Un-licensed use: Refers to the use of a medicinal product that has not been approved for marketing by the country’s medicine regulatory authority (the South African Health Product Regulatory Authority (SAHPRA)) [32].
The categories of off-label use included age, weight, absence of paediatric information, lack of paediatric clinical data, contraindication, route of administration, and formulation/dosage form of administration as stated in the literature insert or official compendium. The categories of unlicensed use included medicines not approved by the national medicine regulator [32].
The dates were deidentified, and all patient identification details (names, identity numbers, and patient file numbers) were not recorded to completely delink the patient from the data. Data were collected from February 2022 to July 2022. This period was chosen as it includes the winter, a flu season for the young and old, with anecdotal evidence suggesting an increase in medicine use during this period.
In terms of developmental differences and medicine use, the children in the PPS forms were categorised into preterm new-born infants (born before 37 weeks of pregnancy), term new-born infants (0–28 days), infants (28 days up to 12 months), and paediatrics (1 year up to 2 years) [33].

2.4. Data Analysis

The collected data were extracted from a mobile application and imported into Microsoft Excel. An unbiased arbitrator checked and cleaned the collected data to ensure consistency. The information was then entered and analysed using (IBM) SPSS Version 28.0. Descriptive statistics were used to calculate the frequencies and percentages of patient demographics and for all variables relevant to the study objectives. Medicines were described at different levels of the World Health Organisation’s Anatomical Therapeutic Chemical Code (ATC) classification. Subsequently, the frequency of medicines used off-label and unlicensed was calculated using the WHO’s (ATC) classification [34]. The conditions under which these medicines were prescribed were categorised as per the International Classification of Diseases 10th revision (ICD10) classification system [35]. A medicine is characterised by its distinct active ingredient, often known by its International Non-proprietary Name (INN). Consequently, various formulations with the same active ingredient, such as paracetamol syrup and paracetamol drops, were recorded as identical medicines. Binary logistic regression was used to evaluate the association among demographic variables with off-label/unlicensed medicine use at a 95% CI and p-value ≤ 0.05 significance level.

2.5. Ethics Approval and Consent to Participate

Ethical clearance (SMUREC/P/128/2020) was obtained from the Sefako Makgatho Health Sciences Research Ethics Committee, University of the Witwatersrand (clearance certificate M210426), and the National Department of Health (GP_202011_0470). The study was conducted after obtaining official permission from the hospital administration. No consent to participate was required because this study was a retrospective data review of patient records with no direct contact with the patient, and the data were delinked from the patient’s details. This is similar to other PPS studies in South Africa [36,37,38,39,40].

3. Results

After receiving ethical approval from all the potential academic hospitals, access to data was denied by the clinicians at one of the four academic hospitals as they feared that the study findings might be used as evidence during litigation despite the anonymity of the data. Overall, 184 (78.6%) of the envisaged 234 samples of paediatric patient files were subsequently accessed from three of the four academic hospitals.

3.1. Demographics

Among the 184 paediatric patient files that were reviewed, 592 medicines were prescribed, translating to an average of 3 medicines per patient file. A total of 79.3% of the files were for children between the ages of 0 and 1, as indicated in the study population (Table 1). The mean weight of the study population was 4.62 kg (SD ± 3.63 kg), with a little more than half (51.6%) of the patients being male and the majority, 96.7%, African.

3.2. Prevalence of Off-Label/Unlicensed Use in Children (0–2 Years)

The prevalence of off-label or unlicensed medicine use in children aged 0–2 years included in this study was 36% (213/592). Overall, 177 medicines (29.9%, n = 592) were prescribed off-label, while 36 (6.1%, n = 592) were categorised as unlicensed. Off-label prescribing was most prevalent among neonates aged 0–28 days, with 84 cases (39.4% of the 213 cases). On the other hand, unlicensed medicine use was most prevalent among infants aged between 29 days and 1 year, with 17 cases (8.0% of the 213 cases), as illustrated in Figure 1.

3.3. The Top 10 Most Prescribed Medicines at ATC Level 5, Chemical Substance, or INN

Six of the top ten most prescribed medicines were off-label or unlicensed (Table 2).
It is worth noting that the use of off-label and unlicensed medicines was not mutually exclusive. In fact, every single paediatric patient (n = 184) included in this study received at least one off-label or unlicensed medicine during their hospital stay. The most frequently prescribed off-label medicine was intravenous caffeine (5.2%, n = 31 of the 592). On the other hand, the medicine that was predominantly used in the unlicensed category was multivitamin syrup/drops, accounting for 6.4% of the cases.

3.4. Off-Label Use by Age Group

Off-label medicine use varied by age group. Table 3 provides an overview of the top 10 off-label medicines stratified by age group.
In children aged 0–28 days, ampicillin injections were the most frequently prescribed off-label medicine, with a total of 15 cases, accounting for 7.0% of all medicines (n = 512). Caffeine citrate injections were the second most prevalent off-label medicine, with 11 cases (5.2%). Additionally, gentamicin injections were identified as a prevalent off-label medicine exclusively among the 0–28-day age group, with a total of nine cases (4.3%).
Injections were the most common (80%) dosage form of off-label medicines used in this age group. In contrast, oral dosage forms—tablets, capsules, and syrups—were most common (90%) in infants. Consequently, most medicines were not established for use in neonates or manipulated in infants.

3.5. Unlicensed Medicine Use by Age Group at the ATC Level 4 Chemical Subgroup

The most used unlicensed medicine across all ages was multivitamins (A11), and probiotics (A07) were the medicines mostly used unlicensed in infants aged from 29 days to two years. In children aged 0–28 days, multivitamins were mostly used unlicensed, with 12 cases (5.8% of 213). Again, in children aged 29 days to one year, multivitamins were the most common unlicensed medicine with 11 cases (5.3% of 213), followed by probiotics in 2 cases (0.9% of 213). Lastly, in children aged 1 to 2 years, multivitamins were the most common unlicensed medicine with five cases (2.3% of 213), followed by probiotics with two cases (0.9% of 213), as indicated in Table 4.

3.6. Conditions Associated with Off-Label and Unlicensed Medicines by ICD-10 Codes

The data presented in Table 5 highlight the most common medical conditions, as indicated by their corresponding ICD-10 codes, in which medicines were used off-label or unlicensed. These were identified based on their frequency within the dataset and comprised 81.7% of diagnosed medical conditions in the sample with off-label or unlicensed medicine use.
Bacterial infections (ICD-10 code A49.9) were the most prevalent, accounting for 26.8% of the cases. Within this category, the majority of cases were prescribed off-label or unlicensed medicines in all age groups, with the highest proportion in the 0–28-day age group (61.4%).

3.7. Off-Label and Unlicensed Medicine Use by Therapeutic (ATC Level 2) and Age Groups

The most common (81.8%) off-label and unlicensed medicines are shown in Table 6.
Anti-bacterial for systemic use (ATC code J01), used off-label, was the most prevalent medicine category, comprising 26.3% (56/213) of all off-label and unlicensed medicines (n = 213). The off-label use of this category was highest in the 0–28-day age group (62.5%). The next most frequent medicine group, accounting for 17.4% (37 cases) of all off-label/unlicensed medicines, were vitamins (ATC code A11). Vitamins were unlicensed and mostly prescribed to infants aged 29 days–1 year.
No statistically significant associations were found between patient demographics/health-related variables and off-label/unlicensed use using binary logistic regression analysis. The Chi-Square Tests between the reason for off-label/unlicensed use and patient demographics (age categories and patient weight) were found to be statistically significant with a p-value of <0.001.

4. Discussion

To the best of our knowledge, this is the first study to report the prevalence of off-label use and unlicensed medicine use among the paediatric population aged zero to two years in South Africa. The frequency of unlicensed and off-label medicine prescribing in our study is consistent with some of the published literature and can be considered high [21,32,33,41,42,43,44,45,46,47,48,49,50,51]. We have seen in published studies among LMICs that off-label use among hospitalised paediatric patients can account for up to 99.5% or more of prescriptions [4,6,7,8,15,35,43,50,51,52,53,54]. However, whilst the percentage of off-label prescribing in our study was appreciably lower than the rates seen in a number of LMICs at 36% for off-label/unlicensed use, this does not negate potential concerns in a number of these very young infants. This practice can pose a risk because it can adversely affect young infants if, for instance, doses and their implications are not properly regulated in hospitals [4,6,7]. Very young infants are more susceptible to side effects when prescribed off-label medicines due to differences in pharmacokinetics and pharmacodynamics compared to adults [43]. This prescribing trend is particularly prevalent in infants aged 0–28 days, with 44% of infants in our study receiving off-label or unlicensed medicines. This rate is higher than in older infants and is consistent with global studies [54,55,56]. The heightened risk stems from the fact that neonates’ renal and hepatic functions are not fully developed [13,21,50,53,56,57,58]. Furthermore, there is a limited evidence base for the safety and efficacy of these medicines in very young infants [35,59,60,61,62].
We saw an average of three medicines prescribed per infant in our study, similar to other studies [31,53,63]. However, this was much higher than in Norway (0.8) and Spain (1.5) [64], and slightly lower than in Italy (3.7) [65], Malaysia (where the median number was 4 [63]), and Indonesia (where the median number of medicines prescribed was 9 [54]). Overall, paediatric patients are exposed to a high number of off-label and unlicensed medicines, which could lead to suboptimal clinical efficacy and unanticipated side effects. This needs to be addressed going forward, enhanced by regularly reviewing the evidence base for their use [66]. This is because for many medicines typically prescribed in neonatal and young infant ICUs, safety and efficacy data for neonatal pharmacotherapy are lacking, with an appreciable number of neonates in ICUs being prescribed medicines that are not approved or are used off-label [4,7,43,67]. Neonatal pharmacotherapy and prescribing practices require special attention, primarily because, as mentioned, neonates have unique pharmacokinetic and pharmacodynamic profiles compared to older children and adults. These differences can influence drug absorption, distribution, metabolism, and elimination [68,69]. Consequently, the efficacy and safety of medications in neonates can vary significantly from other populations [29,70]. Accurate dosing, vigilant monitoring, and a comprehensive understanding of the drug’s effects are essential to prevent potential adverse reactions [71] and to ensure therapeutic efficacy in this very young population. Consequently, healthcare professionals must remain updated on the latest research, guidelines, and recommendations related to neonatal pharmacotherapy [17,69,72]. This is very important for tertiary hospitals in the public healthcare system in South Africa and beyond going forward.
In our study, similar to others [13,35,50,73,74,75,76], systemic antibiotics were the most frequently prescribed medicines, especially among neonates. This high use of antibiotics reflects the fact that the top indication for off-label or unlicensed use in medicines in our study was for bacterial infections at 26.8%, higher than studies in Spain at 12.0% [42], France at 22% [45], and Uganda at 18.9% [77]. However, this study found lower use compared to studies conducted in the Western Cape, South Africa, which had a rate of 39% [78], and Jordan, where the rate of bacterial infections was 54.1% [79]. This high rate of antibiotic prescribing is perhaps not surprising, as academic hospitals typically treat more premature children with low birth weight and sepsis than secondary or community hospitals [80]. However, it is important to fully monitor the prescribing of antibiotics in this population because sepsis is the leading cause of neonatal death globally, killing more than 1 million neonates worldwide each year, with appreciably higher mortality rates in LMICs [81,82,83]. This results in antibiotics being among the most commonly prescribed drugs in neonatal intensive care units [84,85,86]. Proper dosing of antibiotics is critical as under- or over-dosing can increase antimicrobial resistance (AMR) [56,87], which is a concern with mortality from AMR growing globally, with the highest mortality rates from AMR currently seen in sub-Saharan Africa [88]. In addition, an estimated 31.0% of neonatal sepsis deaths are currently due to AMR and are rising [89]. In addition, under- or over-dosing medicines (including antibiotics), which may result from their off-label or unlicensed use, is a concern, as this poses a risk of reduced effectiveness, increased adverse reactions, or both, along with potentially increasing AMR [75,87]. We have seen antimicrobial stewardship (ASP) programmes effectively introduced in hospitals across Africa in recent years to improve antimicrobial prescribing, with hospital pharmacists playing a key role [90,91,92,93]. These ASP exemplars should provide guidance to key stakeholder groups in South Africa and beyond to address the inappropriate use of antibiotics alongside rising AMR on the continent.
There was also appreciable prescribing of caffeine in our study. Thomas (2014) classified caffeine as unlicensed in all dosage formulations [49]. However, at the time of our study, caffeine was registered with the regulators in South Africa as an injectable but was prescribed and administered orally. It is worth noting that there is currently no commercially available oral solution specifically formulated for caffeine in South Africa. Nevertheless, the Department of Health strongly recommends the oral route of administration for caffeine as per EML guidance [94,95,96,97,98,99]. Vitamins were also the most common medicine used unlicensed or unapproved in our study. This was due to a lack of marketing authorisation for vitamins from the regulatory body in South Africa. Currently, the South African Health Products Regulatory Authority classifies vitamins as dietary supplements. Previously, they were considered food/dietary supplements and did not undergo the same registration process as conventional medicines. Consequently, this might be the justification for unlicensed medicine status. This again needs to be looked at in light of their considerable use among this patient population in South Africa.
Age, route of administration, and dosage were the most common reasons for off-label prescribing in our study, similar to previous studies [7,32,49,100]. Due to the lack of suitable oral drug forms for neonates and young children, tablet splitting and dissolution in sterile liquids before administration are common, as seen in other studies [101]. However, both within and outside hospitals, the practice of tablet splitting or dissolution can place nurses and caregivers in the difficult situation of having to prepare and administer the medications according to current recommendations [102]. Furthermore, child acceptance of these manipulated medicines could be compromised [103]. It is also difficult for physicians to adjust dosages over time to ensure the adequate safety and efficacy of the prescribed medicines because the predominant method of manipulation is mixing with liquid and food. Alongside this, for certain medicines, food–drug interactions can appreciably affect their bioavailability and therapeutic efficacy, which needs to be considered when administering them [101,102]. Drug delivery and uptake can also be influenced by the medicine’s swallowability, taste, smell, texture, and appearance, which can be altered when adjusting or diluting doses [103,104], potentially leading to worse outcomes as a result. Consequently, this again needs careful monitoring.
The role of Drug and Therapeutic Committees (DTCs) in promoting rational and evidence-based prescribing practices is also pivotal, especially in addressing the current lack of rigorous regulatory evaluation of paediatric formulations [105]. We have seen the role of DTCs grow in South Africa compared with other African countries; however, more needs to be accomplished going forward [106,107,108,109,110]. Standard Operating Procedures (SOPs) can aid DTCs in streamlining and regulating inappropriate medication use, particularly concerning dosing for young infants, and preventing adverse drug reactions [110]. Monitoring adherence to these SOPs elevates the quality of care and strengthens the feedback loop, which is essential for continuous improvement.
Collaboration between DTCs and regulatory authorities, including SAHPRA, is paramount to bolstering the impact of these endeavours. Such a partnership would ensure up-to-date information on drug safety, efficacy, and quality for paediatric populations. By prioritising clinical trials tailored to the paediatric population and addressing issues related to off-label and unlicensed medication use, a comprehensive understanding of drug effects and risks can be established for this vulnerable group. Ultimately, by harnessing the synergy of DTCs and SAHPRA, South Africa has the potential to be a beacon for evidence-based paediatric medicine administration, extending best practices across the African continent. This is similar to the situation seen with the implementation of national action plans to reduce AMR across Africa, with ongoing activities in South Africa being more advanced than those seen in a number of other African countries and providing direction [90,105,110,111,112,113,114,115,116,117].
We are aware of a number of limitations with this study. Firstly, as this was a PPS study design, we only recorded medicines prescribed that day. Consequently, we were unable to link any off-label or unlicensed medicine with any contribution to any adverse drug reaction. Furthermore, this pilot study was conducted in only one province. However, despite these limitations, we believe the findings are robust.

5. Conclusions

In this study, off-label and unlicensed medicine use appear very common among paediatric patients aged 0 to 2 years of age admitted to public, academic hospitals in South Africa, similar to other studies. Addressing the issue of off-label and unlicensed drug use in paediatric patients is vital for promoting patient safety and improving healthcare outcomes going forward. In the first instance, this includes a greater role for DTCs in hospitals to develop appropriate standards and monitor their implementation, as well as encouraging greater understanding of neonatal pharmacology. In addition, seeking to instigate clinical trials, where possible, tailored to the paediatric population should be initiated. We will be following up on these suggestions in the future.

Author Contributions

H.M., with the assistance of M.M., developed the study concept. H.M. was responsible for conducting the data collection. Data analysis and manuscript preparation were carried out collaboratively by H.M., M.M., N.S., S.O. and B.G. The initial draft of the manuscript was authored by H.M., and subsequent versions underwent review and comments from all authors. The final manuscript received approval from all authors after careful reading and evaluation. All authors have read and agreed to the published version of the manuscript.

Funding

There was no funding provided for this study.

Institutional Review Board Statement

Ethical clearance (SMUREC/P/128/2020) was obtained from the Sefako Makgatho Health Sciences Research Ethics Committee, University of the Witwatersrand (clearance certificate M210426), and the National Department of Health (GP_202011_0470). This study was conducted after obtaining official permission from the hospital administration. No consent to participate was required because this study was a retrospective data review of patient records with no direct contact with the patient, and the data were delinked from the patient’s details. All procedures were conducted in compliance with the appropriate guidelines and regulations.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated or analysed as part of this study are included in this published paper.

Acknowledgments

We would like to express our gratitude to Danie Kruger for his valuable contribution in developing the data collection mobile application. Additionally, we appreciate his assistance in importing the data into Microsoft Excel, which facilitated convenient access and analysis. We would also like to extend our thanks to the dedicated staff from the paediatric wards in the hospitals for their unwavering support and assistance throughout this study.

Conflicts of Interest

The authors declare no relevant conflict of interest.

References

  1. Gazarian, M.; Kelly, M.; McPhee, J.R.; Graudins, L.V.; Ward, R.L. Off-label use of medicines: Consensus recommendations for evaluating appropriateness. Med. J. Aust. 2006, 185, 544–548. [Google Scholar] [CrossRef] [PubMed]
  2. Corny, J.; Lebel, D.; Bailey, B.; Bussières, J.F. Unlicensed and Off-Label Drug Use in Children Before and After Pediatric Governmental Initiatives. J. Pediatr. Pharmacol. Ther. 2015, 20, 316–328. [Google Scholar] [CrossRef]
  3. Napoleone, E. Children and ADRs (Adverse Drug Reactions). Ital. J. Pediatr. 2010, 36, 4. [Google Scholar] [CrossRef] [PubMed]
  4. Aagaard, L. Off-Label and Unlicensed Prescribing of Medicines in Paediatric Populations: Occurrence and Safety Aspects. Basic Clin. Pharmacol. Toxicol. 2015, 117, 215–218. [Google Scholar] [CrossRef] [PubMed]
  5. Almazroea, A.H.; Almugheerbi, S.I.; Alamri, M.A.; Alloqmani, M.M.; Almohammadi, G.A.S.; Bazarbay, A.A.; Khoshhal, B.A. Prevalence Of Antibiotic Use For Pediatric Acute Viral Gastroenteritis In Medinah Medicine Almunwarah, KSA. Pharmacophore 2019, 10, 37–49. [Google Scholar]
  6. Gore, R.; Chugh, P.K.; Tripathi, C.D.; Lhamo, Y.; Gautam, S. Pediatric Off-Label and Unlicensed Drug Use and Its Implications. Curr. Clin. Pharmacol. 2017, 12, 18–25. [Google Scholar] [CrossRef]
  7. Magalhães, J.; Rodrigues, A.T.; Roque, F.; Figueiras, A.; Falcão, A.; Herdeiro, M.T. Use of off-label and unlicenced drugs in hospitalised paediatric patients: A systematic review. Eur. J. Clin. Pharmacol. 2014, 71, 1–13. [Google Scholar] [CrossRef]
  8. Shuib, W.; Wu, X.Y.; Xiao, F. Extent, reasons and consequences of off-labeled and unlicensed drug prescription in hospitalized children: A narrative review. World J. Pediatr. 2021, 17, 341–354. [Google Scholar] [CrossRef]
  9. Oshikoya, K.A.; Oreagba, I.A.; Godman, B.; Fadare, J.; Orubu, S.; Massele, A.; Senbanjo, I.O. Off-label prescribing for children with chronic diseases in Nigeria; findings and implications. Expert Opin. Drug Saf. 2017, 16, 981–988. [Google Scholar] [CrossRef]
  10. Oshikoya, K.A.; Oreagba, I.A.; Godman, B.; Oguntayo, F.S.; Fadare, J.; Orubu, S.; Massele, A.; Senbanjo, I.O. Potential drug-drug interactions in paediatric outpatient prescriptions in Nigeria and implications for the future. Expert Rev. Clin. Pharmacol. 2016, 9, 1505–1515. [Google Scholar] [CrossRef]
  11. Oshikoya, K.A.; Abayomi Ogunyinka, I.; Godman, B. Off-label use of pentazocine and the associated adverse events among pediatric surgical patients in a tertiary hospital in Northern Nigeria: A retrospective chart review. Curr. Med. Res. Opin. 2019, 35, 1505–1512. [Google Scholar] [CrossRef] [PubMed]
  12. Slater, R.; Moultrie, F.; Bax, R.; van den Anker, J.; Bhatt, A. Preterm health: Time to bridge the evidence gap. Lancet 2020, 396, 872–873. [Google Scholar] [CrossRef] [PubMed]
  13. Kouti, L.; Aletayeb, M.; Aletayeb, S.M.H.; Hardani, A.K.; Eslami, K. Pattern and extent of off-label and unlicensed drug use in neonatal intensive care units in Iran. BMC Pediatr. 2019, 19, 3. [Google Scholar] [CrossRef] [PubMed]
  14. Yamashiro, Y.; Martin, J.; Gazarian, M.; Kling, S.; Nakamura, H.; Matsui, A.; Cucchiara, S.; Aloi, M.; Wynn, E.L.; Mulberg, A.E. Drug development: The use of unlicensed/off-label medicines in pediatrics. J. Pediatr. Gastroenterol. Nutr. 2012, 55, 506–510. [Google Scholar] [CrossRef] [PubMed]
  15. Gidey, M.T.; Gebretsadkan, Y.G.; Tsadik, A.G.; Welie, A.G.; Assefa, B.T. Off-label and unlicensed drug use in Ayder comprehensive specialized hospital neonatal intensive care unit. Ital. J. Pediatr. 2020, 46, 41. [Google Scholar] [CrossRef]
  16. Slogrove, P.D. Babies Born to Mums with HIV Face Higher Risks even Though They’re HIV Negative. The Conversation. 2018. Available online: https://theconversation.com/babies-born-to-mums-with-hiv-face-higher-risks-even-though-theyre-hiv-negative-100509 (accessed on 29 October 2023).
  17. Allegaert, K. Better medicines for neonates: Improving medicine development, testing, and prescribing. Early Hum. Dev. 2017, 114, 22–25. [Google Scholar] [CrossRef]
  18. Star, K.; Sandberg, L.; Bergvall, T.; Choonara, I.; Caduff-Janosa, P.; Edwards, I.R. Paediatric safety signals identified in VigiBase: Methods and results from Uppsala Monitoring Centre. Pharmacoepidemiol. Drug Saf. 2019, 28, 680–689. [Google Scholar] [CrossRef]
  19. Star, K.; Edwards, I.R. Pharmacovigilance for Children’s Sake. Drug Saf. 2014, 37, 91–98. [Google Scholar] [CrossRef]
  20. Kern, S.E. Challenges in conducting clinical trials in children: Approaches for improving performance. Expert Rev. Clin. Pharmacol. 2009, 2, 609–617. [Google Scholar] [CrossRef]
  21. Kimland, E.; Nydert, P.; Odlind, V.; Böttiger, Y.; Lindemalm, S. Paediatric drug use with focus on off-label prescriptions at Swedish hospitals—A nationwide study. Acta Paediatr. 2012, 101, 772–778. [Google Scholar] [CrossRef]
  22. Cianflone, A.; Savoia, F.; Parasole, R.; Mirabelli, P. Pediatric biobanks to enhance clinical and translational research for children. Eur. J. Pediatr. 2023, 182, 1459–1468. [Google Scholar] [CrossRef] [PubMed]
  23. Shirkey, H. Editorial comment: Therapeutic orphans. J. Pediatr. 1968, 72, 119–120. [Google Scholar] [CrossRef] [PubMed]
  24. Shirkey, H.C. Editorial. Ann. Pharmacother. 2006, 40, 1174. [Google Scholar] [CrossRef] [PubMed]
  25. Sammons, H.; Gray, C.; Hudson, H.; Cherrill, J.; Choonara, I. Safety in paediatric clinical trials—A 7-year review. Acta Paediatr. 2008, 97, 474–477. [Google Scholar] [CrossRef]
  26. Meng, M.; Zhou, Q.; Lei, W.; Tian, M.; Wang, P.; Liu, Y.; Sun, Y.; Chen, Y.; Li, Q. Recommendations on Off-Label Drug Use in Pediatric Guidelines. Front. Pharmacol. 2022, 13, 892574. [Google Scholar] [CrossRef]
  27. Nash, M.; Perrin, C.; Seddon, J.A.; Furin, J.; Hauser, J.; Marais, B.; Kitai, I.; Starke, J.; McKenna, L. Access to paediatric formulations for the treatment of childhood tuberculosis. Lancet Child Adolesc. Health 2020, 4, 855–857. [Google Scholar] [CrossRef]
  28. Ivanovska, V.; Rademaker, C.M.A.; Van Dijk, L.; Mantel-Teeuwisse, A.K. Pediatric drug formulations: A review of challenges and progress. Pediatrics. Am. Acad. Pediatr. 2014, 134, 361–372. [Google Scholar] [CrossRef]
  29. Lathyris, D.; Panagiotou, O.A.; Baltogianni, M.; Ioannidis, J.P.A.; Contopoulos-Ioannidis, D.G. Safety of Medical Interventions in Children Versus Adults. Pediatrics 2014, 133, e666–e673. [Google Scholar] [CrossRef]
  30. Vandermeer, B.; van der Tweel, I.; Jansen-van der Weide, M.C.; Weinreich, S.S.; Contopoulos-Ioannidis, D.G.; Bassler, D.; Fernandes, R.M.; Askie, L.; Saloojee, H.; Baiardi, P.; et al. Comparison of nuisance parameters in pediatric versus adult randomized trials: A meta-epidemiologic empirical evaluation. BMC Med. Res. Methodol. 2018, 18, 7. [Google Scholar] [CrossRef]
  31. Czarniak, P.; Bint, L.; Favié, L.; Parsons, R.; Hughes, J.; Sunderland, B. Clinical Setting Influences Off-Label and Unlicensed Prescribing in a Paediatric Teaching Hospital. PLoS ONE 2015, 10, e0120630. [Google Scholar] [CrossRef]
  32. Teigen, A.; Wang, S.; Truong, B.T.; Bjerknes, K. Off-label and unlicensed medicines to hospitalised children in Norway. J. Pharm. Pharmacol. 2016, 69, 432–438. [Google Scholar] [PubMed]
  33. Costa, H.T.M.d.L.; Costa, T.X.; Martins, R.R.; Oliveira, A.G. Use of off-label and unlicensed medicines in neonatal intensive care. PLoS ONE 2018, 13, e0204427. [Google Scholar] [CrossRef] [PubMed]
  34. WHO. Anatomical Therapeutic Chemical (ATC) Classification. 2021. Available online: https://www.who.int/tools/atc-ddd-toolkit/atc-classification (accessed on 15 June 2023).
  35. Schweigertova, J.; Durisova, A.; Dolnikova, D.; Ondriasova, E.; Balazova, M.; Slezakova, V.; Kuzelova, M. Off-label and unlicensed use of medicinal products in the neonatal setting in the Slovak Republic. Pediatr. Int. 2015, 58, 126–131. [Google Scholar] [CrossRef] [PubMed]
  36. Kruger, D.; Dlamini, N.; Meyer, J.; Godman, B.; Kurdi, A.; Lennon, M.; Bennie, M.; Schellack, N. Development of a web-based application to improve data collection of antimicrobial utilization in the public health care system in South Africa. Hosp. Pr. 2021, 49, 184–193. [Google Scholar] [CrossRef]
  37. Skosana, P.P.; Schellack, N.; Godman, B.; Kurdi, A.; Bennie, M.; Kruger, D.; Meyer, J.C. A national, multicentre web-based point prevalence survey of antimicrobial use in community healthcare centres across South Africa and the implications. Hosp. Pr. 2022, 50, 306–317. [Google Scholar] [CrossRef]
  38. Makwela, A.B.; Grootboom, W.M.; Abraham, V.; Witika, B.; Godman, B.; Skosana, P.P. Antimicrobial Management of Skin and Soft Tissue Infections among Surgical Wards in South Africa: Findings and Implications. Antibiotics 2023, 12, 275. [Google Scholar] [CrossRef]
  39. Skosana, P.P.; Schellack, N.; Godman, B.; Kurdi, A.; Bennie, M.; Kruger, D.; Meyer, J.C. A point prevalence survey of antimicrobial utilisation patterns and quality indices amongst hospitals in South Africa; findings and implications. Expert Rev. Anti Infect. Ther. 2021, 19, 1353–1366. [Google Scholar] [CrossRef]
  40. Skosana, P.; Schellack, N.; Godman, B.; Kurdi, A.; Bennie, M.; Kruger, D.; Meyer, J. A national, multicentre, web-based point prevalence survey of antimicrobial use and quality indices among hospitalised paediatric patients across South Africa. J. Glob. Antimicrob. Resist. 2021, 29, 542–550. [Google Scholar] [CrossRef]
  41. Lizano-Díez, I.; Kargodorian, J.; Piñero-López, M.Á.; Lastra, C.F.; Mariño, E.L.; Modamio, P. Off-label drug use in neonates and infants in Spain: A five-year observational study. Pharmacoepidemiol. Drug Saf. 2022, 31, 270–282. [Google Scholar] [CrossRef]
  42. Weda, M.; Hoebert, J.; Vervloet, M.; Moltó Puigmarti, C.; Damen, N.; Marchange, S.; Dijk, L.V.; Langedijk, J. Study on Off-Label Use of Medicinal Products in the European Union. 2017. Available online: https://data.europa.eu/doi/10.2875/464022 (accessed on 29 October 2023).
  43. Allen, H.C.; Garbe, M.C.; Lees, J.; Aziz, N.; Chaaban, H.; Miller, J.L.; Johnson, P.; DeLeon, S. Off-Label Medication use in Children, More Common than We Think: A Systematic Review of the Literature. J. Okla State Med. Assoc. 2018, 111, 776–783. [Google Scholar]
  44. Morales-Carpi, C.; Estañ, L.; Rubio, E.; Lurbe, E.; Morales-Olivas, F.J. Drug utilization and off-label drug use among Spanish emergency room paediatric patients. Eur. J. Clin. Pharmacol. 2010, 66, 315–320. [Google Scholar] [CrossRef] [PubMed]
  45. Palmaro, A.; Bissuel, R.; Renaud, N.; Durrieu, G.; Escourrou, B.; Oustric, S.; Montastruc, J.-L.; Lapeyre-Mestre, M. Off-Label Prescribing in Pediatric Outpatients. Pediatrics 2015, 135, 49–58. [Google Scholar] [CrossRef] [PubMed]
  46. Neville, K.A.; Frattarelli, D.A.; Galinkin, J.L.; Green, T.P.; Johnson, T.D.; Paul, I.M.; Anker, J.N.V.D. Off-Label Use of Drugs in Children. Pediatrics 2014, 133, 563–567. [Google Scholar]
  47. Cuzzolin, L. Off-label drug in the newborn Proceedings Review. J. Pediatr. Neonatal Individ. Med. 2014, 3, e030224. [Google Scholar] [CrossRef]
  48. Yackey, K.; Stukus, K.; Cohen, D.; Kline, D.; Zhao, S.; Stanley, R. Off-label Medication Prescribing Patterns in Pediatrics: An update. Hosp. Pediatr. 2019, 9, 186–193. [Google Scholar] [CrossRef]
  49. Thomas, A. The Use of Unlicensed and Off Label Drugs in Tygerberg Hospital Neonatal Intensive Care Unit. Ph.D. Thesis, Stellenbosch University, Stellenbosch, South Africa, 19 April 2014. Available online: http://hdl.handle.net/10019.1/86722 (accessed on 29 October 2023).
  50. Jain, S.; Saini, S.S.; Chawla, D.; Kumar, P.; Dhir, S. Off-label Use of Drugs in Neonatal Intensive Care Units. Indian Pediatr. 2014, 51, 644–646. Available online: http://bnfc.org/bnfc (accessed on 16 June 2023). [CrossRef]
  51. De Souza, A.S.; dos Santos, D.B.; Rey, L.C.; Medeiros, M.G.; Vieira, M.G.; Coelho, H.L.L. Off-label use and harmful potential of drugs in a NICU in Brazil: A descriptive study. BMC Pediatr. 2016, 16, 13. [Google Scholar] [CrossRef]
  52. Saiyed, M.M.; Lalwani, T.; Rana, D. Off-Label Medicine Use in Pediatric Inpatients: A Prospective Observational Study at a Tertiary Care Hospital in India. Int. J. Pediatr. 2014, 2014, 415815. [Google Scholar] [CrossRef]
  53. Aamir, M.; Khan, J.A.; Shakeel, F.; Shareef, R.; Shah, N. Drug utilization in neonatal setting of Pakistan: Focus on unlicensed and off label drug prescribing. BMC Pediatr. 2018, 18, 242. [Google Scholar] [CrossRef]
  54. Tukayo, B.L.A.; Sunderland, B.; Parsons, R.; Czarniak, P. High prevalence of off-label and unlicensed paediatric prescribing in a hospital in Indonesia during the period Aug.—Oct. 2014. PLoS ONE 2020, 15, e0227687. [Google Scholar] [CrossRef]
  55. Lee, J.H.; Byon, H.J.; Choi, S.; Jang, Y.E.; Kim, E.H.; Kim, J.T.; Kim, H.S. Safety and Efficacy of Off-label and Unlicensed Medicines in Children. J. Korean Med. Sci. 2018, 33, e227. [Google Scholar] [CrossRef] [PubMed]
  56. Ribeiro, M.; Jorge, A.; Macedo, A.F. Off-label drug prescribing in a Portuguese Paediatric Emergency Unit. Int. J. Clin. Pharm. 2013, 35, 30–36. [Google Scholar] [CrossRef] [PubMed]
  57. Gonçalves, A.C.D.S.; Reis, A.M.M.; Marçal, A.C.G.; Bouzada, M.C.F. Use of unlicensed and off-label drugs in neonates in a Brazilian university hospital. Braz. J. Pharm. Sci. 2018, 53, e00252. [Google Scholar] [CrossRef]
  58. Carvalho, C.G.; Ribeiro, M.R.; Bonilha, M.M.; Fernandes, M., Jr.; Procianoy, R.S.; Silveira, R.C. Use of off-label and unlicensed drugs in the neonatal intensive care unit and its association with severity scores. J. Pediatr. 2012, 88, 465–470. [Google Scholar] [CrossRef] [PubMed]
  59. Claassen, K.; Thelen, K.; Coboeken, K.; Gaub, T.; Lippert, J.; Allegaert, K.; Willmann, S. Development of a Physiologically-Based Pharmacokinetic Model for Preterm Neonates: Evaluation with In Vivo Data. Curr. Pharm. Des. 2015, 21, 5688–5698. [Google Scholar] [CrossRef] [PubMed]
  60. Kieran, E.A.; O’Callaghan, N.; O’Donnell, C.P. Unlicensed and off-label drug use in an Irish neonatal intensive care unit: A prospective cohort study. Acta Paediatr. 2014, 103, e139–e142. [Google Scholar] [CrossRef]
  61. Cuzzolin, L.; Agostino, R. Off-label and unlicensed drug treatments in Neonatal Intensive Care Units: An Italian multicentre study. Eur. J. Clin. Pharmacol. 2016, 72, 117–123. [Google Scholar] [CrossRef]
  62. Laforgia, N.; Nuccio, M.M.; Schettini, F.; Dell’Aera, M.; Gasbarro, A.R.; Dell’Erba, A.; Solarino, B. Off-label and unlicensed drug use among neonatal intensive care units in Southern Italy. Pediatr. Int. 2014, 56, 57–59. [Google Scholar] [CrossRef]
  63. Lee, J.L.; Redzuan, A.M.; Shah, N.M. Unlicensed and off-label use of medicines in children admitted to the intensive care units of a hospital in Malaysia. Int. J. Clin. Pharm. 2013, 35, 1025–1029. [Google Scholar] [CrossRef]
  64. Clavenna, A.; Bonati, M. Drug prescriptions to outpatient children: A review of the literature. Eur. J. Clin. Pharmacol. 2009, 65, 749–755. [Google Scholar] [CrossRef]
  65. Piovani, D.; Clavenna, A.; Bonati, M. Drug use profile in outpatient children and adolescents in different Italian regions. BMC Pediatr. 2013, 13, 46. [Google Scholar] [CrossRef] [PubMed]
  66. Ballard, C.D.; Peterson, G.M.; Thompson, A.J.; Beggs, S.A. Off-label use of medicines in paediatric inpatients at an Australian teaching hospital. J. Paediatr. Child Health 2013, 49, 38–42. [Google Scholar] [CrossRef] [PubMed]
  67. Kleiber, N.; Tromp, K.; Mooij, M.G.; van de Vathorst, S.; Tibboel, D.; de Wildt, S.N. Ethics of Drug Research in the Pediatric Intensive Care Unit. Pediatr. Drugs 2015, 17, 43–53. [Google Scholar] [CrossRef] [PubMed]
  68. Pacifici, G. Clinical Pharmacology of Theophylline in Preterm Infants: Effects, Metabolism and Pharmacokinetics. Curr. Pediatr. Rev. 2015, 10, 297–303. [Google Scholar] [CrossRef]
  69. Allegaert, K.; van den Anker, J.N. Clinical Pharmacology in Neonates: Small Size, Huge Variability. Neonatology 2014, 105, 344–349. [Google Scholar] [CrossRef]
  70. Jonas, M.M.; Rhee, S.; Kelly, D.A.; Del Valle-Segarra, A.; Feiterna-Sperling, C.; Gilmour, S.; Gonzalez-Peralta, R.P.; Hierro, L.; Leung, D.H.; Ling, S.C.; et al. Pharmacokinetics, Safety, and Efficacy of Glecaprevir/Pibrentasvir in Children With Chronic HCV: Part 2 of the DORA Study. Hepatology 2021, 74, 19–27. [Google Scholar] [CrossRef]
  71. Fabiano, V.; Mameli, C.; Zuccotti, G.V. Adverse drug reactions in newborns, infants and toddlers: Pediatric pharmacovigilance between present and future. Expert Opin. Drug Saf. 2011, 11, 95–105. [Google Scholar] [CrossRef]
  72. Laughon, M.M.; Benjamin, D.K.; Capparelli, E.V.; Kearns, G.L.; Berezny, K.; Paul, I.M.; Wade, K.; Barrett, J.; Smith, P.B.; Cohen-Wolkowiez, M. Innovative clinical trial design for pediatric therapeutics. Expert Rev. Clin. Pharmacol. 2011, 4, 643–652. [Google Scholar] [CrossRef]
  73. Al-Turkait, A.; Szatkowski, L.; Choonara, I.; Ojha, S. Review of Drug Utilization Studies in Neonatal Units: A Global Perspective. Int. J. Environ. Res. Public Health 2020, 17, 5669. [Google Scholar] [CrossRef]
  74. Girardi, A.; Galletti, S.; Raschi, E.; Koci, A.; Poluzzi, E.; Faldella, G.; De Ponti, F. Pattern of drug use among preterm neonates: Results from an Italian neonatal intensive care unit. Ital. J. Pediatr. 2017, 43, 37. [Google Scholar] [CrossRef]
  75. Hafeez, M.; Saleem, Z.; Bukhari, N.A.; Hussain, K.; Shamim, R.; Hussain, A.; Bukhari, N.I. Off-label antibiotic use in a specialized children care hospital in Punjab, Pakistan: Findings and implications. J. Infect. Dev. Ctries. 2020, 14, 540–544. [Google Scholar] [CrossRef] [PubMed]
  76. Casañ, V.A.; Escribano, B.C.; Garrido-Corro, B.; Murie, P.D.L.C.; Álvarez, M.J.B.; De la Rubia Nieto, M.A. Off-label and unlicensed drug use in a Spanish Neonatal Intensive Care Unit. Farm. Hosp. 2017, 41, 371–381. [Google Scholar]
  77. Obura, B.; Alele, P.E.; Obua, C. Off-label antibiotic use among paediatric in-patients: A mixed-method prospective study at a tertiary hospital in southwestern Uganda. Int. J. Clin. Pharm. 2021, 43, 637–644. [Google Scholar] [CrossRef] [PubMed]
  78. Kooblal, Y. Unregistered and Off-Label Medicine Use in Highly Specialised Paediatric at Tigerberg Hopsital. Ph.D. Thesis, Stellenbosch University, Stellenbosch, South Africa, 2016. [Google Scholar]
  79. Abdel-Qader, D.H.; Ismael, N.S.; Albassam, A.; El-Shara’, A.A.; Aljamal, M.S.; Ismail, R.; Abdel-Qader, H.A.; Hamadi, S.; Al Mazrouei, N.; Ibrahim, O.M. Antibiotics use and appropriateness in two Jordanian children hospitals: A point prevalence study. J. Pharm. Health Serv. Res. 2021, 12, 166–172. [Google Scholar] [CrossRef]
  80. Vergnano, S.; Sharland, M.; Kazembe, P.; Mwansambo, C.; Heath, P.T. Neonatal sepsis: An international perspective. Arch. Dis. Child. Fetal Neonatal Ed. 2005, 90, F220–F224. [Google Scholar] [CrossRef]
  81. Russell, N.J.; Stöhr, W.; Plakkal, N.; Cook, A.; Berkley, J.A.; Adhisivam, B.; Agarwal, R.; Ahmed, N.U.; Balasegaram, M.; Ballot, D.; et al. Patterns of antibiotic use, pathogens, and prediction of mortality in hospitalized neonates and young infants with sepsis: A global neonatal sepsis observational cohort study (NeoOBS). PLoS Med. 2023, 20, e1004179. [Google Scholar] [CrossRef] [PubMed]
  82. Wen, S.C.H.; Ezure, Y.; Rolley, L.; Spurling, G.; Lau, C.L.; Riaz, S.; Paterson, D.L.; Irwin, A.D. Gram-negative neonatal sepsis in low- and lower-middle-income countries and WHO empirical antibiotic recommendations: A systematic review and meta-analysis. PLOS Med. 2021, 18, e1003787. [Google Scholar] [CrossRef] [PubMed]
  83. Jackson, C.; Hsia, Y.; Basmaci, R.; Bielicki, J.; Heath, P.T.; Versporten, A.; Goossens, H.; Sharland, M. Global Divergence From World Health Organization Treatment Guidelines for Neonatal and Pediatric Sepsis. Pediatr. Infect. Dis. J. 2019, 38, 1104–1106. [Google Scholar] [CrossRef]
  84. Milton, R.; Gillespie, D.; Dyer, C.; Taiyari, K.; Carvalho, M.J.; Thomson, K.; Sands, K.; Portal, E.A.R.; Hood, K.; Ferreira, A.; et al. Neonatal sepsis and mortality in low-income and middle-income countries from a facility-based birth cohort: An international multisite prospective observational study. Lancet Glob. Health 2022, 10, e661–e672. [Google Scholar] [CrossRef]
  85. Popescu, C.R.; Cavanagh, M.M.M.; Tembo, B.; Chiume, M.; Lufesi, N.; Goldfarb, D.M.; Kissoon, N.; Lavoie, P.M. Neonatal sepsis in low-income countries: Epidemiology, diagnosis and prevention. Expert Rev. Anti Infect. Ther. 2020, 18, 443–452. [Google Scholar] [CrossRef]
  86. Depani, S.J.M.; Ladhani, S.M.; Heath, P.T.F.; Lamagni, T.L.; Johnson, A.P.; Pebody, R.G.F.; Ramsay, M.E.F.; Sharland, M.F. The Contribution of Infections to Neonatal Deaths in England and Wales. Pediatr. Infect. Dis. J. 2011, 30, 345–347. [Google Scholar] [CrossRef] [PubMed]
  87. Dryden, M.; Johnson, A.P.; Ashiru-Oredope, D.; Sharland, M. Using antibiotics responsibly: Right drug, right time, right dose, right duration. J. Antimicrob. Chemother. 2011, 66, 2441–2443. [Google Scholar] [CrossRef] [PubMed]
  88. Murray, C.J.L.; Ikuta, K.S.; Sharara, F.; Swetschinski, L.; Aguilar, G.R.; Gray, A.; Han, C.; Bisignano, C.; Rao, P.; Wool, E.; et al. Global burden of bacterial antimicrobial resistance in 2019: A systematic analysis. Lancet 2022, 399, 629–655. [Google Scholar] [CrossRef] [PubMed]
  89. Li, G.; Bielicki, J.A.; Ahmed, A.S.M.N.U.; Islam, M.S.; Berezin, E.N.; Gallacci, C.B.; Guinsburg, R.; da Silva Figueiredo, C.E.; Vieira, R.S.; Silva, A.R.; et al. Towards understanding global patterns of antimicrobial use and resistance in neonatal sepsis: Insights from the NeoAMR network. Arch. Dis. Child. 2020, 105, 26–31. [Google Scholar] [CrossRef] [PubMed]
  90. Saleem, Z.; Godman, B.; Cook, A.; Khan, M.A.; Campbell, S.M.; Seaton, R.A.; Siachalinga, L.; Haseeb, A.; Amir, A.; Kurdi, A.; et al. Ongoing Efforts to Improve Antimicrobial Utilization in Hospitals among African Countries and Implications for the Future. Antibiotics 2022, 11, 1824. [Google Scholar] [CrossRef]
  91. Siachalinga, L.; Mufwambi, W.; Lee, I.H. Impact of antimicrobial stewardship interventions to improve antibiotic prescribing for hospital inpatients in Africa: A systematic review and meta-analysis. J. Hosp. Infect. 2022, 129, 124–143. [Google Scholar] [CrossRef]
  92. Akpan, M.R.; Isemin, N.U.; Udoh, A.E.; Ashiru-Oredope, D. Implementation of antimicrobial stewardship programmes in African countries: A systematic literature review. J. Glob. Antimicrob. Resist. 2020, 22, 317–324. [Google Scholar] [CrossRef]
  93. Schellack, N.; Bronkhorst, E.; Coetzee, R.; Godman, B.; Gous, A.; Kolman, S. ASOCP position statement on the pharmacist’s role in antibiotic stewardship 2018. South. Afr. J. Infect. Dis. 2018, 33, 28–35. [Google Scholar]
  94. Hsieh, E.; Hornik, C.; Clark, R.; Laughon, M.; Benjamin, D.; Smith, P. Medication Use in the Neonatal Intensive Care Unit. Am. J. Perinatol. 2013, 31, 811–822. [Google Scholar] [CrossRef]
  95. Frey, H.A.; Klebanoff, M.A. The epidemiology, etiology, and costs of preterm birth. Semin. Fetal Neonatal Med. 2016, 21, 68–73. [Google Scholar] [CrossRef]
  96. Decramer, M. The European Respiratory Roadmap. Lancet 2011, 378, 1765–1767. [Google Scholar] [CrossRef] [PubMed]
  97. Schmalisch, G.; Wilitzki, S.; Roehr, C.C.; Proquitté, H.; Bührer, C. Differential effects of immaturity and neonatal lung disease on the lung function of very low birth weight infants at 48-52 postconceptional weeks. Pediatr. Pulmonol. 2013, 48, 1214–1223. [Google Scholar] [CrossRef] [PubMed]
  98. Baraldi, E.; Filippone, M. Chronic Lung Disease after Premature Birth. N. Engl. J. Med. 2007, 357, 1946–1955. [Google Scholar] [CrossRef] [PubMed]
  99. Moschino, L.; Stocchero, M.; Filippone, M.; Carraro, S.; Baraldi, E. Longitudinal Assessment of Lung Function in Survivors of Bronchopulmonary Dysplasia from Birth to Adulthood. The Padova BPD Study. Am. J. Respir. Crit. Care Med. 2018, 198, 134–137. [Google Scholar] [CrossRef]
  100. Lindell-Osuagwu, L.; Hakkarainen, M.; Sepponen, K.; Vainio, K.; Naaranlahti, T.; Kokki, H. Prescribing for off-label use and unauthorized medicines in three paediatric wards in Finland, the status before and after the European Union Paediatric Regulation. J. Clin. Pharm. Ther. 2014, 39, 144–153. [Google Scholar] [CrossRef]
  101. Wensel, T.M. Administration of proton pump inhibitors in patients requiring enteral nutrition. Pharm. Ther. 2009, 34, 143–160. [Google Scholar]
  102. van der Vossen, A.C.; Al-Hassany, L.; Buljac, S.; Brugma, J.D.; Vulto, A.G.; Hanff, L.M. Manipulation of oral medication for children by parents and nurses occurs frequently and is often not supported by instructions. Acta Paediatr. 2019, 108, 1475–1481. [Google Scholar] [CrossRef]
  103. Mistry, P.; Batchelor, H. Evidence of acceptability of oral paediatric medicines: A review*. J. Pharm. Pharmacol. 2016, 69, 361–376. [Google Scholar] [CrossRef]
  104. Archary, M.; Zanoni, B.; Lallemant, M.; Suwannaprom, P.; Clarke, D.; Penazzato, M. Acceptability and Feasibility of Using Raltegravir Oral Granules for the Treatment of Neonates in a Low-resource Setting. Pediatr. Infect. Dis. J. 2020, 39, 57–60. [Google Scholar] [CrossRef]
  105. Campbell, S.M.; Meyer, J.C.; Godman, B. Why Compliance to National Prescribing Guidelines is Important Especially across Sub-Saharan Africa and Suggestions for the Future. J. Biomed. Pharm. Sci. 2021, 4, 4. [Google Scholar]
  106. Hoffmann, M. The right drug, but from whose perspective? A framework for analysing the structure and activities of drug and therapeutics committees. Eur. J. Clin. Pharmacol. 2013, 69, 79–87. [Google Scholar] [CrossRef] [PubMed]
  107. Fadare, J.O.; Ogunleye, O.; Obiako, R.; Orubu, S.; Enwere, O.; Ajemigbitse, A.A.; Meyer, J.C.; Enato, E.; Massele, A.; Godman, B.; et al. Drug and therapeutics committees in Nigeria: Evaluation of scope and functionality. Expert Rev. Clin. Pharmacol. 2018, 11, 1255–1262. [Google Scholar] [PubMed]
  108. Lachhab, Z.; Serragui, S.; Hassar, M.; Cherrah, Y.; Errougani, A.; Ahid, S. Analysis of the drug formulary and the purchasing process at a Moroccan university medical center. Expert Rev. Pharmacoecon. Outcomes Res. 2018, 18, 415–421. [Google Scholar] [CrossRef] [PubMed]
  109. Matlala, M.; Gous, A.G.S.; Meyer, J.C.; Godman, B. Formulary Management Activities and Practice Implications Among Public Sector Hospital Pharmaceutical and Therapeutics Committees in a South African Province. Front. Pharmacol. 2020, 11, 1267. [Google Scholar] [CrossRef]
  110. Matlala, M.; Gous, A.G.; Godman, B.; Meyer, J.C. Structure and activities of pharmacy and therapeutics committees among public hospitals in South Africa; findings and implications. Expert Rev. Clin. Pharmacol. 2017, 10, 1273–1280. [Google Scholar] [CrossRef]
  111. Dunlea, T.; Richards, S.; Lembo, T. Healthcare provider-focused antimicrobial stewardship in sub-Saharan Africa: Opportunities and challenges. Trends Microbiol. 2023, 31, 215–218. [Google Scholar] [CrossRef]
  112. Godman, B.; Egwuenu, A.; Wesangula, E.; Schellack, N.; Kalungia, A.C.; Tiroyakgosi, C.; Kgatlwane, J.; Mwita, J.C.; Patrick, O.; Niba, L.L.; et al. Tackling antimicrobial resistance across sub-Saharan Africa: Current challenges and implications for the future. Expert Opin. Drug Saf. 2022, 21, 1089–1111. [Google Scholar] [CrossRef]
  113. Otieno, P.A.; Campbell, S.; Maley, S.; Arunga, T.O.; Okumu, M.O. A Systematic Review of Pharmacist-Led Antimicrobial Stewardship Programs in Sub-Saharan Africa. Int. J. Clin. Pr. 2022, 2022, 3639943. [Google Scholar] [CrossRef]
  114. Elton, L.; Thomason, M.J.; Tembo, J.; Velavan, T.P.; Pallerla, S.R.; Arruda, L.B.; Vairo, F.; Montaldo, C.; Ntoumi, F.; Hamid, M.M.A.; et al. Antimicrobial resistance preparedness in sub-Saharan African countries. Antimicrob. Resist. Infect. Control. 2020, 9, 145. [Google Scholar] [CrossRef]
  115. Godman, B.; Basu, D.; Pillay, Y.; Mwita, J.C.; Rwegerera, G.M.; Paramadhas, B.D.A.; Tiroyakgosi, C.; Okwen, P.M.; Niba, L.L.; Nonvignon, J.; et al. Review of Ongoing Activities and Challenges to Improve the Care of Patients With Type 2 Diabetes Across Africa and the Implications for the Future. Front. Pharmacol. 2020, 11, 108. [Google Scholar] [CrossRef]
  116. Godman, B.; Basu, D.; Pillay, Y.; Almeida, P.H.R.F.; Mwita, J.C.; Rwegerera, G.M.; Paramadhas, B.D.A.; Tiroyakgosi, C.; Patrick, O.; Niba, L.L.; et al. Ongoing and planned activities to improve the management of patients with Type 1 diabetes across Africa; implications for the future. Hosp. Pract. 2020, 48, 51–67. [Google Scholar]
  117. Ogunleye, O.O.; Godman, B.; Fadare, J.O.; Mudenda, S.; Adeoti, A.O.; Yinka-Ogunleye, A.F.; Ogundele, S.O.; Oyawole, M.R.; Schönfeldt, M.; Rashed, W.M.; et al. Coronavirus Disease 2019 (COVID-19) Pandemic across Africa: Current Status of Vaccinations and Implications for the Future. Vaccines 2022, 10, 1553. [Google Scholar] [PubMed]
Pharmacy 11 00174 g001
Figure 1. Prevalence of off-label and unlicensed medicine use in different age categories within a sample of 184 children aged 0–2 years old across three academic hospitals located in Gauteng Province, South Africa.
Figure 1. Prevalence of off-label and unlicensed medicine use in different age categories within a sample of 184 children aged 0–2 years old across three academic hospitals located in Gauteng Province, South Africa.
Pharmacy 11 00174 g001
Table 1. Patient demographic data.
Table 1. Patient demographic data.
Age Categories
AgePrevalencePercentage
0–28 days (neonates)7038.0%
29–1 year (infants)7641.3%
1–2 years (paediatrics)3820.7%
Mean age6.2 months
SD±±236.6
Total184100.0%
Gender
GenderPrevalencePercentage
Male9551.6%
Female8948.4%
Total184100.0%
Weight categories in grams
WeightPrevalencePercentage
630–5000 g11663.0%
5001–10,000 g5831.5%
10,001–15,000 g73.8%
15,001–20,000 g31.6%
Mean4625.9
SD±3633.7
Table 2. Top 10 prescribed medicines by chemical substance (ATC Level 5).
Table 2. Top 10 prescribed medicines by chemical substance (ATC Level 5).
ATC CodeMedicine NameDosage FormFreq. N = 592PercentageUsed On/Off-Label/Unlicensed
A11CCVitamin DDrops386.4on-label
B03BBFolateSyrup366.1on-label
A11ABMultivitaminSyrup/drops325.4unlicensed
N06BC01Caffeine 20 mg per mLInjection315.2off-label
J01CA01AmpicillinInjection274.6off-label
B03AA03Ferrous GluconateSyrup254.2on-label
N02BE01Paracetamol 120 mg per 5 mLSyrup223.7off-label
J05AG01Nevirapine solution 50 mg per 5 mLSolution203.4on-label
J01GB06AmikacinInjection183.0off-label
J01CR02Amoxicillin 500 mg/Clavulanic acid 100 mg per 20 mLInjection142.4off-label
Table 3. Categories of the top 10 off-label medicines (ATC Level 5) in children under 2 years of age.
Table 3. Categories of the top 10 off-label medicines (ATC Level 5) in children under 2 years of age.
ATC CodeMedicineDosage FormFreq. N = 213 (%)Reason for Being Off-Label
0–28 days
J01CA01AmpicillinInjection15 (7.0)Not established for use
N06BC01Caffeine 20 mg per mLInjection11 (5.2)Administration orally
J01GB03GentamycinInjection9 (4.3)Not established for use
N02BE01Paracetamol 120 mgSyrup5 (2.3)Not established for use (<2 months)
A03FA01Metoclopramide 2mg/mLInjection4(1.9)Not established for use (<1 year)
N02BE01Paracetamol 10 mg/mLinjection4 (1.9)Not established for use
J01DH02Meropenem 500 mginjection3 (1.4)Not established for use (<3 months)
N05CF08Midazolam 50 mginjection2 (1.0)
A11HA02Pyridoxine 25 mgTablet2 (1.0)Dosage form manipulation
J01CR02Amoxicillin 500 mg/clavulanic acid 100 mg/20 mLInjection2 (1.0)High dose/weight of patient
ATC CodeMedicineDosage formFreq. N = 213 (%)Reason for being off-label
29 days to 1 year
N02AB03Fentanylinjection5 (2.5)Not established for use (<2 years)
J01DH02Meropenem 500 mgInjection5 (2.5)Not established for use (<3 months)
J01CR02Amoxicillin 500 mg/Clavulanic acid 100 mg/20 mLInjection5 (2.5)High dose/weight of patient
Isoniazid 100 mgTablet5 (2.5)Dosage form manipulation
A03FA01Metoclopramide 5 mg per 5 mLSyrup4 (1.9)Not established for use (<1 year)
N06BC01Caffeine 20 mg per mLInjection4 (1.9)Route of administration (orally)
G01AA03Amphotericin BInjection4(1.9)Not established for use (manufacturer)
N07BC02Methadone 10 mg/mLsolution3 (1.4)Not established for use in children
A12BA01Potassium chlorideTablet3 (1.4)Dosage form manipulation
N05BA01DiazepamTablet3 (1.4)Dosage form manipulation
ATC CodeMedicineDosage formFreq. N = 213 (%)Reason for being off-label
1 year to 2 years
C03AA03HydrochlorothiazideTablet7 (3.3)Dosage form manipulation
J04AC01Isoniazid 100 mgTablet5 (2.3)Dosage form manipulation
J01CR02Amoxicillin 500 mg/Clavulanic acid 100 mg/20 mLInjection2 (1.0)High dose/weight of patient
A12BA01Potassium chlorideTablet2 (1.0)Dosage form manipulation
R06AE07CetirizineSyrup1(0.5)Not established for use (<2 years)
A04AA01Ondansetron 4 mgTablet1 (0.5)Not established for use (<4 years)/dosage form manipulation
G04BD04Oxybutynin 5 mgTablet1 (0.5)Not established for use (<5 years)/dosage form manipulation
J04AK01PyrazinamideTablet1 (0.5)Dosage form manipulation
J04AM02Rifampicin/IsoniazidTablet1 (0.5)Dosage form manipulation
A02BC01Omeprazole 10 mgCapsule1 (0.5)Dosage form manipulation
Table 4. Most prevalent unlicensed medicines used.
Table 4. Most prevalent unlicensed medicines used.
ATC CodeMedicineDosage FormFreq. N = 213(%)Reason for Being Unlicensed
0–28 days
A11ABMultivitaminSyrup4 (2.0)Not approved by SAHPRA
A11ABAbidec multivitaminDrops8 (3.8)Not approved by SAHPRA
29 days to 1 year
A11ABAbidec multivitaminDrops7 (3.3)Not approved by SAHPRA
A11ABMultivitaminSyrup4 (2.0)Not approved by SAHPRA
A07FA01ProbioticsDrops2 (0.9)Not registered with SAHPRA
1 year to 2 years
A11ABMultivitaminSyrup5 (2.3.0)Not approved by SAHPRA
A07FA01ProbioticsDrops2 (0.9)Not registered with SAHPRA
Table 5. Most common medical diagnoses or conditions per ICD-10 codes for which medicines were prescribed off-label or unlicensed in three different age groups.
Table 5. Most common medical diagnoses or conditions per ICD-10 codes for which medicines were prescribed off-label or unlicensed in three different age groups.
ICD10 CodeDescriptionFreq. N = 213%0–28 Days29 Days–1 Year1–2 Years
A49.9Bacterial infections5726.835 (61.4%)15 (26.3%)7 (12.3%)
E56Vitamin deficiency, unspecified3215.012 (37.5%)15 (46.9%)5 (15.6%)
R52Pain, not elsewhere classified219.913 (61.9%)7 (33.3%)1 (4.8%)
P28.3Primary apnoea of new-born, unspecified157.011 (73.3%)4 (26.7)0 (0.0%)
A15Respiratory tuberculosis136.12 (15.4%)8 (61.5%)3 (23.1%)
R11Nausea and vomiting115.24 (36.4%)6 (54.5%)1 (9.1%)
R60.9Oedema73.36 (85.7%)1 (14.3%)0 (0.0%)
F13.20Sedative, hypnotic, or anxiolytic73.32 (28.6%)5 (71.4%)0 (0.0%)
Y40.7Fungal infections62.81 (16.7%)5 (83.3%)0 (0.0%)
E87.6Potassium deficiency52.30 (0.0%)3 (60.0%)2 (40.0%)
Table 6. Categories of off-label or unlicensed medicines used by age group (ATC Level 2).
Table 6. Categories of off-label or unlicensed medicines used by age group (ATC Level 2).
Top 10 Used ATC Code of Medicine Categories Used Off-Label/Unlicensed
ATC CodeTherapeutic SubgroupOff-Label/UnlicensedFreq. N = 213%0–28 Days29 Days–1 Year1–2 Years
J01Anti-bacterial for systemic useOff-label5626.335 (62.5%)14 (25.0%)7 (12.5%)
A11VitaminsUnlicensed3717.414 (37.8%)17 (45.9%)6 (16.2%)
N02AnalgesicsOff-label187.011 (61.1%)7 (38.9%)0
N06PsychoanalepticsOff-label157.011 (73.3%)4 (26.7%)0
J04Anti-mycobacterialOff-label136.12 (15.4%)8 (61.5%)3 (23.1%)
A03Drugs for functional gastrointestinal disordersOff-label/unlicenced104.74 (40.0%)6 (60.0%)0
C03DiureticsOff-label94.26 (66.7%)3 (33.3%)0
N05PsycholepticsOff-label73.32 (28.6%)5 (71.4%)0
J02Antimycotics for systemic useOff-label62.81 (16.7%)5 (83.3%)0
N01AnaestheticsOff-label52.32 (40.0%)3 (60.0%)0
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mathevula, H.; Schellack, N.; Orubu, S.; Godman, B.; Matlala, M. Off-Label and Unlicenced Medicine Use among Hospitalised Children in South Africa: Practice and Policy Implications. Pharmacy 2023, 11, 174. https://doi.org/10.3390/pharmacy11060174

AMA Style

Mathevula H, Schellack N, Orubu S, Godman B, Matlala M. Off-Label and Unlicenced Medicine Use among Hospitalised Children in South Africa: Practice and Policy Implications. Pharmacy. 2023; 11(6):174. https://doi.org/10.3390/pharmacy11060174

Chicago/Turabian Style

Mathevula, Hlayiseka, Natalie Schellack, Samuel Orubu, Brian Godman, and Moliehi Matlala. 2023. "Off-Label and Unlicenced Medicine Use among Hospitalised Children in South Africa: Practice and Policy Implications" Pharmacy 11, no. 6: 174. https://doi.org/10.3390/pharmacy11060174

APA Style

Mathevula, H., Schellack, N., Orubu, S., Godman, B., & Matlala, M. (2023). Off-Label and Unlicenced Medicine Use among Hospitalised Children in South Africa: Practice and Policy Implications. Pharmacy, 11(6), 174. https://doi.org/10.3390/pharmacy11060174

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop