Next Article in Journal
Impact of Educational Films on Antibiotic Prescription among Physicians: A Web-Based Survey in Japan
Next Article in Special Issue
Novel Variant of New Delhi Metallo-Beta-Lactamase (blaNDM-60) Discovered in a Clinical Strain of Escherichia coli from the United Arab Emirates: An Emerging Challenge in Antimicrobial Resistance
Previous Article in Journal
Antibacterial and Antifungal Potential of Helichrysum italicum (Roth) G. Don Essential Oil
Previous Article in Special Issue
From Species to Genes: A New Diagnostic Paradigm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigating the Antimicrobial Potential of 560 Compounds from the Pandemic Response Box and COVID Box against Resistant Gram-Negative Bacteria

by
Rita de Cássia Cerqueira Melo
,
Aline Andrade Martins
,
Andressa Leite Ferraz Melo
,
Jean Carlos Pael Vicente
,
Mariana Carvalho Sturaro
,
Julia Pimentel Arantes
,
Luana Rossato
,
Gleyce Hellen de Almeida de Souza
and
Simone Simionatto
*
Health Sciences Research Laboratory, Federal University of Grande Dourados (UFGD), Dourados 79804970, Mato Grosso do Sul, Brazil
*
Author to whom correspondence should be addressed.
Antibiotics 2024, 13(8), 723; https://doi.org/10.3390/antibiotics13080723
Submission received: 19 June 2024 / Revised: 25 July 2024 / Accepted: 26 July 2024 / Published: 1 August 2024
(This article belongs to the Special Issue Antibiotics Resistance in Gram-Negative Bacteria, 2nd Edition)

Abstract

:
Antimicrobial resistance (AMR) has emerged as a significant threat to public health, particularly in infections caused by critically important Gram-negative bacteria. The development of novel antibiotics has its limitations, and therefore it is crucial to explore alternative strategies to effectively combat infections with resistant pathogens. In this context, the present study investigated the antibacterial potency of 560 compounds against the multidrug-resistant (MDR) strains of Klebsiella pneumoniae and Serratia marcescens. The evaluated compounds were selected from the Pandemic Response Box (PRB) and COVID Box (CB) and subjected to assays to determine the inhibitory concentration (IC), minimum bactericidal concentration (MBC), and biofilm formation. Further, the effects of these compounds on membrane integrity were assessed through protein quantification. Several of the evaluated compounds, including fusidic acid, MMV1580853, and MMV1634399, exhibited a significant reduction in biofilm formation and growth in K. pneumoniae. Trimethoprim exhibited potential against S. marcescens. The IC values of the compounds indicated significant microbial growth inhibition at various concentrations. These findings underscore the potency of the existing antibiotics and novel compounds in combating the MDR strains of bacteria. The importance of reconsidering the known antibiotics and utilizing drug repositioning strategies to address the increasing risk of AMR is highlighted.

Graphical Abstract

1. Introduction

Antimicrobial resistance (AMR) in critical pathogens has emerged as a major public health concern globally, with significant implications in terms of morbidity, mortality, and healthcare costs [1]. Considering the urgency of addressing AMR, the World Health Organization (WHO) has identified a list of priority pathogens, including critical multidrug-resistant (MDR) bacteria, such as Klebsiella pneumoniae and Serratia marcescens [2,3]. The WHO recommends prioritizing the research and development efforts to identify novel treatment options for infections caused by these pathogens that greatly threaten human health owing to their high levels of resistance and the severity of the infections they cause [4]. The multidrug-resistant (MDR) strains of K. pneumoniae and S. marcescens are clinically and epidemiologically significant as they cause severe and often life-threatening infections, especially in healthcare settings [5]. The significant impact of these pathogens on patient outcomes and the challenges they pose to infection control in healthcare settings highlight the importance of focusing on MDR strains [6,7].
The development of effective treatments against these MDR bacteria is essential to improve clinical outcomes and manage the spread of infections with resistant bacteria. In this context, adhering to the WHO recommendations could facilitate the effective coordination of efforts worldwide to combat the increasing threat of AMR. However, the development rate of novel antibiotics has decelerated in recent times, with only two novel classes of antibiotics reaching the market in the last years [8]. This stagnation underscores the urgent requirement for developing alternative strategies to combat AMR. One promising approach is to repurpose existing drugs originally developed for other bacterial strains to treat infections with MDR bacteria. This strategy could accelerate the availability of novel treatment options against MDR bacteria by leveraging the pre-existing clinical data and streamlining the preclinical and clinical testing phases. Institutions providing open-access drug libraries, such as the Pandemic Response Box (PRB) and the COVID Box (CB), play a crucial role in facilitating the discovery of novel antimicrobial therapies through potential repositioning [9,10].
The present study involved evaluating a total of 560 compounds from the Medicines for Malaria Venture (MMV) Pandemic Response Box and COVID Box for their antibacterial potential against the multidrug-resistant (MDR) strains of K. pneumoniae and S. marcescens.

2. Results

2.1. Antimicrobial Susceptibility Evaluation

Antimicrobial susceptibility testing of strains showed resistance to multiple antibiotics (Table 1). The inhibitory effects of compounds from the MMV PRB and CB against critical MDR pathogens were evaluated. Most compounds exhibited limited inhibitory potential (Figure 1). For the carbapenem- and polymyxin-resistant K. pneumoniae (CPR-Kp) strain, thirty-eight compounds exhibited inhibition percentages above 80%, while three compounds exhibited inhibitory percentages above 90% (Figure 1A, including fusidic acid (91.28%), MMV1580853 (90%), and MMV1634399 (90%). Against the carbapenem-resistant K. pneumoniae (CR-Kp) strain, four CB compounds exhibited inhibition rates greater than 80% (Figure 1B), namely oxyclozanide (93.12%), doxorubicin (91.74%), and niclosamide (89.00%), while among PRB compounds, only gepotidacin (91.84%) and MMV1634402 (90.78%) exhibited inhibition percentages above 80% (Figure 1A). The IC values of gepotidacin and MMV1634402 against CR-Kp were 0.625 µM and 10 µM, respectively (Figure 2c). None of the compounds from CB exhibited an inhibition percentage over 80% against CR-Kp (Figure 1B).
For carbapenem-resistant S. marcescens (CR-Sm), trimethoprim exhibited an inhibition percentage of 82.14%, while sitafloxacin, MMV1580849, and eravacycline exhibited 79.60%, 79.37%, and 71.16% inhibition, respectively (Figure 1B). Trimethoprim exhibited an MIC value of 10 µM against CR-Sm (Figure 2d). None of the compounds from CB exhibited an inhibition percentage of over 80% against CR-Sm (Figure 1B).

2.2. Survival Curves

Growth curves were obtained to evaluate the effectiveness of compounds that initially showed activity against the CPR-Kp, CR-Kp, and CR-Sm strains for 24 h. Among the PRB compounds, MMV1634399, MMV1580853, and fusidic acid exhibited efficacy against CPR-Kp after 10 h (Figure 3a). Gepotidacin exhibited efficacy initially, followed by a decline in the efficacy against CR-Kp (Figure 3c). Trimethoprim from PRB exhibited consistent efficacy in the inhibition of CR-Sm growth (Figure 3d). A summary of the compounds with the best activities, showing the percentage of inhibition, the IC, the disease set, and the chemical structure of the compound can be viewed in Table 2.

2.3. Anti-Biofilm Assay

MMV1634399, fusidic acid, and MMV1580853 were observed to significantly inhibit biofilm formation of CPR-Kp (Figure 4a). Doxycycline, tetracycline, doxorubicin, oxyclozanide, and niclosamide led to significantly lowered biofilm formation, indicating their inhibitory activities against CPR-Kp (Figure 4b). In contrast, gepotidacin and MMV1634402 exhibited low anti-biofilm efficacy for CR-Kp, with results similar to those observed for the positive control (Figure 4c). No significant inhibitory effect of the compounds on biofilm formation was observed for CR-Sm (Figure 4d).

2.4. Membrane Integrity Assay

The effects of the evaluated compounds on bacterial cell membrane integrity were determined using protein leakage quantification as an indicator. However, when the bacteria were treated with these compounds, no protein leakage was observed (Figure 5).

3. Discussion

The antibacterial potential of the compounds from PRB and CB against the MDR strains of K. pneumoniae and S. marcescens was evaluated. The discovery of novel compounds with the ability to control CRP-Kp growth was an important finding of the present study. Since this strain is resistant to carbapenems and polymyxins, it is considered a major challenge in the field of medicine in terms of the management and control of AMR [11,12]. Several other compounds were revealed to be promising in terms of their inhibitory activities, highlighting the potential of both under-investigated molecules and antibiotics to be applied against MDR bacteria. Among the 560 compounds evaluated in the present study, three were particularly relevant for CPR-Kp, with promising results obtained in the IC, MBC, and biofilm assays: fusidic acid, MMV1580853, and MMV1634399. It is noteworthy that the CPR-Kp strain is the most difficult to treat due to its resistance profile and is, therefore, on the priority list of the WHO [3]. To our knowledge, this is the first study to evaluate these box compounds against the MDR bacteria with intrinsic or chromosomal resistance to polymyxin.
Fusidic acid is a unique antibiotic derived from the fungus Fusidium coccineum, with a steroid-like structure but no corticosteroid effects [13,14]. It inhibits bacterial protein synthesis by binding to elongation factor G, preventing ribosomal translocation [15]. Fusidic acid is particularly effective against Staphylococcus aureus, including methicillin-resistant strains, and is used to treat various skin and soft tissue infections [16,17]. Its structure allows for high skin penetration, and it shows low resistance and no cross-resistance with other antibiotics [13]. Topical combinations with corticosteroids are useful in treating atopic dermatitis with suspected staphylococcal infection [16]. A new oral dosing regimen involving front-loading followed by maintenance doses has been developed to minimize resistance development in monotherapy [15]. The application of fusidic acid for the treatment of staphylococcal [13] and enterococci infections [15] was described. In addition, fusidic acid showed a synergistic effect when combined with polymyxin B against K. pneumoniae and E. coli [14]. Thus, these results corroborate its potential repurposing against Gram-negative MDR bacteria identified in our study.
MMV1580853 is a bisamidine derivative that acts on undecaprenyl diphosphate synthase (UPPS), which is a critical enzyme for bacterial cell wall synthesis [18]. Although there are no ongoing clinical studies, preliminary findings suggest that MMV1580853 may have the potential to disrupt UPPS, which could in turn affect the production of essential components of the bacterial cell wall, ultimately leading to bacterial cell death [19,20]. Pre-clinical evaluations utilizing murine models of staphylococcal infection have indicated that MMV1580853 is generally safe, despite its potential toxicity. Furthermore, these evaluations have demonstrated the compound’s reproducibility in vivo [21]. MMV1580853 may also act as an active inhibitor of the main protease (Mpro) of SARS-CoV-2, which is crucial for the virus’s replication. Further studies in molecular dynamics and interactions between MMV1580853 and Mpro, with high free energy binding, suggest that it could be a promising therapeutic agent for treating the novel coronavirus disease. Additionally, in vivo tests with diamidine derivatives similar to MMV1580853 in Trypanosoma brucei infection models have shown promising results, with 100% survival in treated mice at 3 mg/kg intraperitoneally. These results suggest that MMV1580853 may have potential in antiviral and antiparasitic therapies. We tested a series of amidine and related compounds against Trypanosoma brucei [22].
MMV1634399, also known as HT61 (4-methyl-8-phenoxy-1-(2-phenylethyl)-2,3-dihydropyrrolo[3,2-c]quinoline), is a quinoline derivative that has been demonstrated to exhibit bactericidal activity against both methicillin-sensitive and methicillin-resistant Staphylococcus aureus [23]. It has been demonstrated that HT61 acts by increasing the permeability of bacterial membranes, resulting in the depolarization and release of intracellular constituents, which indicates significant structural damage to the bacterial membrane [24]. Moreover, HT61 has been tested in combination with other antimicrobials, including neomycin, gentamicin, mupirocin, and chlorhexidine, demonstrating significant synergistic effects against clinical strains of MSSA and MRSA, both in vitro and in vivo [24,25]. In murine models of lung infection, the combination of HT61 with tobramycin has been demonstrated to effectively deplete the bacterial burden, thereby highlighting its potential as an adjuvant agent to enhance the efficacy of conventional antibiotics [26]. Additionally, it has been shown to exhibit inhibitory activity against fungi [27].
The present study demonstrated that MMV1634399 is an effective agent for the reduction of bacterial growth and the inhibition of biofilm formation. This indicates that the compound targets essential bacterial processes that are independent of any impact on the cell membrane. The capacity of MMV1634399 to repress biofilm formation, which serves to protect bacteria against assaults from the immune system and antibiotics, underscores its potential as a valuable contender for future investigation. Drug repurposing, or reprofiling, is the process of identifying new therapeutic applications for existing pharmaceutical agents. While in vitro (test tube or cell culture) and pre-clinical (animal) studies can provide promising initial results, the process of translating these findings into clinical use is inherently rigorous and lengthy. This process comprises several phases of clinical trials, the objective of which is to guarantee the drug’s therapeutic efficacy and safety for human use [28,29,30]. The drug discovery and development are considered complex, time-consuming, and resource-intensive. They require multidisciplinary expertise and innovative approaches [31].
S. marcescens is intrinsically resistant to a broad spectrum of antibiotics, including carbapenems, polymyxins, penicillins, cephalosporins, macrolides, nitrofurantoin, and polymyxins. When bacteria develop resistance to carbapenems, treating infections becomes significantly more challenging. In the present study, trimethoprim was evaluated for its inhibitory effects on CR-Sm bacterial growth, and the results revealed its efficacy in this regard. Scottish guidelines for treating UTIs, especially those caused by multidrug-resistant (MDR) organisms, recommend the nitrofurantoin trimethoprim [32], which, despite the risks of resistance, continues to be effective against several strains, including CR-Sm. Trimethoprim is used commonly in combination with sulfamethoxazole and is considered valuable for urinary infections due to its high urinary concentration [33]. However, trimethoprim should be used only after susceptibility testing due to its potential adverse effects, although it could be reconsidered as an option when clinical choices are limited, due to its demonstrated efficacy against the resistant strains [34].
To identify possible mechanisms of action of the compounds tested, we conducted the protein extravasation test, which is often used as an indicator of the integrity of the cell membrane. This leakage means significant damage to the cell envelope, which includes the cell membrane and, in some cases, the cell wall. Minor damage may not lead to detectable protein leakage but can still impair cell function and viability. Furthermore, cells have mechanisms to quickly repair minor damage to the envelope, preventing protein leakage. However, the cell envelope can still allow leakage of smaller molecules, such as ions and metabolites, without proteins. Therefore, the absence of protein extravasation in our assays does not rule out the presence of damage [35,36].
Although our results were promising, this study had some limitations, including a limited number of strains tested and the assays only being performed in duplicate. This study was also constrained by the limited number of investigations involving these compounds with antibacterial activity. Further research is needed to elucidate their mechanisms of action. Additionally, in vivo assays need to be conducted to confirm that they are effective in an infection model.
The findings of the present study highlight the potential of both well-established and novel compounds for application in combating MDR bacterial strains. The efficacy demonstrated by fusidic acid, MMV1580853, and MMV1634399 against K. pneumoniae highlighted their potential as valuable candidates for further research, particularly to address the challenges raised by biofilm formation and antibiotic resistance. The notable performance of trimethoprim against S. marcescens suggested the requirement for continued exploration of its application potential in the treatment of resistant strains. The findings of the present comprehensive evaluation of some compounds emphasize the critical role of drug repositioning and exploration of synergistic drug combinations in developing effective treatments against MDR infections, offering hope for improved clinical outcomes in the face of escalating antibiotic resistance.

4. Materials and Methods

4.1. Bacterial Isolates

Previously characterized carbapenem-resistant K. pneumoniae (CR-Kp), carbapenem-polymyxin-resistant K. pneumoniae (CPR-Kp), and carbapenem-resistant S. marcescens (CR-Sm) strains were used in the present study. All strains used in this study were clinical isolates from patients admitted to a tertiary hospital in the Central-West region of Brazil, serving as a reference center for 32 cities [11,37]. Species identification was performed using a Phoenix® Automated System (BD Diagnostic Systems, Sparks, MD, USA), followed by validation through matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) mass spectrometry using a Microflex LT spectrometer (Bruker Daltonics, Billerica, MA, USA). Antimicrobial susceptibility profiles were determined next, including the determination of the minimum inhibitory concentrations (MICs), using the broth microdilution method by following the guidelines of the Clinical and Laboratory Standards Institute (CLSI) [38]. Whole-genome sequencing was then conducted to explore the molecular mechanisms underlying the resistance to carbapenems and polymyxin B.

4.2. Screening the Antibacterial Compounds

The Pandemic Response Box (PRB) was provided by Medicines for Malaria Venture (MMV, Geneva, Switzerland) and the Drugs for Neglected Diseases initiative (DNDi, Geneva, Switzerland), and the COVID Box by DNDi. The Pandemic Response Box is made up of 201 antibacterials, 153 antivirals, and 46 antifungals. The biological activity of the compounds was not confirmed by the MMV/DNDi partners, and the selection was made based on information available in the literature [39]. The compounds present in the 10 mM stock solution plate to a concentration of 1 mM in 100% DMSO were diluted in 90 µL of DMSO to prepare the stock solution and then diluted in the working solution in intermediate plates with a concentration range of 20–0.039 µM. The screening assay was performed by described for [40]. Bacterial cultures adjusted to the 0.5 McFarland density standard (1.5 × 108 CFU/mL) were dispensed into the assay plates, reaching a final concentration of 10 µM per compound in a total volume of 200 µL. Assay plates were then incubated at 37 °C for 18–24 h, after which growth inhibition was quantified by measuring optical density (OD) at 595 nm using a Bio-Rad iMark™ microplate reader (Bio-Rad, Hercules, CA, USA). Viability was also assessed with a 1% resazurin solution. Compounds with inhibitory activities greater than or equal to 80% were considered potential antimicrobial compounds. All experiments were performed in duplicate.

4.3. Determining the IC and MBC Values of Compounds

The inhibitory concentration (IC) and minimum bactericidal concentration (MBC) values of the Pandemic Response Box (PRB) and COVID Box (CB) compounds were determined using the broth microdilution method [38,41]. In the wells of 96-well plates, two-fold serial dilutions were prepared for the concentration range of 20–0.039 µM. After incubation, each well’s optical density (OD) was measured at 595 nm using a Bio-Rad microplate reader (Bio-Rad, Hercules, CA, USA), and based on the OD values, the inhibition percentages were calculated. MHB served as the negative control. The bacterial isolates were used as positive controls. All experiments were performed in duplicate. Percentage inhibition (%) was calculated using the following equation:
I n h i b i t i o n % = O D u n t r e a t e d c o n t r o l O D t r e a t m e n t O D u n t r e a t e d c o n t r o l × 100

4.4. Survival Curve

The efficacy of each compound at the respective inhibitory concentration was determined over 24 h by measuring absorbance at predetermined intervals followed by plotting the growth curves. A bacterial suspension was adjusted to the 0.5 McFarland density standard (1.5 × 108 CFU/mL) and inoculated into the wells containing the compounds to be evaluated (0, 2, 4, 6, 8, 10, 12, and 24 h). Afterward, the absorbance in each well was measured at 595 nm using an iMarkTM Microplate (Bio-Rad, Hercules, CA, USA), and the corresponding bacterial growth curves were plotted. All experiments were performed in duplicate.

4.5. Biofilm Formation Inhibition Analysis

The ability of the concerned compounds to inhibit biofilm formation was investigated. Plates were maintained under stable incubation conditions at 37 °C for 24 h to promote bacterial development and biofilm maturation. Subsequently, the planktonic cells were removed, and the biofilms were stained with 0.1% crystal violet [15,16]. Biofilm biomass was then quantified by measuring the optical density at 595 nm using an iMarkTM Microplate (Bio-Rad, Hercules, CA, USA) [42]. Percentage inhibition was calculated using the amount of biofilm formed (defined as 100% biofilm) and the sterility control of the medium (defined as 0% biofilm). All experiments were performed in triplicate.

4.6. Membrane Integrity Assay: Protein Quantification

The effects of the concerned compounds on bacterial cell membrane integrity were monitored through the quantification of protein leakage. The microplate was incubated at 37 °C for 4 h, following which the contents of each microplate were centrifuged at 2500 rpm for 5 min at 4 °C. The obtained supernatant was then assayed using the PierceTM BCA Protein Assay Kit (Thermo Scientific, Waltham, MA, USA) followed by OD (595 nm) measurement using an iMarkTM Microplate Absorbance Reader (Bio-Rad, Hercules, CA, USA) to determine the protein quantity released from the cytoplasm. All experiments were performed in duplicate.

4.7. Statistical Analysis

The results are presented as mean ± standard deviation. The treated and untreated controls were compared using a one-way analysis of variance followed by the Kruskal–Wallis test. A two-tailed t-test was conducted to determine the biofilm-associated CFUs in the control and treatment group wells. All statistical analyses and graph plotting were performed using GraphPad Prism (version 8.1). The size for all labels and compound names was chosen to ensure consistency. The chemical structures of compounds were drawn in a standardized manner using the Draw Structure tool available to researchers on PubChem (https://pubchem.ncbi.nlm.nih.gov, accessed on 20 July 2024).

Author Contributions

Conceptualization, R.d.C.C.M. and S.S.; methodology, R.d.C.C.M. and J.C.P.V.; software, A.A.M.; validation, G.H.d.A.d.S., M.C.S. and J.P.A.; formal analysis, A.L.F.M.; research, R.d.C.C.M.; resources, L.R.; data curation: G.H.d.A.d.S. and L.R.; writing—preparation of the original draft, A.A.M.; writing—review and editing, A.A.M.; visualization, G.H.d.A.d.S.; supervision, S.S.; project administration, S.S.; acquisition of financing, S.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially supported by the National Council for Scientific and Technological Development (CNPq) under Grants 408778/2022-9, 307946/2022-3, 444735/2023-2 and 420743/2023-5; Foundation to Support the Development of Education, Science, and Technology of the State of Mato Grosso do Sul (FUNDECT) under Grants 76/2023, 113/2023 and 115/2023; Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) and the Federal University of Grande Dourados (UFGD). G.H.d.A.d.S. received a CNPq junior postdoctoral fellowship through the FUNDECT (76/2023). M.C.S and J.P.A received a research grant from CAPES. R.C.C.M, A.A.M., J.C.P.V. and S.S. received a research grant from CNPq. Sponsors didn’t take part in data collection, analysis and interpretation or in manuscript writing.

Data Availability Statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Acknowledgments

The authors acknowledge the support of the Medicines for Malaria Venture (MMV, Geneva, Switzerland) and the Drugs for Neglected Diseases initiative (DNDi, Geneva, Switzerland), in designing and providing the Pandemic Response Box and COVID Box.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Murray, C.J.; Ikuta, K.S.; Sharara, F.; Swetschinski, L.; Robles Aguilar, G.; Gray, A.; Han, C.; Bisignano, C.; Rao, P.; Wool, E.; et al. Global burden of bacterial antimicrobial resistance in 2019: A systematic analysis. Lancet 2022, 399, 629–655. [Google Scholar] [CrossRef] [PubMed]
  2. Wise, M.G.; Karlowsky, J.A.; Mohamed, N.; Hermsen, E.D.; Kamat, S.; Townsend, A.; Brink, A.; Soriano, A.; Paterson, D.L.; Moore, L.S.P.; et al. Global trends in carbapenem- and difficult-to-treat-resistance among World Health Organization priority bacterial pathogens: ATLAS surveillance program 2018–2022. J. Glob. Antimicrob. Resist. 2024, 37, 168–175. [Google Scholar] [CrossRef] [PubMed]
  3. World Health Organization. Bacterial Priority Pathogens List, 2024; World Health Organization: Gevena, Switzerland, 2024; ISBN 9789240093461. [Google Scholar]
  4. World Health Organization. Global Antimicrobial Resistance Surveillance System (GLASS); World Health Organization: Gevena, Switzerland, 2022; p. 80. [Google Scholar]
  5. Wei, X.L.; Zeng, Q.L.; Xie, M.; Bao, Y. Pathogen Distribution, Drug Resistance Risk Factors, and Construction of Risk Prediction Model for Drug-Resistant Bacterial Infection in Hospitalized Patients at the Respiratory Department during the COVID-19 Pandemic. Infect. Drug Resist. 2023, 16, 1107–1121. [Google Scholar] [CrossRef] [PubMed]
  6. Mohapatra, S.S.; Dwibedy, S.K.; Padhy, I. Polymyxins, the last-resort antibiotics: Mode of action, resistance emergence, and potential solutions. J. Biosci. 2021, 46, 85. [Google Scholar] [CrossRef] [PubMed]
  7. Spera, A.M.; Esposito, S.; Pagliano, P. Emerging antibiotic resistance: Carbapenemase-producing enterobacteria. New bad bugs, still no new drugs. Infez. Med. 2019, 27, 357–364. [Google Scholar] [PubMed]
  8. Laxminarayan, R. The overlooked pandemic of antimicrobial resistance. Lancet 2022, 399, 606–607. [Google Scholar] [CrossRef] [PubMed]
  9. Samby, K.; Besson, D.; Dutta, A.; Patra, B.; Doy, A.; Glossop, P.; Mills, J.; Whitlock, G.; Hooft Van Huijsduijnen, R.; Monaco, A.; et al. The Pandemic Response Box-Accelerating Drug Discovery Efforts after Disease Outbreaks. ACS Infect. Dis. 2022, 8, 713–720. [Google Scholar] [CrossRef] [PubMed]
  10. Van Voorhis, W.C.; Adams, J.H.; Adelfio, R.; Ahyong, V.; Akabas, M.H.; Alano, P.; Alday, A.; Alemán Resto, Y.; Alsibaee, A.; Alzualde, A.; et al. Open Source Drug Discovery with the Malaria Box Compound Collection for Neglected Diseases and Beyond. PLoS Pathog. 2016, 12, e1005763. [Google Scholar] [CrossRef]
  11. da Silva, K.E.; Maciel, W.G.; Correia Sacchi, F.P.; Carvalhaes, C.G.; Rodrigues-Costa, F.; da Silva, A.C.R.; Croda, M.G.; Negrão, F.J.; Croda, J.; Gales, A.C.; et al. Risk factors for KPC-producing Klebsiella pneumoniae: Watch out for surgery. J. Med. Microbiol. 2016, 65, 547–553. [Google Scholar] [CrossRef] [PubMed]
  12. Mancuso, G.; Midiri, A.; Gerace, E.; Biondo, C. Bacterial Antibiotic Resistance: The Most Critical Pathogens. Pathogens 2021, 10, 1310. [Google Scholar] [CrossRef] [PubMed]
  13. Curbete, M.M.; Salgado, H.R.N. A Critical Review of the Properties of Fusidic Acid and Analytical Methods for Its Determination. Crit. Rev. Anal. Chem. 2016, 46, 352–360. [Google Scholar] [CrossRef]
  14. Musmade, P.B.; Tumkur, A.; Trilok, M.; Bairy, K.L. Fusidic Acid—Topical Antimicrobial in the Management of Staphylococcus aureus. Cold Spring Harb. Perspect. Med. 2013, 5, 381–390. [Google Scholar]
  15. Fernandes, P. Fusidic acid: A bacterial elongation factor inhibitor for the oral treatment of acute and chronic staphylococcal infections. Cold Spring Harb. Perspect. Med. 2016, 6, a025437. [Google Scholar] [CrossRef] [PubMed]
  16. Wilkinson, J.D. Fusidic acid in dermatology. Br. J. Dermatol. 1998, 139, 37–40. [Google Scholar] [CrossRef] [PubMed]
  17. Sharma, A.; Dhiman, K.; Goyal, K.; Pandit, V.R.; Ashawat, M.S.; Jindal, S. Fusidic Acid: A Therapeutic Review. Asian J. Res. Chem. 2022, 46, 352–360. [Google Scholar] [CrossRef]
  18. Lindert, S.; Zhu, W.; Liu, Y.L.; Pang, R.; Oldfield, E.; Mccammon, J.A. Farnesyl diphosphate synthase inhibitors from in silico screening. Chem. Biol. Drug Des. 2013, 81, 742–748. [Google Scholar] [CrossRef] [PubMed]
  19. Zhang, G.; Zhu, M.; Liao, Y.; Gong, D.; Hu, X. Action mechanisms of two key xanthine oxidase inhibitors in tea polyphenols and their combined effect with allopurinol. J. Sci. Food Agric. 2022, 102, 7195–7208. [Google Scholar] [CrossRef] [PubMed]
  20. Zhu, W.; Wang, Y.; Li, K.; Gao, J.; Huang, C.-H.; Chen, C.-C.; Ko, T.-P.; Zhang, Y.; Guo, R.-T.; Oldfield, E. Antibacterial Drug Leads: DNA and Enzyme Multitargeting. J. Med. Chem. 2015, 58, 1215–1227. [Google Scholar] [CrossRef] [PubMed]
  21. Zhu, W.; Zhang, Y.; Sinko, W.; Hensler, M.E.; Olson, J.; Molohon, K.J.; Lindert, S.; Cao, R.; Li, K.; Wang, K.; et al. Antibacterial drug leads targeting isoprenoid biosynthesis. Proc. Natl. Acad. Sci. USA 2013, 110, 123–128. [Google Scholar] [CrossRef] [PubMed]
  22. Yang, G.; Zhu, W.; Wang, Y.; Huang, G.; Byun, S.Y.; Choi, G.; Li, K.; Huang, Z.; Docampo, R.; Oldfield, E.; et al. In Vitro and In Vivo Activity of Multitarget Inhibitors against Trypanosoma brucei. ACS Infect. Dis. 2015, 1, 388–398. [Google Scholar] [CrossRef] [PubMed]
  23. Hu, Y.; Shamaei-Tousi, A.; Liu, Y.; Coates, A. A new approach for the discovery of antibiotics by targeting non-multiplying bacteria: A novel topical antibiotic for Staphylococcal infections. PLoS ONE 2010, 5, e11818. [Google Scholar] [CrossRef] [PubMed]
  24. Hubbard, A.T.M.; Coates, A.R.M.; Harvey, R.D. Comparing the action of HT61 and chlorhexidine on natural and model Staphylococcus aureus membranes. J. Antibiot. 2017, 70, 1020–1025. [Google Scholar] [CrossRef]
  25. Hu, Y.; Coates, A.R.M. Enhancement by novel anti-methicillin-resistant Staphylococcus aureus compound HT61 of the activity of neomycin, gentamicin, mupirocin and chlorhexidine: In vitro and in vivo studies. J. Antimicrob. Chemother. 2013, 68, 374–384. [Google Scholar] [CrossRef] [PubMed]
  26. Amison, R.T.; Faure, M.E.; O’Shaughnessy, B.G.; Bruce, K.D.; Hu, Y.; Coates, A.; Page, C.P. The small quinolone derived compound HT61 enhances the effect of tobramycin against Pseudomonas aeruginosa in vitro and in vivo. Pulm. Pharmacol. Ther. 2020, 61, 101884. [Google Scholar] [CrossRef] [PubMed]
  27. dos Reis, T.F.; de Castro, P.A.; Bastos, R.W.; Pinzan, C.F.; Souza, P.F.N.; Ackloo, S.; Hossain, M.A.; Drewry, D.H.; Alkhazraji, S.; Ibrahim, A.S.; et al. A host defense peptide mimetic, brilacidin, potentiates caspofungin antifungal activity against human pathogenic fungi. Nat. Commun. 2023, 14, 2052. [Google Scholar] [CrossRef] [PubMed]
  28. Drevon-Gaillot, E.; Blair, T.; Clermont, G. Optimizing the design of preclinical safety and performance studies—Examples in soft tissues and cardio-vascular implants. Biocompat. Perform. Med. Devices 2020, 371–392. [Google Scholar] [CrossRef]
  29. Shegokar, R. Preclinical testing—Understanding the basics first. In Drug Delivery Aspects; Volume 4: Expectations and Realities of Multifunctional Drug Delivery Systems; Elsevier: Amsterdam, The Netherlands, 2020; pp. 19–32. [Google Scholar] [CrossRef]
  30. Belov, M.V.; Shakhmuradyan, M.A. Improvement of a pharmaceutical enterprise’s business processes at the stage of preclinical development of new drugs. Bus. Inform. 2019, 13, 17–27. [Google Scholar] [CrossRef]
  31. Kapetanovic, I.M. We are IntechOpen, the world’s leading publisher of Open Access books Built by scientists, for scientists TOP 1%. In Advanced Biometric Technologies; IntechOpen: London, UK, 2016; Volume 11, p. 13. ISBN 0000957720. [Google Scholar]
  32. Bassetti, M.; Garau, J. Current and future perspectives in the treatment of multidrug-resistant Gram-negative infections. J. Antimicrob. Chemother. 2021, 76, IV23–IV37. [Google Scholar] [CrossRef] [PubMed]
  33. Zivkovic Zaric, R.; Zaric, M.; Sekulic, M.; Zornic, N.; Nesic, J.; Rosic, V.; Vulovic, T.; Spasic, M.; Vuleta, M.; Jovanovic, J.; et al. Antimicrobial Treatment of Serratia marcescens Invasive Infections: Systematic Review. Antibiotics 2023, 12, 367. [Google Scholar] [CrossRef] [PubMed]
  34. Raz-Pasteur, A.; Liron, Y.; Amir-Ronen, R.; Abdelgani, S.; Ohanyan, A.; Geffen, Y.; Paul, M. Trimethoprim-sulfamethoxazole vs. colistin or ampicillin-sulbactam for the treatment of carbapenem-resistant Acinetobacter baumannii: A retrospective matched cohort study. J. Glob. Antimicrob. Resist. 2019, 17, 168–172. [Google Scholar] [CrossRef] [PubMed]
  35. Vázquez-Laslop, N.; Lee, H.; Hu, R.; Neyfakh, A.A. Molecular sieve mechanism of selective release of cytoplasmic proteins by osmotically shocked Escherichia coli. J. Bacteriol. 2001, 183, 2399–2404. [Google Scholar] [CrossRef] [PubMed]
  36. Barisch, C.; Holthuis, J.C.M.; Cosentino, K. Membrane damage and repair: A thin line between life and death. Biol. Chem. 2023, 404, 467–490. [Google Scholar] [CrossRef] [PubMed]
  37. da Silva, K.E.; Rossato, L.; Jorge, S.; de Oliveira, N.R.; Kremer, F.S.; Campos, V.F.; da Silva Pinto, L.; Dellagostin, O.A.; Simionatto, S. Three challenging cases of infections by multidrug-resistant Serratia marcescens in patients admitted to intensive care units. Braz. J. Microbiol. 2021, 52, 1341–1345. [Google Scholar] [CrossRef] [PubMed]
  38. Weinstein, M.P.; Lewis, J.S. The clinical and laboratory standards institute subcommittee on Antimicrobial susceptibility testing: Background, organization, functions, and processes. J. Clin. Microbiol. 2020, 58, e01864-19. [Google Scholar] [CrossRef] [PubMed]
  39. Medicines for Malaria Venture about the Pandemic Response Box and COVID Box. Available online: https://www.mmv.org/mmv-open/pandemic-response-box/about-pandemic-response-box (accessed on 1 September 2023).
  40. Sivasankar, S.; Premnath, M.A.; Boppe, A.; Grobusch, M.P.; Jeyaraj, S. Screening of MMV pandemic response and pathogen box compounds against pan-drug-resistant Klebsiella pneumoniae to identify potent inhibitory compounds. New Microbes New Infect. 2023, 55, 101193. [Google Scholar] [CrossRef] [PubMed]
  41. Kim, T.; Hanh, B.T.B.; Heo, B.; Quang, N.; Park, Y.; Shin, J.; Jeon, S.; Park, J.W.; Samby, K.; Jang, J. A screening of the mmv pandemic response box reveals epetraborole as a new potent inhibitor against mycobacterium abscessus. Int. J. Mol. Sci. 2021, 22, 5936. [Google Scholar] [CrossRef] [PubMed]
  42. Rossato, L.; Arantes, J.P.; Ribeiro, S.M.; Simionatto, S. Antibacterial activity of gallium nitrate against polymyxin-resistant Klebsiella pneumoniae strains. Diagn. Microbiol. Infect. Dis. 2022, 102, 115569. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Initial screening results for the boxes. (A) Among the PRB compounds evaluated against CPR-Kp, 38 exhibited inhibition percentages above 80%, with five exhibiting exceptionally high inhibition rates of above 90%: fusidic acid, MMV1580853, and MMV1634399. Only two PRB compounds exhibited an inhibition percentage above 80%: gepotidacin and MMV1634402 for CR-Kp, and against CR-Sm, trimethoprim exhibited a remarkable inhibition percentage of 82.14%. (B) Among the CB compounds evaluated against CPR-Kp, four compounds, oxyclozanide, doxorubicin, simeprevir, and niclosamide, exhibited inhibition rates above 80%.
Figure 1. Initial screening results for the boxes. (A) Among the PRB compounds evaluated against CPR-Kp, 38 exhibited inhibition percentages above 80%, with five exhibiting exceptionally high inhibition rates of above 90%: fusidic acid, MMV1580853, and MMV1634399. Only two PRB compounds exhibited an inhibition percentage above 80%: gepotidacin and MMV1634402 for CR-Kp, and against CR-Sm, trimethoprim exhibited a remarkable inhibition percentage of 82.14%. (B) Among the CB compounds evaluated against CPR-Kp, four compounds, oxyclozanide, doxorubicin, simeprevir, and niclosamide, exhibited inhibition rates above 80%.
Antibiotics 13 00723 g001
Figure 2. Comparative analysis of the antibacterial activities of PRB and the CB compounds. Dose–response analysis of the growth of K. pneumoniae and S. marcescens. (a) ICs were determined for the compounds from PRB with inhibitory activity against CPR-Kp: fusidic acid, MMV1580853, MMV1634399, nadifloxacin, pibenzimol, clofazimine, MMV1593541, and erythromycin. (b) ICs were determined for the CB compounds that inhibited the growth of CPR-Kp: doxycyline, tetracycline, oxyclozanide, doxorubicin, and niclosamide. (c) ICs were determined for the compounds from PRB that inhibited the growth of CR-Kp: gepotidacin and MMV1634402. (d) ICs were determined for the compound from PRB that inhibited the growth of CR-Sm: trimethoprim. All tests were performed in duplicate. Each point represents the mean of duplicate determinations.
Figure 2. Comparative analysis of the antibacterial activities of PRB and the CB compounds. Dose–response analysis of the growth of K. pneumoniae and S. marcescens. (a) ICs were determined for the compounds from PRB with inhibitory activity against CPR-Kp: fusidic acid, MMV1580853, MMV1634399, nadifloxacin, pibenzimol, clofazimine, MMV1593541, and erythromycin. (b) ICs were determined for the CB compounds that inhibited the growth of CPR-Kp: doxycyline, tetracycline, oxyclozanide, doxorubicin, and niclosamide. (c) ICs were determined for the compounds from PRB that inhibited the growth of CR-Kp: gepotidacin and MMV1634402. (d) ICs were determined for the compound from PRB that inhibited the growth of CR-Sm: trimethoprim. All tests were performed in duplicate. Each point represents the mean of duplicate determinations.
Antibiotics 13 00723 g002
Figure 3. Elimination time kinetics of different antibacterial agents against the growth curves of selected bacterial strains under the effect of different compounds from PRB and CB. (a) Survival curve (over 24 h) for CPR-Kp when treated with the compounds from PRB: MMV1634399, MMV1580853, fusidic acid, nadifloxacin, MMV1480967, eberconazole, gepotidacin, erythromycin, pibenzimol, eravacycline, and MMV1580852. (b) Survival curve (over 24 h) for CPR-Kp when treated with the compounds from CB: doxycycline tetracycline, doxorubicin, oxyclozanide, and niclosamide. (c) Survival curve (over 24 h) for CR-Kp when treated with the PRB compounds: gepotidacin and MMV1634402. (d) Survival curve (over 24 h) for CR-Sm when treated with the compounds from PRB: trimethoprim. All tests were performed in duplicate. Each point represents the average of duplicate determinations.
Figure 3. Elimination time kinetics of different antibacterial agents against the growth curves of selected bacterial strains under the effect of different compounds from PRB and CB. (a) Survival curve (over 24 h) for CPR-Kp when treated with the compounds from PRB: MMV1634399, MMV1580853, fusidic acid, nadifloxacin, MMV1480967, eberconazole, gepotidacin, erythromycin, pibenzimol, eravacycline, and MMV1580852. (b) Survival curve (over 24 h) for CPR-Kp when treated with the compounds from CB: doxycycline tetracycline, doxorubicin, oxyclozanide, and niclosamide. (c) Survival curve (over 24 h) for CR-Kp when treated with the PRB compounds: gepotidacin and MMV1634402. (d) Survival curve (over 24 h) for CR-Sm when treated with the compounds from PRB: trimethoprim. All tests were performed in duplicate. Each point represents the average of duplicate determinations.
Antibiotics 13 00723 g003
Figure 4. Inhibition of biofilm formation by PRB and CB compounds. (a) CPR-Kp treated with different PRB compounds exhibiting variable levels of biofilm formation, with only a few compounds demonstrated to significantly reduce biofilm formation, namely, MMV 1634399, MMV 1580853, fusidic acid, nadifloxacin, gepotidacin, erythromycin, pibenzimol MMV 1593537, eravacycline, and MMV1580852. (b) The CB compounds doxycycline, tetracycline, doxorubicin, oxyclozanide, and niclosamide exhibited inhibitory effects on biofilm formation in CPR-Kp compared to the positive control. (c) Gepotidacin and MMV1634402, among the PRB compounds evaluated for biofilm formation against CR-Kp, exhibited low efficacy in biofilm inhibition, with values close to those noted for the positive control. (d) Trimethoprim from PRB did not exhibit a significant difference in its inhibitory effect on biofilm formation in CR-Sm compared to the positive control. All tests were performed in triplicate. Each point represents the average of triplicate determinations. Untreated controls were compared using a one-way analysis of variance (ANOVA) followed by the Kruskal–Wallis test. * p value < 0.5; ns: not significant.
Figure 4. Inhibition of biofilm formation by PRB and CB compounds. (a) CPR-Kp treated with different PRB compounds exhibiting variable levels of biofilm formation, with only a few compounds demonstrated to significantly reduce biofilm formation, namely, MMV 1634399, MMV 1580853, fusidic acid, nadifloxacin, gepotidacin, erythromycin, pibenzimol MMV 1593537, eravacycline, and MMV1580852. (b) The CB compounds doxycycline, tetracycline, doxorubicin, oxyclozanide, and niclosamide exhibited inhibitory effects on biofilm formation in CPR-Kp compared to the positive control. (c) Gepotidacin and MMV1634402, among the PRB compounds evaluated for biofilm formation against CR-Kp, exhibited low efficacy in biofilm inhibition, with values close to those noted for the positive control. (d) Trimethoprim from PRB did not exhibit a significant difference in its inhibitory effect on biofilm formation in CR-Sm compared to the positive control. All tests were performed in triplicate. Each point represents the average of triplicate determinations. Untreated controls were compared using a one-way analysis of variance (ANOVA) followed by the Kruskal–Wallis test. * p value < 0.5; ns: not significant.
Antibiotics 13 00723 g004
Figure 5. The number of proteins released over time, reflecting the integrity of the cell membrane when the bacterial strains were exposed to the compounds from PRB and CB, are depicted. (a) Extravasation of CPR-Kp proteins; (b) extravasation of CPR-Kp proteins; (c) extravasation of CR-Kp proteins; (d) extravasation of CR-Sm proteins. The data points represent the averages of the protein concentration values measured at 0, 1, 2, and 4 h post-treatment, providing insights into the temporal dynamics of bacterial membrane damage. All tests were performed in duplicate. Each point represents the average of duplicate determinations.
Figure 5. The number of proteins released over time, reflecting the integrity of the cell membrane when the bacterial strains were exposed to the compounds from PRB and CB, are depicted. (a) Extravasation of CPR-Kp proteins; (b) extravasation of CPR-Kp proteins; (c) extravasation of CR-Kp proteins; (d) extravasation of CR-Sm proteins. The data points represent the averages of the protein concentration values measured at 0, 1, 2, and 4 h post-treatment, providing insights into the temporal dynamics of bacterial membrane damage. All tests were performed in duplicate. Each point represents the average of duplicate determinations.
Antibiotics 13 00723 g005
Table 1. Antimicrobial susceptibility testing of the strains, showing the resistance profile to multiple antibiotics.
Table 1. Antimicrobial susceptibility testing of the strains, showing the resistance profile to multiple antibiotics.
AntibioticsMinimum Inhibitory Concentration (μg/mL)
CPR-KpCR-KpCR-Sm
Cefepime>256Not tested32
Cefotaxime>256Not tested>256
Ceftazidime>256>256>2
Aztreonam>32>32>32
Imipenem>16>16>16
Meropenem>16>16>8
Ertapenem>32>32>32
Amikacin64<832
Polymyxin40.5>64
Tigecycline<0.5<0.50.5
Antimicrobial susceptibility testing was carried out according to CLSI protocols. MIC: Minimum inhibitory concentration in ug/mL.
Table 2. Strains, compounds, percentage of inhibition, IC, and chemical structure.
Table 2. Strains, compounds, percentage of inhibition, IC, and chemical structure.
StrainsCompoundsInhibition (%)IC (µM)Disease SetChemical Structure
CPR-KpFusidic acid91.281.25AntibacterialsAntibiotics 13 00723 i001
CPR-KpMMV158085390.002.5AntibacterialsAntibiotics 13 00723 i002
CPR-KpMMV163439990.0020AntibacterialsAntibiotics 13 00723 i003
CPR-KpNadifloxacin89.720.625AntibacterialsAntibiotics 13 00723 i004
CPR-KpPibenzimol88.7520AntibacterialsAntibiotics 13 00723 i005
CPR-KpErythromycin89.722.5AntibacterialsAntibiotics 13 00723 i006
CPR-KpDoxorubicin91.742.5AntibacterialsAntibiotics 13 00723 i007
CPR-KpNiclosamide89.005AntiparasiticAntibiotics 13 00723 i008
CR-KpGepotidacin91.840.625AntibacterialsAntibiotics 13 00723 i009
CR-KpMMV163440290.7810AntibacterialsAntibiotics 13 00723 i010
CR-SmTrimethoprim82.1410AntibacterialsAntibiotics 13 00723 i011
Compounds of the Pandemic Response and COVID Box; Inhibition (%): inhibition percentage; IC: inhibitory concentration.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Cerqueira Melo, R.d.C.; Martins, A.A.; Melo, A.L.F.; Vicente, J.C.P.; Sturaro, M.C.; Arantes, J.P.; Rossato, L.; de Souza, G.H.d.A.; Simionatto, S. Investigating the Antimicrobial Potential of 560 Compounds from the Pandemic Response Box and COVID Box against Resistant Gram-Negative Bacteria. Antibiotics 2024, 13, 723. https://doi.org/10.3390/antibiotics13080723

AMA Style

Cerqueira Melo RdC, Martins AA, Melo ALF, Vicente JCP, Sturaro MC, Arantes JP, Rossato L, de Souza GHdA, Simionatto S. Investigating the Antimicrobial Potential of 560 Compounds from the Pandemic Response Box and COVID Box against Resistant Gram-Negative Bacteria. Antibiotics. 2024; 13(8):723. https://doi.org/10.3390/antibiotics13080723

Chicago/Turabian Style

Cerqueira Melo, Rita de Cássia, Aline Andrade Martins, Andressa Leite Ferraz Melo, Jean Carlos Pael Vicente, Mariana Carvalho Sturaro, Julia Pimentel Arantes, Luana Rossato, Gleyce Hellen de Almeida de Souza, and Simone Simionatto. 2024. "Investigating the Antimicrobial Potential of 560 Compounds from the Pandemic Response Box and COVID Box against Resistant Gram-Negative Bacteria" Antibiotics 13, no. 8: 723. https://doi.org/10.3390/antibiotics13080723

APA Style

Cerqueira Melo, R. d. C., Martins, A. A., Melo, A. L. F., Vicente, J. C. P., Sturaro, M. C., Arantes, J. P., Rossato, L., de Souza, G. H. d. A., & Simionatto, S. (2024). Investigating the Antimicrobial Potential of 560 Compounds from the Pandemic Response Box and COVID Box against Resistant Gram-Negative Bacteria. Antibiotics, 13(8), 723. https://doi.org/10.3390/antibiotics13080723

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop