Next Article in Journal
Analysis the Link between Periodontal Diseases and Alzheimer’s Disease: A Systematic Review
Next Article in Special Issue
SARS-CoV-2 RNA and Supermarket Surfaces: A Real or Presumed Threat?
Previous Article in Journal
Identifying the Knowledge Structure and Trends of Outreach in Public Health Care: A Text Network Analysis and Topic Modeling
Previous Article in Special Issue
How Much Does HIV Positivity Affect the Presence of Oral HPV? A Molecular Epidemiology Survey
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Is the Antibacterial Activity of Multi-Walled Carbon Nanotubes (MWCNTs) Related to Antibiotic Resistance? An Assessment in Clinical Isolates

by
Pasqualina Laganà
1,*,
Giuseppa Visalli
1,
Alessio Facciolà
1,
Marianna Pruiti Ciarello
1,
Antonio Laganà
1,
Daniela Iannazzo
2 and
Angela Di Pietro
1
1
Department of Biomedical and Dental Sciences and Morphofunctional Imaging, University of Messina, 98125 Messina, Italy
2
Department of Electronic Engineering, Industrial Chemistry and Engineering, University of Messina, 98125 Messina, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(17), 9310; https://doi.org/10.3390/ijerph18179310
Submission received: 29 June 2021 / Revised: 27 August 2021 / Accepted: 1 September 2021 / Published: 3 September 2021

Abstract

:
Antimicrobial resistance has spread globally, compromising the treatment of common infections. This feature is particularly harmful for nosocomial pathogens that can survive on hospital surfaces. Research studies have been conducted to evaluate new materials that are able to counteract the microbial growth and the colonization of the hospital environment. In this context, nanotechnologies have showed encouraging applications. We investigated the antibacterial activity of multi-walled carbon nanotubes (MWCNTs), both pristine (p) and functionalized (f), at concentrations of 50 and 100 μg mL−1, against bacterial strains isolated from hospital-acquired infections, and this activity was correlated with the antibiotic susceptibility of the strains. The inhibiting effect of MWCNTs occurred for both types and doses tested. Moreover, f-MWCNTs exerted a greater inhibiting effect, with growth decreases greater than 10% at 24 h and 20% at 48 h compared to p-MWCNTs. Moreover, a lower inhibitory effect of MWCNTs, which was more lasting in Gram-positives resistant to cell wall antibiotics, or temporary in Gram-negatives resistant to nucleic acid and protein synthesis inhibitors, was observed, highlighting the strong relation between antibiotic resistance and MWCNT effect. In conclusion, an antimicrobial activity was observed especially for f-MWCNTs that could therefore be loaded with bioactive antimicrobial molecules. However, this potential application of CNTs presupposes the absence of toxicity and therefore total safety for patients.

1. Introduction

Antimicrobial resistance represents one of the most important current public health challenges worldwide. Many bacterial strains have developed resistance to most antibiotics used in therapy, and antibiotic-resistant strains have spread throughout the world. New resistance mechanisms are emerging and spreading globally, compromising the treatment of common infectious diseases. A certain number of infections, such as pneumonia, tuberculosis and sepsis, are becoming harder or even impossible to treat due to the lowered efficacy of antibiotics [1]. As highlighted by the World Health Organization (WHO), this issue represents a health emergency in both high- and low-income countries, affecting anyone of any age, and in a 2020 report, the WHO’s new Global Antimicrobial Surveillance System (GLASS) revealed the widespread occurrence of antibiotic resistance [1]. The Center for Disease Control and Prevention (CDC) affirms that, in 2019, in the USA, at least 2.8 million people are infected with antibiotic-resistant bacteria or fungi, and more than 35,000 people die as a result [2]. This aspect is particularly important for nosocomial pathogens, causing consistent increases of mortality, hospitalization times and costs for health systems [3]. A large number of studies have highlighted that hospital surfaces (beds, beside tables, carts, door handles, taps, mobile phones, computers, humidifiers for oxygen therapy, etc.) can host many nosocomial pathogens and could play an important role in the onset of hospital-acquired infections [4,5,6,7,8,9,10].
This worrying issue has induced researchers to evaluate new materials and strategies for successfully contrasting microbial growth and the colonization of the hospital environment. In this context, nanotechnologies have showed encouraging applications. Previous studies have focused attention on various nanosized antibacterial agents, such as metal and metal oxide nanoparticles (silver and silver oxide, titanium dioxide, zinc oxide, gold, calcium oxide, silica, copper oxide and magnesium oxide), that are able to inactivate microorganisms [11,12,13,14,15,16,17]. In addition, many studies have highlighted the high antimicrobial activity of carbon-based nanoparticles. In particular, early studies have indicated that fullerenes, single-walled carbon nanotubes (SWCNTs) and graphene oxide (GO) nanoparticles exhibit potent antimicrobial properties influenced by the size and surface area of these nanomaterials [18,19,20].
Carbon nanotubes (CNTs) are compounds of almost pure carbon that have been used for many purposes due to their different chemical and physical characteristics. They are used as sensing devices, energy production and storage systems, and, in the medical field, they are used as potential drug-delivery vehicles, especially in cancer therapy [21,22,23,24]. Moreover, interesting antimicrobial properties are associated with CNTs that have attracted relevant attention [25,26,27,28,29].
Some studies have identified oxidative stress (producing bacterial membrane damage) as one of the possible causes of the antimicrobial properties of CNTs [30,31,32,33,34]. However, recent studies have shown that the mechanical interaction of carbon-based nanomaterials with bacteria, and not oxidative stress, is the main antimicrobial activity of these compounds [35,36,37,38,39]. In particular, the first evidence of the strong antimicrobial activity of CNTs was obtained by treatment of Escherichia coli with SWCNTs, which caused severe membrane damage and bacterial death [40]. In a subsequent study, the same author highlighted the importance of the size of CNTs in this activity. Both SWCNTs single- and multi-walled CNTs (SWCNTs and MWCNTs) were studied as antibacterial agents against E. coli, and the results showed that SWCNTs exerted greater antibacterial action than MWCNTs. According to the authors, owing to their smaller diameter, SWCNTs could better penetrate into the cell wall than MWCNTs. Moreover, they highlighted that the differences between the two types of CNTs could also be attributable to the greater surface area, per unit of mass, of the SWCNTs [19].
For all of these reasons, CNTs are promising antibacterial candidates for a wide range of hospital applications. For example, surface-immobilized CNTs could be used to produce linens, furnishings and, above all, new composite materials for medical devices, hindering the colonization of pathogens.
The purpose of this study was to investigate the antibacterial activity of homemade MWCNTs (both pristine and functionalized) against 27 bacterial strains, isolated from hospital-acquired infections (HAIs), characterized by a different degree of antibiotic resistance, namely totally drug resistant (TDR), extensively drug resistant (XDR) and multidrug resistant (MDR). This is in order to more realistically evaluate their potential use in the fight against HAIs, considering the wide circulation of multidrug-resistant bacteria in the hospital environment.

2. Materials and Methods

2.1. Pristine and Functionalized MWCNTs

The biological effects of MWCNTs are strongly linked to their physicochemical properties, which in turn are related to post-synthetic modifications. In addition to homemade pristine MWCNTs (pMWCNTs), we also examined functionalized MWCNTs (fMWCNTs), such as MWCNT-COOH. The pMWCNTs were synthesized by catalytic chemical vapour deposition (CCVD), using Fe/Al2O3 as the catalyst and subsequently purified as reported previously [41,42]. Unlike our previous studies, oxidized carbon nanotubes (fMWCNTs) were prepared by using a mixture of sulfuric acid and nitric acid (1:3 vol ratio) for the treatment of purified pMWCNTs. This method increased the number of functional groups, allowing for wider water dispersion [43]. The inorganic fraction of MWCNTs (3.5–4%) was assessed by oxidative thermogravimetric analysis and was substantially represented by Fe2O3. The iron content was not bioavailable, as shown by abiotic and in vitro experiments [44].
The pMWCNTs had an average length of 10–20 μm and a diameter close to 15–30 nm, whereas the fMWCNTs were much shorter (average length between 200 and 1000 nm) and showed an external layer eroded at many points due to the oxidative insertion of terminal functional groups [41].

2.2. Experimental Conditions

The bactericidal capacity of both MWCNT types was assessed on strains of our collection that were isolated over time from clinical samples of patients admitted to the University Hospital (AOU) ‘G. Martino’ of the city of Messina. In particular, the study examined 27 different bacterial strains, namely 12 Gram-positive and 15 Gram-negative (Table 1). All strains were identified by commercially miniaturized biochemical tests (API 20 E, NE and API STAPH, bioMérieux, Marcy l’Etoile, France).
Based on preliminary tests to assess the bactericidal capacity of MWCNTs, 50 and 100 μg mL−1 concentrations were used. The work suspensions, prepared in peptone water, were obtained from stock suspensions (10 mg mL−1 in phosphate-buffered saline (PBS) at pH 7.2), preliminarily sterilized by autoclaving. In order to reduce MWCNT aggregation, due to the absence of repulsive electrostatic charges on the surface, the stock suspensions were submitted to sonication in an ultrasonic bath (Branson 3210) for 20 min (frequency 40 kHz), keeping the temperature low by using an ice bath. Just before experiments, the work suspensions in peptone water (2X) were further sonicated for 3 min, and the homogeneous suspensions were immediately dispensed into 96-well plates (50 µL/well).
For each bacterial strain, we set up 18–24 h broth cultures from which suspensions adjusted to a 0.5 McFarland turbidity standard (bioMérieux; corresponding to 1.5 × 108 CFU mL−1) were prepared and added to the 96-well plates (50 µL for each preloaded MWCNT well). In each experiment, bacterial suspensions in peptone water without MWCNTs were included to assess bacterial growth in the basal condition, and suspensions of MWCNTs in the absence of bacterial suspensions were prepared as a negative control in order to test the sterility of the nanomaterials.
In the plates that were set up, the optical density (OD) at 550 nm was immediately recorded by using a Multiskan GO Microplate Spectrophotometer (Thermo Scientific) [45]. Then, the plates were incubated at 37 °C, and bacterial growth was assessed after 24 and 48 h.
After subtracting the zero-time OD in order to eliminate the interference caused by the nanotubes, the difference in absorbance was calculated for both 24 and 48 h to obtain bacterial growth in the basal condition (positive control) and in the presence of MWCNTs. All experiments were conducted at least in duplicate, and average values were used to assess bactericidal capacity of MWCNTs.

2.3. Antibiotic Susceptibility

The bacterial isolates were screened for antibiotic susceptibility, using the Kirby–Bauer test [46], performed with three replicates per isolate. The inoculum, consisting of 1.5 × 108 CFU mL−1, was streaked over the surface of a Müeller–Hinton (MH) agar plate, using a cotton swab, and commercially available antibacterial disks (Oxoid) were used. The data in Supplementary Materials Table S1 report the assayed antibiotics, grouped in classes according to their mechanism of action [47].
After 48 h of incubation at 37 °C, the diameters of inhibition were measured with a precision calliper (Mitutoyo, Andover, UK) and averaged [48].
Overall, 24 broad-spectrum antibiotics were tested on all strains, while the following were used exclusively on the S. aureus strains: the cell wall inhibiting antibiotics amoxicillin (AML), oxacillin (OX) and penicillin (P); the protein synthesis inhibitors clindamycin (DA), erythromycin (E), lincomycin (MY), linezolid (LNZ), minocycline (MN), doxycycline (DXT) and methicillin (MET); and the semi-synthetic glycopeptide antibiotics teicoplanin (TEC) and vancomycin.
The Gram-negative strains were tested for the cell wall inhibiting antibiotics aztreonam (AZM), cefoxitin (FOX) and ceftazidime (CAZ); the disrupting membrane antibiotic colistin sulfate (CS); the nucleic acid inhibiting antibiotics nalidixic acid (NA), pipemidic acid (PI) and sulfamethoxazole + trimethoprim (SXT); and the protein synthesis inhibitors amikacina (AK), netilmicin (NET) and tobramycin (TOB).
Each bacterial species was classified as resistant (R), intermediate (I) or sensitive (S) according to the breakpoints established by the European Committee on Antimicrobial Susceptibility Testing (2021) [49]. For cinoxacin and sisomicin molecules, the breakpoints established by the Clinical Laboratory Standards Institute (2020) were used [50].

3. Results

The antibiotic susceptibility of the tested strains is shown in Scheme 1.
The growth inhibiting effect occurred for both p- and f-MWCNTs and for both doses tested. Figure 1 reports the values of the average percentage change (Δ%) after treatment at 24 and 48 h against the strains, divided into Gram-positive and Gram-negative bacteria.
On all the tested strains, the f-MWCNTs exerted a greater inhibiting effect, with growth decreases averaging greater than 10% at 24 h and 20% at 48 h in comparison to pMWCNTs.
The antibacterial effect of MWCNTs was, on average, greater in the Gram-positive bacteria, for which, in comparison to the basal condition, the OD values in MWCNT-exposed suspensions were virtually halved at 24 h. The increase in inhibition as a function of dose was very small, and it was observed only for the most dispersible f-MWCNTs. Similar to what was observed for dose, the correlation between exposure time and antibacterial effect was weak in the Gram-positive bacteria, whereas, in the less sensitive Gram-negative bacteria, the observed percentage change showed, on average, an additional growth inhibiting effect of more than 50%, after exposure for 48 h.
However, the percentage change showed high inter-strain variability, as underlined by the coefficient of variation (CV). Even in the Gram-positive bacteria, consisting exclusively of S. aureus strains, the CV on average was equal to 50% after MWCNT exposure for 24 h. In particular, Δ% values in these strains ranged between −28.51 and −127.97 after exposure to fMWCNTs for 24 h.
As expected, MWCNT-induced inhibitory effects showed a more marked variability (CV on average greater than 100) in the Gram-negative bacteria, which included four different species. This higher inter-strain variability was also maintained by considering the three species separately, for which a greater number of strains had been examined. In particular, the CV was 127.1 in P. aeruginosa strains, which showed Δ% values ranging between −0.60 and −206.6 after exposure to fMWCNTs for 24 h. A similar variability was shown by K. pneumoniae whereas the CV in K. oxytoca strains was comparable to that observed in S. aureus strains.
To evaluate if the observed variability in growth inhibition was influenced by the antibiotic resistance of the different bacterial strains, preliminarily we compared the growth inhibiting effect of MWCNTs with the R/S ratio of each strain. Regardless of the mechanism of action of each drug, the R/S ratio was calculated by dividing the number of molecules to which the strain was resistant (R) or intermediate (I) with those to which it was sensitive (S).
The tested bacteria were previously isolated from clinical specimens in a hospital setting; the strains were multidrug resistant; and, in almost all of them, the R/S ratio was >1. Moreover, only in five strains did the R/S ratio highlight a higher number of molecules towards which the strain was sensitive compared to those towards which it was resistant. These included three strains of S. aureus (R/S ratio = 0.71), one K. oxytoca strain (R/S ratio = 0.53) and one P. mirabilis strain (R/S ratio = 0.69).
All S. aureus strains were resistant to amoxicillin, ampicillin and fosfomycin and sensitive to linezolid, nitrofurantoin and vancomycin, but the ratio of resistance/sensitivity against the other antibiotics was extremely variable.
With regard to the Gram-negative bacteria, all of the examined strains were resistant to ampicillin, amoxicillin + clavulanic acid and cefoxitin. On average, compared to those towards which they were sensitive, the number of antibiotics towards which they were resistant was three times higher. In the P. aeruginosa and K. pneumoniae strains, antibiotic resistance was highly represented. In particular, one strain of K. pneumoniae showed resistance to all the tested molecules (TDR), and one was sensitive only to the protein synthesis inhibitors amikacin and tigecycline (XDR), while two strains of P. aeruginosa were XDR. On average R/S values were 11.0, 17.0 and 2.4 in P. aeruginosa, K. pneumoniae and K. oxytoca, respectively.
The assessment of the inhibitor effect MWCNT-induced as a function of the antibiotic resistance of each S. aureus strain highlighted a close inverse correlation between the two variables, and a decreased effect was observed for higher R/S ratios. Significant Pearson’s correlation coefficients were observed for both doses of f-MWCNTs and the highest dose of p-MWCNTs (p < 0.05) and at both exposure times. As expected, the significance was maintained by using as independent variables both the number of molecules towards which the strain was resistant and the number towards which it was sensitive, highlighting an inverse and direct correlation, respectively. Moreover, as shown in Figure 2, a weaker effect of MWCNTs was observed with an increasing number of molecules towards which the strain was resistant, whereas the slopes of the regression lines confirmed the greater effectiveness of functionalized nanotubes. However, on analyzing the different classes of antibiotics separately, the growth inhibiting effect of MWCNTs was inversely related to drug resistance exclusively for molecules that act on the bacterial wall (r = 0.618; p = 0.03).
In Gram-negative strains, the antibacterial effect of the MWCNTs was not related to the R/S ratio calculated for all the tested molecules. However, the MWCNT-induced inhibitor effect in the strains exposed for 24 h was inversely related to drug resistance for both nucleic acid inhibitors (r = −0.460 and −0.492 for p- and f-MWCNT respectively; p < 0.05) and protein synthesis inhibitors (r = −0.510 and −0.530 for p- and f-MWCNTs, respectively; p < 0.01). However, unlike what was observed in the Gram-positive strains, the lower growth inhibitor effect of MWNCTs as a function of resistance to these two classes of antibiotics was temporary. After exposure for 48 h, no differences were observed as a function of drug resistance for both drug classes, as highlighted by the MWCNT-induced inhibiting effect being more marked in the drug-resistant strains. This rebound effect was confirmed by analyzing only the P. aeruginosa and K. pneumoniae strains, characterized by the highest R/S values. In these bacteria, the inhibitor effect of prolonged exposure to MWCNTs (48 h) was directly related to the R/S values, showing an increased susceptibility to engineered nanoparticles for the most drug-resistant strains (r = 0.551, p = 0.03 and r = 0.623, p = 0.01 in p- and f-MWCNTs, respectively).
Unfortunately, the small number of K. oxytoca and P. mirabilis strains did not allow us to evaluate the relationship between the MWCNT-induced effect and drug resistance for these Gram-negative strains with lower antibiotic resistance.

4. Discussion

To our knowledge, this is the first report to assess the MWCNT-induced antibacterial effect as a function of antibiotic resistance, a feature of fundamental importance when evaluating the potential use of nanomaterials for the production of devices to use in healthcare. Even if our homemade MWCNTs would have a less inhibiting effect compared to what observed by others authors, we evaluated the effects in presence of proteins which could neutralize the assayed antibacterial effect. Moreover, the relatively low inhibiting effects were due to the high prevalence of multidrug-resistant strains that, as demonstrated by our results, are inversely related to the antibacterial properties of MWCNTs.
To date, the spread of drug resistance in both clinical and environmental samples is a problem of primary importance in public health due to misuse of antibiotics in humans and animals and the horizontal intra-species and inter-species transmission of genes encoding drug resistance factors. As is well-known, acquired bacterial resistance involves several diverse mechanisms, including structural and biochemical changes. Referring to more specific reviews [51], we briefly report that, in these resistant phenotypes, due to chromosomal (vertical transfer) and extrachromosomal (horizontal plasmid transfer by conjugation) genes, different molecular pathways are involved in antibiotic resistance. These mechanisms are (i) production of enzymes responsible for drug degradation, (ii) change in membrane permeability that reduces the entry of water-soluble drugs by under-expression of porins, (iii) drug efflux determined by pump activation and, finally, (iv) reduced drug affinity consequent to a change in the bacterial target [52].
In addition to extended spectrum β-lactamases (ESBLs), often associated with factors responsible for resistance to aminoglycosides and trimethoprim/sulfamethoxazole), in several strains of Gram-negative bacteria, drug resistance is caused by a deficiency of porins due to transcriptional downregulation or mutation of the oprD gene. The mechanism slows down the uptake of nutrients and allows bacterial survival, decreasing the entry of hydrophilic antibiotics, such as β-lactams, aminoglycosides, tetracyclines and some fluoroquinolones [53,54,55,56].
Moreover, decreased intracellular drug concentration can be realized via export through membrane-located efflux pumps, and drug extrusion is achieved with several efflux pumps (ATP-binding cassette, resistance-nodulation-division, etc.) [57].
Finally, the MecA gene, which encodes for resistant proteins (penicillin-binding protein 2a), is present in several S. aureus strains (MRSA) that are able to continuously perform the transpeptidation required in peptidoglycan crosslinking for correct cell wall synthesis in the presence of antibiotics [58].
Previous studies have shown that the antimicrobial properties of CNTs depend particularly on their intrinsic structural characteristics. Indeed, it has been reported that a significant role is played by the surface charge, which is capable of interrupting cell membrane integrity [59]. Moreover, Bing et al. [60] found that positive and negative surface charges in carbon dots had an antibacterial activity that determined bacterial death, whereas Dwyer et al. [61] showed that the major factor responsible for inhibition of bacterial growth was the production of reactive oxygen species (ROS), such as hydroxyl radicals after interaction between charged dots and bacterial cells. In addition, Yang et al. [35] highlighted the role of CNT length on antimicrobial activity, confirming that the longer the SWCNTs, the better their aggregation and the stronger their antimicrobial properties. Finally, it is also plausible that the possible presence of impurities (especially metals used as catalysts in synthetic processes) [44] could play a certain role in the antimicrobial properties of CNTs.
Although all of these intrinsic characteristics affect the antimicrobial properties of CNTs, the above-described biochemical pathways regulating structural and biochemical changes in drug-resistant bacteria could be responsible for the lower inhibitory effect of MWCNTs, which is long-lasting in Gram-positive strains resistant to cell wall and disruptive membrane antibiotics or temporary in Gram-negative strains resistant to nucleic acid and protein synthesis inhibitors.
Therefore, even if it is beyond the aim of our study, it is plausible to believe that the inhibiting effect of the studied CNTs is not due to simple mechanical damage, as assumed by Yang et al. [35]. This effect due to MWCNT–bacteria interactions would determine the same outcome, regardless of antibiotic resistance. In response to exposure to stressors (i.e., drugs), antibiotic-resistant phenotypes could also express a greater ability to counteract more common stressors such as redox imbalance due to oxidative stress. As reported above, many authors [30,31,32,33,34] believe that the antimicrobial effect of CNTs is due to oxidative stress. In previous studies, the same MWCNTs assayed here were able to cause strong ROS overproduction in human cells, resulting in oxidative damages [42,62], and further study should aim to verify this hypothesis in bacterial cells.
Regardless of the variability of MWCNT-induced inhibition, our results highlight the greater efficacy of fMWCNTs, confirming how the greater water solubility resulting in greater dispersibility due to the presence of surface groups favors bacteria–CNT interactions. Furthermore, it is useful to underline that our homemade MWCNTs were subjected to functionalization by means of strong oxidation, remarkably increasing their bioreactivity due to surface defects in the hexagon ring of graphene caused by disruption of sp2 hybridization of the carbon atoms [44].
Although, as reported by Kang [19], the antibacterial effect of MWCNTs is weaker compared to SWCNTs at the same dose, these carbon-based nanomaterials have potential use in the production of composite materials to hinder microbial colonization.
Moreover, the presence of functional groups, in addition to allowing anchoring to the substrate (e.g., fabrics, plastics, paints, resins, etc.), allows conjugation to various molecules with disinfectant activity, enhancing the antimicrobial effect.

5. Conclusions

On overall, the results highlighted the potential use of functionalized MWCNTs in the production of composite materials to hinder microbial colonization. In any case, it is necessary to underline that the antibacterial effect is not exclusively attributable to the intrinsic characteristics of the MWCNTs (length, surface charge etc.) but also to the characteristics of the individual bacterial strains, such as structural and biochemical changes in drug-resistant bacteria. Referring to more specific reviews that only considered the potential use of carbon-based nanomaterials as carriers for drug delivery [21,22,23,24], MWCNTs can be loaded with bioactive antimicrobial molecules by means of functional groups. However, this potential application of CNTs presupposes the absence of toxicity against eukaryotic cells and thus total safety for patients, also considering the inter-individual variability of susceptibility [63]. To date, the results of CNT toxicity in humans and animals are controversial, and many studies have shown the capacity of carbon-based nanomaterials to induce oxidative stress in several human cells, such as alveolar and bronchial cells [41,64], neurons [42,65,66], etc. Taking this into consideration, it is necessary to make sure that the CNTs used to counteract microbial colonization are not released from the surfaces on which they are adsorbed or from the composite materials in which they are present.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph18179310/s1, Table S1: List of assayed antibiotics with the doses for each drug, grouped in classes according to their mechanism of action.

Author Contributions

Conceptualization, A.D.P. and P.L.; methodology, A.D.P., P.L., G.V. and A.F.; resources, D.I., A.L. and M.P.C.; writing, A.D.P., G.V. and A.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization (WHO). Antibiotic Resistance. 2020. Available online: https://www.who.int/news-room/fact-sheets/detail/antibiotic-resistance (accessed on 13 May 2021).
  2. Center for Disease Control and Prevention (CDC). Antibiotic Resistance Threats in the United States. 2019. Available online: https://www.cdc.gov/drugresistance/pdf/threats-report/2019-ar-threats-report-508.pdf (accessed on 8 May 2021).
  3. World Health Organization (WHO). Global Antimicrobial Resistance Surveillance System (GLASS) Report: Early Implementation. 2016–2017. Available online: http://apps.who.int/iris/bitstream/handle/10665/259744/9789241513449-eng.pdf;jsessionid=3BECF83728850BDDA2CB63DFA68A2522?sequence=1 (accessed on 8 May 2021).
  4. Redmond, S.N.; Pearlmutter, B.S.; Ng-Wong, Y.K.; Alhmidi, H.; Cadnum, J.L.; Silva, S.Y.; Wilson, B.M.; Donskey, C.J. Timing and route of contamination of hospitalized patient rooms with healthcare-associated pathogens. Infect. Control. Hosp. Epidemiol. 2021, 1–6. [Google Scholar] [CrossRef]
  5. Assadian, O.; Harbarth, S.; Vos, M.; Knobloch, J.K.; Asensio, A.; Widmer, A.F. Practical recommendations for routine cleaning and disinfection procedures in healthcare institutions: A narrative review. J. Hosp. Infect. 2021, 113, 104–114. [Google Scholar] [CrossRef]
  6. Weber, D.J.; Rutala, W.A.; Miller, M.B.; Huslage, K.; Sickbert-Bennett, E. Role of hospital surfaces in the transmission of emerging health care-associated pathogens: Norovirus, Clostridium difficile, and Acinetobacter spp. Am. J. Infect. Control 2010, 38, S25–S33. [Google Scholar] [CrossRef] [PubMed]
  7. Wißmann, J.E.; Kirchhoff, L.; Brüggemann, Y.; Todt, D.; Steinmann, J.; Steinmann, E. Persistence of Pathogens on Inanimate Surfaces: A Narrative Review. Microorganisms 2021, 9, 343. [Google Scholar] [CrossRef]
  8. Laganà, P.; Melcarne, L.; Delia, S. Acinetobacter baumannii and endocarditis, rare complication but important clinical relevance. Int. J. Cardiol. 2015, 187, 678–679. [Google Scholar] [CrossRef] [PubMed]
  9. Facciolà, A.; Pellicanò, G.F.; Visalli, G.; Paolucci, I.A.; Venanzi Rullo, E.; Ceccarelli, M.; D’Aleo, F.; Di Pietro, A.; Squeri, R.; Nunnari, G.; et al. The role of the hospital environment in the healthcare-associated infections: A general review of the literature. Eur. Rev. Med. Pharmacol. Sci. 2019, 23, 1266–1278. [Google Scholar] [PubMed]
  10. Laganà, P.; Delia, S.; Coniglio, M.A. Cardiology Rehabilitation wards: Isolation of Staphylococcus capitis. A risk of infection to be kept under control. Cor Vasa 2019, 61, E79–E81. [Google Scholar] [CrossRef]
  11. Khalid, A.; Ahmad, P.; Alharthi, A.I.; Muhammad, S.; Khandaker, M.U.; Faruque, M.R.I.; Din, I.U.; Alotaibi, M.A.; Khan, A. Synergistic effects of Cu-doped ZnO nanoantibiotic against Gram-positive bacterial strains. PLoS ONE 2021, 16, e0251082. [Google Scholar] [CrossRef]
  12. Dadi, R.; Azouani, R.; Traore, M.; Mielcarek, C.; Kanaev, A. Antibacterial activity of ZnO and CuO nanoparticles against gram positive and gram negative strains. Mater. Sci. Eng. C Mater. Biol. Appl. 2019, 104, 109968. [Google Scholar] [CrossRef] [PubMed]
  13. Staroń, A.; Długosz, O. Antimicrobial properties of nanoparticles in the context of advantages and potential risks of their use. J. Environ. Sci. Health A Tox. Hazard. Subst. Environ. Eng. 2021, 56, 680–693. [Google Scholar] [CrossRef]
  14. Chen, Q.; Xue, Y.; Sun, J. Kupfer cell-mediated hepatic injury induced by silica nanoparticles in vitro and in vivo. Int. J. Nanomed. 2013, 8, 1129–1140. [Google Scholar]
  15. Besinis, A.; De Peralta, T.; Handy, R.D. The antibacterial effects of silver, titanium dioxide and silica dioxide nanoparticles compared to the dental disinfectant chlorhexidine on Streptococcus mutans using a suite of bioassays. Nanotoxicology 2014, 8, 1–16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Khalid, A.; Ahmad, P.; Alharthi, A.I.; Muhammad, S.; Khandaker, M.U.; Rehman, M.; Faruque, M.R.I.; Din, I.U.; Alotaibi, M.A.; Alzimami, K.; et al. Structural, Optical and Antibacterial Efficacy of Pure and Zinc-Doped Copper Oxide against Pathogenic Bacteria. Nanomaterials 2021, 11, 451. [Google Scholar] [CrossRef]
  17. Zannella, C.; Shinde, S.; Vitiello, M.; Falanga, A.; Galdiero, E.; Fahmi, A.; Santella, B.; Nucci, L.; Gasparro, R.; Galdiero, M.; et al. Antibacterial Activity of Indolicidin-Coated Silver Nanoparticles in Oral Disease. Appl. Sci. 2020, 10, 1837. [Google Scholar] [CrossRef] [Green Version]
  18. Buzea, C.; Pacheco, I.I.; Robbie, K. Nanomaterials and nanoparticles: Sources and toxicity. Biointerphases 2007, 2, MR17–MR71. [Google Scholar] [CrossRef] [Green Version]
  19. Kang, S.; Herzberg, M.; Rodrigues, D.F.; Elimelech, M. Antibacterial effects of carbon nanotubes: Size does matter! Langmuir 2008, 24, 6409–6413. [Google Scholar] [CrossRef]
  20. Hajipour, M.J.; Fromm, K.M.; Ashkarran, A.A.; de Aberasturi, D.J.; de Larramendi, I.R.; Rojo, T.; Serpooshan, V.; Parak, W.J.; Mahmoudi, M. Antibacterial properties of nanoparticles. Trends Biotechnol. 2012, 30, 499–511. [Google Scholar] [CrossRef] [Green Version]
  21. Trovato, M.C.; Andronico, D.; Sciacchitano, S.; Ruggeri, R.M.; Picerno, I.; di Pietro, A.; Visalli, G. Nanostructures: Between natural environment and medical practice. Rev. Environ. Health 2018, 33, 305–317. [Google Scholar] [CrossRef]
  22. Iannazzo, D.; Piperno, A.; Pistone, A.; Grassi, G.; Galvagno, S. Recent advances in carbon nanotubes as delivery systems for anticancer drugs. Curr. Med. Chem. 2013, 20, 1333–1354. [Google Scholar] [CrossRef] [PubMed]
  23. Gupta, T.K.; Budarapu, P.R.; Chappidi, S.R.; YB, S.S.; Paggi, M.; Bordas, S.P. Advances in Carbon Based Nanomaterials for Bio-Medical Applications. Curr. Med. Chem. 2019, 26, 6851–6877. [Google Scholar] [CrossRef]
  24. Facciolà, A.; Visalli, G.; la Maestra, S.; Ceccarelli, M.; D’Aleo, F.; Nunnari, G.; Pellicanò, G.F.; di Pietro, A. Carbon nanotubes and central nervous system: Environmental risks, toxicological aspects and future perspectives. Environ. Toxicol. Pharmacol. 2019, 65, 23–30. [Google Scholar] [CrossRef] [PubMed]
  25. Teixeira-Santos, R.; Gomes, M.; Gomes, L.C.; Mergulhão, F.J. Antimicrobial and anti-adhesive properties of carbon nanotube-based surfaces for medical applications: A systematic review. iScience 2020, 24, 102001. [Google Scholar] [CrossRef]
  26. Olivi, M.; Zanni, E.; de Bellis, G.; Talora, C.; Sarto, M.S.; Palleschi, C.; Flahaut, E.; Monthioux, M.; Rapino, S.; Uccelletti, D.; et al. Inhibition of microbial growth by carbon nanotube networks. Nanoscale 2013, 5, 9023–9029. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Al-Jumaili, A.; Alancherry, S.; Bazaka, K.; Jacob, M.V. Review on the Antimicrobial Properties of Carbon Nanostructures. Materials 2017, 10, 1066. [Google Scholar] [CrossRef]
  28. Mocan, T.; Matea, C.T.; Pop, T.; Mosteanu, O.; Buzoianu, A.D.; Suciu, S.; Puia, C.; Zdrehus, C.; Iancu, C.; Mocan, L. Carbon nanotubes as anti-bacterial agents. Cell. Mol. Life Sci. 2017, 74, 3467–3479. [Google Scholar] [CrossRef]
  29. Pattnaik, S.; Asad, S.; Busi, S. Novel Nanotherapeutics as Next-generation Anti-infective Agents: Current Trends and Future Prospectives. Curr. Drug Discov. Technol. 2020, 17, 457–468. [Google Scholar] [CrossRef]
  30. Gurunathan, S.; Han, J.W.; Dayem, A.A.; Eppakayala, V.; Kim, J.H. Oxidative stress-mediated antibacterial activity of graphene oxide and reduced graphene oxide in Pseudomonas aeruginosa. Int. J. Nanomed. 2012, 7, 5901–5914. [Google Scholar] [CrossRef] [Green Version]
  31. Shvedova, A.A.; Pietroiusti, A.; Fadeel, B.; Kagan, V.E. Mechanisms of carbon nanotube-induced toxicity: Focus on oxidative stress. Toxicol. Appl. Pharmacol. 2012, 261, 121–133. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Manke, A.; Wang, L.; Rojanasakul, Y. Mechanisms of nanoparticle-induced oxidative stress and toxicity. Biomed. Res. Int. 2013, 2013, 942916. [Google Scholar] [CrossRef] [Green Version]
  33. Shaikh, S.; Nazam, N.; Rizvi, S.M.D.; Ahmad, K.; Baig, M.H.; Lee, E.J.; Choi, I. Mechanistic Insights into the Antimicrobial Actions of Metallic Nanoparticles and Their Implications for Multidrug Resistance. Int. J. Mol. Sci. 2019, 20, 2468. [Google Scholar] [CrossRef] [Green Version]
  34. Chen, M.; Sun, Y.; Liang, J.; Zeng, G.; Li, Z.; Tang, L.; Zhu, Y.; Jiang, D.; Song, B. Understanding the influence of carbon nanomaterials on microbial communities. Environ. Int. 2019, 126, 690–698. [Google Scholar] [CrossRef]
  35. Yang, C.; Mamouni, J.; Tang, Y.; Yang, L. Antimicrobial activity of single-walled carbon nanotubes: Length effect. Langmuir 2010, 26, 16013–16019. [Google Scholar] [CrossRef]
  36. Jiang, T.; Amadei, C.A.; Gou, N.; Lin, Y.; Lan, J.; Vecitis, C.D.; Gu, A.Z. Toxicity of Single-Walled Carbon Nanotubes (SWCNTs): Effect of Lengths, Functional Groups and Electronic Structures Revealed by a Quantitative Toxicogenomics Assay. Environ. Sci. Nano 2020, 7, 1348–1364. [Google Scholar] [CrossRef]
  37. Sivaraj, D.; Vijayalakshmi, K. Preferential killing of bacterial cells by hybrid carbon nanotube-MnO2 nanocomposite synthesized by novel microwave assisted processing. Mater. Sci. Eng. C Mater. Biol. Appl. 2017, 81, 469–477. [Google Scholar] [CrossRef]
  38. Saleemi, M.A.; Fouladi, M.H.; Yong, P.V.C.; Wong, E.H. Elucidation of Antimicrobial Activity of Non-Covalently Dispersed Carbon Nanotubes. Materials 2020, 13, 1676. [Google Scholar] [CrossRef] [Green Version]
  39. Xin, Q.; Shah, H.; Nawaz, A.; Xie, W.; Akram, M.Z.; Batool, A.; Tian, L.; Jan, S.U.; Boddula, R.; Guo, B.; et al. Antibacterial Carbon-Based Nanomaterials. Adv. Mater. 2019, 31, e1804838. [Google Scholar] [CrossRef]
  40. Kang, S.; Pinault, M.; Pfefferle, L.D.; Elimelech, M. Single-walled carbon nanotubes exhibit strong antimicrobial activity. Langmuir 2007, 23, 8670–8673. [Google Scholar] [CrossRef]
  41. Visalli, G.; Bertuccio, M.P.; Iannazzo, D.; Piperno, A.; Pistone, A.; di Pietro, A. Toxicological assessment of multi-walled carbon nanotubes on A549 human lung epithelial cells. Toxicol. Vitro 2015, 29, 352–362. [Google Scholar] [CrossRef] [PubMed]
  42. Visalli, G.; Currò, M.; Iannazzo, D.; Pistone, A.; Pruiti Ciarello, M.; Acri, G.; Testagrossa, B.; Bertuccio, M.P.; Squeri, R.; di Pietro, A. In Vitro assessment of neurotoxicity and neuroinflammation of homemade MWCNTs. Environ. Toxicol. Pharmacol. 2017, 56, 121–128. [Google Scholar] [CrossRef]
  43. Pistone, A.; Ferlazzo, A.; Lanza, M.; Milone, C.; Iannazzo, D.; Piperno, A.; Piperopoulos, E.; Galvagno, S. Morphological modification of MWCNT functionalized with HNO3/H2SO4 mixtures. J. Nanosci. Nanotechnol. 2012, 12, 5054–5060. [Google Scholar] [CrossRef]
  44. Visalli, G.; Facciolà, A.; Iannazzo, D.; Piperno, A.; Pistone, A.; di Pietro, A. The role of the iron catalyst in the toxicity of multi-walled carbon nanotubes (MWCNTs). J. Trace Elem. Med. Biol. Sci. 2017, 43, 153–160. [Google Scholar] [CrossRef]
  45. Laganà, P.; Caruso, G.; Corsi, I.; Bergami, E.; Venuti, V.; Majolino, D.; La Ferla, R.; Azzaro, M.; Cappello, S. Do plastics serve as a possible vector for the spread of antibiotic resistance? First insights from bacteria associated to a polystyrene piece from King George Island (Antarctica). Int. J. Hyg. Environ. Health 2019, 222, 89–100. [Google Scholar] [CrossRef] [PubMed]
  46. Bauer, A.W.; Kirby, W.M.; Sherris, J.C.; Turck, M. Antibiotic susceptibility testing by a standardized single disk method. Am. J. Clin. Pathol. 1966, 45, 493–496. [Google Scholar] [CrossRef]
  47. Laganà, P.; Caruso, G.; Minutoli, E.; Zaccone, R.; Delia, S. Susceptibility to antibiotics of Vibrio spp. and Photobacterium damsela ssp. piscicida strains isolated from Italian aquaculture farms. New Microbiol. 2011, 34, 53–63. [Google Scholar]
  48. Laganà, P.; Votano, L.; Caruso, G.; Azzaro, M.; Lo Giudice, A.; Delia, S. Bacterial isolates from the Arctic region (Pasvik River, Norway): Assessment of biofilm production and antibiotic susceptibility profiles. Environ. Sci. Pollut. Res. Int. 2018, 25, 1089–1102. [Google Scholar] [CrossRef] [PubMed]
  49. European Committee on Antimicrobial Susceptibility Testing (EUCAST). Development and Validation of EUCAST Disk Diffusion Breakpoints. 2021. Available online: https://www.eucast.org/ast_of_bacteria/calibration_and_validation/ (accessed on 16 April 2021).
  50. Clinical and Laboratory Standard Institute (CLSI). Performance Standards for Antimicrobial Susceptibility Testing, 30th Edition. 2020. Available online: https://www.nih.org.pk/wp-content/uploads/2021/02/CLSI-2020.pdf (accessed on 16 April 2021).
  51. Xia, J.; Gao, J.; Tang, W. Nosocomial infection and its molecular mechanisms of antibiotic resistance. Biosci. Trends 2016, 10, 14–21. [Google Scholar] [CrossRef] [Green Version]
  52. Li, X.Z.; Plésiat, P.; Nikaido, H. The challenge of efflux-mediated antibiotic resistance in Gram-negative bacteria. Clin. Microbiol. Rev. 2015, 28, 337–418. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Guerin, F.; Isnard, C.; Cattoir, V.; Giard, J.C. Complex Regulation Pathways of AmpC-Mediated beta-Lactam Resistance in Enterobacter cloacae Complex. Antimicrob. Agents Chemother. 2015, 59, 7753–7761. [Google Scholar] [CrossRef] [Green Version]
  54. Tondi, D.; Cross, S.; Venturelli, A.; Costi, M.P.; Cruciani, G.; Spyrakis, F. Decoding the structural basis for carbapenem hydrolysis by class A—Lactamases: Fishing for a pharmacophore. Curr. Drug Targets 2016, 17, 983–1005. [Google Scholar] [CrossRef]
  55. Zykov, I.N.; Sundsfjord, A.; Smabrekke, L.; Samuelsen, O. The antimicrobial activity of mecillinam, nitrofurantoin, temocillin and fosfomycin and comparative analysis of resistance patterns in a nationwide collection of ESBL-producing Escherichia coli in Norway 2010–2011. Infect. Dis. 2016, 48, 99–107. [Google Scholar] [CrossRef]
  56. Srinivasan, V.B.; Venkataramaiah, M.; Mondal, A.; Vaidyanathan, V.; Govil, T.; Rajamohan, G. Functional characterization of a novel outer membrane porin KpnO, regulated by PhoBR two-component system in Klebsiella pneumoniae NTUH-K2044. PLoS ONE 2012, 7, e41505. [Google Scholar] [CrossRef] [Green Version]
  57. Wang, D.; Seeve, C.; Pierson, L.S.; Pierson, E.A. Transcriptome profiling reveals links between ParS/ParR, MexEF-OprN, and quorum sensing in the regulation of adaptation and virulence in Pseudomonas aeruginosa. BMC Genom. 2013, 14, 618. [Google Scholar] [CrossRef] [Green Version]
  58. Xia, J.; Gao, J.; Kokudo, N.; Hasegawa, K.; Tang, W. Methicillin-resistant Staphylococcus aureus antibiotic resistance and virulence. Biosci. Trends. 2013, 7, 113–121. [Google Scholar] [PubMed]
  59. Li, P.; Poon, Y.F.; Li, W.; Zhu, H.Y.; Yeap, S.H.; Cao, Y.; Qi, X.; Zhou, C.; Lamrani, M.; Beuerman, R.W.; et al. A polycationic antimicrobial and biocompatible hydrogel with microbe membrane suctioning ability. Nat. Mater. 2011, 10, 149–156. [Google Scholar] [CrossRef] [PubMed]
  60. Bing, W.; Sun, H.; Yan, Z.; Ren, J.; Qu, X. Programmed bacteria death induced by carbon dots with different surface charge. Small 2016, 12, 4713–4718. [Google Scholar] [CrossRef]
  61. Dwyer, D.J.; Camacho, D.M.; Kohanski, M.A.; Callura, J.M.; Collins, J.J. Antibiotic-induced bacterial cell death exhibits physiological and biochemical hallmarks of apoptosis. Mol. Cell 2012, 46, 561–572. [Google Scholar] [CrossRef] [Green Version]
  62. Visalli, G.; Facciolà, A.; Currò, M.; Laganà, P.; La Fauci, V.; Iannazzo, D.; Pistone, A.; di Pietro, A. Mitochondrial Impairment Induced by Sub-Chronic Exposure to Multi-Walled Carbon Nanotubes. Int. J. Environ. Res. Public Health 2019, 16, 792. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Di Pietro, A.; Baluce, B.; Visalli, G.; La Maestra, S.; Micale, R.; Izzotti, A. Ex vivo study for the assessment of behavioral factor and gene polymorphisms in individual susceptibility to oxidative DNA damage metals-induced. Int. J. Hyg. Environ. Health 2011, 214, 210–218. [Google Scholar] [CrossRef]
  64. Otsuka, K.; Yamada, K.; Taquahashi, Y.; Arakaki, R.; Ushio, A.; Saito, M.; Yamada, A.; Tsunematsu, T.; Kudo, Y.; Kanno, J.; et al. Long-term polarization of alveolar macrophages to a profibrotic phenotype after inhalation exposure to multi-wall carbon nanotubes. PLoS ONE 2018, 13, e0205702. [Google Scholar] [CrossRef]
  65. Bussy, C.; Al-Jamal, K.T.; Boczkowski, J.; Lanone, S.; Prato, M.; Bianco, A.; Kostarelos, K. Microglia Determine Brain Region-Specific Neurotoxic Responses to Chemically Functionalized Carbon Nanotubes. ACS Nano 2015, 9, 7815–7830. [Google Scholar] [CrossRef]
  66. Gholamine, B.; Karimi, I.; Salimi, A.; Mazdarani, P.; Becker, L.A. Neurobehavioral toxicity of carbon nanotubes in mice. Toxicol. Ind. Health 2017, 33, 340–350. [Google Scholar] [CrossRef] [PubMed]
Scheme 1. Mean percentages of antibiotic resistance to the tested strains. (A). P. aeruginosa; (B). K. Pneumoniae; (C). E. coli; (D). S. aureus.
Scheme 1. Mean percentages of antibiotic resistance to the tested strains. (A). P. aeruginosa; (B). K. Pneumoniae; (C). E. coli; (D). S. aureus.
Ijerph 18 09310 sch001
Figure 1. Values of the average percentage change (Δ%) after treatment at 24 and 48 h against the strains, divided into Gram-positive and Gram-negative bacteria.
Figure 1. Values of the average percentage change (Δ%) after treatment at 24 and 48 h against the strains, divided into Gram-positive and Gram-negative bacteria.
Ijerph 18 09310 g001
Figure 2. Correlation between the percentage increase of MWCNT antimicrobial activity and the R/S ratio of the studied bacterial strains.
Figure 2. Correlation between the percentage increase of MWCNT antimicrobial activity and the R/S ratio of the studied bacterial strains.
Ijerph 18 09310 g002
Table 1. Bacterial strains used in the experiment.
Table 1. Bacterial strains used in the experiment.
Gram-Positive Strains (n)Gram-Negative Strains (n)
Staphylococcus aureus (12)Pseudomonas aeruginosa (7)
Klebsiella pneumoniae (3)
Klebsiella oxytoca (4)
Proteus mirabilis (1)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Laganà, P.; Visalli, G.; Facciolà, A.; Ciarello, M.P.; Laganà, A.; Iannazzo, D.; Di Pietro, A. Is the Antibacterial Activity of Multi-Walled Carbon Nanotubes (MWCNTs) Related to Antibiotic Resistance? An Assessment in Clinical Isolates. Int. J. Environ. Res. Public Health 2021, 18, 9310. https://doi.org/10.3390/ijerph18179310

AMA Style

Laganà P, Visalli G, Facciolà A, Ciarello MP, Laganà A, Iannazzo D, Di Pietro A. Is the Antibacterial Activity of Multi-Walled Carbon Nanotubes (MWCNTs) Related to Antibiotic Resistance? An Assessment in Clinical Isolates. International Journal of Environmental Research and Public Health. 2021; 18(17):9310. https://doi.org/10.3390/ijerph18179310

Chicago/Turabian Style

Laganà, Pasqualina, Giuseppa Visalli, Alessio Facciolà, Marianna Pruiti Ciarello, Antonio Laganà, Daniela Iannazzo, and Angela Di Pietro. 2021. "Is the Antibacterial Activity of Multi-Walled Carbon Nanotubes (MWCNTs) Related to Antibiotic Resistance? An Assessment in Clinical Isolates" International Journal of Environmental Research and Public Health 18, no. 17: 9310. https://doi.org/10.3390/ijerph18179310

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop