Next Article in Journal
Profound Modification of Fatty Acid Profile and Endocannabinoid-Related Mediators in PPARα Agonist Fenofibrate-Treated Mice
Next Article in Special Issue
Optimizing Axial and Peripheral Substitutions in Si-Centered Naphthalocyanine Dyes for Enhancing Aqueous Solubility and Photoacoustic Signal Intensity
Previous Article in Journal
Employing Engineered Enolase Promoter for Efficient Expression of Thermomyces lanuginosus Lipase in Yarrowia lipolytica via a Self-Excisable Vector
Previous Article in Special Issue
Study on the Optimal Treatment Condition Control of Photothermal Therapy under Various Cooling Time Ratios of Lasers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of Antimicrobial Photodynamic Therapy for Inactivation of Acinetobacter baumannii Biofilms

by
Irina Buchovec
1,*,
Enrika Vyčaitė
2,
Kazimieras Badokas
1,
Edita Sužiedelienė
2 and
Saulius Bagdonas
3
1
Institute of Photonics and Nanotechnology, Faculty of Physics, Vilnius University, Sauletekio av. 3, LT-10222 Vilnius, Lithuania
2
Institute of Biosciences, Life Sciences Center, Vilnius University, Sauletekio av. 7, LT-10257 Vilnius, Lithuania
3
Laser Research Center, Faculty of Physics, Vilnius University, Sauletekio av. 10, LT-10223 Vilnius, Lithuania
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2023, 24(1), 722; https://doi.org/10.3390/ijms24010722
Submission received: 12 December 2022 / Revised: 24 December 2022 / Accepted: 28 December 2022 / Published: 31 December 2022
(This article belongs to the Special Issue Photodynamic Therapy and Photodetection)

Abstract

:
Acinetobacter baumannii is a dangerous hospital pathogen primarily due to its ability to form biofilms on different abiotic and biotic surfaces. The present study investigated the effect of riboflavin- and chlorophyllin-based antimicrobial photodynamic therapy, performed with near-ultraviolet or blue light on the viability of bacterial cells in biofilms and their structural stability, also determining the extent of photoinduced generation of intracellular reactive oxygen species as well as the ability of A. baumannii to form biofilms after the treatment. The efficacy of antimicrobial photodynamic therapy was compared with that of light alone and the role of the photosensitizer type on the photosensitization mechanism was demonstrated. We found that the antibacterial effect of riboflavin-based antimicrobial photodynamic therapy depends on the ability of photoactivated riboflavin to generate intracellular reactive oxygen species but does not depend on the concentration of riboflavin and pre-incubation time before irradiation. Moreover, our results suggest a clear interconnection between the inactivation efficiency of chlorophyllin-based antimicrobial photodynamic therapy and the sensitivity of A. baumannii biofilms to used light. In summary, all the analyzed results suggest that riboflavin-based antimicrobial photodynamic therapy and chlorophyllin-based antimicrobial photodynamic therapy have the potential to be applied as an antibacterial treatment against A. baumannii biofilms or as a preventive measure against biofilm formation.

1. Introduction

Bacterial resistance to antibiotics is one of the most important medical and scientific problems of our time [1,2]. A significant threat comes from the pathogens of the clinically important ESKAPE group (Enterococcus faecium, Staphylococcus aureus, Klebsiella pneumonia, Acinetobacter baumannii, Pseudomonas aeruginosa and Enterobacter spp.), mostly represented by nosocomial infection agents, which are associated with the highest risk of mortality and increased healthcare costs [3].
One of the most problematic infection agents of this group is the Gram-negative opportunistic pathogen A. baumannii, accounting for about 2% of all nosocomial infections in the USA and Europe [4]. The A. baumannii-associated infections are prevalent in intensive care units and are characterized by hospital outbreaks [5]. Immune-compromised and injured patients are the most susceptible to A. baumannii infections, which are difficult to treat due to the resistance of A. baumannii to most antibiotic classes [6]. Multidrug-resistant (MDR) and extensively drug-resistant (XDR) A. baumannii clones have spread in clinical settings worldwide, thereby limiting antibiotic treatment and raising urgent need for new antimicrobials and treatment strategies [7].
A. baumannii persistence and spread in the hospital environment are largely attributed to its ability to form biofilms on biotic (human skin, mucous membranes) and abiotic (plastic, glass, metal) surfaces [6]. Biofilms are communities of bacterial cells attached to the surface and surrounded by self-produced extracellular exopolysaccharide matrix [8]. Biofilms contribute to protecting bacteria from antibacterial drugs, harsh environmental conditions, and host immune defense [4].
Antimicrobial photodynamic therapy (aPDT) against bacterial biofilms has gained increased attention recently as an alternative strategy to inactivate bacterial pathogens [9]. aPDT is based on the interaction of non-toxic photosensitizer (PS), molecular oxygen, and light of suitable wavelengths to match the PS absorption. After photoexcitation, the PS interacts with molecular oxygen and generates reactive oxygen species (ROS) such as superoxide, hydrogen peroxide, hydroxyl radicals, and reactive singlet oxygen (1O2) that initiate cellular damage, thereby destroying the bacterial cells [10,11]. The aPDT aims at multiple biofilm targets, such as proteins, lipids, DNA, and extracellular polymeric substance (EPS). ROS generated upon the photoactivation of the PS attack adjacent targets present within the biofilm matrix, inside and outside the bacterial cells [8,9].
aPDT has several advantages over antibiotics, including the ability to inactivate multiple cellular targets, and the lack of resistance to the treatment [12]. The efficiency of aPDT applied for inactivation of biofilms depends on the numerous factors but especially on physicochemical properties of the PS used, the type of bacteria, the matrix composition, and also on the irradiation conditions [9,13].
In this study, we aimed to investigate the efficiency of aPDT based on natural photosensitizers, riboflavin- and chlorophyllin, against A. baumannii biofilms with the focus on the role of applied irradiation, regimen of incubation with the PS, and the ability of the PS to generate intracellular ROS.

2. Results

2.1. Inactivation of Planktonic A. baumannii Cells with aPDT

We first evaluated the sensitivity of A. baumanni planktonic cells to aPDT and to light alone. The effect of LED light with a peak at 402 nm or 440 nm on the viability of planktonic cells was assessed at 35 mW/cm2 irradiance. The irradiance doses ranged from 21 to 84 J/cm2 (Table 1). The effect of 440 nm blue light on A. baumannii viability was negligible in the whole dose range applied (Figure 1), whereas exposure to 402 nm near-UV light at doses higher than 50 J/cm2 progressively decreased A. baumannii counts yielding reduction by 1.8 log10 after applied 84 J/cm2 dose.
aPTD treatment using riboflavin (RF) and chlorophyllin (Chl) dyes efficiently inactivated A. baumannii planktonic cells, as shown in Figure 1. A. baumannii was found to be more sensitive to riboflavin-based aPDT (RF-aPDT) than to chlorophyllin-based aPDT (Chl-aPDT), especially in the range of the lower irradiance doses. The application of RF-aPTD and Chl-PTD with a higher, 84 J/cm2 irradiance dose resulted in 6.7 log10 and 5.7 log10 inactivation, respectively (Figure 1). The incubation for 40 min with 15 µM Chl or 11 µM RF showed no dark toxicity on the viability of A. baumannii.

2.2. Intracellular ROS Generation

To compare the pro-oxidant effect of aPDT with irradiation alone and also to ascertain the role of the PS type on the photoinactivation mechanism, we evaluated the ability of Chl and RF PS to generate ROS intracellularly. Intracellular ROS levels were measured in live bacterial cells by using 2′,7′ -dichlorofluorescein-diacetate (DCFH-DA) assay as described in Section 4.5. Generation of ROS was observed as an increase in 2′,7′-dichlorofluorescein (DCF) fluorescence intensity (IFL) after irradiation of A. baumannii cells in the presence or absence of the PS (Figure 2). RF-aPDT produced the highest peak fluorescence signal, while that in the case of Chl-aPDT was about 1.3-fold lower. On the other hand, exposure of A. baumannii samples to 440 nm LED light alone resulted in the lowest DCF signal—IFL at the peak was about 53% of that detected after RF-aPDT. In contrast, the DCF peak fluorescence signal detected after irradiation with 402 nm light alone, reached as much as 91% of the signal measured after Chl-aPDT (Figure 2).

2.3. A. baumannii Biofilm Formation after aPDT Treatment

In order to access the impact of aPTD as a preventive against A. baumannii biofilms, the capacity of planktonic cells to form biofilms after RF-aPDT and Chl-aPDT was tested at the beginning. Formed biofilms were quantified using crystal violet (CV) assay as described in Section 4.6. As seen in Figure 3, both exposure to LED light and aPDT decreased the capacity of A. baumannii to form biofilms in a dose-dependent manner. Thus, aPDT treatment with irradiance doses ranging from 21 J/cm2 to 63 J/cm2 reduced the OD580/600 value from about 1.6-fold for the lowest dose to 5-fold for the highest dose after RF-aPTD and from 1.5-fold to 2.6-fold after Chl-aPTD (Figure 3).
The irradiation of A. baumannii planktonic culture with LED light alone had less effect on the subsequent formation of biofilms compared to RF-aPDT and Chl-aPDT, albeit it reduced the OD580/600 value by 1.4-fold (in the case of 440 nm) and 1.6-fold (402 nm) at 63 J/cm2 irradiance dose, as compared to non-irradiated control samples.

2.4. Inactivation of A. baumannii Biofilms with RF-aPDT and Chl-PDT

The efficacy of aPDT using RF and Chl as sensitizers for the inactivation of A. baumannii biofilms was investigated. First, we evaluated the dark toxicity of RF and Chl. Biofilms were incubated in the dark with 11 µM or 110 µM RF and 15 µM or 150 µM Chl at room temperature for different periods (Table S1). Higher concentrations of the PS were included since bacterial biofilms are known to be more resistant than planktonic cells to antimicrobial treatments [9,14]. After incubation, bacterial CFUs were determined upon detachment of the biofilm cells as described in the Section 4.7. It has been found that incubation with the PS even at 10-fold higher concentration alone had no impact on A. baumannii biofilms, indicating that the PS was nontoxic without irradiation (Table S1).
Next, photoinactivation of A. baumannii biofilms after exposure to 402 nm and 440 nm LED light alone or after Chl-aPDT and RF-aPDT treatment was investigated by applying higher irradiance doses (Figure 4). The viability of A. baumannii biofilm cells decreased by 0.9 log10 and 1.9 log10 after exposure to 126 J/cm2 and to 189 J/cm2 doses of 402 nm light, respectively. The highest applied irradiance dose of 252 J/cm2 resulted in a viability loss by 4.8 log10. The effect of irradiation with 440 nm light was less pronounced and yielded reduction in CFUs by 1.7 log10 at the highest 252 J/cm2 dose applied (Figure 4).
The combination of light and 11 µM RF or 15 µM Chl had a modest bactericidal effect on the biofilm cells compared to the light alone and resulted in a CFU reduction by 5.6 log10 and 2.3 log10, respectively, at 252 J/cm2 dose.
To improve the efficacy of aPDT treatment on A. baumannii biofilms, we used the higher concentrations of PSs and added a step of preincubation with the PS to the aPDT regimen. It has been reported that preincubation of bacterial biofilms with the PS before irradiation can increase the efficiency of aPDT, as more PS can penetrate the cells in the biofilms [15,16,17]. In the presented experiments, an increase in the efficiency of aPDT was observed with a higher Chl concentration, but not at the highest irradiation dose used. The A. baumannii CFU number decreased by 3.5 log10 after the photoactivation of 150 µM Chl with 402 nm light at 126 J/cm2 (Figure 5B). As can be seen in Figure 5A, application of a higher concentration of RF (110 μM) had no additional impact on the efficiency of RF-aPDT against the biofilms as compared to 11 μM RF-aPDT (Figure 4), and reduction in CFU of a similar range was observed at all irradiance doses used. The preincubation step using 110 μM RF had no impact on the efficiency of RF-aPDT compared to the non-preincubated samples, whereas in the case of Chl-aPDT it resulted in a reduced CFU loss as compared to the non-preincubated biofilm samples (Figure 5B).

2.5. Quantification of Biofilms after aPDT

To quantify the remaining A. baumannii biofilms after Chl-aPDT and RF-aPDT treatment using 110 μM RF or 150 μM Chl and exposing to 126 J/cm2, CV assay was applied as described in Section 4.6. As shown in Figure 6, for the chosen combinations RF-aPDT had a higher anti-biofilm effect than Chl-aPDT resulting in an 8-fold reduction in the OD580/600 value compared to a 1.9-fold reduction in the latter case. The results also demonstrated no significant difference in the damaging effect on the biofilms exposed with 402 nm and 440 nm LED light alone or after 1 h incubation PS in the dark compared to the control samples (Figure 6).

3. Discussion

Bacterial biofilms cause up to 80% of chronic and recurrent infections, and their resistance to antibiotics is 10–1000 times higher than planktonic cells [14]. Since A. baumannii is known for multiple resistance mechanisms and a strong capacity to form biofilms [5], the available options for the pharmacological treatment of infections caused by these pathogens are limited. The efficiency of aPDT is known to strongly depend on the physicochemical properties of the chosen photosensitizer [9]. The PS of different chemical classes (phenothiazinium dyes, xanthene dyes, tetrapyrrolic compounds, fullerenes, and flavins) has been used to inactivate A. baumannii [18]. Some studies have demonstrated a good bactericidal effect against A. baumannii planktonic cells; however, only a few studies have been focused on biofilms [18].
Natural flavonoid RF and tetrapyrrole Chl have also been considered as a potential PS for the antimicrobial treatment of opportunistic pathogens [19,20]. Our previous study showed the susceptibility of planktonic A. baumannii to RF-aPDT and Chl- aPDT [21]. In the present study, we show that the enhanced bactericidal effect of aPDT on A. baumannii planktonic cells and their reduced capacity to form biofilms could be achieved by increasing the irradiance dose. This is an important observation, implying that the photosensitization of bacterial cells grown in the planktonic population or at the initial phase of attachment to the surface may minimize the likelihood of subsequent formation of the more resistant biofilm population.
Remarkably, the exposure of the A. baumannii planktonic population to 402 nm LED light alone showed a stronger bactericidal effect than 440 nm LED light. In general, the sensitivity of A. baumannii to the blue or near-UV light can be explained by the fact that bacteria possess endogenous photosensitizing chromophores such as coproporphyrin III, which, after absorbing light, exerts an antibacterial effect by inducing ROS-mediated cytotoxicity in bacterial cells [22]. While it is implied that ROS formed during irradiation (by light alone and in combination with the PS) play a significant role in bacterial inactivation, there is no clear answer that could explain the extent of the antibacterial effect of the blue light. The role of photoreceptors, chemoreceptors, and DNA repair-related genes in eliciting protective pathways against oxidative stress or modulating bacterial physiological characteristics under blue light irradiation could also be important [23].
In this study, we compared the ability of Chl and RF after photoactivation with near-UV and blue LED light (402 nm and 440 nm, respectively) to generate intracellular ROS in A. baumannii with the photoinduced ROS generation by light alone. The measurement of intracellular ROS in bacteria was performed using the 2′,7′-dichlorofluorescein-diacetate (DCFH-DA) staining method [24]. This method is usually used to detect the total intracellular ROS, including hydroxyl radicals (•OH), hydrogen peroxide (H2O2), and peroxyl radicals (ROO•) [25]. The fluorescence signal of the produced DCF is directly proportional to the amount of ROS generated in cells. The highest DCF fluorescence signal was obtained after RF-aPDT, which indicates that RF can enter planktonic A. baumannii cells and generate higher amounts of intracellular ROS in irradiated bacteria. It is important to note that the extent of the intracellular ROS generation in A. baumannii boosted the antibacterial effect of the photoactivated RF, but not that of 440 nm LED light irradiation alone at 42 J/cm2. This could indicate that bacterial cells are capable to cope with ROS generated by light alone and imply the dependence of the damage on the localization of the PS. These results are supported by other studies [26,27,28] demonstrating that the photoactivated RF does produce ROS, which leads to inactivation of planktonic bacteria. Khan et al. [26] demonstrated a significant increase in the DCF fluorescence level in Escherichia coli cells treated with 50 µM RF and white light (27.8 J/cm2), indicating intracellular ROS formation. Other authors [27] found that 50 µM RF photoactivated with the blue 450 nm light increased the DCF fluorescence intensity up to 16.8-fold in E. coli cells compared to the control, which together with the light only group showed no fluorescence increase. Kim et al. [28] demonstrated a similar fluorescence increase in E. coli cells when the ROS generation upon treatment with 50 µM RF and blue LED light (30 mJ/cm2) was about 16 times higher than in control.
In contrast, the intracellular ROS generation reflected by the DCF fluorescence signal after Chl-aPDT was 1.5-fold lower compared to RF-aPDT and was comparable to that obtained after irradiation with 402 nm LED light only. These results imply that Chl does not penetrate into the bacterial cells, and during Chl-aPDT the cellular damage is mainly caused by externally generated ROS, presumably, the type II reaction resulting in the formation of singlet oxygen. This is consistent with other studies, where negatively charged PS (some porphyrins and Rose Bengal) in suspensions have been applied to effectively inactivate the Gram-negative pathogens such as Salmonella enterica [29] or E. coli [30,31].
The effect of aPDT on the biofilms strongly depends on the interaction between the PS and the matrix [9]. The PS could be blocked by the matrix EPS and may not reach the cells in the biofilms. Otherwise, some of the photosensitizers pass through the EPS and come into contact with the bacterial cells. Then the PS binds to the cell surfaces or reaches into the cellular cytoplasm to generate ROS after photoexcitation [9,32]. In this context, it seems appropriate to use the preincubation of the PS with bacteria before irradiation [33]. The primary results of the A. baumannii biofilm inactivation with RF-aPDT and Chl-aPDT, presented in our previous study [21] were obtained only with the usage of the pre-incubation step and showed that the A. baumannii biofilm cells were more susceptible to near-UV light (402 nm LED light) and Chl-aPDT than to blue light (440 nm) and RF-aPDT. In the present study, we compare the antibacterial effects of both treatments with and without pre-incubation before irradiation. The results confirmed that in all those cases Chl-aPDT was more effective against the biofilms than RB-aPDT, presumably, due to the combined activity of light and aPDT, given that A. baumannii cells are more sensitive to 402 nm light alone. However, the preincubation period negatively influenced the Chl-aPDT efficiency on A. baumannii cells in the biofilm. Such a finding can be explained by the fact that Chl, like most porphyrins, tend to aggregate in aqueous medium [34]. The RF-aPDT showed similar efficacy in reducing the capacity of the viable A. baumannii bacterial count in the biofilms in both cases (without and with pre-incubation) before irradiation. Moreover, no significant differences were seen with the increasing RF concentration. When the remaining A. baumannii biofilms were quantified after the RF-aPDT treatment, it was found that RF-aPDT resulted in a stronger biofilm destruction than Chl-aPDT, which may indicate a protective role of the biofilm matrix in the preservation of bacterial cells.
In summary, all the analyzed results suggest that RF-aPDT and Chl-aPDT have the potential to be applied as methods of antibacterial treatment against A. baumannii biofilms or as preventive measures against biofilm formation. We found that the antibacterial effect of RF-aPDT with the chosen irradiation depended only on the ability of the photoactivated RF to generate ROS. In the case of Chl-aPDT, the choice of wavelength of light revealed its importance, as it can provide an additional antibacterial effect, most likely, by exciting endogenous chromophores. Moreover, our observations indicate that RF- and Chl-based aPDT anti-biofilm efficiency against A. baumannii does not necessarily benefit from the preincubation with a PS; therefore, optimization of standard aPDT treatment schemes, suitable for planktonic cell populations, should be taken into consideration, when applying aPDT treatment for bacterial biofilms.

4. Materials and Methods

4.1. Preparation of Photosensitizers

Non-copperized chlorophyllin sodium salt (Chl) (Carl Roth, Karlsruhe, Germany) (Figure 7A), and riboflavin (RF) (Sigma-Aldrich, St. Louis, MO, USA) (Figure 7B) were used as photosensitizers (PSs). A stock solution of 150 µM Chl (pH 7.2) was prepared by dissolving Chl in distilled water, without any heating or shaking. In contrast, a stock solution of 110 µM RF (pH 6.8) was prepared by stirring (~55 rpm) RF in distilled water at 50 °C for 4 h. The solution was sterilized with a 0.22 µm syringe filter (Carl Roth, Karlsruhe, Germany, ROTILABO® PVDF, P666.1) and stored at 4 °C in the dark before use [21].
The absorption spectra of samples prepared from RF and Chl stock solutions were recorded on a UV/Vis spectrophotometer (Thermo Scientific, GENESYS 10S UV/Vis; Waltham, MA, USA) (Figure 7). All working solutions were freshly prepared by diluting with 0.01 M PBS buffer on the day of use. Polymethyl methacrylate cuvettes of 1 cm were used for the measurements.

4.2. Bacterial Strain

A. baumannii clinical isolate II-a [35] was chosen for the aPDT approach study. The bacterial culture was grown at 37 °C in Luria–Bertani (LB) medium (Carl Roth, Karlsruhe, Germany) under constant 144 rpm shaking (GVL, Burgwedel, Germany) overnight (~16 h). Then, the overnight culture was inoculated to a fresh LB media and grown under the same conditions until optical density (OD) at 600 nm (OD600) reached a value of 0.65 corresponding to the concentration of 3–4 × 108 colony forming units (CFU)/mL. Bacterial cells were harvested by centrifugation (10 min, 6 °C, 7000× g), suspended in 0.01 M PBS (pH 7.4) and immediately used for the aPDT experiments. The concentration of bacteria in working solutions was 107 CFU/mL

4.3. Light Source for aPDT

A light emitting diode (LED)-based light source (constructed at the Institute of Photonics and Nanotechnology of Vilnius University) emitted light (a peak intensity at λ = 402 nm or λ = 440 nm) with irradiance 35 mW/cm2 at the surface of samples (a distance of 7 cm), which was used for the aPDT experiments [21]. The applied irradiance doses are shown in Table 1.

4.4. aPDT of A. baumannii Planktonic Cells

A. baumannii was grown as described in Section 4.2. Two pairs of bacterial samples in PBS buffer were prepared, consisting of a control sample with bacteria (Control) and a bacterial sample with PS (15 µM Chl or 11 µM RF). For the photoinactivation, 200 μL of the samples (control and with PSs) was placed into a sterile 96-well microtiter polystyrene plate (MtP) without preincubation period and exposed to the LED light for different time intervals (Table 1). For irradiation, LEDs with peaks of 402 nm and 440 nm were used in Chl-based aPDT and RF-based aPDT, respectively. At the same time, non-irradiated samples of A. baumannii (control and with PSs) were incubated in the dark at room temperature. The antibacterial activity of photoactivated Chl and RF using 402 nm and 440 nm LED light on A. baumannii viability was evaluated by the microdilution method [36]. Particularly, 10 μL of a diluted bacterial suspension after treatment was inoculated onto the surface of LB agar (LBA) plate (method detection limit 2 log10 CFU/mL). If no colonies were detected, a whole volume of treated bacterial suspension (200 μL) was spread afterwards on LBA plates (method detection limit 0.5 log10 CFU/mL). LBA plates were kept for 24 h at 37 °C. After incubation, the colonies were counted, an average value was calculated for every point (from 3 to 6 experiments) and bacterial cells counts were recalculated from CFU/mL into log10/mL.

4.5. Detection of Intracellular ROS

The measurement of ROS, generated inside A. baumannii cells after RF-aPDT and Chl-aPDT, was performed using the 2′,7′-dichlorofluorescein-diacetate (DCFH-DA) method assay as described by Misba et al. [37]. The bacterial strain was grown as described in Section 4.2. Then 107 CFU/mL of A. baumannii cells was incubated with 5 μM DCFH-DA (Sigma-Aldrich, St. Louis, MO, USA) for 10 min in PBS (pH 7.4) at 37 °C (Control-2 group). After incubation, 3.6 mL of solution was mixed with either 0.4 mL of PS stock solutions (final concentrations of RF and Chl were 11 µM and 15 µM, respectively, for RF-aPDT and Chl-aPDT groups), or with 0.4 mL of PBS (for 402 nm and 440 nm groups) and irradiated with a dose of 42 J/cm2. Then the ROS were quantified by a fluorescence spectroscopy method using a spectrophotometer (Perkin Elmer LS55, Waltham, MA, USA). The excitation (λex), emission (λem) wavelengths, and a width of both slits were set as λex = 470 nm, λem = 525 nm and 5 nm, respectively. Polymethyl methacrylate cuvettes of 1 cm were used for the measurements.

4.6. A. baumannii Biofilm Formation after aPDT

A. baumannii planktonic culture was grown as described in Section 4.2. The irradiation experiments were conducted as described in Section 2.3, and the irradiance doses were 21 J/cm2, 42 J/cm2 and 63 J/cm2. After irradiation, 4 μL of cell suspensions were transferred to a sterile MtP with 196 μL of fresh LB medium and incubated in static conditions for biofilm formation at 37 °C for 24 h (Figure 8). The non-irradiated control samples were also prepared in the same way. The capacity of A. baumannii cells to form biofilms was assessed using crystal violet staining according to Skerniškytė et al. [35]. Firstly, OD600 of unattached planktonic cells was measured in supernatants taken from the wells by means of a microplate reader (Tecan infinite M200 pro, Tecan, Männedorf, Switzerland). The wells were then washed three times with 0.01 M PBS buffer to remove residual non-adherent bacteria. Biofilms were stained with 0.5% CV dye for 15 min and washed four times with 0.01 M PBS. Dye was eluted with 96% ethanol by incubation for 10 min, and OD580 was determined by means of a microplate reader. The biofilm forming capacity was expressed as a OD580/600 ratio.

4.7. aPDT for Inactivation of A. baumannii Biofilms

A. baumannii biofilms were grown in sterile 96-well MtPs (in LB medium) as described in Section 4.6. Biofilms were gently washed with sterile 0.01 M PBS (pH 7.4). Then wells with biofilms were filled with PS solutions (11 µM RF or 15 µM Chl) or with 0.01 M PBS (Figure S1). The biofilms were immediately irradiated with corresponding LED light at 35 mW/cm2 After irradiation, biofilms were mechanically detached from the wells and vigorously vortexed. aPDT efficacy was evaluated by determining the CFU on LBA plates, as described in Section 2.4.
In an effort to increase the aPDT efficiency, a set of A. baumannii biofilm samples were treated with PS at tenfold higher concentrations (110 µM RF and 150 µM Chl) and incubated in the dark at room temperature (approx. 25 °C) for 60 min. before irradiation (Supplementary Figure S1). Then the samples were exposed to various irradiance doses indicated in Table 1. The biofilms of the non-irradiated controls were detached immediately after preincubation. aPTD efficiency was evaluated by counting CFU as described above.
The effect of aPTD on biofilm integrity was assessed by CV assay according to Skerniškytė et al. [33] with few modifications. After incubation of each suspension (107 CFU/mL) in static conditions for biofilm formation at 37 °C for 24 h, wells with biofilms were exposed to either PS (110 µM RF or 150 µM Chl), LED light (440 nm or 402 nm), or aPDT (RF-aPDT or Chl-aPDT). Then OD600 of detached cells was measured, as described in Section 4.6. The wells were gently washed with 0.01 M PBS buffer three times, stained with 0.5% CV dye for 15 min, and washed three to four times with 0.01 M PBS. Next, the dye was eluted with 96% ethanol during incubation for 10 min, and OD580 was determined by a microplate reader. The OD580/600 ratio was calculated to evaluate the relative level of destruction of biofilm.

4.8. Statistical Analysis

All experiments were repeated 3–6 times. A standard deviation was estimated for every experimental point from values of at least three independent experiments and shown in the figures as an error bar. Data were processed with Origin Pro 9.1 software (OriginLab Corporation, Northampton, MA, USA) and were statistically analyzed using One-way Analysis of Variance (ANOVA). The post hoc Bonferroni test was used for the comparison between the experimental groups and the control group. The level of significance was set at p < 0.05.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijms24010722/s1.

Author Contributions

Conceptualization, I.B., E.S. and S.B.; methodology, I.B.; validation, I.B., E.S. and S.B.; formal analysis, I.B., E.V.; investigation, I.B., E.V. and K.B.; resources, E.S.; data curation, I.B., E.S. and S.B.; writing—original draft preparation, I.B. and S.B; writing—review and editing, I.B., E.S. and S.B; visualization, I.B.; supervision, S.B.; project administration, I.B.; funding acquisition, I.B. and S.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the European Social Fund under the No 09.3.3-LMT-K-712 “Development of Competences of Scientist, other Researchers and Students through Practical Research Activities” measure.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dadgostar, P. Antimicrobial resistance: Implications and costs. Infect. Drug Resist. 2019, 12, 3903–3910. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Ventola, C.L. The Antibiotic Resistance Crisis Part 1: Causes and Threats. Pharm. Ther. 2015, 40, 277–283. [Google Scholar]
  3. Mulani, M.S.; Kamble, E.E.; Kumkar, S.N.; Tawre, M.S.; Pardesi, K.R. Emerging Strategies to Combat ESKAPE Pathogens in the Era of Antimicrobial Resistance: A Review. Front. Microbiol. 2019, 10, 539. [Google Scholar] [CrossRef]
  4. Harding, C.M.; Hennon, S.W.; Feldman, M.F. Uncovering the mechanisms of Acinetobacter baumannii virulence. Nat. Rev. Microbiol. 2017, 16, 91–102. [Google Scholar] [CrossRef] [PubMed]
  5. Ayobami, O.; Willrich, N.; Harder, T.; Okeke, I.N.; Eckmanns, T.; Markwart, R. The incidence and prevalence of hospital-acquired (carbapenem-resistant) Acinetobacter baumannii in Europe, Eastern Mediterranean and Africa: A systematic review and meta-analysis. Emerg. Microbes Infect. 2019, 8, 1747–1759. [Google Scholar] [CrossRef] [Green Version]
  6. Roy, S.; Chowdhury, G.; Mukhopadhyay, A.K.; Dutta, S.; Basu, S. Convergence of Biofilm Formation and Antibiotic Resistance in Acinetobacter baumannii Infection. Front. Med. 2022, 9, 793615. [Google Scholar] [CrossRef] [PubMed]
  7. Asif, M.; Alvi, I.A.; Rehman, S.U. Insight into Acinetobacter baumannii: Pathogenesis, global resistance, mechanisms of resistance, treatment options, and alternative modalities. Infect. Drug Resist. 2018, 11, 1249–1260. [Google Scholar] [CrossRef] [Green Version]
  8. Songca, S.P.; Adjei, Y. Applications of Antimicrobial Photodynamic Therapy against Bacterial Biofilms. Int. J. Mol. Sci. 2022, 23, 3209. [Google Scholar] [CrossRef]
  9. Hu, X.; Huang, Y.Y.; Wang, Y.; Wang, X.; Hamblin, M.R. Antimicrobial Photodynamic Therapy to Control Clinically Relevant Bio-film Infections. Front. Microbiol. 2018, 9, 1299. [Google Scholar] [CrossRef] [Green Version]
  10. Hamblin, M.R. Antimicrobial photodynamic inactivation: A bright new technique to kill resistant microbes. Curr. Opin. Microbiol. 2016, 33, 67–73. [Google Scholar] [CrossRef] [Green Version]
  11. Wainwright, M.; Maisch, T.; Nonell, S.; Plaetzer, K.; Almeida, A.; Tegos, G.P.; Hamblin, M.R. Photoantimicrobials—Are we afraid of the light? Lancet Infect. Dis. 2017, 17, 49–55. [Google Scholar] [CrossRef] [PubMed]
  12. Gilaberte, Y.; Rezusta, A.; Juarranz, A.; Hamblin, M.R. Editorial: Antimicrobial Photodynamic Therapy: A New Paradigm in the Fight against Infections. Front. Med 2021, 8, 788888. [Google Scholar] [CrossRef] [PubMed]
  13. Ribeiro, M.; Gomes, I.B.; Saavedra, M.J.; Simões, M. Photodynamic therapy and combinatory treatments for the control of biofilm-associated infections. Lett. Appl. Microbiol. 2022, 75, 548–564. [Google Scholar] [CrossRef] [PubMed]
  14. Sharma, D.; Misba, L.; Khan, A.U. Antibiotics versus biofilm: An emerging battleground in microbial communities. Antimicrob. Resist. Infect. Control 2019, 8, 76. [Google Scholar] [CrossRef] [Green Version]
  15. Goulart, R.D.; Bolean, M.; Paulino, T.D.; Thedei, G., Jr.; Souza, S.L.; Tedesco, A.C.; Ciancaglini, P. Photodynamic therapy in planktonic and biofilm cultures of Aggregatibacter actinomycetemcomitans. Photomed. Laser Surg. 2010, 28, 53–60. [Google Scholar] [CrossRef] [PubMed]
  16. García, I.; Ballesta, S.; Gilaberte, Y.; Rezusta, A.; Pascual, Á. Antimicrobial photodynamic activity of hypericin against methicillin-susceptible and resistant Staphylococcus aureus biofilms. Future Microbiol. 2015, 10, 347–356. [Google Scholar] [CrossRef] [PubMed]
  17. Diogo, P.; Fernandes, C.; Caramelo, F.; Mota, M.; Miranda, I.M.; Faustino, M.A.F.; Neves, M.G.P.M.S.; Uliana, M.P.; de Oliveira, K.T.; Santos, J.M.; et al. Antimicrobial Photodynamic Therapy against Endodontic Enterococcus faecalis and Candida albicans Mono and Mixed Biofilms in the Presence of Photosensitizers: A Comparative Study with Classical Endodontic Irrigants. Front. Microbiol. 2017, 8, 498. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. da Fonseca, A.D.S.; Mencalha, A.L.; de Paoli, F. Antimicrobial photodynamic therapy against Acinetobacter baumannii. Photodiagnosis Photodyn. Ther. 2021, 35, 102430. [Google Scholar] [CrossRef]
  19. Buchovec, I.; Gricajeva, A.; Kalėdienė, L.; Vitta, P. Antimicrobial Photoinactivation Approach Based on Natural Agents for Control of Bacteria Biofilms in Spacecraft. Int. J. Mol. Sci. 2020, 21, 6932. [Google Scholar] [CrossRef]
  20. Polat, E.; Kang, K. Natural Photosensitizers in Antimicrobial Photodynamic Therapy. Biomedicines 2021, 9, 584. [Google Scholar] [CrossRef]
  21. Buchovec, I.; Klimkaitė, L.; Sužiedėlienė, E.; Bagdonas, S. Inactivation of opportunistic pathogens Acinetobacter baumannii and Stenotrophomonas maltophilia by antimicrobial photodynamic therapy. Microorganisms 2022, 10, 506. [Google Scholar] [CrossRef] [PubMed]
  22. Zhang, Y.; Zhu, Y.; Gupta, A.; Huang, Y.; Murray, C.K.; Vrahas, M.S.; Sherwood, M.E.; Baer, D.G.; Hamblin, M.R.; Dai, T. Antimicrobial blue light therapy for multidrug-resistant Acinetobacter baumannii infection in a mouse burn model: Implications for prophylaxis and treatment of combat-related wound infections. J. Infect. Dis. 2014, 209, 1963–1971. [Google Scholar] [CrossRef] [Green Version]
  23. Hadi, J.; Wu, S.; Soni, A.; Gardner, A.; Brightwell, G. Genetic Factors Affect the Survival and Behaviors of Selected Bacteria during Antimicrobial Blue Light Treatment. Int. J. Mol. Sci. 2021, 22, 10452. [Google Scholar] [CrossRef] [PubMed]
  24. Gomes, A.; Fernandes, E.; Lima, J.L. Fluorescence probes used for detection of reactive oxygen species. J. Biochem. Biophys. Methods 2005, 65, 45–80. [Google Scholar] [CrossRef] [PubMed]
  25. Castro-Alférez, M.; Polo-López, M.I.; Fernández-Ibáñez, P. Intracellular mechanisms of solar water disinfection. Sci. Rep. 2016, 6, 38145. [Google Scholar] [CrossRef] [Green Version]
  26. Khan, S.; Rayis, M.; Rizvi, A.; Alam, M.M.; Rizvi, M.; Naseem, I. ROS mediated antibacterial activity of photoilluminated riboflavin: A photodynamic mechanism against nosocomial infections. Toxicol. Rep. 2019, 6, 136–142. [Google Scholar] [CrossRef]
  27. Banerjee, S.; Ghosh, D.; Vishakha, K.; Das, S.; Mondal, S.; Ganguli, A. Photodynamic antimicrobial chemotherapy (PACT) using riboflavin inhibits the mono and dual species biofilm produced by antibiotic resistant Staphylococcus aureus and Escherichia coli. Photodiagnosis Photodyn. Ther. 2020, 32, 102002. [Google Scholar] [CrossRef]
  28. Kim, D.; Shin, M.; Kim, H.; Kang, D. Inactivation efficacy of combination treatment of blue light-emitting diodes (LEDs) and riboflavin to control E. coli O157:H7 and S. typhimurium in apple juice. Innov. Food Sci. Emerg. Technol. 2022, 78, 103014. [Google Scholar] [CrossRef]
  29. Buchovec, I.; Lukseviciūtė, V.; Kokstaite, R.; Labeikyte, D.; Kaziukonyte, L.; Luksiene, Z. Inactivation of Gram (−) bacteria Salmonella enterica by chlorophyllin-based photosensitization: Mechanism of action and new strategies to enhance the inactivation efficiency. J. Photochem. Photobiol. B 2017, 172, 1–10. [Google Scholar] [CrossRef]
  30. Demidova, T.N.; Hamblin, M.R. Effect of cell-photosensitizer binding and cell density on microbial photoinactivation. Antimicrob. Agents Chemother. 2005, 49, 2329–2335. [Google Scholar] [CrossRef] [Green Version]
  31. Zoltan, T.; Vargas, F.; López, V.; Chávez, V.; Rivas, C.; Ramírez, Á.H. Influence of charge and metal coordination of meso-substituted porphyrins on bacterial photoinactivation. Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 2015, 135, 747–756. [Google Scholar] [CrossRef] [PubMed]
  32. Anane, Y.A.; Apalata, T.; Vasaikar, S.; Okuthe., G.E.; Songca, S.P. In vitro antimicrobial photodynamic inactivation of multidrug-resistant Acinetobacter baumannii biofilm using Protoporphyrin IX and Methylene blue. Photodiagnosis Photodyn. Ther. 2020, 30, 101752. [Google Scholar] [CrossRef] [PubMed]
  33. Galo, I.D.C.; Carvalho, J.A.; Santos, J.L.M.C.; Braoios, A.; Prado, R.P. The ineffectiveness of antimicrobial photodynamic therapy in the absence of preincubation of the microorganisms in the photosensitizer. Fisioter. Mov. 2020, 33, e003304. [Google Scholar] [CrossRef]
  34. Stefanelli, M.; Mandoj, F.; Magna, G.; Lettieri, R.; Venanzi, M.; Paolesse, R.; Monti, D. The Self-Aggregation of Porphyrins with Multiple Chiral Centers in Organic/Aqueous Media: The Case of Sugar- and Steroid-Porphyrin Conjugates. Molecules 2020, 25, 4544. [Google Scholar] [CrossRef]
  35. Skerniškytė, J.; Krasauskas, R.; Péchoux, C.; Kulakauskas, S.; Armalytė, J.; Sužiedėlienė, E. Surface-related features and virulence among Acinetobacter baumannii clinical isolates belonging to international clones I and II. Front. Microbiol. 2019, 9, 3116. [Google Scholar] [CrossRef] [Green Version]
  36. Naghili, H.; Tajik, H.; Mardani, K.; Razavi Rouhani, S.M.; Ehsani, A.; Zare, P. Validation of drop plate technique for bacterial enumeration by parametric and nonparametric tests. Vet. Res. Forum 2013, 4, 179–183. [Google Scholar]
  37. Misba, L.; Zaidi, S.; Khan, A.U. Efficacy of photodynamic therapy against Streptococcus mutans biofilm: Role of singlet oxygen. J. Photochem. Photobiol. B Biol. 2018, 183, 16–21. [Google Scholar] [CrossRef]
Figure 1. Inactivation of A. baumannii planktonic cells by aPDT as a function of irradiance doses (irradiance of 35 mW/cm2). Samples in the legend: 440 nm and 402 nm—bacteria in 0.01 M PBS without PS; RF-aPDT—bacteria with 11 µM riboflavin (RF); Chl-aPDT—bacteria with 15 µM chlorophyllin (Chl). Every point is the average of 3–6 independent experiments (10 µL), error bars indicate standard deviation. * indicates statistical significance compared to control culture, p < 0.05. The red square means the point detection limit (200 µL 0.5 log10). The detection limit of other points is 2 log10.
Figure 1. Inactivation of A. baumannii planktonic cells by aPDT as a function of irradiance doses (irradiance of 35 mW/cm2). Samples in the legend: 440 nm and 402 nm—bacteria in 0.01 M PBS without PS; RF-aPDT—bacteria with 11 µM riboflavin (RF); Chl-aPDT—bacteria with 15 µM chlorophyllin (Chl). Every point is the average of 3–6 independent experiments (10 µL), error bars indicate standard deviation. * indicates statistical significance compared to control culture, p < 0.05. The red square means the point detection limit (200 µL 0.5 log10). The detection limit of other points is 2 log10.
Ijms 24 00722 g001
Figure 2. Detection of reactive oxygen species (ROS) activity in A. baumannii cells based on measurements of fluorescence spectra of 2′,7′-dichlorofluorescein (DCF). 11 μM RF and 15 μM Chl, irradiance dose of 42 J/cm2 for both 440 nm and 402 nm LED light was used. The concentration of bacteria in working solutions was 107 CFU/mL. Samples in the legend: Control-1—A. baumannii in 0.01 M PBS buffer without 2′,7′-dichlorofluorescein-diacetate (DCFH-DA); Control-2—A. baumannii in 0.01 M PBS buffer with DCFH-DA; 440 nm and 402 nm—Control-2 irradiated with 440 nm and 402 nm, respectively; RF-aPDT—Control-2 + RF + 440 nm irradiation; Chl-aPDT—Control-2 + Chl + 402 nm irradiation.
Figure 2. Detection of reactive oxygen species (ROS) activity in A. baumannii cells based on measurements of fluorescence spectra of 2′,7′-dichlorofluorescein (DCF). 11 μM RF and 15 μM Chl, irradiance dose of 42 J/cm2 for both 440 nm and 402 nm LED light was used. The concentration of bacteria in working solutions was 107 CFU/mL. Samples in the legend: Control-1—A. baumannii in 0.01 M PBS buffer without 2′,7′-dichlorofluorescein-diacetate (DCFH-DA); Control-2—A. baumannii in 0.01 M PBS buffer with DCFH-DA; 440 nm and 402 nm—Control-2 irradiated with 440 nm and 402 nm, respectively; RF-aPDT—Control-2 + RF + 440 nm irradiation; Chl-aPDT—Control-2 + Chl + 402 nm irradiation.
Ijms 24 00722 g002
Figure 3. Effect of aPDT on A. baumannii biofilm formation as quantified by crystal violet (CV) assay. 440 nm and 402 nm—bacteria irradiated without PS; RF-aPDT—bacteria with 11 µM RF; Chl-aPDT—bacteria with 15 µM Chl. Every point is the average of OD580/600 ratio of three independent experiments, error bars indicate standard deviation; * indicates statistical significance compared to control culture, p < 0.05.
Figure 3. Effect of aPDT on A. baumannii biofilm formation as quantified by crystal violet (CV) assay. 440 nm and 402 nm—bacteria irradiated without PS; RF-aPDT—bacteria with 11 µM RF; Chl-aPDT—bacteria with 15 µM Chl. Every point is the average of OD580/600 ratio of three independent experiments, error bars indicate standard deviation; * indicates statistical significance compared to control culture, p < 0.05.
Ijms 24 00722 g003
Figure 4. Photodynamic inactivation of A. baumannii biofilms by RF-aPDT and Chl-aPDT with 11 μM RF and 15 μM Chl, presented in numbers of the surviving cells as a function of irradiance doses. CFU values present the average of three independent experiments, error bars indicate standard deviation. * Shows statistical significance compared to the control culture, p < 0.05.
Figure 4. Photodynamic inactivation of A. baumannii biofilms by RF-aPDT and Chl-aPDT with 11 μM RF and 15 μM Chl, presented in numbers of the surviving cells as a function of irradiance doses. CFU values present the average of three independent experiments, error bars indicate standard deviation. * Shows statistical significance compared to the control culture, p < 0.05.
Ijms 24 00722 g004
Figure 5. Photodynamic inactivation of A. baumannii biofilms by aPDT with 110 μM RF (A) or 150 μM Chl (B) without preincubation and with 60 min preincubation in the dark at room temperature followed by corresponding irradiation (irradiance doses shown in Table 1). The effect of light alone was determined for bacterial samples without PS at the same conditions. CFU values present the average of three experiments, error bars indicate standard deviation. * shows statistical significance compared to the control culture, p < 0.05.
Figure 5. Photodynamic inactivation of A. baumannii biofilms by aPDT with 110 μM RF (A) or 150 μM Chl (B) without preincubation and with 60 min preincubation in the dark at room temperature followed by corresponding irradiation (irradiance doses shown in Table 1). The effect of light alone was determined for bacterial samples without PS at the same conditions. CFU values present the average of three experiments, error bars indicate standard deviation. * shows statistical significance compared to the control culture, p < 0.05.
Ijms 24 00722 g005
Figure 6. Effect of aPDT on the destruction of A. baumannii biofilms as quantified by crystal violet (CV) assay. Samples: Control—without PS and non-irradiated; 440 nm and 402 nm—irradiated without PS; RF-aPDT—with 110 µM RF and irradiated with 440 nm; Chl-aPDT—with 150 µM Chl and irradiated with 402 nm. Every point is the average of OD580/600 ratio of three independent experiments, error bars indicate standard deviation, * indicates statistical significance compared to control culture, p < 0.05.
Figure 6. Effect of aPDT on the destruction of A. baumannii biofilms as quantified by crystal violet (CV) assay. Samples: Control—without PS and non-irradiated; 440 nm and 402 nm—irradiated without PS; RF-aPDT—with 110 µM RF and irradiated with 440 nm; Chl-aPDT—with 150 µM Chl and irradiated with 402 nm. Every point is the average of OD580/600 ratio of three independent experiments, error bars indicate standard deviation, * indicates statistical significance compared to control culture, p < 0.05.
Ijms 24 00722 g006
Figure 7. Absorption spectra of 15 µM Chl (A) and 11 µM RF (B) solutions in distilled water. Chemical structures of PSs are shown.
Figure 7. Absorption spectra of 15 µM Chl (A) and 11 µM RF (B) solutions in distilled water. Chemical structures of PSs are shown.
Ijms 24 00722 g007
Figure 8. Scheme of A. baumannii biofilm formation assay after aPDT.
Figure 8. Scheme of A. baumannii biofilm formation assay after aPDT.
Ijms 24 00722 g008
Table 1. Irradiance doses at 402 nm and 440 nm used in experiments.
Table 1. Irradiance doses at 402 nm and 440 nm used in experiments.
Planktonic CellsBiofilms
Time (min)1015202530406090120
Irradiance dose
(J/cm2)
2131.54252.56384126189252
The irradiance dose (J/cm2) was calculated as irradiance (mW/cm2) multiplied by irradiation time (s).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Buchovec, I.; Vyčaitė, E.; Badokas, K.; Sužiedelienė, E.; Bagdonas, S. Application of Antimicrobial Photodynamic Therapy for Inactivation of Acinetobacter baumannii Biofilms. Int. J. Mol. Sci. 2023, 24, 722. https://doi.org/10.3390/ijms24010722

AMA Style

Buchovec I, Vyčaitė E, Badokas K, Sužiedelienė E, Bagdonas S. Application of Antimicrobial Photodynamic Therapy for Inactivation of Acinetobacter baumannii Biofilms. International Journal of Molecular Sciences. 2023; 24(1):722. https://doi.org/10.3390/ijms24010722

Chicago/Turabian Style

Buchovec, Irina, Enrika Vyčaitė, Kazimieras Badokas, Edita Sužiedelienė, and Saulius Bagdonas. 2023. "Application of Antimicrobial Photodynamic Therapy for Inactivation of Acinetobacter baumannii Biofilms" International Journal of Molecular Sciences 24, no. 1: 722. https://doi.org/10.3390/ijms24010722

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop