Next Article in Journal
The Effect of the Ultra-High-Pressure Homogenization of Protein Encapsulants on the Survivability of Probiotic Cultures after Spray Drying
Previous Article in Journal
Effect of Hydrocolloid Gums on the Pasting, Thermal, Rheological and Textural Properties of Chickpea Starch
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:

Flow Cytometry to Assess the Counts and Physiological State of Cronobacter sakazakii Cells after Heat Exposure

Department of Nutrition and Food Science, Faculty of Medicine, University of Valladolid, 47005 Valladolid, Spain
Department of Nursery, Faculty of Nursery, University of Valladolid, 47005 Valladolid, Spain
Department of Hygiene and Food Technology, Faculty of Veterinary Medicine, University of León, 24071 León, Spain
Author to whom correspondence should be addressed.
Foods 2019, 8(12), 688;
Received: 5 November 2019 / Revised: 6 December 2019 / Accepted: 11 December 2019 / Published: 16 December 2019
(This article belongs to the Section Food Quality and Safety)


Cronobacter sakazakii is an opportunistic pathogen that is associated with outbreaks of neonatal necrotizing enterocolitis, septicaemia, and meningitis. Reconstituted powdered infant formulae is the most common vehicle of infection. The aim of the present study is to gain insight into the physiological states of C. sakazakii cells using flow cytometry to detect the compromised cells, which are viable but non-culturable using plate-based methods, and to evaluate the impact of milk heat treatments on those populations. Dead-cell suspensions as well as heat-treated and non-heat-treated cell suspensions were used. After 60 or 65 °C treatments, the number of compromised cells increased as a result of cells with compromised membranes shifting from the heat-treated suspension. These temperatures were not effective at killing all bacteria but were effective at compromising their membranes. Thus, mild heat treatments are not enough to guarantee the safety of powered infant formulae. Flow cytometry was capable of detecting C. sakazakii’s compromised cells that cannot be detected with classical plate count methods; thus, it could be used as a screening test to decrease the risk derived from the presence of pathogenic viable but non-culturable cells in this food that is intended for newborns’ nutrition.

Graphical Abstract

1. Introduction

During the last decade, scientific interest has turned to Cronobacter sakazakii, formerly Enterobacter sakazakii, as a human pathogen. C. sakazakii is an opportunistic pathogen that is associated with outbreaks of neonatal necrotizing enterocolitis, septicemia, and meningitis [1,2,3]. The first virulence factors identified in C. sakazakii were enterotoxins [4]. Raghav and Aggarwal [5] identified a 66kDa toxin which was most active at pH 6, with the ability to be stable at 90 °C for 30 min, and potent cell toxicity (LD50 = 56 pg). This organism has a high case fatality rate in vulnerable infants in neonatal intensive care units and in surviving patients, severe neurological sequelae have occurred including hydrocephalus, quadriplegia, and developmental delay [2,6].
The International Commission for Microbiological Specifications for Foods [7] ranked Cronobacter spp. as a “severe hazard for restricted populations causing life-threatening or substantial chronic sequelae of long duration.” The FAO/WHO [8] noted that infants are the group at particular risk although C. sakazakii can cause invasive infection in all age groups. Reconstituted powdered infant formulae (PIF) and powdered milk are the most common vehicles implicated in neonatal C. sakazakii infections [3,9,10,11,12].
PIF could be easily contaminated because it is a non-sterilized product [3]. In hospitals, environmental contamination and temperature abuse of the reconstituted formula have been contributory factors [9,13]. The FAO/WHO [14] recommends cooling the temperature of boiled water not below 70°C for safe preparation of PIF. Heat stress can damage the bacterial cell wall and cause breakage of genomic DNA along with misfolding of cytoplasmic proteins [15]. However, bacteria can survive to sublethal heat stress and can also be adaptive by inducing a response to high environmental temperatures [16], which has been demonstrated for Cronobacter spp. [17].
The use of plate count methods to assess the number of stressed bacteria does not provide direct information on their physiological status [15,18]. This approach only detects cells that are able to form colonies but cannot detect metabolically active cells that do not form them [18,19], i.e., compromised—damaged or injured—bacteria [15,20,21,22]. In contrast, flow cytometry (FC) provides information on the physiological heterogeneity of bacterial populations [22,23,24,25] using fluorescence markers and direct optical devices to quantify the properties of single cells [26,27] and provides a fundamental advantage over conventional methods [28,29]. Compromised bacteria have special growth requirements due to their physiological state and include two types of cells, i.e., those that could be culturable through proper culture conditions and cells that are viable but non-culturable. To detect the former, it is necessary to adapt the culture conditions such as media, temperature, and time [30]. The most common strategy is to include a recovery step using a non-selective medium prior to the inoculation of the bacteria into the selective media. Some authors propose to use a plate count technique with both non-selective and selective culture media. Indeed, the difference between both counts would reflect the count of cells with sublethal damage [31,32]. Although non-selective methods are used, compromised viable but non-culturable cells cannot be detected by using classical plate count methods [33,34,35] and, unfortunately, from a public health point of view, they can retain their pathogenic potential.
Bacteria culture techniques are time-consuming and do not show the physiological state of the cells [36,37]. Therefore, the aim of the present study is to gain insight into the physiological states of Cronobacter sakazakii cells using flow cytometry in order to detect viable but non-culturable compromised cells and to evaluate the impact of mild heat treatments on those populations.

2. Materials and Methods

2.1. Culture Preparation

Cronobacter sakazakii ATCC 29544 was used [38,39,40,41]. In triplicate (in three different days) the strain was cultured twice in sterile Trypticase Soy Broth (TSB; Difco, BD Diagnostics, Spark, MD, USA) at 37 °C for 24 h to reach the stationary phase, with a concentration of ca. 109 CFU/mL. The populations were counted after spreading 10 µL aliquots from serial dilutions onto TSA plates following the drop method [42] and were incubated at 37 °C for 24 h. A population of 1.1 × 109 (±0.1 × 109) CFU/mL was counted.

2.2. Dead-Cells Suspensions (DCS)

Dead-cells single-colour suspensions were prepared as controls for setting up the FC procedure following the manufacturer’s instructions of the staining kit that is used later (see below). Portions of 1 mL from the microorganism’s cultures were dispensed into microcentrifuge tubes, centrifuged at 10,000 g for 3 min to pellet the cells, and washed with 0.85% NaCl. The supernatants were removed and discarded. Centrifugation and washing procedures were repeated twice. The pellets were re-suspended with 1 mL of 70% isopropyl alcohol and incubated at room temperature for 60 min mixing every 15 min, getting DCS ready for the staining.

2.3. Non-Heat-Treated (nTCS) and Heat-Treated (TCS) Cell Suspensions

To begin, 1 mL aliquots from the microorganism’s cultures were dispensed into microcentrifuge tubes and centrifuged at 10,000 g for 3 min. The pelleted cells were washed with 0.85% NaCl and the supernatants were removed and discarded. Centrifugation and washing procedures were repeated twice. The pellet was re-suspended with 1 mL of 0.85% NaCl, giving a non-heat-treated cell suspension (nTCS), and an aliquot was used for viable cell count as mentioned above [42].
For the heat treatment viability assays, 10 mL from broth cultures were placed in 50 mL screw-cap glass tubes and heated at 60, 65, or 100 °C for 5 min and immediately introduced in a water bath at 4 °C for 5 min. As C. sakazakii mean thermal inactivation D60 °C and D65 °C values are about 4.3 and 0.6 min, respectively (z-value of 5.6 °C; [43]), partial thermal inactivation and sublethal damaged cells resembling under-pasteurization heating conditions were expected after both 60 or 65 °C heat treatments. After the 100 °C treatment, irreversibly destroyed cells were expected, resembling high pasteurization conditions. After the heat treatments, 1 mL of each of the heat-treated cultures were dispensed into microcentrifuge tubes, centrifuged, and washed twice with 0.85% NaCl, as previously described, obtaining heat-treated cell suspensions from each temperature (TCS60, TCS65, and TCS100). The resulting viable cell concentrations were determined as described for the nTCS.
Finally, cell suspensions were mixed into FC analysis tubes at different nTCS:TCS ratios (vol:vol): 100, 75, 50, 25, and 0% of nTCS. Control tubes with only 0.85% NaCl were also prepared.

2.4. FC Analysis

Cell suspensions were stained using the Live/Dead BacLight Bacterial Viability and Counting Kit (Molecular Probes, Invitrogen, CO, USA) according to the manufacturer’s instructions as follows: 10 µL of the bacterial cell suspension, 987 µL of 0.85% NaCl, 1.5 µL of 3.34 mM SYTO9 green fluorescent nucleic acid stain, and 1.5 µL of 30 mM propidium iodide (PI) red fluorescent nucleic acid stain were dispensed into each FC tube. For accurate counting, the total volume in the FC tubes was 1000 µL. The final population of the microorganisms should be calculated taking into account the 100-fold dilution into the FC tubes. The tubes were incubated at room temperature for 15 min and were protected from light, as they were wrapped with aluminium foil and stored in a cabinet.
FC analyses were conducted using a Cytomics FC 500 (Beckman Coulter, Brea, CA, USA) with an excitation wavelength of 488 nm from a blue argon laser. Each cell (called event) was characterized by two fluorescent parameters that measured green fluorescence emission (FL1 channel) and red fluorescence emission (FL3 channel). Green fluorescing SYTO9 can enter all cells and is used for assessing total cell counts, whereas red fluorescing PI only enters cells with damaged cytoplasmic membranes. Optical bandpass filters were set up to measure the green fluorescence of SYTO9 at 525/40 nm (FL1; SYTO9 FL1 Log) and the red fluorescence of PI at 620/30 nm (FL3; PI FL3 Log). The measurements were conducted after 300 s or 500,000 events at a low flow rate (10 µL/min).

2.5. FC Events versus Plate Counts

Correlations between the FC method and plate counts were calculated [44]. Different cell concentrations of C. sakazakii between 104 and 109 CFU/mL were analyzed using the FC and plate count method.

3. Results

3.1. DCS

The FC plot that was obtained from C. sakazakii dead-cells suspensions is shown in Figure 1. The events are distributed according to fluorescence intensity at the two wavelengths that were studied. A gate was positively identified for dead cells since all of them were restricted to a very well-defined area, allowing its use as a control for future differentiation between dead and live cells in different areas.

3.2. nTCS and TCS

Figure 2 shows the distribution of the events that were observed in the cytometer according to the staining of nTCS and different nTCS:TCS ratios. Figure 2A shows three different 100% nTCS plots before they had been heat treated. An area for the live cells was identified. Figure 2B shows the nTCS:TCS mixtures: 0, 25, 50, or 75% of nTCS cultures mixed with TCS previously heat-treated at 60, 65, or 100 °C. After the 100 °C heat treatment (TCS100), dead cells were restricted to a very well-defined area (Figure 2(B3); 0% nTCS or 100% TCS), as previously observed from DCS controls, which are shown in Figure 1. The identification of live cells and dead cells areas allowed the identification of the third area for cells with compromised membranes, which was stained with both colourants. Compromised cells (CC) spread themselves into the intact-membrane (live cells) and damaged-membrane (dead cells) areas, as is observed with the different nTCS:TCS mixtures. When only TCS cells were studied, the number of CC decreased as the heat-treatments’ temperature increased from 60 to 65 °C (Figure 2(B1,B2), respectively) and were not detected at 100 °C (Figure 2(B3)). Furthermore, a small number of live cells were detected in TCS60 (Figure 2 (B1)) but in TCS65 or TCS100 (Figure 2(B2,B3), respectively), showing that the 60 °C treatment does not kill all bacteria, resulting in a high number of CC.
When the percentage of nTCS cells (live cells) was increased in the nTCS:TCS100 mixtures (Figure 2(B3a–c)), the number of CC slightly increased, showing that some of the live cells have compromised membranes—dead cells or TCS100 were detected in a well-defined area without a shift towards the CC’s area (Figure 2(B3)). The number of CC increased with cells coming from both nTCS and TCS65 areas in nTCS:TCS65 mixtures (Figure 2(B2a–c)). This CC’s rise was even more evident in the case of TCS60 in nTCS:TCS6o mixtures (Figure 2(B1a–c)).

3.3. FC Events versus Plate Counts

Linear regression analysis between FC events of live cells and plate counts was carried out, obtaining a strong correlation (R2 = 0.932) (Figure 3).

4. Discussion

C. sakazakii is a pathogenic bacterium that is able to produce capsular material and biofilms [40,45]. This ability has public health implications because biofilms are usually pathogenic and can cause foodborne outbreaks as well as nosocomial infections [46]. These characteristics allow the microorganism to protect itself from hostile environments—such as food industries and/or hospitals—growing on food matrixes and food industry infrastructures as well as in medical devices [46,47,48]. Three different heat treatments were used to assess the viability of C. sakazakii cells, and CC were found. The number of CC slightly increased as the percentage of nTCS (live cells) was gradually increased in the nTCS:TCS100 mixtures. The number of live bacteria without compromised membranes in a cell suspension will depend on the environmental conditions affecting their physiological state. Indeed, each cell has its characteristics, behaviour, and response to the environment. Following previous statements [49,50], the kinetics of a bacterial population can be characterized by the extracellular environment and the intracellular conditions. To know how and when cells enter a compromised physiological state will require further investigation and it is far from the aim of the present study. The results were different in nTCS:TCS60 and nTCS:TCS65 mixtures, i.e., the number of CC increased as a result of cells, with compromised membranes shifting from TCS, i.e., the used temperatures were not completely effective at killing all bacteria but were effective at compromising their membranes and subsequently, their capacity to grow on agar forming colonies and be detected with conventional analyses.
SYTO9 is a hydrophobic cell-permeant nucleic acid stain that shows a large fluorescence enhancement upon binding nucleic acids after penetrating the cell intact membrane [19,27,51]. PI is a membrane impermeant hydrophilic stain with a high molecular weight that binds to nucleic acids only when the cell membrane has pores [27,52,53]. When the PI is mixed with the SYTO9, cells with intact membrane fluoresce green, while cells with damaged membrane fluoresce red—they lose their green fluorescence because the PI competes for the same target areas than the SYTO9, which is a reason behind its greater affinity for nucleic acids than SYTO9 forcing its displacement from its binding [25,27,51,53]. According to Berney et al. [54], microscopy allows one to distinguish the difference between green or red fluorescent cells, however FC allows us to observe a curve-shaped pattern of fluorescence with different amounts of both stains. A third green-red fluorescent group of cells can be detected [23,25,30,55,56], which represents an intermediate state in the permeabilization of the cell membrane, allowing the PI to penetrate the cell but not in enough quantities to efficiently displace the SYTO9 from its binding to the nucleic acids [23,30,57,58,59,60]. Indeed, intermediate states reflecting physiological heterogeneity of cells have been observed [22,23,25,34,54,55,56,57,61,62,63,64,65]. As previously reported [54], the region of intermediate states—with high green and red fluorescence intensity—could have an impact in both the decision making process and the interpretation of results, e.g., the effectiveness of disinfection methods or the counts of viable bacteria in food systems [23,54,55].
SYTO9 has the ability (i) to penetrate both live and dead cells, (ii) it can better penetrate dead cells than live cells because of their damaged membrane, and (iii) it can better penetrate compromised cells than live cells because of their wider membrane pores. PI has the ability (i) to penetrate dead cells because of their damaged membrane, (ii) it can penetrate compromised cells with some limitations due to its high molecular weight and the size of the membrane pores, and (iii) it can compete with SYTO9 for binding the nucleic acids into the dead and/or compromised cells. Due to these facts and the combination of both dyes, the fluorescence intensity of compromised cells is slightly higher than the dead cells intensity (axis Y, Figure 2B1 and/or Figure 2B2) and it is slightly higher than the live cells intensity (axis X, Figure 2B1 and/or Figure 2B2). Moreover, C. sakazakii cells linked high quantities of both dyes, showing higher signals than the live and/or dead cells because of the high amount of nucleic acids in the interior of the cells and in the exterior around them (compromised cells have problems in the structure of their membranes and high amounts of extracellular nucleic acids can be detected after its staining, contributing to the fluorescence intensity).
Berney et al. [54] related the mentioned intermediate area with different concentrations of dyes in the interior of the cells, attributing the lead role to the intracellular SYTO9 concentration—the intracellular PI concentration had a low impact on the increase in green and red fluorescence intensity according to these authors.
Recently, Rosenberg et al. [66] reported similar subpopulations of double-stained (SYTO9 plus PI) Escherichia coli cells from a biofilm. These authors were able to detect cells with green interiors and red surfaces; the latter probably due to the staining of extracellular nucleic acids by PI. These authors have identified this subpopulation as a false dead population with increased green and red fluorescence intensity.
To the best of our knowledge, the nature of this intermediate state has not been clarified in C. sakazakii, probably due to the technical sophistication of the techniques and the associated costs. In the present study, we have detected such a state and linked it to the physiological properties of the bacterial cells. We have observed a distinctive curve-shaped pattern of fluorescence for C. sakazakii cells suspensions that are exposed to heat treatments. The cloud of live cells followed a curve-shaped pattern, with events shifting through the dead cells area, reflecting the different physiological states of Gram-negative bacteria as the damage of the cells proceeds. A first step would be the damage of the outer membrane while the cytoplasmic membrane is still intact, as PI cannot penetrate it, followed by a second step with the complete damage of the cytoplasmic membrane. Berney et al. [54] reported a similar pattern when Gram-negative bacterial cells such as Escherichia coli, Salmonella enterica serovar Typhimurium, and Shigella flexneri were UVA-irradiated or EDTA-treated, indicating that the outer membrane of late stationary-phase cells of Gram-negative bacteria is a barrier for SYTO9. The permeabilization of the outer membrane can be done with artificial UV [54,63,67,68] as well as sunlight [63] before the disruption of the cytoplasmic membrane. Our results would show the disruption of the outer membrane by mild heat treatments followed by some grade of permeabilization of the cytoplasmic membrane. This phenomenon was not observed in Gram-positive Enterococcus faecalis [54], which lacks an outer membrane.
C. sakazakii may be present in reconstituted PIF and may possibly survive the mild heat stress associated with its reconstitution [41] because clinical strains appeared to be more thermotolerant than their environmental counterparts [69]. Furthermore, cross-contamination can occur, resulting in the presence of cells that were not subjected to the heat treatment that is used for PIF reconstitution [41]. Recommendations for the preparation of PIF in the neonatal intensive care units or for bottle-feeding at home were proposed by the FAO/WHO [14] to ensure safety in PIF: boiled water has to be cooled down up to 70 °C for 30 min. Despite these recommendations, the instructions for reconstitution may suggest using water at temperatures as low as 40 °C [41,70,71] due to undesirable effects on the organoleptic and nutritional properties of reconstituted PIF [72] or to avoid the risk of severe burns [73]. Furthermore, a moderate reheating (35–40 °C) of previously reconstituted PIF or a mild heat treatment (40–70 °C) of the water intended for the reconstitution of PIF should not be discarded, especially at home, as these situations would represent high-risk food safety scenarios for children [73] because untreated and/or mildly heat-treated cells may recover and grow during the holding time [71]. In the present study, three heat treatments were used. The 100 °C heat-treated samples did not show bacterial growth on agar plates nor live cells in the flow cytometer; however, treatments at 60 or 65 °C did not eliminate all bacteria, giving counts of about 4 to 5 log CFU/mL in agar plates and 5.1–5.6 log events/mL in the flow cytometer. These results show that mild heat treatments are not high enough to guarantee the safety of PIF and stress the importance of proper boiling of water prior to its use for reconstituting PIF. Furthermore, a cooling period under sterilized conditions until an adequate temperature for consumption is achieved should be carried out. Parra-Flores et al. [41] arrived at a similar conclusion after studying the variability in cell response of C. sakazakii after mild heat treatments at 50 °C for 5 or 10 min.
Several authors [15,17,19,20] stated that the membrane integrity reflecting the viability of the cell appears to be dependent on both environmental conditions and the physiological status of the cell during the time of analysis. Among the environmental conditions, temperature, time, and different compounds have a great influence on the viability of the cells: Arku et al. [15] showed that C. sakazakii cell survival decreases as the temperature increases from 52 to 67 °C for 30 min, Choi et al. [38] found that the proportion of C. sakazakii cells in the PI fluorescent region increases under the influence of antimicrobial compounds as a function of the time for 5, 10, or 30 min, and Marty et al. [74] reported that a large fraction of the proteome of Halobacterium salinarum was strongly disrupted under heat stress from 40 to 60 °C for 60 min. Similar results were found for Escherichia coli [75]. The ability of a C. sakazakii toxin to be able to remain stable at 90 °C for 30 min needs to be addressed [5].
The physiological status of the cells is very important for the integrity of its membrane. Parra-Flores et al. [41] observed high variability in the lag phase of C. sakazakii populations due to both a previous heat-shock of the cells and the subsequent growth temperature; these results agree with previous findings regarding Listeria innocua, Enterococcus faecalis, Salmonella enterica, and Pseudomonas fluorescens [70,76,77,78,79,80].
FC analyses cell by cell quickly and precisely give quantitative information about the heterogeneity of the physiological state of the population [22,25,30,55,56,81]. Compromised cells cannot be detected using classical plate count methods [33,34,35] and unfortunately, from a public health point of view, they can retain their pathogenic potential. The ability of pathogenic bacteria to recover after different treatments has been reported: Escherichia coli O157:H7 were recovered during the refrigerated storage of ready-to-eat pasta salads [30], Bacillus cereus and B. weihenstephanensis after assessing their acid shock viability [22], Legionella pneumophila and Escherichia coli were recovered after heat treatments [82], and Staphylococcus epidermidis and E. coli were retrieved from biofilms [66].

5. Conclusions

Despite the recommendations, several situations could arise such as the reconstitution of PIF with water at 40–70 °C or even the use of a mild re-heating treatment of a previously reconstituted PIF. All these situations dramatically increase the risk associated with the presence of C. sakazakii in reconstituted PIF. Mild heat treatments at 60 or 65 °C did not eliminate all bacteria, so the proper use of boiled water for reconstituting PIF must be emphasized. Furthermore, high numbers of compromised cells were detected after the mild heat treatments; flow cytometry was able to differentiate the compromised cells, which were viable but non-culturable, from live and/or dead cells. Classic culture techniques are time-consuming and do not show the physiological state of the cells, so samples with compromised cells—maintaining their pathogenic characteristics—could be consumed by children. A screening test of the bottles of formulae with flow cytometry prior to administration to the neonates in the neonatal intensive care units could help to discriminate those samples showing compromised cells, which could represent a risk to the infant.

Author Contributions

Conceptualization, I.C. and E.J.Q.; methodology, P.C.-S. and I.C.; formal analysis, P.C.-S. and I.C.; writing—original draft preparation, P.C.-S. and I.C.; writing—review and editing, J.M. and E.J.Q.; project administration, E.J.Q.; funding acquisition, M.J.C. (María J. Castro), M.J.C. (María J. Cao), and E.J.Q.


This research was funded by the I+D+I Program, Consejería de Sanidad, Junta de Castilla y León, Spain (SAN196/VA07/07, SAN673/VA05/08, and SAN126/09).

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of the data; in the writing of the manuscript, or in the decision to publish the results.


  1. Farmer, J.J.; Asbury, M.A.; Hickman, F.W.; Brenner, D.J. Enterobacter sakazakii: A new species of Enterobacteriaceae isolated from clinical specimens. Int. J. Syst. Bacteriol. 1980, 30, 569–584. [Google Scholar] [CrossRef][Green Version]
  2. Iversen, C.; Mullane, N.; McCardell, B.; Tall, B.D.; Lehner, A.; Fanning, S.; Stephan, R.; Joosten, H. Cronobacter gen. nov., a new genus to accommodate the biogroups of Enterobacter sakazakii, and proposal of Cronobacter sakazakii gen. nov., comb. nov., Cronobacter malonaticus sp. nov., Cronobacter turicensis sp. nov., Cronobacter muytjensii sp. nov. Int. J. Syst. Evol. Microbiol. 2008, 58, 1442–1447. [Google Scholar] [CrossRef] [PubMed]
  3. Beuchat, L.R.; Kim, H.; Gurtler, J.B.; Lin, L.-C.; Ryu, J.-H.; Richards, G.M. Cronobacter sakazakii in foods and factors affecting its survival, growth, and inactivation. Int. J. Food Microbiol. 2009, 136, 204–213. [Google Scholar] [CrossRef] [PubMed]
  4. Pagotto, F.; Nazarowec-White, M.; Bidawid, S.; Farber, J. Enterobacter sakazakii: Infectivity and enterotoxin production in vitro and in vivo. J. Food Prot. 2003, 66, 370–376. [Google Scholar] [CrossRef] [PubMed]
  5. Raghav, M.; Aggarwal, P.K. Purification and characterization of Enterobacter sakazakii enterotoxin. Can. J. Microbiol 2007, 53, 750–755. [Google Scholar] [CrossRef]
  6. Lai, K.K. Enterobacter sakazakii infections among neonates, infants, children, and adults. Medicine 2001, 80, 113–122. [Google Scholar] [CrossRef]
  7. International Commission for Microbiological Specification for Foods. Microorganisms in Foods 7: Microbiological Testing in Food Safety Management, 1st ed.; Springer: New York, NY, USA, 2002; ISBN 978-1-4613-5221-1. [Google Scholar]
  8. Arvanitoyannis, I.S. Enterobacter sakazakii and Salmonella in powdered infant formula: Meeting report. Int. J. Food Sci. Technol. 2009, 45, 858. [Google Scholar]
  9. Biering, G.; Karlsson, S.; Clark, N.C.; Jonsdottir, K.E.; Ludvigsson, P.; Steingrimsson, O. Three cases of neonatal meningitis caused by Enterobacter sakazakii in powdered milk. J. Clin. Microbiol. 1989, 27, 2054–2056. [Google Scholar]
  10. Simmons, B.P.; Gelfand, M.S.; Haas, M.; Metts, L.; Ferguson, J. Enterobacter sakazakii infections in neonates associated with intrinsic contamination of a powdered infant formula. Infect. Control. Hosp. Epidemiol. 1989, 10, 398–401. [Google Scholar] [CrossRef]
  11. Van Acker, J.; de Smet, F.; Muyldermans, G.; Bougatef, A.; Naessens, A.; Lauwers, S. Outbreak of necrotizing enterocolitis associated with Enterobacter sakazakii in powdered milk formula. J. Clin. Microbiol. 2001, 39, 293–297. [Google Scholar] [CrossRef][Green Version]
  12. Centers for Disease Control and Prevention (CDC). Enterobacter sakazakii infections associated with the use of powdered infant formula—Tennessee, 2001. MMWR. Morb. Mortal. Wkly. Rep. 2002, 51, 297–300. [Google Scholar]
  13. Bar-Oz, B.; Preminger, A.; Peleg, O.; Block, C.; Arad, I. Enterobacter sakazakii infection in the newborn. Acta Paediatr. 2007, 90, 356–358. [Google Scholar] [CrossRef]
  14. WHO; FAO. Safe Preparation, Storage and Handling of Powdered Infant Formula: Guidelines. Available online: (accessed on 4 November 2019).
  15. Arku, B.; Fanning, S.; Jordan, K. Flow cytometry to assess biochemical pathways in heat-stressed Cronobacter spp. (formerly Enterobacter sakazakii). J. Appl. Microbiol. 2011, 111, 616–624. [Google Scholar] [CrossRef] [PubMed]
  16. Jordan, K.N.; Oxford, L.; O’Byrne, C.P. Survival of low-pH stress by Escherichia coli O157:H7: Correlation between alterations in the cell envelope and increased acid tolerance. Appl. Environ. Microbiol. 1999, 65, 3048–3055. [Google Scholar]
  17. Arku, B.; Fanning, S.; Jordan, K. Heat adaptation and survival of Cronobacter spp. (formerly Enterobacter sakazakii). Foodborne Pathog. Dis. 2011, 8, 975–981. [Google Scholar] [CrossRef]
  18. Herrero, M.; Quiros, C.; Garcia, L.A.; Diaz, M. Use of flow cytometry to follow the physiological states of microorganisms in cider fermentation processes. Appl. Environ. Microbiol. 2006, 72, 6725–6733. [Google Scholar] [CrossRef][Green Version]
  19. Bunthof, C.J.; Abee, T. Development of a flow cytometric method to analyze subpopulations of bacteria in probiotic products and dairy starters. Appl. Environ. Microbiol. 2002, 68, 2934–2942. [Google Scholar] [CrossRef][Green Version]
  20. Baatout, S.; De Boever, P.; Mergeay, M. Temperature-induced changes in bacterial physiology as determined by flow cytometry. Ann. Microbiol. 2005, 55, 73–80. [Google Scholar]
  21. Kim, H.T.; Choi, H.J.; Kim, K.H. Flow cytometric analysis of Salmonella enterica serotype Typhimurium inactivated with supercritical carbon dioxide. J. Microbiol. Methods 2009, 78, 155–160. [Google Scholar] [CrossRef]
  22. Antolinos, V.; Esteban, M.D.; Ros-Chumillas, M.; Huertas, J.P.; Periago, P.M.; Palop, A.; Fernández, P.S. Assessment of the of acid shock effect on viability of Bacillus cereus and Bacillus weihenstephanensis using flow cytometry. Food Res. Int. 2014, 66, 306–312. [Google Scholar] [CrossRef]
  23. Pianetti, A.; Falcioni, T.; Bruscolini, F.; Sabatini, L.; Sisti, E.; Papa, S. Determination of the viability of Aeromonas hydrophila in different types of water by flow cytometry, and comparison with classical methods. Appl. Environ. Microbiol. 2005, 71, 7948–7954. [Google Scholar] [CrossRef] [PubMed][Green Version]
  24. Ben-Amor, K.; Breeuwer, P.; Verbaarschot, P.; Rombouts, F.M.; Akkermans, A.D.L.; De Vos, W.M.; Abee, T. Multiparametric flow cytometry and cell sorting for the assessment of viable, injured, and dead Bifidobacterium cells during bile salt stress. Appl. Environ. Microbiol. 2002, 68, 5209–5216. [Google Scholar] [CrossRef] [PubMed][Green Version]
  25. Ambriz-Aviña, V.; Contreras-Garduño, J.A.; Pedraza-Reyes, M. Applications of flow cytometry to characterize bacterial physiological responses. BioMed Res. Int. 2014. [Google Scholar] [CrossRef]
  26. Papadimitriou, K.; Pratsinis, H.; Nebe-von-Caron, G.; Kletsas, D.; Tsakalidou, E. Rapid assessment of the physiological status of Streptococcus macedonicus by flow cytometry and fluorescence probes. Int. J. Food Microbiol. 2006, 111, 197–205. [Google Scholar] [CrossRef] [PubMed]
  27. Adan, A.; Alizada, G.; Kiraz, Y.; Baran, Y.; Nalbant, A. Flow cytometry: Basic principles and applications. Crit. Rev. Biotechnol. 2017, 37, 163–176. [Google Scholar] [CrossRef] [PubMed]
  28. Nebe-von-Caron, G.; Stephens, P.; Hewitt, C.; Powell, J.; Badley, R. Analysis of bacterial function by multi-colour fluorescence flow cytometry and single cell sorting. J. Microbiol. Methods 2000, 42, 97–114. [Google Scholar] [CrossRef]
  29. Shapiro, H.M. Microbial analysis at the single-cell level: Tasks and techniques. J. Microbiol. Methods 2000, 42, 3–16. [Google Scholar] [CrossRef]
  30. Subires, A.; Yuste, J.; Capellas, M. Flow cytometry immunodetection and membrane integrity assessment of Escherichia coli O157:H7 in ready-to-eat pasta salad during refrigerated storage. Int. J. Food Microbiol. 2014, 168–169, 47–56. [Google Scholar] [CrossRef] [PubMed]
  31. Kell, D.B.; Kaprelyants, A.S.; Weichart, D.H.; Harwood, C.R.; Barer, M.R. Viability and activity in readily culturable bacteria: A review and discussion of the practical issues. Antonie Leeuwenhoek 1998, 73, 169–187. [Google Scholar] [CrossRef]
  32. Wesche, A.M.; Gurtler, J.B.; Marks, B.P.; Ryser, E.T. Stress, sublethal injury, resuscitation, and virulence of bacterial foodborne pathogens. J. Food Prot. 2009, 72, 1121–1138. [Google Scholar] [CrossRef]
  33. Braux, A.S.; Minet, J.; Tamanai-Shacoori, Z.; Riou, G.; Cormier, M. Direct enumeration of injured Escherichia coli cells harvested onto membrane filters. J. Microbiol. Methods 1997, 31, 1–8. [Google Scholar] [CrossRef]
  34. Gregori, G.; Citterio, S.; Ghiani, A.; Labra, M.; Sgorbati, S.; Brown, S.; Denis, M. Resolution of viable and membrane-compromised bacteria in freshwater and marine waters based on analytical flow cytometry and nucleic acid double staining. Appl. Environ. Microbiol. 2001, 67, 4662–4670. [Google Scholar] [CrossRef] [PubMed][Green Version]
  35. Zhao, X.; Zhong, J.; Wei, C.; Lin, C.-W.; Ding, T. Current perspectives on viable but non-culturable state in foodborne pathogens. Front. Microbiol. 2017, 8, 580. [Google Scholar] [CrossRef] [PubMed][Green Version]
  36. Ueckert, J.E.; Nebe von-Caron, G.; Bos, A.P.; Ter Steeg, P.F. Flow cytometric analysis of Lactobacillus plantarum to monitor lag times, cell divisionand injury. Lett. Appl. Microbiol. 1997, 25, 295–299. [Google Scholar] [CrossRef] [PubMed]
  37. Lemarchand, K.; Parthuisot, N.; Catala, P.; Lebaron, P. Comparative assessment of epifluorescence microscopy, flow cytometry and solid-phase cytometry used in the enumeration of specific bacteria in water. Aquat. Microb. Ecol. 2001, 25, 301–309. [Google Scholar] [CrossRef][Green Version]
  38. Choi, M.J.; Kim, S.A.; Lee, N.Y.; Rhee, M.S. New decontamination method based on caprylic acid in combination with citric acid or vanillin for eliminating Cronobacter sakazakii and Salmonella enterica serovar Typhimurium in reconstituted infant formula. Int. J. Food Microbiol. 2013, 166, 499–507. [Google Scholar] [CrossRef]
  39. Joshi, S.S.; Howell, A.B.; D’Souza, D.H. Cronobacter sakazakii reduction by blueberry proanthocyanidins. Food Microbiol. 2014, 39, 127–131. [Google Scholar] [CrossRef]
  40. Lehner, A.; Riedel, K.; Eberl, L.; Breeuwer, P.; Diep, B.; Stephan, R. Biofilm formation, extracellular polysaccharide production, and cell-to-cell signaling in various Enterobacter sakazakii strains: Aspects promoting environmental persistence. J. Food Prot. 2005, 68, 2287–2294. [Google Scholar] [CrossRef]
  41. Parra-Flores, J.; Juneja, V.; de Fernando, G.G.; Aguirre, J. Variability in cell response of Cronobacter sakazakii after mild-heat treatments and its impact on food safety. Front. Microbiol. 2016, 7, 1–14. [Google Scholar] [CrossRef]
  42. Chen, C.-Y.; Nace, G.W.; Irwin, P.L. A 6×6 drop plate method for simultaneous colony counting and MPN enumeration of Campylobacter jejuni, Listeria monocytogenes, and Escherichia coli. J. Microbiol. Methods 2003, 55, 475–479. [Google Scholar] [CrossRef]
  43. Edelson-Mammel, S.G.; Buchanan, R.L. Thermal inactivation of Enterobacter sakazakii in rehydrated infant formula. J. Food Prot. 2004, 67, 60–63. [Google Scholar] [CrossRef] [PubMed]
  44. Gunasekera, T.S.; Attfield, P.V.; Veal, D.A. A flow cytometry method for rapid detection and enumeration of total bacteria in milk. Appl. Environ. Microbiol. 2000, 66, 1228–1232. [Google Scholar] [CrossRef] [PubMed][Green Version]
  45. Iversen, C.; Lane, M.; Forsythe, S.J. The growth profile, thermotolerance and biofilm formation of Enterobacter sakazakii grown in infant formula milk. Lett. Appl. Microbiol. 2004, 38, 378–382. [Google Scholar] [CrossRef] [PubMed]
  46. Jamal, M.; Ahmad, W.; Andleeb, S.; Jalil, F.; Imran, M.; Nawaz, M.A.; Hussain, T.; Ali, M.; Rafiq, M.; Kamil, M.A. Bacterial biofilm and associated infections. J. Chin. Med. Assoc. 2018, 81, 7–11. [Google Scholar] [CrossRef]
  47. Miquel, S.; Lagrafeuille, R.; Souweine, B.; Forestier, C. Anti-biofilm activity as a health issue. Front. Microbiol. 2016, 7, 592. [Google Scholar] [CrossRef]
  48. Galié, S.; García-Gutiérrez, C.; Miguélez, E.M.; Villar, C.J.; Lombó, F. Biofilms in the food industry: Health aspects and control methods. Front. Microbiol. 2018, 9, 898. [Google Scholar] [CrossRef]
  49. Fredrickson, A.G.; Ramkrishna, D.; Tsuchiya, H.M. Statistics and dynamics of procaryotic cell populations. Math. Biosci. 1967, 1, 327–374. [Google Scholar] [CrossRef]
  50. Baranyi, J.; Roberts, T.A. A dynamic approach to predicting bacterial growth in food. Int. J. Food Microbiol. 1994, 23, 277–294. [Google Scholar] [CrossRef]
  51. Stocks, S.M. Mechanism and use of the commercially available viability stain, BacLight. Cytometry 2004, 61, 189–195. [Google Scholar] [CrossRef]
  52. Müller, S.; Nebe-von-Caron, G. Functional single-cell analyses: Flow cytometry and cell sorting of microbial populations and communities. FEMS Microbiol. Rev. 2010, 34, 554–587. [Google Scholar] [CrossRef][Green Version]
  53. Manini, E.; Danovaro, R. Synoptic determination of living/dead and active/dormant bacterial fractions in marine sediments. FEMS Microbiol. Ecol. 2006, 55, 416–423. [Google Scholar] [CrossRef] [PubMed][Green Version]
  54. Berney, M.; Hammes, F.; Bosshard, F.; Weilenmann, H.U.; Egli, T. Assessment and interpretation of bacterial viability by using the LIVE/DEAD BacLight kit in combination with flow cytometry. Appl. Environ. Microbiol. 2007, 73, 3283–3290. [Google Scholar] [CrossRef][Green Version]
  55. Díaz, M.; Herrero, M.; García, L.A.; Quirós, C. Application of flow cytometry to industrial microbial bioprocesses. Biochem. Eng. J. 2010, 48, 385–407. [Google Scholar] [CrossRef]
  56. Sträuber, H.; Müller, S. Viability states of bacteria-specific mechanisms of selected probes. Cytom. Part A 2010, 77, 623–634. [Google Scholar] [CrossRef] [PubMed]
  57. Barbesti, S.; Citterio, S.; Labra, M.; Baroni, M.D.; Neri, M.G.; Sgorbati, S. Two and three-color fluorescence flow cytometric analysis of immunoidentified viable bacteria. Cytometry 2000, 40, 214–218. [Google Scholar] [CrossRef]
  58. Ben-Amor, K.; Heilig, H.; Smidt, H.; Vaughan, E.E.; Abee, T.; de Vos, W.M. Genetic diversity of viable, injured, and dead fecal bacteria assessed by fluorescence-activated cell sorting and 16S rRNA gene analysis. Appl. Environ. Microbiol. 2005, 71, 4679–4689. [Google Scholar] [CrossRef] [PubMed][Green Version]
  59. Saegeman, V.S.M.; De Vos, R.; Tebaldi, N.D.; van der Wolf, J.M.; Bergervoet, J.H.W.; Verhaegen, J.; Lismont, D.; Verduyckt, B.; Ectors, N.L. Flow cytometric viability assessment and transmission electron microscopic morphological study of bacteria in glycerol. Microsc. Microanal. 2007, 13, 18–29. [Google Scholar] [CrossRef] [PubMed][Green Version]
  60. Silva, F.; Ferreira, S.; Queiroz, J.A.; Domingues, F.C. Coriander (Coriandrum sativum L.) essential oil: Its antibacterial activity and mode of action evaluated by flow cytometry. J. Med. Microbiol. 2011, 60, 1479–1486. [Google Scholar] [CrossRef][Green Version]
  61. Sachidanandham, R.; Yew-Hoong Gin, K.; Laa Poh, C. Monitoring of active but non-culturable bacterial cells by flow cytometry. Biotechnol. Bioeng. 2005, 89, 24–31. [Google Scholar] [CrossRef]
  62. Virta, M.; Lineri, S.; Kankaanpää, P.; Karp, M.; Peltonen, K.; Nuutila, J.; Lilius, E.M. Determination of complement-mediated killing of bacteria by viability staining and bioluminescence. Appl. Environ. Microbiol. 1998, 64, 515–519. [Google Scholar]
  63. Berney, M.; Weilenmann, H.-U.; Egli, T. Flow-cytometric study of vital cellular functions in Escherichia coli during solar disinfection (SODIS). Microbiology 2006, 152, 1719–1729. [Google Scholar] [CrossRef] [PubMed][Green Version]
  64. Hoefel, D.; Grooby, W.L.; Monis, P.T.; Andrews, S.; Saint, C.P. Enumeration of water-borne bacteria using viability assays and flow cytometry: A comparison to culture-based techniques. J. Microbiol. Methods 2003, 55, 585–597. [Google Scholar] [CrossRef]
  65. Joux, F.; Lebaron, P. Use of fluorescent probes to assess physiological functions of bacteria at single-cell level. Microbes Infect. 2000, 2, 1523–1535. [Google Scholar] [CrossRef]
  66. Rosenberg, M.; Azevedo, N.F.; Ivask, A. Propidium iodide staining underestimates viability of adherent bacterial cells. Sci. Rep. 2019, 9, 6483. [Google Scholar] [CrossRef] [PubMed][Green Version]
  67. Chamberlain, J.; Moss, S.H. Lipid peroxidation and other membrane damage produced in Escherichia coli K1060 by near-UV radiation and deuterium oxide. Photochem. Photobiol. 1987, 45, 625–630. [Google Scholar] [CrossRef] [PubMed]
  68. Wagner, S.; Snipes, W. Effects of acridine plus near-ultraviolet light on the outer membrane of Escherichia coli. Photochem. Photobiol. 1982, 36, 255–258. [Google Scholar] [CrossRef] [PubMed]
  69. Yan, Q.Q.; Condell, O.; Power, K.; Butler, F.; Tall, B.D.; Fanning, S. Cronobacter species (formerly known as Enterobacter sakazakii) in powdered infant formula: A review of our current understanding of the biology of this bacterium. J. Appl. Microbiol. 2012, 113, 1–15. [Google Scholar] [CrossRef]
  70. Xu, Y.Z.; Métris, A.; Stasinopoulos, D.M.; Forsythe, S.J.; Sutherland, J.P. Effect of heat shock and recovery temperature on variability of single cell lag time of Cronobacter turicensis. Food Microbiol. 2015, 45, 195–204. [Google Scholar] [CrossRef]
  71. Forsythe, S.J. FSA Project B13010. Bactericidal Preparation of Powdered Infant Formula, Final Report. 2009. Available online: (accessed on 4 November 2019).
  72. Pina-Pérez, M.C.; Rodrigo, D.; Martínez, A. Nonthermal inactivation of Cronobacter sakazakii in infant formula milk: A review. Crit. Rev. Food Sci. Nutr. 2016, 56, 1620–1629. [Google Scholar] [CrossRef]
  73. Turck, D. Safety aspects in preparation and handling of infant food. Ann. Nutr. Metab. 2012, 60, 211–214. [Google Scholar] [CrossRef]
  74. Marty, V.; Jasnin, M.; Fabiani, E.; Vauclare, P.; Gabel, F.; Trapp, M.; Peters, J.; Zaccai, G.; Franzetti, B. Neutron scattering: A tool to detect in vivo thermal stress effects at the molecular dynamics level in micro-organisms. J. R. Soc. Interface 2013, 10, 20130003. [Google Scholar] [CrossRef] [PubMed][Green Version]
  75. Tehei, M.; Franzetti, B.; Madern, D.; Ginzburg, M.; Ginzburg, B.Z.; Giudici-Orticoni, M.-T.; Bruschi, M.; Zaccai, G. Adaptation to extreme environments: Macromolecular dynamics in bacteria compared in vivo by neutron scattering. EMBO Rep. 2004, 5, 66–70. [Google Scholar] [CrossRef] [PubMed][Green Version]
  76. Koutsoumanis, K. A study on the variability in the growth limits of individual cells and its effect on the behavior of microbial populations. Int. J. Food Microbiol. 2008, 128, 116–121. [Google Scholar] [CrossRef] [PubMed]
  77. Metris, A.; George, S.M.; Mackey, B.M.; Baranyi, J. Modeling the variability of single-cell lag times for Listeria innocua populations after sublethal and lethal heat treatments. Appl. Environ. Microbiol. 2008, 74, 6949–6955. [Google Scholar] [CrossRef][Green Version]
  78. Aguirre, J.S.; González, A.; Özçelik, N.; Rodríguez, M.R.; García de Fernando, G.D. Modeling the Listeria innocua micropopulation lag phase and its variability. Int. J. Food Microbiol. 2013, 164, 60–69. [Google Scholar] [CrossRef]
  79. Aguirre, J.S.; Pin, C.; Rodriguez, M.R.; Garcia de Fernando, G.D. Analysis of the variability in the number of viable bacteria after mild heat treatment of food. Appl. Environ. Microbiol. 2009, 75, 6992–6997. [Google Scholar] [CrossRef][Green Version]
  80. Lianou, A.; Koutsoumanis, K.P. Effect of the growth environment on the strain variability of Salmonella enterica kinetic behavior. Food Microbiol. 2011, 28, 828–837. [Google Scholar] [CrossRef]
  81. Davey, H.M. Flow cytometric techniques for the detection of microorganisms. Meth. Cell Sci. 2002, 24, 91–97. [Google Scholar] [CrossRef]
  82. Zacharias, N.; Kistemann, T.; Schreiber, C. Application of flow cytometry and PMA-qPCR to distinguish between membrane intact and membrane compromised bacteria cells in an aquatic milieu. Int. J. Hyg. Environ. Health 2015, 218, 714–722. [Google Scholar] [CrossRef]
Figure 1. Flow cytometry plot of SYTO9-PI stained alcohol-treated dead cells of Cronobacter sakazakii. The distribution of the observed events was a function of forward and side light scatter Results from one of the assays carried out in triplicate.
Figure 1. Flow cytometry plot of SYTO9-PI stained alcohol-treated dead cells of Cronobacter sakazakii. The distribution of the observed events was a function of forward and side light scatter Results from one of the assays carried out in triplicate.
Foods 08 00688 g001
Figure 2. Flow cytometry plots of SYTO9-PI stained Cronobacter sakazakii cells from non-treated cell suspensions (A: 100% nTCS) and treated cell suspensions (B13: 0% nTCS, i.e., TCS). Different ratios of nTCS:TCS are shown (0, 25, 50, or 75% nTCS) after heat treatments at 60 (B1ac), 65 (B2ac) or 100 °C (B3ac). The plots show gates for live, compromised, and dead cells. Axis X: SYTO9 FL1 Log. Axis Y: PI FL3 Log. Results from one of the assays carried out in triplicate.
Figure 2. Flow cytometry plots of SYTO9-PI stained Cronobacter sakazakii cells from non-treated cell suspensions (A: 100% nTCS) and treated cell suspensions (B13: 0% nTCS, i.e., TCS). Different ratios of nTCS:TCS are shown (0, 25, 50, or 75% nTCS) after heat treatments at 60 (B1ac), 65 (B2ac) or 100 °C (B3ac). The plots show gates for live, compromised, and dead cells. Axis X: SYTO9 FL1 Log. Axis Y: PI FL3 Log. Results from one of the assays carried out in triplicate.
Foods 08 00688 g002
Figure 3. Correlation between the agar plate counts (log CFU/mL) of C. sakazakii and total bacterial counts detected by flow cytometry (log FC counts/mL).
Figure 3. Correlation between the agar plate counts (log CFU/mL) of C. sakazakii and total bacterial counts detected by flow cytometry (log FC counts/mL).
Foods 08 00688 g003

Share and Cite

MDPI and ACS Style

Cal-Sabater, P.; Caro, I.; Castro, M.J.; Cao, M.J.; Mateo, J.; Quinto, E.J. Flow Cytometry to Assess the Counts and Physiological State of Cronobacter sakazakii Cells after Heat Exposure. Foods 2019, 8, 688.

AMA Style

Cal-Sabater P, Caro I, Castro MJ, Cao MJ, Mateo J, Quinto EJ. Flow Cytometry to Assess the Counts and Physiological State of Cronobacter sakazakii Cells after Heat Exposure. Foods. 2019; 8(12):688.

Chicago/Turabian Style

Cal-Sabater, Paloma, Irma Caro, María J. Castro, María J. Cao, Javier Mateo, and Emiliano J. Quinto. 2019. "Flow Cytometry to Assess the Counts and Physiological State of Cronobacter sakazakii Cells after Heat Exposure" Foods 8, no. 12: 688.

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop