Next Article in Journal
Retrospective Analysis of Leishmaniasis in Sicily (Italy) from 2013 to 2021: One-Health Impact and Future Control Strategies
Next Article in Special Issue
Long-Term Effects of Single-Dose Cephalosporin or Macrolide Use on the Prevalence of AmpC and Extended-Spectrum β-Lactamase Producing Escherichia coli in the Feces of Beef Cattle
Previous Article in Journal
Molecular Identification of Babesia spp. and Anaplasma marginale in Water Buffaloes in Veracruz and Tabasco, Mexico: A Retrospective Study
Previous Article in Special Issue
Tracking Antimicrobial Resistant E. coli from Pigs on Farm to Pork at Slaughter
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Preharvest Environmental and Management Drivers of Multidrug Resistance in Major Bacterial Zoonotic Pathogens in Pastured Poultry Flocks

by
Moses B. Ayoola
1,2,†,
Nisha Pillai
3,†,
Bindu Nanduri
2,
Michael J. Rothrock
4 and
Mahalingam Ramkumar
3,*
1
Geosystems Research Institute, Mississippi State University, Starkville, MS 39762, USA
2
College of Veterinary Medicine, Mississippi State University, Starkville, MS 39762, USA
3
Computer Science & Engineering, Mississippi State University, Starkville, MS 39762, USA
4
Egg Safety and Quality Research Unit, USDA-ARS U.S. National Poultry Research Center, Athens, GA 30605, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Microorganisms 2022, 10(9), 1703; https://doi.org/10.3390/microorganisms10091703
Submission received: 28 June 2022 / Revised: 25 July 2022 / Accepted: 18 August 2022 / Published: 24 August 2022
(This article belongs to the Special Issue Pathogens and Antimicrobial Drug Resistance in the Food Chain)

Abstract

:
Due to nutritional benefits and perceived humane ways of treating the animals, the demand for antibiotic-free pastured poultry chicken has continued to be steadily rise. Despite the non-usage of antibiotics in pastured poultry broiler production, antibiotic resistance (AR) is reported in zoonotic poultry pathogens. However, factors that drive multidrug resistance (MDR) in pastured poultry are not well understood. In this study, we used machine learning and deep learning approaches to predict farm management practices and physicochemical properties of feces and soil that drive MDR in zoonotic poultry pathogens. Antibiotic use in agroecosystems is known to contribute to resistance. Evaluation of the development of resistance in environments that are free of antibiotics such as the all-natural, antibiotic-free, pastured poultry production systems described here is critical to understand the background AR in the absence of any selection pressure, i.e., basal levels of resistance. We analyzed 1635 preharvest (feces and soil) samples collected from forty-two pastured poultry flocks and eleven farms in the Southeastern United States. CDC National Antimicrobial Resistance Monitoring System guidelines were used to determine antimicrobial/multidrug resistance profiles of Salmonella, Listeria, and Campylobacter. A combination of two traditional machine learning (RandomForest and XGBoost) and three deep learning (Multi-layer Perceptron, Generative Adversarial Network, and Auto-Encoder) approaches identified critical farm management practices and environmental variables that drive multidrug resistance in poultry pathogens in broiler production systems that represents background resistance. This study enumerates management practices that contribute to AR and makes recommendations to potentially mitigate multidrug resistance and the prevalence of Salmonella and Listeria in pastured poultry.

Graphical Abstract

1. Introduction

The increasing incidence of antibiotic resistance (AR) is a major global threat to public health. Apart from the main usage of antibiotics for the treatment of infection, there is also prophylactic use to enhance growth in commercial poultry production in some countries. Antibiotics as growth promoters were banned in the EU in 2006 and in the US in 2017 [1]. The persistent presence of antibiotics in the environment could enhance the expression of antibiotic resistance genes and potentiate antibiotic-resistant bacteria [2,3]. In some scenarios, pathogens may develop resistance to multiple antibiotics/drugs, i.e., multidrug resistance (MDR) [4]. In addition to the overuse and misuse of antibiotics, co-selection of resistance genes due to the usage of biocides [5,6] or the presence of heavy metals [7] found naturally in the soil in agricultural environments can contribute to AR. The prevalence of MDR poultry pathogens such as Salmonella spp., Listeria spp., and Campylobacter spp. is a food biosafety concern. Poultry is a major repository of these pathogens, and millions of people depend on poultry products for their daily protein supply. According to CDC, Salmonella spp., Listeria spp., and Campylobacter spp. are among the top nine causative agents of foodborne illnesses reported in the US [8].
The AR transmission mode and rates between animals, the environment, and humans is not well understood for all pathogens. As the potential risk of exacerbating AR in humans is a major concern, global efforts to mitigate AR are required. Salmonella MDR in pastured poultry is reported to be comparable to the MDR observed in conventional poultry production systems [9]. Specific farm management practices and/or physicochemical properties of the preharvest samples (feces, soil) that could contribute to the development of MDR are not known. Here, we sampled eleven different antibiotic-free pastured poultry farms, representing forty-two flocks in the Southeastern United States. Salmonella, Campylobacter, and Listeria were isolated from preharvest samples (feces and soil), and AR profiles were characterized utilizing National Antimicrobial Resistance Monitoring System for Enteric Bacteria (NARMS) protocols (www.cdc.gov/narms, accessed on 1 July 2021). To determine the management and environmental drivers of MDR among these pathogens, an ensemble machine learning approach comprising both traditional learning and deep learning was employed.

2. Materials and Methods

Forty-two flocks from eleven pastured poultry farms located in the southeastern U.S. were sampled over a period of four years. All broilers flocks were considered all-natural, pasture-raised, and never had any antibiotics administered to them during their grow-out, nor were they used historically on the farms.
Sample Collection: Preharvest samples (feces and soil) were collected from the pasture (i) within a few days of broilers being placed on the pasture, (ii) halfway through their time on pasture, and (iii) on the day the flock was processed. At each sampling time, the pasture area was divided into five separate sections, and five subsamples in each section were pooled into a single sample for each section (five total samples each of feces and soil samples were collected on each sampling day). The total volume of sample collected for each field sample was at least 25 g. All samples were collected in the field, and returned to the lab in a cooler packed in ice. Three grams (feces, soil) were combined within filtered stomacher bags (Seward Laboratories Systems, Inc., West cSussex, UK) and diluted 1:3 using 10 mmol/L phosphate-buffered saline (PBS). All samples were homogenized for 60 s, and homogenates were used for all downstream cultural isolations.

2.1. Cultural Isolation Methods

Salmonella spp.: As a pre-enrichment step, the stomached homogenates remained in the filtered stomacher bags and were incubated overnight at 35 C. Two different enrichment broths were used to isolate Salmonella spp. from these environmental samples: Tetrathionate broth and Rappaport Vassiliadis (Becton Dickinson, Sparks, MD, USA) media. After overnight incubation at 42 C in both of these enrichment broths, one loopful from each enrichment broth was spread on two different differential media: Brilliant Green Sulfa with novobiocin (Becton Dickinson, Sparks, MD, USA) agar and xylose lysine tergitol-4 (Becton Dickinson, Sparks, MD, USA) agar. These plates were incubated overnight at 35 C, and on each plate, three Salmonella-like colonies per subsample were picked and confirmed using triple sugar iron agar (Becton Dickinson, Sparks, MD, USA) and lysine iron agar fermentation (Becton Dickinson, Sparks, MD, USA) using an incubation period of 18 to 24 h. Final confirmation of suspect triple sugar iron/lysine iron agar isolates was performed using Salmonella polyvalent O antiserum agglutination (Becton Dickinson, Sparks, MD, USA) using the manufacturer’s specifications. Positive Salmonellae were serogrouped using individual Salmonella poly O antisera for O groups A through I following the Kauffman–White scheme [10].
Campylobacter spp.: Recovery of Campylobacter spp. from homogenized samples was performed as previously described [11]. Initially, 100 mL of homogenized suspension was removed, plated onto Campy–Cefex agar, and incubated at 42 ± 1 C for 36 to 48 h in a microaerobic atmosphere (5N2). Putative Campylobacter spp. colonies were enumerated, and up to five colonies per sample were subcultured on Brucella agar supplemented with 10% lysed horse blood (BAB plates) for isolation and incubated as previously described.
Listeria spp.: As a pre-enrichment step, the stomached homogenates remained in the filtered stomacher bags and were incubated overnight at 35 C. This pre-enrichment step was followed by two enrichments in UVM-Modified Listeria Enrichment Broth (Becton Dickinson, Sparks, MD, USA) and Fraser Broth (Becton Dickinson, Sparks, MD, USA), both requiring overnight incubation at 30 C. One loopful of the Fraser’s enrichment was streaked for isolation of Listeria selective agar (Becton Dickinson, Sparks, MD, USA). These plates were incubated overnight at 30 C, and on each plate, three Listeria-like colonies per positive subsample were picked and confirmed as Listeria using the appropriate BAX PCR assay (DuPont).

2.2. Antibiotic Sensitivity Testing

For all three target bacteria, the published NARMS protocols and NARMS breakpoints were used for characterization and AR determination for each isolate (www.cdc.gov/narms, accessed on 1 July 2021). Isolates were considered multidrug resistant if they were resistant to three or more tested antibiotics.
Salmonella spp.: Recovered isolates were subcultured on blood agar plates (BAPs) overnight at 36 ± 1 C, twice sequentially. One or two colonies were used to inoculate 5 mL of demineralized water to achieve a 0.5 McFarland equivalent using the Sensititre nephelometer (Thermo Fisher Scientific, Waltham, MA, USA). After vortexing, 10 mL of the cell suspension was transferred to 11 mL of Sensititre Cation adjusted Mueller–Hinton Broth with TES, followed by thorough vortexing. Fifty microliters of the inoculum was transferred to each well of the Sensititre NARMS Gram-Negative Format CMV3AGNF plate (Thermo Fisher Scientific, Waltham, MA, USA). These antibiotic sensitivity testing plates contained varying concentrations of the following antimicrobials in µg/mL: cefoxitin (0.5–32), azithromycin (0.12–16), chloramphenicol (2–32), tetracycline (4–32), ceftriaxone (0.25–64), amoxicillin/clavulanic acid (2:1) (1/0.5v32/16), ciprofloxacin (0.015–4), gentamicin (0.25–16), nalidixic acid (0.5–32), ceftiofur (0.12–8), sulfisoxazole (16–256), trimethoprim/sulfamethoxazole (0.12/2.4–4/76), ampicillin (1–32), and streptomycin (32–64). Plates were sealed and incubated at 36 ± 1 C for 24 h. Quality control strains E. coli ATCC25922, Staphylococcus aureus ATCC 29213, Enterococcus fecalis ATCC 29212, and Pseudomonas aeruginosa ATCC 27853 were included in susceptibility tests as controls (Clinical and Laboratory Standards Institute, 2010).
Campylobacter spp.: Recovered Campylobacter spp. isolates were subcultured on BAPs overnight at 42 ± 1 C. Three or four colonies were used to inoculate 5 mL of Sensititre Cation adjusted Mueller–Hinton Broth with TES (Thermo Fisher Scientific, Waltham, MA, USA) to achieve a 0.5 McFarland equivalent using the Sensititre nephelometer. After vortexing, 100 mL of the suspension was transferred to 11 mL of Sensititre Cation adjusted AutoRead Mueller–Hinton Broth with TES and 5% lysed horse blood. One hundred microliters of the inoculum was transferred to each well of the Sensititre CAMPY custom-made microtiter panel as previously described [12,13]. The panel contains nine antimicrobials with the following range of concentration in µg/mL: azithromycin (0.015–64), ciprofloxacin (0.015–64), clindamycin (0.03–16), erythromycin (0.03–64), florfenicol (0.03–64), gentamicin (0.12–32), nalidixic acid (4–64), telithromycin (0.015–8), and tetracycline (0.06–64). Panels were incubated under microaerobic conditions at 42 ± 1 C for 24 h, and Campylobacter jejuni isolate 33560 [14] was used as a quality control organism.
Listeria spp.: Recovered isolates were subcultured on BAPs overnight at 36 ± 1 C, twice sequentially. Colonies were used to inoculate 5 mL of Sensititre Cation adjusted Mueller–Hinton Broth with TES to achieve a 0.5 McFarland equivalent using the Sensititre nephelometer (Thermo Fisher Scientific, Waltham, MA, USA). After vortexing, 50 mL of the cell suspension was transferred to 11 mL of Sensititre Cation-Adjusted Mueller–Hinton Broth with TES with lysed horse blood, followed by thorough mixing by inversion. One hundred microliters of the inoculum was transferred to each well of the Sensititre NARMS Gram-Positive Format CMV3AGPF plate (Thermo Fisher Scientific, Waltham, MA, USA). These antibiotic sensitivity testing plates contained varying concentrations of the following antimicrobials in µg/mL: tigecycline (0.015–0.5), tetracycline (1–32), chloramphenicol (2–32), daptomycin (0.25–16), streptomycin (512–2048), tylosin tartrate (0.25–32), quinupristin/dalfopristin (0.5–32), linezolid (0.5–8), nitrofurantoin (2–64), penicillin (0.25–16), kanamycin (128–1024), erythromycin (0.25–8), ciprofloxacin (0.12–4), vancomycin (0.25–32), lincomycin (1–8), and gentamicin (128–1024). Plates were sealed and incubated at 36 ± 1 C for 24 h. A quality control strain (Streptococcus pneumoniae ATCC 49619) was included in susceptibility tests as a positive control (Clinical and Laboratory Standards Institute, 2010). Reported minimum inhibitory concentration values were divided by two to compensate for the double volume of inoculum transferred to plate wells, and the NARMS Enterococcus breakpoints were used for all drugs except penicillin, which has a Listeria-specific breakpoint listed.

2.3. Physicochemical Analysis

Feces and soil samples were analyzed as previously described [15]. The moisture content of the fecal and soil samples was determined by drying overnight at 65 C and calculating the difference between the wet and dried weights of the soil/feces. Fecal and soil pH and electrical conductivity (EC) were determined using an Orion Versa Star Advanced Electrochemistry Meter (Thermo Fisher Scientific, Waltham, MA, USA) using a 1:5 dilution in distilled water. Fecal and soil samples were submitted to the University of Georgia Soils Testing Laboratory (Athens, GA, USA) for determining the elemental composition.
Thirty-one distinct farm variables and management practice variables (Appendix A Table A1) associated with the feces and soil that were inputs for RandomForest algorithm [16] were used with an ensemble of five different machine learning approaches. Furthermore, the following twenty-four constituents/properties of poultry feces and pastured soil were included as additional input variables for models in this study: acidity/alkalinity (pH), electrical conductivity (EC), moisture, total carbon (TotalC), total nitrogen (TotalN), carbon-to-nitrogen ratio (C:N), aluminum (A), boron (B), calcium (Ca), cadmium (Cd), chromium (Cr), copper (Cu), iron (Fe), potassium (K), magnesium (Mg), manganese (Mn), molybdenum (Mo), sodium (Na), nickel (Ni), phosphorous (P), lead (Pb), sulfur (S), silicon (Si), and zinc (Zn).

2.4. MDR Prediction

An imbalanced, noisy, complex data set presents a major challenge in predicting MDR. This research uses predictive analytics to estimate the likelihood of MDR in Salmonella, Campylobacter, and Listeria by using historical poultry farm management variables. In our predictive modeling, we rely primarily on three processes: (1) standardization or normalization to reduce redundancy; (2) over-sampling to balance skewed distribution; and (3) deep learning to enhance confidence in MDR prediction (Please visit https://github.com/nispillai/EnsembleModellingForFoodSafety (accessed on 26 June 2022) for code). A pipeline combining quantile transformation, random sampling, and auto-encoding was created for the classification of MDR in Salmonella. Our auto-encoder model consists of an encoder layer and a decoder layer with 70 neural network units each and a latent layer with 30 neural network units. Additionally, we have a prediction model using 70 neural network units and a binary output node that can predict positive and negative samples from the latent representation. We use HE uniform [17] for the initialization of our kernel weights, Adam [18] for stochastic gradient descent, and ReLU [19] for activation. Campylobacter MDR is classified using unit normalization, SMOTE sampling, and multi-layer perception (MLP) framework. We used 30 neural network units in the hidden layer, along with a binary classification output layer. The weights of our kernels are initialized with HE uniform and Adam algorithms for stochastic gradient descent. In addition, we used robust-scale normalization, SMOTE sampling, and generative adversarial networks (GAN) to classify MDR in Listeria. For GAN, the discriminator model is composed of a hidden layer with 50 units and an output node. In the generator model, there are three layers: a hidden layer of 70 units, a latent layer of 50 units, and a generator layer of 70 units. We compute the results using the ReLU activation function and Adam optimizer, as well as HE uniform kernel initialization. We used four-fold cross-validation for all the models to train, evaluate, and predict the data sampled from the dataset. Our analyses are performed by using Python (v3.7.11), Tensor-flow (v1.15) [20], Keras (v2.3.1) [21], scikit-learn (v1.0.2) [22], pandas (v1.3.4) ([23,24]), and imblearn (v0.9.0) [25]. To perform the normalization, we used scikit-learn libraries with default parameters. We used the imblearn library with default parameters for oversampling approaches.

2.5. Critical Farm Feature Selection

In order to determine the critical and influential farm practices associated with MDR, we use a multi algorithm ensemble approach. In addition to the three deep learning algorithms (MLP, GAN, and Auto-Encoder), we also use popular machine learning algorithms such as Random Forest and XGBoost in this ensemble model. Following the training of the five learning models with the same data, we use the SHAP (SHapley Additive exPlanations) library (v0.39.0) [26] to select the top 15 most important features from all the models. We use majority voting, i.e., features selected by at least three models, to determine the most influential features. Once the influential features have been selected, we analyze the SHAP plots to determine which feature values are most likely to result in a reduction in MDR.

3. Results and Discussion

There is growing interest in antibiotic resistance (AR) and multidrug resistance (MDR) in the agricultural sector, as they are public health concerns especially for both clinicians and veterinarians. The use of antibiotics for the treatment of animal infections and prophylactic use at sub-therapeutic dose to enhance animal growth could lead to MDR and transmission to humans. About 148 mg of antibiotics per kilogram of chicken is estimated to be consumed by humans, and the quantity is projected to continue in an upward direction [27]. The application of animal waste as organic manure is an indirect environmental mechanism of AR transmission to humans as these anthropogenic contaminants could potentially enhance antibiotic resistance genes of the microorganisms in the ecosystem [28]. Nevertheless, microorganisms such as Pseudomonas aeruginosa, Stenotrophomonas maltophilia, and Enterococci possess intrinsic capability to develop antibiotic resistance without encountering any antimicrobial contaminant ([29,30]). Recent studies report the prevalence of MDR (resistance to three or more antibiotics) isolates of Salmonella, Listeria, and Campylobacter, important zoonotic pathogens on poultry farms without historical or exogenous sources of antibiotics [31]. However, the drivers of MDR from the environment (soil) or animals themselves (feces) are yet to be identified. We utilized an ensemble approach combining machine learning and deep learning to identify preharvest management practices that are predictive of MDR in poultry pathogens and determine the feature values that are associated with low MDR.
As stated in Section 2.4, our implementation uses some popular machine learning and data science libraries. We use Tensorflow, which is an open source library for implementing deep neural networks. In order to facilitate faster experimentation, we use Keras, a deep learning API that runs on top of Tensorflow. The scikit-learn package is another popular Python-based API that is used for machine learning algorithms. In addition, the pandas package is commonly used for data manipulation and analysis.

3.1. Data Analysis

Table 1 is an overview of the number of samples in our dataset that exhibit varying degrees of antibiotic resistance.
Only 27% of fecal samples had Salmonella that were resistant to three or more antibiotics (MDR), while 37% of Salmonella isolates were MDR in soil samples. Salmonella MDR included antibiotics that inhibit protein synthesis (tetracycline, streptomycin) and antibiotics that target cell wall synthesis (ampicillin, augmentin, cefoxitin, ceftriaxone, ceftiofur) among the antibiotics tested in this study. High prevalence (frequency of PCR-based detection) of the tetA and aadA1 genes responsible for E. coli resistance to protein-synthesis-targeting tetracycline and streptomycin (72 and 33% prevalence rate, respectively) have been previously reported in poultry broiler chicken [32]. The same study found a similar pattern of resistance to protein-targeting antibiotics in layers. The horizontal transfer of resistance genes between E. coli and other organisms such as Salmonella, Listeria, and Campylobacter in the poultry production environment could contribute to the development of AR in these zoonotic poultry pathogens. Salmonella isolates resistant to a combination of tetracyline, streptomycin, and ampicillin, as observed in this study, have been reported in human, animal, and environmental samples [33]. Known mechanisms of resistance to these antibiotics involve bacterial plasmid and chromosomal DNA ([34,35]). Our results also show that 97.8% of the Salmonella isolates with MDR are of the Kentucky serotype and are of lesser public health concerns in humans, consistent with an earlier observation [9]. Only 1.1% of MDR Salmonella isolates belonging to the Braenderup/Cholareasuis strains are of significant importance to human health [36], while the remaining 1.1% represent ungrouped serotypes.
Our results show that only 5% of Campylobacter isolates were MDR in feces and soil. This dataset is highly imbalanced from the perspective of machine learning, making it difficult to build a generalized predictive model. The MDR Campylobacter identified in this study include C. jejuni (43%), C. coli (43%), and a mixed culture of C. jejuni and C. coli (14%). C_MDR included antibiotics that inhibit protein synthesis (azithromycin, gentamicin, clindamycin, erythromycin, florfenicol, telithromycin, tetracycline) and antibiotics that target DNA replication (ciprofloxacin and nalidixic acid). Similar to our observation, Aksomaitiene and colleagues reported Campylobacter resistance to tetracycline and ciprofloxacin in broiler chickens, as well as in humans, wild birds, and cattle [37]. Noreen et al. reported a high level of MDR in livestock-associated Campylobacter isolates compared to Campylobacter isolates from non-livestock sources such as water and wildlife [38]. Furthermore, their work identified Camplobacter MDR to antibiotics such as erythromycin, ciprofloxacin, nalidixic acid, tetracycline, and gentamicin, as observed in this study. Mutations in tetO, aphA, and aadE genes that could alter antibiotic binding sites, the presence of super efflux pump RE-CmeABC, and the carriage of pTet plasmid that could confer resistance could be the mechanisms for the development of Campylobacter MDR ([39,40]).
The MDRs observed in this study for Listeria in feces and soil samples are 72% and 85%, respectively. Listeria MDR predominantly involves antimicrobials that inhibit protein synthesis such as tetracycline, streptomycin, daptomycin, lincomycin, erythromycin, streptogramins, and tigecycline. Resistance to ciprofloxacin that inhibits DNA replication was also observed. MDR isolates of Listeria include L. innocua (78.3%), L. welshimeri (14.1%), L. monocytogenes (7.1%), and uncharacterized (0.5%). These results are consistent with the report of Okorie-Kanu and colleagues that identified L. innocua as the predominant species in chicken [41]. Although L. innocua is generally known to be non-pathogenic but genetically closely related to pathogenic L. monocytogenes, atypical hemolytic L. innocua has been reported to be virulent, albeit to a lower extent compared to L. monocytogenes [42]. A recent report indicates that L. innocua is capable of causing disease in farm animals [43]. Similar to the observation in this study, Listeria MDR to ciprofloxacin, tetracycline, and erythromycin has been previously reported in environmental samples [44]. Similar to Salmonella and Campylobacter MDR, mechanisms of Listeria MDR could involve both chromosomal and plasmid DNA [45].
MDR rates reported here corroborate the reported rates of 36.0%, 1.4%, and 63.9% in Salmonella, Campylobacter, and Listeria, respectively, in a survey of six pastured poultry farms [31].

3.2. Predictive Analysis

Our study examined preharvest feces and soil as separate models and a common model (combined soil and feces) for MDR classification in Salmonella, Campylobacter, and Listeria. These models aim to estimate the likelihood of pastured poultry farms developing MDR as a function of the farm management practices. Prior to building a prediction model based on the data, we standardize/normalize and oversample the data as described in Section 2.4.
Standardization: The goal of normalization is to convert numeric values in a dataset to a standardized scale while maintaining the differences in range. We compared the classification performance of four different normalization methods (unit normalization, robust-scale standardization, quantile transformation, and standard scale normalization) with our data. Our preliminary analysis showed that quantile transformations, unit normalization, and robust-scale normalization were effective in the classification of MDR in Salmonella, Campylobacter, and Listeria, respectively. (a) Unit Normalization: This method normalizes every sample, shrinking/stretching the input feature vector (x) to a unit sphere. This ensures that the vector scales to the unit norm without regard to the distribution of the samples (Equation (1)):
X = x | | x | |
(b) Robust-Scale Standardization: This scaler centers and scales each feature independently using the quantile range (IQR: Interquartile Range) to reduce the influence of outliers in the feature set. Instead of considering the mean to standardize the feature, the method uses the median that is less significant to the outliers in scaling. (c) Quantile Transformation: A quantile function provides an approximation of the quantile positions of actual values by inversely calculating the cumulative distribution function. In quantile transformations [46], imbalanced distributions of data with outliers are converted to uniform distributions. This non-linear transformation smooths out the relation between observations by removing the linear correlation between the input variables. It is a popular and effective way to improve prediction with complex and noisy inputs. (d) Standard-Scale Normalization: Standardization is beneficial when the distribution of feature values follows a Gaussian distribution. It is a method for transforming feature values by subtracting from the mean and dividing by the standard deviation. Alternatively, this process is referred to as z-score standardization.
Oversampling: The percentage of negative samples outweighs the percentage of positive samples in our data. Oversampling is a technique often used to balance such skewed distributions. It maintains class balance by adding new points to the minority class rather than removing them from the majority class. We tested two popular oversampling strategies to balance the distribution during data processing. In our preliminary evaluations, random sampling proved effective for Salmonella MDR classification, while SMOTE sampling was effective for prediction of MDR in Campylobacter and Listeria. (a) Random Oversampling: In random oversampling [25], an increase in sample size is achieved by selecting minority class examples in random order and including them in the training set. This sampling technique iterates until a majority sample equals a minority sample. (b) Synthetic Minority Oversampling Technique: SMOTE [47] is based on the selection of a random sample from the minority class and one of its nearest neighbors, followed by the generation of a new synthetic sample within that range. Oversampling uses the nearest neighbor method in place of adding random duplicate samples to the minority class.
Deep Neural Network Learning We compared the performance of three different deep learning architectures to find an efficient method of detecting MDR for Salmonella, Campylobacter, and Listeria. In preliminary analyses, a generative adversarial network (GAN) proved more effective than Auto-Encoder for Listeria MDR, while a multi-layer perceptron (MLP) provided the best results for Campylobacter MDR. Additionally, Salmonella MDR classification was best performed with the Auto-Encoder design. (a) Multi-Layer Perceptron: An MLP [48] is a type of feed-forward artificial neural network that can distinguish data that cannot be linearly separated. These multi-layered networks consist of hidden nodes with a non-linear activation function that are connected with specific weights to the next layer of nodes. At the learning stage, connection weights are adjusted based on the amount of error in the output using a backpropagation function. (b) Generative Adversarial Network: A GAN [49] is a deep learning method for generating models from data using supervised learning techniques. Generative modeling involves discovering and understanding regularities and patterns in data. Rather than treating the problem as an unsupervised problem, GAN treats it as a supervised problem with two submodels: a generator model and a discriminator model. The generator model attempts to generate new samples from the negatives, while the discriminator model tries to determine what is positive and what is negative. Using backpropagation, we train the generator and discriminator models together. (c) Auto-Encoder: Autoencoder [50] is a stacked neural network layer system comprising an encoder layer, a latent or representative layer, a decoder layer, and an output layer. The latent layer will embed data without labels in a meaningful manner, and the output layer will attempt to recreate the original input. With the backpropagation algorithm, the networks are learned by minimizing the reconstruction error, which is the difference between the original and the reconstructed inputs.
For MDR classification using the above models, the prediction the confusion matrix, which is used to compare the model performance, is shown in Table 2. The ground truth has been presented as the actual value and the model’s prediction has been presented as the predicted value in this table. When the actual value and predicted value are both positive (+), this is known as a true-positive prediction in the confusion matrix (also known as the error matrix). False-positive predictions occur when the actual value is negative (−) and the predicted value is positive (+). A true-negative prediction is one in which both the actual and the predicted results are negative (−), while a false-negative prediction is one in which the actual is positive (+) and the prediction is negative (−). Precision is the measure of the proportion of correct positive predictions among the positive predictions. Similarly, recall measures the proportion of actual positives identified. Specificity refers to the number of correctly identified negative samples. Furthermore, the F1-Score is the harmonic mean of precision and recall. The purpose of these metrics is to evaluate the predictive ability of a model.
In order to avoid overfitting in our models, the scores are averaged from four-fold stratified cross-validation. The imbalanced dataset could be responsible for the high number of false negatives shown in the table for Listeria MDR (Table 2). Overall, our learning models are able to predict MDR with a greater than 86% F1-Score confidence. Considering the imbalance in the dataset, the prediction scores are reasonable (Table 2). Additionally, we generated receiver operating characteristic curves (ROC curves) to show the performance of our binary classification models at different thresholds.
Figure 1, Figure 2 and Figure 3 show representative ROC curves of MDR models. AUC-ROC curves are generally used to measure the performance of classification problems at different threshold levels. It depicts the trade-off between the True-Positive Rate (sensitivity) and the False-Positive Rate (1—specificity). ROC represents a probability curve, while AUC represents the measure of separation. It is indicative of better performance when classifiers provide curves that are close to the top-left corner. According to the ROC plots, our MDR prediction models are able to distinguish the classes fairly well. For all MDR models, the AUC provides a distinguishing metric that is higher than 86%. It is an indication of the effectiveness of our classification models.

3.3. Critical Farm Feature Prediction

Our ensemble approach for selecting critical features utilized two traditional machine learning (RandomForest (RT) and eXtreme Gradient Boosting (XG)) and three deep learning (Multi-layer Perceptron (MLP), Generative Adversarial Network (GAN), and Auto-Encoder (ENC)) methods (see Section 2.5). In the RandomForest machine learning algorithm [51], individual decision trees that work together make up an ensemble of powerful algorithms. Using random samples from the dataset with replacement, random forest constructs several decision trees and predicts the outcome based on the majority vote. XGBoost [52] is another powerful decision-tree-based ensemble technique that incrementally improves the performance by adding new models in sequence to fix previous models’ errors. The gradient descent optimization algorithm minimizes the weak prediction loss of current models when adding new models.
The most influential variables agreed by at least three machine learning models and their rankings in individual algorithm predictions are enumerated in the following Table 3, Table 4 and Table 5. In machine learning, the approach determines the performance of the algorithm. There is no single model that is suitable for all applications. Thus, different models produce different results. To ensure reliability, majority voting is used in this study.
While Mg, P, and flock size appear to affect MDR in all pathogens, Salmonella and Campylobacter MDR is further affected by EC, Mn, flock age, and Listeria, and Campylobacter MDR appears to be affected by K, C:N, and Cu. Salmonella MDR alone is affected by pH, Na, Ca, water source, and housing type. Campylobacter MDR alone is affected by Zn, egg source, and brood feed and Listeria MDR by Cr and years of farming (Table 3, Table 4 and Table 5). However, as shown in Table 1 and reported earlier, the prevalence of Campylobacter MDR is negligible in the pastured poultry farms included in this study. Therefore, the focus will be on Salmonella and Listeria MDR in this manuscript.

3.4. Feature Values Associated with Low MDR Incidence

As described in Section 2.5, we use SHAP (SHapley Additive exPlanations) [26] to compute the effect of each feature on the model output. A model’s output with and without a specific feature is compared to determine its relative importance. When SHAP values are positive, they indicate greater importance than when SHAP values are negative. Feature values with negative SHAP values are recommended to lower the presence of multidrug resistance. We present our analysis of the most influential features in Table 6 and Table 7 along with value recommendations for reducing MDR.
SHAP dependency plots show the potential internal factors from feces that drive Salmonella MDR, such as EC and pH, while the external factors determined from the soil include P, Mn, and Na (Table 7). Only Mg appears to be critical for Salmonella MDR in both feces and soil. In Listeria, P, Cu, and Cr are correlated to MDR in feces while Mg, C:N, and years of farming are identified to be important for the MDR in soil (Table 6). Flock size and K appear to be critical for Listeria MDR in both soil and feces models. Although the exact mechanisms by which these farm management practices and physicochemical properties impact MDR are not fully understood, based on the current literature, we provide insights into the impact of variables on Listeria and Salmonella MDR.

3.4.1. Drivers of Listeria MDR in Pastured Poultry

Possible mechanisms by which preharvest variables, specifically physicochemical properties of soil, contribute to the development of MDR are discussed below.
Magnesium (Mg): The Mg ion provides a strong cohesive force that strengthens bacterial ribosomes, the protein synthesis machinery. Its presence provides stability for the cell and counteracts the action of ribosome targeting antibiotics. Diminished levels of Mg have been shown to promote the activities of antibiotics and hamper the protein synthesis in bacteria [53]. The presence of Mg has also been reported to inhibit the transcription of genes involved in biofilm formation and promote the penetration of antibiotics [54]. In addition, Mg itself has been shown to have antimicrobial properties [55]. While ([56]) reported the Mg level of conventional poultry soil to be between 285 and 463 ppm, our analysis suggests that the optimum level of Mg to prevent MDR is <300 ppm. Pastured poultry farmers could utilize gypsum, a calcium sulphate salt that could reduce soil Mg by displacing the Mg within the soil with calcium.
Phosphorus (P): The buffering effect of phosphate formed from phosphorus in the bacterial culture medium has been reported to both enhance and diminish antimicrobial activities depending on the antimicrobial agents. Phosphate promotes the resistance of S. lactis to streptomycin but increases its sensitivity to tetracycline [57]. Moreover, the addition of 30 to 300 ug/L phosphorus has been shown to significantly increase biofilm formation in drinking water supply [58], which could potentially increase antibiotic resistance. Reducing the phosphorus level to below 5000 ppm as suggested by this study could potentially reduce MDR.
Potassium (K): Acesulfame potassium is an artificial sweetener found in various consumables and products such as soft drinks, jellies, beverages, and also poultry feed. The recent work of [59] shows that with increasing concentration of acesulfame potassium, and invariably potassium, the growth of bacteria with antibiotic resistance genes (ARGs) is inhibited. Contrarily, [60] show that uptake of K is essential for growth and antibiotic resistance in Staphylococcus aureus. While potassium levels in the conventional poultry litter and soil are reported to be between 3000 and 13,000 ppm, our models indicate that potassium levels between 7000 and 12,000 ppm are optimal to reduce the incidence of Listeria MDR. This supports the observation of [59] on the detrimental effects of potassium on antibiotic resistance bacteria.
Carbon–Nitrogen Ratio (C:N): Composting is one important way to remove undesirable antibiotics that are not metabolized by animals and that enter the environment through excretion. The C:N levels positively correlate and are indicative of the presence of ARGs in the environment [61]. Our predictive models recommend a C:N higher than 15 to mitigate MDR in Listeria. However, the recent work of [62] shows that a C:N of 26 is sufficient to remove ARGs from compost, and values higher than this may not be effective. Therefore, C:N values between 15 and 26 ppm are recommended to reduce MDR.
Copper (Cu): Based on Cu exposure studies with 96 microorganism isolates, Cu led to increased resistance to different clinically important antibiotics [63]. However, a comprehensive review on the effect of the antibiotic-binding capability of Cu indicates that it could both enhance or diminish antibiotic resistance [64]. This is not surprising, as Cu is an important cofactor for many enzymes required by bacteria. However, at elevated levels, it becomes toxic and acts as an antimicrobial and invokes adaptive response in the form of resistance from the organism [65]. Our prediction algorithms recommend Cu levels greater than 18 ppm to combat MDR.
Chromium (Cr): Investigation into the role of Cr in Staphylococcus aureus and Escherichia coli has established that it acts as an antibiotic and works synergistically with conventional antimicrobial agents to induce oxidative stress in the organisms [66]. Nevertheless, bacteria such as Pseudomonas aeruginosa have developed effective ways of reducing and ejecting chromium from the cell, thereby making it less potent. Increasing the level of chromium to > 3 ppm as predicted by our models could help prevent MDR in Listeria.

3.4.2. Drivers of Salmonella MDR in Pastured Poultry

Magnesium (Mg): Similar to the observation with Listeria, Mg appears to be an important driver of MDR in Salmonella. Mg is important for stabilizing protein synthesis machinery. It is interesting to note that both Salmonella and Listeria exhibit MDR to classes of antimicrobials that target protein synthesis such as aminoglycosides, macrolides, glycylcycline, and ketolides. While the median range in conventional poultry for Mg is around 374 ppm, our prediction models recommend Mg levels lower than 300 ppm to destabilize bacterial ribosomes and increase the pathogen sensitivity to the antibiotics. Furthermore, the role of Mg in modulating nitrosative stress has been established [67]. Reduction in the Mg levels proposed in this study may lower Salmonella viability and increase its susceptibility to antimicrobial activity.
Phosphorus (P): P is capable of modulating buffering capacity of the pathogen environment as well as the capability to form biofilms, thereby potentially altering the sensitivity to antibiotics. Therefore, reducing access of Salmonella to phosphorus could reduce the MDR. Our model suggests P 150 ppm in the soil could help reduce Salmonella MDR. In an in vivo study, dietary and systemic increases in the level of phosphorus have been reported to lower pig mortality during Salmonella infection [68], possibly due to phosphorus-mediated stimulation of leukocyte production and defense mechanisms against the pathogen. Therefore, while P restriction in the poultry soil where Salmonella is found may be a good practice, supplementation of the poultry brood feed with P may enhance immune response and have a synergistic effect in further lowering presence and MDR of Salmonella.
Electrical Conductivity (EC): Treatment of MDR methicillin-resistant Staphylococcus aureus (MDR-MRSA) with chlorhexidine acetate nanoemulsion has been shown to have both in vivo and in vitro efficacy against the pathogen that correlated with an increase in the electrical conductivity [69]. ECs that range from 0.97 to 10.07 S/m, i.e., 970 mS/m to 10,070 mS/m, in graphene oxide have been reported to promote wound healing against MDR-MRSA. While EC levels detected in the samples in this study are below 1000 μ S/cm, our models suggest that soil EC of 2000 μ S/cm (200 mS/m) would be sufficient to reduce MDR incidence in Salmonella.
pH:Salmonella is equipped with mechanisms to survive a wide range of pH between 4.4 and 9.0 with an optimum pH of around 7.0 [70]. Food safety regulation indicates acidic pH of 4.2 or lower is effective against Salmonella [71]. The recent work of [72] also indicates that a pH between 4.0 and 6.0 is sufficient to inhibit biofilm formation in Salmonella. The formation of biofilm is known to protect Salmonella from both in vitro and in vivo actions of antibiotics [73]. Our predictive model for soil suggests that a pH 6.5 could reduce MDR, possibly by inhibiting biofilm formation.
Manganese (Mn): Mn complex with antibiotic colistin has been reported to be effective against poultry avian pathogenic Escherichia coli, known for being highly antibiotic resistant. Mn in the metal complex form alone ([Mn(CO) 3 ( t p a k 3 N )]Br) has antimicrobial activity, and synergistic combination with colistin further increases the killing efficiency of Mn [74]. The recommendation here to increase the Mn levels up to 70 ppm or above in the soil compared to 5 to 7 ppm found in the conventional poultry soil [56] could increase its availability and ultimately its antibacterial activity.
Sodium (Na): The presence of Na in the form of sodium chloride salt has been established to both increase the thermal and antibiotic resistance in multiple strains of Salmonella [75]. This was speculated to be a result of an increase in osmotic stress. Our predictive models suggest that decreasing the Na content of the soil to below 50 ppm could mitigate Salmonella MDR.
Factors such as water source, housing type, flock size, and age are identified as variables that could contribute to Salmonella MDR. However, the observational study described here does not account for factors that may influence such dynamic management practices. Future experiments that control for these changing variables are warranted.

4. Conclusions

In conclusion, while previous work established the presence of AR in pastured poultry with no historical use of antibiotics; in this study, we used machine learning and deep learning approaches to predict farm management practices and physicochemical properties of feces and soil that drive MDR in zoonotic poultry pathogens Salmonella, Campylobacter, and Listeria. Antibiotic use in agroecosystems is known to contribute to resistance. It is necessary to determine factors that contribute to the development of basal/background resistance in the absence of antibiotic selection pressure to understand its contribution in the animal–environment–human triad. Evaluation of the development of resistance in environments that are free of antibiotics, such as the all-natural antibiotic-free, pastured poultry production systems described here, are critical to understand the background AR. Understanding the drivers of background AR will aid future agroecosystem studies to determine the impact of antibiotic use in animal, environment and public health domains for designing optimal animal production systems to reduce AR in zoonotic pathogens, ensuring the safety of animal-based food products.

Author Contributions

Conceptualization, M.R. and B.N.; methodology, N.P. and M.R.; software, N.P.; validation, N.P.; formal analysis, M.B.A.; investigation, M.B.A. and B.N.; resources, M.R. and B.N.; data curation, M.J.R. and M.B.A.; writing—original draft preparation, N.P. and M.B.A.; writing—review and editing, M.B.A., B.N., N.P., and M.J.R.; visualization, N.P.; supervision, M.R. and B.N.; project administration, B.N. and M.R.; funding acquisition, B.N. and M.R. All authors have read and agreed to the published version of the manuscript.

Funding

Dataset used in this study is provided by the Agricultural Research Service, USDA CRIS Project “Reduction of Invasive Salmonella enterica in Poultry through Genomics, Phenomics and Field Investigations of Small MultiSpecies Farm Environments” #6040-32000-011-00-D. This research was supported by the Agricultural Research Service, USDA NACA project entitled “Advancing Agricultural Re481 search through High Performance Computing” #58-0200-0-002.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Restrictions apply to the availability of these data. Data were obtained from the Agricultural Research Service, USDA, and are available from Rothrock with the permission of the USDA.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ARAntibiotic resistance
MDRMultidrug resistance
CDCCenters for Disease Control and Prevention
RTRandom Forest
XGeXtreme Gradient Boosting (XGBoost)
MLPMulti-layer Perceptron
GANGenerative Adversarial Network
ENCAuto-Encoder
SHAPSHapley Additive exPlanations
SMOTESynthetic Minority Oversampling Technique
S_MDRSalmonella multidrug resistance
C_MDRCampylobacter multidrug resistance
L_MDRListeria multidrug resistance
MDPIMultidisciplinary Digital Publishing Institute
MgMagnesium
PPhosphorus
KPotassium
FeIron
ECElectrical Conductivity
pHPotential of hydrogen
MnManganese
NaSodium
CaCalcium
C:NCarbon–Nitrogen Ratio
ZnZinc
CuCopper
PbLead
CrChromium
CdCadmium

Appendix A

Table A1. Poultry management practices.
Table A1. Poultry management practices.
VariableDescription
AvgNumBirdsAverage number of birds that the farm handle in 1 year
AvgNumFlocksAverage number of flocks that the farm handle in 1 year
YearsFarmingNumber of years the farm had been operating at the time of sampling
EggSourceSource of broiler eggs
BroodBeddingType of bedding broilers received during brooding
BroodFeedUp to top 3 sources of protein in brooding feed
BrGMOFreeWas the brood feed GMO free?
BrSoyFreeWas the brood soy free?
BrMedicatedWas the brood feed medicated?
BroodCleanFrequencyHow often the brooding area was cleaned?
AveAgeToPastureAverage age broilers were put on pasture
PastureHousingType of pasture housing environment (CT: Chicken Tractor and CTF: Chicken Tractor with Fencing)
FreqHousingMoveHow often the pasture area was moved?
AlwaysNewPastureWas the pasture always moved to a brand-new pasture area?
PasturedFeedUp to top 3 sources of protein in pasture feed
PaGMOFreeWas the pasture feed GMO free?
PaSoyFreeWas the pasture feed soy free?
PaMedicatedWere broilers medicated while on pasture?
LayersOnFarmWere layers present on the farm?
CattleOnFarmWere cattle present on the farm?
SwinOnFarmWere swine present on the farm?
GoatsOnFarmWere goats present on the farm?
SheepOnFarmWere sheep present on the farm?
WaterSourceWater source for broilers during grow-out
FreqBirdHandlingHow often chickens were handled on pasture?
AnyABXUseWere antibiotics ever used on the broilers?
LengthFeedRestrixProcessLength of feed restriction before processing
SeasonsSeason of sample collection
FlockAgeDaysAge of flock at sample collection
BreedBreed of broilers
FlockSizeNumber of birds in the sample flock

References

  1. Roth, N.; Käsbohrer, A.; Mayrhofer, S.; Zitz, U.; Hofacre, C.; Domig, K.J. The application of antibiotics in broiler production and the resulting antibiotic resistance in Escherichia coli: A global overview. Poult. Sci. 2019, 98, 1791–1804. [Google Scholar] [CrossRef] [PubMed]
  2. Polianciuc, S.I.; Gurzău, A.E.; Kiss, B.; Ştefan, M.G.; Loghin, F. Antibiotics in the environment: Causes and consequences. Med. Pharm. Rep. 2020, 93, 231. [Google Scholar] [CrossRef] [PubMed]
  3. Larsson, D.; Flach, C.F. Antibiotic resistance in the environment. Nat. Rev. Microbiol. 2022, 20, 257–269. [Google Scholar] [CrossRef] [PubMed]
  4. Skandalis, N.; Maeusli, M.; Papafotis, D.; Miller, S.; Lee, B.; Theologidis, I.; Luna, B. Environmental spread of antibiotic resistance. Antibiotics 2021, 10, 640. [Google Scholar] [CrossRef]
  5. Kampf, G. Biocidal agents used for disinfection can enhance antibiotic resistance in gram-negative species. Antibiotics 2018, 7, 110. [Google Scholar] [CrossRef] [Green Version]
  6. Kampf, G. Antibiotic resistance can be enhanced in Gram-positive species by some biocidal agents used for disinfection. Antibiotics 2019, 8, 13. [Google Scholar] [CrossRef] [Green Version]
  7. Nguyen, C.C.; Hugie, C.N.; Kile, M.L.; Navab-Daneshmand, T. Association between heavy metals and antibiotic-resistant human pathogens in environmental reservoirs: A review. Front. Environ. Sci. Eng. 2019, 13, 46. [Google Scholar] [CrossRef]
  8. CDC. Foodborne Germs and Illnesses. Available online: https://www.cdc.gov/foodsafety/foodborne-germs.html (accessed on 18 July 2022).
  9. Rothrock, M.J.; Guard, J.Y.; Oladeinde, A. Salmonella diversity along the farm-to-fork continuum of pastured poultry flocks in the southeastern United States. Front. Anim. Sci. 2021, 2. [Google Scholar] [CrossRef]
  10. Popoff, M.Y. Antigenic Formulas of the Salmonella Serovars; WHO Collaborating Centre for Reference and Research on Salmonella: Paris, France, 1997. [Google Scholar]
  11. Stern, N.J.; Wojton, B.; Kwiatek, K. A differential-selective medium and dry ice-generated atmosphere for recovery of Campylobacter jejuni. J. Food Prot. 1992, 55, 514–517. [Google Scholar] [CrossRef]
  12. Chapin, K.C.; Musgnug, M.C. Evaluation of Sensititre automated reading and incubation system for automated reading of Sensititre broth microdilution susceptibility plates. J. Clin. Microbiol. 2004, 42, 909–911. [Google Scholar] [CrossRef] [Green Version]
  13. Gupta, A.; Nelson, J.M.; Barrett, T.J.; Tauxe, R.V.; Rossiter, S.P.; Friedman, C.R.; Joyce, K.W.; Smith, K.E.; Jones, T.F.; Hawkins, M.A.; et al. Antimicrobial resistance among campylobacter strains, United States, 1997–2001. Emerg. Infect. Dis. 2004, 10, 1102. [Google Scholar] [CrossRef] [PubMed]
  14. Konkel, M.E.; Joens, L.A. Effect of enteroviruses on adherence to and invasion of HEp-2 cells by Campylobacter isolates. Infect. Immun. 1990, 58, 1101–1105. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Rothrock, M.J., Jr.; Locatelli, A.; Feye, K.M.; Caudill, A.J.; Guard, J.; Hiett, K.; Ricke, S.C. A microbiomic analysis of a pasture-raised broiler flock elucidates foodborne pathogen ecology along the farm-to-fork continuum. Front. Vet. Sci. 2019, 6, 260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Hwang, D.; Rothrock, M.J., Jr.; Pang, H.; Kumar, G.D.; Mishra, A. Farm management practices that affect the prevalence of Salmonella in pastured poultry farms. LWT 2020, 127, 109423. [Google Scholar] [CrossRef]
  17. He, K.; Zhang, X.; Ren, S.; Sun, J. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 7–13 December 2015; pp. 1026–1034. [Google Scholar]
  18. Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
  19. Agarap, A.F. Deep learning using rectified linear units (relu). arXiv 2018, arXiv:1803.08375. [Google Scholar]
  20. Abadi, M.; Agarwal, A.; Barham, P.; Brevdo, E.; Chen, Z.; Citro, C.; Corrado, G.S.; Davis, A.; Dean, J.; Devin, M.; et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv 2016, arXiv:1603.04467. [Google Scholar]
  21. Chollet, F. Keras. Available online: https://keras.io (accessed on 20 June 2022).
  22. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  23. McKinney, W. Data Structures for Statistical Computing in Python. In Proceedings of the 9th Python in Science Conference, Austin, TX, USA, 28 June–3 July 2010; pp. 56–61. [Google Scholar] [CrossRef] [Green Version]
  24. Pandas Development Team. Pandas-Dev/Pandas: Pandas; Pandas: Rosemead, CA, USA, 2020. [Google Scholar] [CrossRef]
  25. Lemaître, G.; Nogueira, F.; Aridas, C.K. Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. J. Mach. Learn. Res. 2017, 18, 1–5. [Google Scholar]
  26. Lundberg, S.M.; Lee, S.I. A unified approach to interpreting model predictions. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017; Volume 30. [Google Scholar]
  27. Van Boeckel, T.P.; Brower, C.; Gilbert, M.; Grenfell, B.T.; Levin, S.A.; Robinson, T.P.; Teillant, A.; Laxminarayan, R. Global trends in antimicrobial use in food animals. Proc. Natl. Acad. Sci. USA 2015, 112, 5649–5654. [Google Scholar] [CrossRef] [Green Version]
  28. Manyi-Loh, C.; Mamphweli, S.; Meyer, E.; Okoh, A. Antibiotic use in agriculture and its consequential resistance in environmental sources: Potential public health implications. Molecules 2018, 23, 795. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Reygaert, W.C. An overview of the antimicrobial resistance mechanisms of bacteria. AIMS Microbiol. 2018, 4, 482. [Google Scholar] [CrossRef] [PubMed]
  30. Pang, Z.; Raudonis, R.; Glick, B.R.; Lin, T.J.; Cheng, Z. Antibiotic resistance in Pseudomonas aeruginosa: Mechanisms and alternative therapeutic strategies. Biotechnol. Adv. 2019, 37, 177–192. [Google Scholar] [CrossRef]
  31. Rothrock, M.J., Jr.; Hiett, K.L.; Guard, J.Y.; Jackson, C.R. Antibiotic resistance patterns of major zoonotic pathogens from all-natural, antibiotic-free, pasture-raised broiler flocks in the Southeastern United States. J. Environ. Qual. 2016, 45, 593–603. [Google Scholar] [CrossRef] [PubMed]
  32. Rahman, M.; Husna, A.; Elshabrawy, H.A.; Alam, J.; Runa, N.Y.; Badruzzaman, A.; Banu, N.A.; Al Mamun, M.; Paul, B.; Das, S.; et al. Isolation and molecular characterization of multidrug-resistant Escherichia coli from chicken meat. Sci. Rep. 2020, 10, 21999. [Google Scholar] [CrossRef] [PubMed]
  33. Xu, X.; Biswas, S.; Gu, G.; Elbediwi, M.; Li, Y.; Yue, M. Characterization of multidrug resistance patterns of emerging Salmonella enterica serovar Rissen along the food chain in China. Antibiotics 2020, 9, 660. [Google Scholar] [CrossRef]
  34. Tasmin, R.; Hasan, N.A.; Grim, C.J.; Grant, A.; Choi, S.Y.; Alam, M.S.; Bell, R.; Cavanaugh, C.; Balan, K.V.; Babu, U.S.; et al. Genotypic and phenotypic characterization of multidrug resistant Salmonella Typhimurium and Salmonella Kentucky strains recovered from chicken carcasses. PLoS ONE 2017, 12, e0176938. [Google Scholar] [CrossRef] [Green Version]
  35. Britto, C.D.; Wong, V.K.; Dougan, G.; Pollard, A.J. A systematic review of antimicrobial resistance in Salmonella enterica serovar Typhi, the etiological agent of typhoid. PLoS Negl. Trop. Dis. 2018, 12, e0006779. [Google Scholar] [CrossRef] [Green Version]
  36. CDC. An Atlas of Salmonella in the United States, 1968–2011. Available online: https://www.cdc.gov/salmonella/pdf/salmonella-atlas-508c.pdf (accessed on 18 July 2022).
  37. Aksomaitiene, J.; Ramonaite, S.; Tamuleviciene, E.; Novoslavskij, A.; Alter, T.; Malakauskas, M. Overlap of antibiotic resistant Campylobacter jejuni MLST genotypes isolated from humans, broiler products, dairy cattle and wild birds in Lithuania. Front. Microbiol. 2019, 10, 1377. [Google Scholar] [CrossRef]
  38. Noreen, Z.; Siddiqui, F.; Javed, S.; Wren, B.W.; Bokhari, H. Transmission of multidrug-resistant Campylobacter jejuni to children from different sources in Pakistan. J. Glob. Antimicrob. Resist. 2020, 20, 219–224. [Google Scholar] [CrossRef]
  39. Yang, Y.; Feye, K.M.; Shi, Z.; Pavlidis, H.O.; Kogut, M.; Ashworth, A.J.; Ricke, S.C. A historical review on antibiotic resistance of foodborne Campylobacter. Front. Microbiol. 2019, 10, 1509. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Liu, D.; Liu, W.; Li, X.; Yao, H.; Shen, Z.; Wang, Y.; Shen, J. Presence and antimicrobial susceptibility of RE-cmeABC-positive Campylobacter isolated from food-producing animals, 2014–2016. Engineering 2020, 6, 34–39. [Google Scholar] [CrossRef]
  41. Okorie-Kanu, O.J.; Anyanwu, M.U.; Ezenduka, E.V.; Mgbeahuruike, A.C.; Okorie-Kanu, C.O.; Ugwuijem, E.E.; Idogwu, M.N.; Anyaoha, C.O.; Majesty-Alukagberie, O.L.; Vidal, R.O.; et al. Occurrence and antibiogram of Listeria species in raw pork, beef, and chicken meats marketed in Enugu State, Southeast Nigeria. Vet. World 2020, 13, 317. [Google Scholar] [CrossRef] [Green Version]
  42. Moura, A.; Disson, O.; Lavina, M.; Thouvenot, P.; Huang, L.; Leclercq, A.; Fredriksson-Ahomaa, M.; Eshwar, A.K.; Stephan, R.; Lecuit, M. Atypical hemolytic Listeria innocua isolates are virulent, albeit less than Listeria monocytogenes. Infect. Immun. 2019, 87, e00758-18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Matto, C.; D’Alessandro, B.; Mota, M.I.; Braga, V.; Buschiazzo, A.; Gianneechini, E.; Varela, G.; Rivero, R. Listeria innocua isolated from diseased ruminants harbour minor virulence genes of L. monocytogenes. Vet. Med. Sci. 2022, 8, 735–740. [Google Scholar] [CrossRef] [PubMed]
  44. Mpondo, L.; Ebomah, K.E.; Okoh, A.I. Multidrug-resistant Listeria species shows abundance in environmental waters of a key district municipality in South Africa. Int. J. Environ. Res. Public Health 2021, 18, 481. [Google Scholar] [CrossRef] [PubMed]
  45. Olaimat, A.N.; Al-Holy, M.A.; Shahbaz, H.M.; Al-Nabulsi, A.A.; Abu Ghoush, M.H.; Osaili, T.M.; Ayyash, M.M.; Holley, R.A. Emergence of antibiotic resistance in Listeria monocytogenes isolated from food products: A comprehensive review. Compr. Rev. Food Sci. Food Saf. 2018, 17, 1277–1292. [Google Scholar] [CrossRef] [Green Version]
  46. Krzysztofowicz, R. Transformation and normalization of variates with specified distributions. J. Hydrol. 1997, 197, 286–292. [Google Scholar] [CrossRef]
  47. Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  48. Haykin, S. Neural Networks: A Comprehensive Foundation; Prentice Hall PTR: Hoboken, NJ, USA, 1994. [Google Scholar]
  49. Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial nets. Adv. Neural Inf. Process. Syst. 2014, 2, 2672–2680. [Google Scholar]
  50. Liou, C.Y.; Cheng, W.C.; Liou, J.W.; Liou, D.R. Autoencoder for words. Neurocomputing 2014, 139, 84–96. [Google Scholar] [CrossRef]
  51. Ho, T.K. Random decision forests. In Proceedings of the 3rd International Conference on Document Analysis and Recognition IEEE, Montreal, QC, Canada, 14–16 August 1995; Volume 1, pp. 278–282. [Google Scholar]
  52. Chen, T.; Guestrin, C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
  53. Dong-yeon, D.L.; Galera-Laporta, L.; Bialecka-Fornal, M.; Moon, E.C.; Shen, Z.; Briggs, S.P.; Garcia-Ojalvo, J.; Süel, G.M. Magnesium flux modulates ribosomes to increase bacterial survival. Cell 2019, 177, 352–360. [Google Scholar]
  54. Ben-Ishay, N.; Oknin, H.; Steinberg, D.; Berkovich, Z.; Reifen, R.; Shemesh, M. Enrichment of milk with magnesium provides healthier and safer dairy products. npj Biofilms Microbiomes 2017, 3, 24. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Demishtein, K.; Reifen, R.; Shemesh, M. Antimicrobial properties of magnesium open opportunities to develop healthier food. Nutrients 2019, 11, 2363. [Google Scholar] [CrossRef] [Green Version]
  56. Crippen, T.L.; Sheffield, C.L.; Byrd, J.A.; Esquivel, J.F.; Beier, R.C.; Yeater, K. Poultry litter and the environment: Physiochemical properties of litter and soil during successive flock rotations and after remote site deposition. Sci. Total. Environ. 2016, 553, 650–661. [Google Scholar] [CrossRef] [Green Version]
  57. Sinha, R. Roles of Phosphate in Influencing Resistance to and Bacterial Uptake of Tetracycline and Streptomycin in Lactic Streptococci. J. Food Prot. 1985, 48, 1025–1027. [Google Scholar] [CrossRef]
  58. Fang, W.; Hu, J.; Ong, S. Influence of phosphorus on biofilm formation in model drinking water distribution systems. J. Appl. Microbiol. 2009, 106, 1328–1335. [Google Scholar] [CrossRef]
  59. Li, Z.; Gao, J.; Guo, Y.; Cui, Y.; Wang, Y.; Duan, W.; Wu, Z. Enhancement of antibiotic resistance dissemination by artificial sweetener acesulfame potassium: Insights from cell membrane, enzyme, energy supply and transcriptomics. J. Hazard. Mater. 2022, 422, 126942. [Google Scholar] [CrossRef]
  60. Gries, C.M.; Bose, J.L.; Nuxoll, A.S.; Fey, P.D.; Bayles, K.W. The Ktr potassium transport system in S taphylococcus aureus and its role in cell physiology, antimicrobial resistance and pathogenesis. Mol. Microbiol. 2013, 89, 760–773. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Wei, H.; Ma, J.; Su, Y.; Xie, B. Effect of nutritional energy regulation on the fate of antibiotic resistance genes during composting of sewage sludge. Bioresour. Technol. 2020, 297, 122513. [Google Scholar] [CrossRef]
  62. Zhu, P.; Qin, H.; Zhang, H.; Luo, Y.; Ru, Y.; Li, J.; San, K.W.; Wang, L.; Yu, X.; Guo, W. Variations in antibiotic resistance genes and removal mechanisms induced by C/N ratio of substrate during composting. Sci. Total Environ. 2021, 798, 149288. [Google Scholar] [CrossRef] [PubMed]
  63. Glibota, N.; Grande Burgos, M.J.; Gálvez, A.; Ortega, E. Copper tolerance and antibiotic resistance in soil bacteria from olive tree agricultural fields routinely treated with copper compounds. J. Sci. Food Agric. 2019, 99, 4677–4685. [Google Scholar] [CrossRef] [PubMed]
  64. Poole, K. At the nexus of antibiotics and metals: The impact of Cu and Zn on antibiotic activity and resistance. Trends Microbiol. 2017, 25, 820–832. [Google Scholar] [CrossRef] [PubMed]
  65. Lemire, J.A.; Harrison, J.J.; Turner, R.J. Antimicrobial activity of metals: Mechanisms, molecular targets and applications. Nat. Rev. Microbiol. 2013, 11, 371–384. [Google Scholar] [CrossRef]
  66. Páez, P.L.; Bazán, C.M.; Bongiovanni, M.E.; Toneatto, J.; Albesa, I.; Becerra, M.C.; Argüello, G.A. Oxidative stress and antimicrobial activity of chromium (III) and ruthenium (II) complexes on Staphylococcus aureus and Escherichia coli. BioMed Res. Int. 2013, 2013, 906912. [Google Scholar] [CrossRef] [Green Version]
  67. Bourret, T.J.; Liu, L.; Shaw, J.A.; Husain, M.; Vázquez-Torres, A. Magnesium homeostasis protects Salmonella against nitrooxidative stress. Sci. Rep. 2017, 7, 15083. [Google Scholar] [CrossRef]
  68. Doak, R.; Garner, G.; Huebner, P.; O’Dell, B. Effect of dietary phosphorus on blood phosphorus and leukocyte levels in experimental salmonellosis. Proc. Soc. Exp. Biol. Med. 1972, 141, 953–957. [Google Scholar] [CrossRef]
  69. Song, Z.; Sun, H.; Yang, Y.; Jing, H.; Yang, L.; Tong, Y.; Wei, C.; Wang, Z.; Zou, Q.; Zeng, H. Enhanced efficacy and anti-biofilm activity of novel nanoemulsions against skin burn wound multi-drug resistant MRSA infections. Nanomed. Nanotechnol. Biol. Med. 2016, 12, 1543–1555. [Google Scholar] [CrossRef]
  70. Suehr, Q.J.; Chen, F.; Anderson, N.M.; Keller, S.E. Effect of pH on survival of Escherichia coli O157, Escherichia coli O121, and Salmonella enterica during desiccation and short-term storage. J. Food Prot. 2020, 83, 211–220. [Google Scholar] [CrossRef]
  71. Keerthirathne, T.P.; Ross, K.; Fallowfield, H.; Whiley, H. A review of temperature, pH, and other factors that influence the survival of Salmonella in mayonnaise and other raw egg products. Pathogens 2016, 5, 63. [Google Scholar] [CrossRef] [Green Version]
  72. Roy, P.K.; Ha, A.J.W.; Mizan, M.F.R.; Hossain, M.I.; Ashrafudoulla, M.; Toushik, S.H.; Nahar, S.; Kim, Y.K.; Ha, S.D. Effects of environmental conditions (temperature, pH, and glucose) on biofilm formation of Salmonella enterica serotype Kentucky and virulence gene expression. Poult. Sci. 2021, 100, 101209. [Google Scholar] [CrossRef] [PubMed]
  73. González, J.F.; Alberts, H.; Lee, J.; Doolittle, L.; Gunn, J.S. Biofilm formation protects Salmonella from the antibiotic ciprofloxacin in vitro and in vivo in the mouse model of chronic carriage. Sci. Rep. 2018, 8, 222. [Google Scholar] [CrossRef] [Green Version]
  74. Betts, J.; Nagel, C.; Schatzschneider, U.; Poole, R.; La Ragione, R.M. Antimicrobial activity of carbon monoxide-releasing molecule [Mn (CO) 3 (tpa-κ3 N)] Br versus multidrug-resistant isolates of Avian Pathogenic Escherichia coli and its synergy with colistin. PLoS ONE 2017, 12, e0186359. [Google Scholar]
  75. Yoon, H.; Park, B.Y.; Oh, M.H.; Choi, K.H.; Yoon, Y. Effect of NaCl on heat resistance, antibiotic susceptibility, and Caco-2 cell invasion of Salmonella. BioMed Res. Int. 2013, 2013, 274096. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Receiver operating characteristic curve (ROC curve) of SalmonellaMDR models.
Figure 1. Receiver operating characteristic curve (ROC curve) of SalmonellaMDR models.
Microorganisms 10 01703 g001
Figure 2. Receiver operating characteristic curve (ROC curve) of CampylobacterMDR models.
Figure 2. Receiver operating characteristic curve (ROC curve) of CampylobacterMDR models.
Microorganisms 10 01703 g002
Figure 3. Receiver operating characteristic curve (ROC curve) of ListeriaMDR predictive models.
Figure 3. Receiver operating characteristic curve (ROC curve) of ListeriaMDR predictive models.
Microorganisms 10 01703 g003
Table 1. Antibiotic resistance profile of Salmonella, Campylobacter, and Listeria in soil and feces.
Table 1. Antibiotic resistance profile of Salmonella, Campylobacter, and Listeria in soil and feces.
Sample TypeTotal No. of Samples with BacteriaNumber of Samples (Percentage) Resistant to
3 or More Antibiotics1 or 2 Antibiotics0 Antibiotics
SalmonellaFeces11431 (27%)52 (46%)31 (27%)
Soil8331 (37%)29 (35%)23 (28%)
CampylobacterFeces34316 (5%)72 (21%)255 (74%)
Soil1508 (5%)10 (7%)132 (88%)
ListeriaFeces10173 (72%)28 (28%)0 (0%)
Soil11497 (85%)17 (15%)0 (0%)
Table 2. The classification results of MDR predictive preharvest (feces and soil) models. Models are trained with farm practices and environmental physicochemical variables.
Table 2. The classification results of MDR predictive preharvest (feces and soil) models. Models are trained with farm practices and environmental physicochemical variables.
Sample TypeActualPredictedPrecisionRecallSpecificityF1-Score
+
Salmonella_MDRFeces+1610.880.940.830.9
314
Soil+920.980.830.980.89
010
Overall Preharvest+2700.930.980.920.95
225
Campylobacter_MDRFeces+6500.9410.940.97
462
Soil+2810.890.970.870.93
425
Overall Preharvest+9310.920.980.920.95
886
Listeria_MDRFeces+1230.940.800.950.86
114
Soil+1630.960.820.960.88
119
Overall Preharvest+2860.920.830.920.87
331
Table 3. The influential variables and their rank in respective algorithm for the prediction of Salmonella multidrug resistance (S_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, the top five most influential variables for S_MDR in feces are Mg, Water_Source_Well, Pasture_Housing_CTF, pH, and EC, while the top five for soil are Mg, P, Na, EC, and Ca.
Table 3. The influential variables and their rank in respective algorithm for the prediction of Salmonella multidrug resistance (S_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, the top five most influential variables for S_MDR in feces are Mg, Water_Source_Well, Pasture_Housing_CTF, pH, and EC, while the top five for soil are Mg, P, Na, EC, and Ca.
SampleTypeModelMgPKFeECpHMnNaWaterSource WellPasture Housing_CTFlock SizeCaFlock AgeDaysPastureHousing_CTFBrSoy Free
FecesRT1 5 86 15
XG 143 24 8 1
MLP513 4 6 109 2
ENC 4 1 1053 2 711
GAN4 8 65
SoilRT 710 9 65
XG2 10 71
MLP 356 1082 41 12
ENC235 1 86 4 710
GAN42 93 51012 67
Table 4. The influential variables and their rank in their respective algorithm for the prediction of Campylobacter multidrug resistance (C_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, the top five most influential variables for C_MDR in feces are P, EC, Zn, Cu, and Mn, while the top five for soil are EC, K, FlockSize, Mg, and P.
Table 4. The influential variables and their rank in their respective algorithm for the prediction of Campylobacter multidrug resistance (C_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, the top five most influential variables for C_MDR in feces are P, EC, Zn, Cu, and Mn, while the top five for soil are EC, K, FlockSize, Mg, and P.
SampleTypeModelPECMgKFlockSizeMnC:NFlockAgeDaysZnCuFePbEggSourceYearsFarmingBroodFeed
FecesRT 1 139687 10
XG 31 15 7
MLP14368 75 92
ENC23 5 481067 914
GAN4635 10 78 2 1415
SoilRT 14 2 13
XG 345 2 6 7
MLP31425 98 1114
ENC4 31 62
GAN5 123 46 8
Table 5. The influential variables and their rank in their respective algorithm for the prediction of Listeria multidrug resistance (L_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, top five most influential variables for L_MDR in feces are K, P, FlockSize, Cu, and Cr, while the top five for soil are K, FlockSize, Mg, C:N, and YearsFarming.
Table 5. The influential variables and their rank in their respective algorithm for the prediction of Listeria multidrug resistance (L_MDR). Please see Table A1 for variable descriptions. The top five ranks are shown in blue and the top ten in brown. Overall, top five most influential variables for L_MDR in feces are K, P, FlockSize, Cu, and Cr, while the top five for soil are K, FlockSize, Mg, C:N, and YearsFarming.
SampleTypeModelKFlockSizePMgECAvgNumBirdsCrCuC:NNaCdYearsFarming
FecesRT1 376 84105 2
XG 5 15
MLP1 2106 5
ENC352 4 8 15
GAN321 6 95 8
SoilRT 5 728101115
XG
MLP31 4 5
ENC25 4 3 12
GAN21 5 874 10
Table 6. Pre-harvest feature value recommendations for reducing for Listeria MDR Incidence.
Table 6. Pre-harvest feature value recommendations for reducing for Listeria MDR Incidence.
   Farm VariableListeria MDR
FecesSoil
   Mg ≤300
   P≤5000
   FlockSize 200 700
   K7000–12,000>200
   C:N >15
   Cu>18
   Cr>3
   YearsFarming 6–15
Table 7. Pre-harvest feature value recommendations for reducing Salmonella multidrug resistance.
Table 7. Pre-harvest feature value recommendations for reducing Salmonella multidrug resistance.
   Farm VariableSalmonella MDR
FecesSoil
   Mg≥2000≤300
   P ≤150
   EC≤2000
   pH≤6.5
   Mn ≥70
   Na <50
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ayoola, M.B.; Pillai, N.; Nanduri, B.; Rothrock, M.J.; Ramkumar, M. Preharvest Environmental and Management Drivers of Multidrug Resistance in Major Bacterial Zoonotic Pathogens in Pastured Poultry Flocks. Microorganisms 2022, 10, 1703. https://doi.org/10.3390/microorganisms10091703

AMA Style

Ayoola MB, Pillai N, Nanduri B, Rothrock MJ, Ramkumar M. Preharvest Environmental and Management Drivers of Multidrug Resistance in Major Bacterial Zoonotic Pathogens in Pastured Poultry Flocks. Microorganisms. 2022; 10(9):1703. https://doi.org/10.3390/microorganisms10091703

Chicago/Turabian Style

Ayoola, Moses B., Nisha Pillai, Bindu Nanduri, Michael J. Rothrock, and Mahalingam Ramkumar. 2022. "Preharvest Environmental and Management Drivers of Multidrug Resistance in Major Bacterial Zoonotic Pathogens in Pastured Poultry Flocks" Microorganisms 10, no. 9: 1703. https://doi.org/10.3390/microorganisms10091703

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop