Next Article in Journal
A Survey of African American Physicians on the Health Effects of Climate Change
Next Article in Special Issue
Diversity of Bacterial Communities of Fitness Center Surfaces in a U.S. Metropolitan Area
Previous Article in Journal
Risk Assessment of Heavy Metals in Surface Sediments from the Yanghe River, China
Previous Article in Special Issue
Survival of Salmonella enterica in Aerated and Nonaerated Wastewaters from Dairy Lagoons
 
 
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Muddying the Waters: A New Area of Concern for Drinking Water Contamination in Cameroon

1
Division of Environmental Health Sciences, the Ohio State University, Columbus, OH 43210, USA
2
Department of Environmental Sciences, University of Maroua, Maroua BP 46, Far North Region, Cameroon
3
Department of Food Science and Technology, the Ohio State University, Columbus, OH 43210, USA
4
Department of Veterinary Preventive Medicine, the Ohio State University, Columbus, OH 43210, USA
5
Department of Anthropology, the Ohio State University, Columbus, OH 43210, USA
6
Department of Mathematics, the Ohio State University, Columbus, OH 43210, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2014, 11(12), 12454-12472; https://doi.org/10.3390/ijerph111212454
Received: 5 September 2014 / Revised: 5 November 2014 / Accepted: 14 November 2014 / Published: 28 November 2014
(This article belongs to the Special Issue Environmental Determinants of Infectious Disease Transmission)

Abstract

:
In urban Maroua, Cameroon, improved drinking water sources are available to a large majority of the population, yet this water is frequently distributed through informal distribution systems and stored in home containers (canaries), leaving it vulnerable to contamination. We assessed where contamination occurs within the distribution system, determined potential sources of environmental contamination, and investigated potential pathogens. Gastrointestinal health status (785 individuals) was collected via health surveys. Drinking water samples were collected from drinking water sources and canaries. Escherichia coli and total coliform levels were evaluated and molecular detection was performed to measure human-associated faecal marker, HF183; tetracycline-resistance gene, tetQ; Campylobacter spp.; and Staphylococcus aureus. Statistical analyses were performed to evaluate the relationship between microbial contamination and gastrointestinal illness. Canari samples had higher levels of contamination than source samples. HF183 and tetQ were detected in home and source samples. An inverse relationship was found between tetQ and E. coli. Presence of tetQ with lower E. coli levels increased the odds of reported diarrhoeal illness than E. coli levels alone. Further work is warranted to better assess the relationship between antimicrobial-resistant bacteria and other pathogens in micro-ecosystems within canaries and this relationship’s impact on drinking water quality.

1. Introduction

In 2011, diarrhoeal illness was responsible for the death of 1.9 million people [1]. A majority of these deaths occurred in children under the age of five living in developing countries [2]. Due in part to their underdeveloped immune systems, diarrhoea kills more children annually than malaria and is the second leading cause of mortality behind pneumonia [2,3].
In addition to improving sanitation, there are two main ways to reduce the amount of microbial contamination in drinking water and, thus, reduce the incidence of diarrhoeal disease in developing countries: (1) increasing availability and access to clean water suitable for drinking; and, (2) providing improved methods of drinking water storage that prevent recontamination in the home [4,5,6]. Improving the quality and availability of drinking water is helpful in reducing diarrhoeal disease incidence, but if water is then contaminated during transportation and storage, diarrhoeal disease transmission is still possible. While there has been some debate on which side of the improved source water-improved home drinking water equation results in a greater decrease in diarrhoeal disease [7,8,9,10,11,12,13], all sides agree that tackling the problem from both ends is the most desirable approach. This is especially true for preventing diarrhoea in children under the age of five who have not yet developed immunity to the naturally circulating human pathogens that are present in the drinking water storage containers in their homes [13].
This study was conducted in Maroua, a regional capital of Cameroon. Maroua was chosen because recent epidemiological information (i.e., cholera incidence rates) collected during the 2009–2011 cholera outbreak allowed for identification of neighbourhoods that had high, middle, and low incidence rates of diarrhoeal illness. Home to over 300,000 people, Maroua also provided an opportunity to explore drinking water quality in an urban environment where a large percentage of people obtain their drinking water through an informal distribution system of water suppliers who transport the water from city taps to homes using jerry cans (Figure 1), a situation that is common throughout the developing world [14].
Previous drinking water quality studies have been conducted in the Far North Region and in other regions of Cameroon. Previous studies have mostly focused on well water quality [15,16], quality of ground and surface waters [17], general associations between access to drinking water and diarrhoeal illness [18], or the management of household drinking water treatment [19]. Despite the fact that Maroua is a rapidly growing urban centre [20] of great importance to the greater Chad Basin region, the majority of drinking water and gastrointestinal health studies carried out to date have been in the more southern regions of the country [17,18,19,21,22,23]. To the best of our knowledge, this was the first study to investigate the associations between diarrhoeal disease and the drinking water quality within the formal and informal drinking water delivery system in addition to canaries within the city of Maroua. The aims of this study were: (1) to investigate microbial contamination of drinking water along the water delivery system within the city; (2) to identify the potential sources of the microbial contamination from the general environment using microbial source tracking; (3) to examine the relationship between water quality and reported gastrointestinal illnesses; and, (4) test for the presence of antibiotic resistant microbes in drinking water.
Figure 1. Flowchart of the drinking water delivery chain in Maroua including both formal and informal distribution systems.
Figure 1. Flowchart of the drinking water delivery chain in Maroua including both formal and informal distribution systems.
Ijerph 11 12454 g001

2. Experimental Section

2.1. Study Site

In order to achieve these aims, health surveys were administered to residents of the study households, and drinking water samples were collected from home storage containers (HSC) and drinking water sources of households located in four different Maroua neighbourhoods between 1 June and 1 August 2013. Sampling coincided with the beginning of the rainy season, the traditional peak season of cholera outbreaks. Neighbourhoods were selected based on their relative cholera incidence rates (one high, two medium, one low) during the 2009–2011 epidemic. The number of households surveyed in each neighbourhood was based on the relative proportion that the neighbourhood contributed to Maroua’s overall population. A map of each neighbourhood was printed and sectioned into numbered quadrants using a 2 cm × 2 cm grid. The quadrants were then randomly selected by drawing numbered pieces of paper and one household within each quadrant was surveyed.

2.2. Health Survey

The health survey was administered in a total of 120 households. The survey included questions on household demographics, as well as reported health and drinking water handling behaviours of the individual members of the household. For children too young to respond, caretakers (usually the mother) answered for them. In terms of health, individuals were asked if they had experienced any of the following gastrointestinal symptoms during the 30 days prior to the survey: diarrhoea, bloody diarrhoea, stomach cramps, vomiting, nausea, and/or fever. Participants were asked how many days the symptom(s) had lasted, if they had received treatment at a hospital and/or had been under a doctor’s care for any reason, and for how many days they received care or treatment. Each survey lasted 20–50 min, depending on family size.
Due to low literacy rates in the study area, informed consent was verbally obtained before proceeding with each survey and documented through the full completion of the survey. The guardian(s) of children enrolled in the study also provided verbal, informed consent for the release of their children’s information and at least one guardian was present during each survey. Each home and individual household member was assigned unique identification codes to ensure anonymity. Participants were made aware that they were free to stop the survey at anytime, for any reason and without penalty. Research involving survey of human subjects (including verbal consent) was approved from The Ohio State University Institutional Review Board (IRB 2010B004 and Amendment 032013) and permission to perform fieldwork was granted from the local Cameroon Ministry of Health, local délégués, and traditional community leaders.

2.3. Drinking Water Sample Collection

Drinking water samples were collected from households that had water available (n = 60). Between 300 and 750 mL of water were taken directly from the family’s drinking water storage container, which was usually a traditional, wide-mouth clay jar (canari in French) used to allow the water to “breathe” and stay cool in a hot Sahelian climate (Figure 2). Home water storage is necessary due to frequent, unpredictable rationing of city tap water. When accessible, samples were also taken from the originating source where drinking water was procured (n = 28), which was usually a public tap, but also included water distributers’ jerry cans, open wells, and a community borehole. Out of the total 86 drinking water samples collected, 25 home samples were paired to a matching source. All samples were collected using single, sterile 800 mL, pre-labeled Whirl-Pak bags (Nasco, Fort Atkinson, WI, USA). The sampling bags were filled with water using the same technique that household members typically used when handling their drinking water. The drinking water samples were then immediately placed in a cooler and transported to a field laboratory where chemical and biological analyses were conducted.
Figure 2. Canaries in a household’s compound being used for drinking water storage.
Figure 2. Canaries in a household’s compound being used for drinking water storage.
Ijerph 11 12454 g002

2.3.1. Water Quality Measurements

Chemical quality of the water (total chorine, mg/L; free chlorine/bromine, mg/L; pH; total alkalinity, mg/L; total hardness, mg/L of CaCO3; and cyanuric acid, mg/L) was evaluated using a six-way paper-testing strip (Kokido Development Ltd., Hong Kong). Biological quality was initially evaluated in the field using Coliplates® (Bluewater Biosciences, Inc. Ontario, ON, Canada), which measured the most probable number of colony forming units (CFU)/100 mL of both total coliforms and E. coli [24].

2.3.2. Molecular Detection

Aliquots of the same water sample were then filtered through a sterile 0.45 micron Millipore size membrane filter (IsoporeTM Membrane Filters, Millipore, Tullagreen, Cork, Ireland), placed in a sterile 2 mL test tube, and immediately frozen at −20 °C. The filters were transported back to the laboratory located at The Ohio State University, College of Public Health, Division of Environmental Health Sciences in the United States on ice for further analyses.
To evaluate the potential sources of microbial contamination, the human-specific Bacteroides genetic marker, HF183, was targeted to identify human faecal contamination [25]; Campylobacter spp. was determined to assess potential livestock/wildlife faecal contamination by targeting the 16S rRNA gene of C. jejuni, C. coli and C. lari [26]; and Staphylococcus aureus was detected to assess potential contact of drinking water with human skin (i.e., hand contact) by targeting nuc gene [27]. As this was a pilot project for a larger study, resource constraints only allowed for the assessment of antibiotic resistance to one class of antibiotics. Tetracycline was selected as it is one of the most commonly used antibiotics in both human and veterinary medicine both in the area [28,29,30] and globally [31]. Although there are numerous genes that code for tetracycline resistance [32], due our limited resources, only tetQ was targeted to assess the presence of antibacterial-resistant bacteria and also, potentially, human-and livestock-associated faecal contamination. This specific gene was targeted as it has been documented in previous studies to be the gene with the highest detection frequency in wastewater influent [31], was found to be one of the tetracycline resistance genes in greatest abundance in surface waters associated with livestock production [33], and has been documented as having the ability to transfer horizontally between bacteria native to human and ruminant gastrointestinal tracts [28]. Further information regarding PCR analysis methods can be reviewed in the supplementary material.

2.4. Statistical Analyses

Statistical analyses were performed using Microsoft Excel 2008 (Release ver. 12.3.6 Microsoft® Excel®) and Stata 13.1 (StataCorp Lp, College Station, TX, USA) software. Due to the non-normal distribution of the data, Mann-Whitney U tests were used to compare contamination levels between source and home samples. Spearman Rank-Order analysis and adjusted odds ratios were used to evaluate the relationships among water quality parameters and to evaluate the relationship between gastrointestinal illness and the quality of stored drinking water, respectively. During the calculation of the odds ratios, the null hypothesis assumed was that the microbial quality of stored drinking water would have no effect on the gastrointestinal health of individuals in the household. The alternative hypothesis was that there would be some effect, either protective (OR less than 1) or that the odds of reporting a gastrointestinal event would be higher (OR greater than 1) based on the presence of microbial contamination.

3. Results and Discussion

3.1. Health Survey Results

The descriptive demographic statistics are summarized in Table 1. Interviews were conducted in 120 households (n = 785 individuals). Average household size was 6.7 members, with several homes having more than 20 members. As in many developing countries, the age-structure of the population was young; 14% of individuals were under five years and 52% were under age 18 years. The median age was 17 years and average age was 21 years.
The top three gastrointestinal illness (GI) symptoms reported during the survey were stomach cramps, diarrhoea and fever (Table 2). On average, stomach cramps were reported to last 6 days (range 1–60 days); diarrhoea, 6 days (1–28); and fever, 8 days (1–60). 11% of the total survey population reported receiving care at a hospital (average duration 2.1 days) and 16% reported being under a doctor’s care (average 6.6 days).
Table 1. Descriptive statistics of demographic information obtained from heath surveys.
Table 1. Descriptive statistics of demographic information obtained from heath surveys.
Demographic CategoryCategory of MeasureNumber% of Total Study Population (Individuals)
Number of Households SurveyedTotal120-
Number of Individuals Included on SurveysTotal785-
AgeMean21.0 years-
Median17 years-
Range3 days-100 years-
Number less than 5 yearsTotal9713.8%
Number between 5-18 yearsTotal28640.6%
Number less than 18 yearsTotal36752.1%
Number between 19-60 yearsTotal30142.8%
Number over 60 yearsTotal10114.3%
GenderTotal Males38549.0%
Total Females40051.0%
Household SizeMean6.7 people-
Median6.5 people-
Range2–25 people-
ReligionTotal Muslim64081.5%
Total Christian14318.2%
Total Animist/Other20.3%
Number of different ethnic groups reportedTotal44-
Table 2. Number and percentage of individuals who reported gastrointestinal illness symptom(s) during the health survey; overall, and by age class and gender.
Table 2. Number and percentage of individuals who reported gastrointestinal illness symptom(s) during the health survey; overall, and by age class and gender.
Overall(%)<2 Years(%)<5 Years(%)5–18(%)19–60(%)61+(%)
Diarrhoea 19812.51644.42323.713411.883110.2915.2
Males4141.8743.71147.81235.31135.51100
Females5758.2956.31252.22264.72064.500
Bloody diarrhoea91.1412.7822.0651.7410.3300
Males444.411002100240.000--
Females555.60000360.01100--
Stomach 2 cramps13116.7411.111111.345519.235016.6131.57
Males4433.6125545.51629.11428.0133.3
Females8766.4375654.53970.93672.0266.7
Vomiting253.125.5622.0682.7992.9900
Males1456.0150150562.5444.4--
Females1144.0150150337.5555.6--
Nausea344.30000134.54175.6400
Males1235.3----430.8635.3--
Females2264.7----969.21164.7--
Fever 310913.938.3366.14315.034314.28315.78
Males5853.2310061002251.21944.2266.7
Females5146.800002148.82455.8133.3
1 The third most reported symptom. 2 The number one most reported symptom. 3 The second most reported symptom. Note: 80 people were unsure of their age and were removed for purposes of the age-related breakdown. They remain included in the overall statistics.
Reported gastrointestinal symptoms were higher for the younger age ranges: 55% of individuals 5–18 years (158/286) and 45% of individuals under the age of 5 years (44/97) reported to have had at least one GI symptom in the prior month. Over 16% percent (16/98) of individuals who had experienced diarrhoea were under the age of 2, despite this age group only making up only 5% of the overall population (36/705).

3.2. Sources and Storage of Drinking Water

Overall, 61% of surveyed households reported receiving their drinking water through a water supplier who transports water from a public tap or private water seller using plastic jerry cans loaded on a pull cart and delivers the water to their home; 20% had a private tap in their homes or compound; 13% bought their water from a neighbour using their own jerry cans; 3% regularly got their drinking water from a well; and 2% got their drinking water from a community borehole. Although a majority of households received their drinking water from a supplier, the supplier was not always available in order to obtain a sample from his jerry can. In these cases, the family directed us to the public tap source where their water supplier regularly obtained their water and a sample was taken from that tap. This resulted in the collection of 18 source samples directly from public/private taps, three from water suppliers’ jerry cans, three from open wells, and one from a borehole.
89% of households surveyed reported storing their drinking water at home in canaries. This included households with private taps within their compounds. Households who did not store their water in canaries generally used plastic bottles, buckets, and/or basins. 93% of households reported that they always or usually kept their drinking water storage containers (all types) covered. 73% said that they refilled the container every day, 22% at least every other day, and 1% every 3 or more days.

3.3. Drinking Water Quality

3.3.1. Chemical

Chemical analyses of all drinking water samples (both home and source water) revealed little detectable chlorine (average 0.23 mg/L of total chlorine and 0 mg/L of free chlorine). The average pH of all samples was 7.0. Average total alkalinity was 157 mg/L and the total hardness CaCO3 was 75.9 mg/L. Other than free chlorine levels, there were no statistically significant differences in chemical quality between home and source samples (Table 3).
Table 3. Comparison of water quality from the water samples collected at drinking water sources and homes (source, n = 25; home, n = 59).
Table 3. Comparison of water quality from the water samples collected at drinking water sources and homes (source, n = 25; home, n = 59).
ParameterStatisticSourceHomep-Value (Mann-Whitney U Test)
Total Coliforms (CFU/100 ml)Mean a3.2 × 1021.7 × 1030.0001 b
Median2.2 × 1012.4 × 103-
Range2.2 × 101–2.4 × 1032.2 × 101–2.4 × 103-
E. coli (CFU/100 ml)Mean6.8 × 1015.5 × 1020.0004 b
Median4.0 × 1001.6 × 102-
Range2.2 × 101–8.6 × 1022.2 × 101–2.4 × 103-
Total Chlorine (mg/L)Mean0.40.10.1067
Median00-
Range0–30–5-
Free Chlorine/Bromine (mg/L)Mean0.110.010.0390 b
Median00-
Range0–0.750–0.5-
pHMean6.97.00.3118
Median6.87.2-
Range6.8–7.66.8–8.0-
Total Alkalinity (mg/L)Mean148.61610.4808
Median120180-
Range80–24080–240-
Total Hardness (mg/L CaCO3)Mean64.880.80.5787
Median0100-
Range0–5000–1000-
a All means reported are arithmetic. b Home and source values are statistically significant, corresponding p-values listed.

3.3.2. Microbial

Microbial analysis of all drinking water samples (both home and source water) revealed a high level of bacterial contamination that surpassed the World Health Organization’s “no action required” threshold of <1 CFU/100 mL for E. coli in drinking water [34]. In-situ analysis showed that the average total coliform count for all samples (i.e., both home and source samples) was 1.27 × 103 CFU/100 mL (median value = 1.4 × 103) and the average E. coli count was 4.3 × 102 CFU/100 mL (median value = 7.8 × 101). When home and source samples were separated, home samples had statistically significant higher levels of coliforms (p = 0.0001) and E. coli (p = 0.0004) (CFU/100 mL coliform average 1.7 × 103, median 2.4 × 103; CFU/100 mL E. coli average 5.5 × 102, median 1.6 × 102) compared to source samples (CFU/100 mL coliform average 3.2 × 102, median 2.2 × 101; CFU/100 mL E. coli average 6.8 × 101, median 4 × 100) (Table 3).
Most source samples (18/25) were taken from improved drinking water sources (i.e., stand taps) but most of the bacterial contamination in source samples were detected from the few non-improved sources that were collected (e.g., open wells; 3/25). Because fewer non-stand tap sources (n = 7) were able to be collected and because their microbial quality greatly skewed the data, they were removed from subsequent analyses. Upon removing these non-tap sources from the analysis, the difference between paired home and tap source water quality samples was even greater in terms of E. coli and coliform levels (Home: mean E. coli level = 5.51 × 102 CFU/100 mL, median E. coli level = 1.6 × 102; mean total coliform = 1.03 × 103, median coliform = 2.4 × 103. Taps: mean E. coli level = 5.8 × 101, median E.coli level = 2 × 100; mean total coliform level = 1.77 × 102, median total coliform level = 4 × 100. E. coli, p = 0.0001; total coliform, p = 0.001). Yet it is important to note that although water collected directly from taps exhibited lower concentrations of both total coliform bacteria and E. coli, non-tap sources collected indicated that once the drinking water began moving through the informal distribution system (e.g., into water suppliers’ jerry cans), microbial contamination levels rose substantially for both total coliforms and E. coli. This increase in microbial contamination suggested that receiving water from an improved source had only a small impact on the quality of the water at the point of use, the home (Figure 3). Note, due to the non-normal distribution of contamination levels and small sample sizes of non-tap sources, the median concentration values have been displayed.
Figure 3. Total coliforms and E. coli median concentration values from different types of drinking water sources and home storage container.
Figure 3. Total coliforms and E. coli median concentration values from different types of drinking water sources and home storage container.
Ijerph 11 12454 g003
* There was only 1 sample taken from a closed well/borehole. 3 from open wells, 3 from jerry canes and 18 from stand taps.

3.3.3. Molecular Detections

qPCR analysis detected tetracycline-resistant gene copies (tetQ) and human faecal marker gene copies, HF183; in 19% (n = 13) and 7% (n = 5) of total samples, respectively (Table 4). Campylobacter spp., a common waterborne pathogen of zoonotic origin, and S. aureus, a common part of the natural flora of human skin, were also detected in 12% (n = 8) and 19% (n = 13) of all water samples, respectively. With the exception of tetQ and HF183, home samples had substantially higher positive test frequencies of all other bacteria assayed compared to source samples. This is especially true of S. aureus and Campylobacter positive samples, which were found in twice to three times higher percentages in homes versus source samples.

3.4. Reported Gastrointestinal Illness & Drinking Water Quality

Based on the results of the health survey, individuals were divided into four categories using GI symptoms in the prior 30 days: (1) non-case; (2) diarrhoea case (i.e., any individual who reported experiencing diarrhoea); (3) highly confirmed case of gastrointestinal illness with bloody diarrhoea (HCGI-BD; any individual who reported experiencing bloody diarrhoea, stomach cramps, and fever); or (4) highly confirmed case of gastrointestinal illness without bloody diarrhoea (HCGI-NBD; any individual who reported experiencing non-bloody diarrhoea, stomach cramps, and fever).
Table 4. Microbial contamination found in water samples from stand tap water sources and all home storage containers.
Table 4. Microbial contamination found in water samples from stand tap water sources and all home storage containers.
Genetic Marker or BacteriaPositive Source ºPositive Home ªTotal Positives
n (% Positive source samples)n (% Positive home samples)n (% Of total samples)
E. coli *,Υ9 (50)52 (87)61 (87)
tetQ ŧ5 (28)8 (13)13 (19)
S. aureus ŧ1 (6)12 (20)13 (19)
Campylocbacter ŧ1 (6)7 (12)8 (12)
HF183 ŧ1 (6)4 (7)5 (7)
º Source samples only include source samples taken from stand taps (n = 18). ª Includes all home samples regardless of source type (n = 60). * Mesaured in CFU/100 mL and includes samples above the ColiPlate limit of detection. ŧ Measured in gene copies/100 mL and includes samples above qPCR limit of detection. Υ 2 samples were lost during DNA extraction, thus the denominator for E.coli samples is 88 instead of 86.
Spearman Rank-Order analyses were used to measure the relationship between the following home drinking water quality parameters: number of HF183 gene copies/100 mL; number of tet Qgene copies/100 mL; and concentration of E. coli CFU/100 mL. tetQ had a statistically significant inverse relationship both with E. coli levels (Rho = −0.31, p = 0.001) and with HF183 (Rho = −0.11, p = 0.003). Initial statistical analyses did not demonstrate a statistically significant relationship between Campylobacter, S. aureus and gastrointestinal illness, thus these parameters were not included in further analyses. Mann-Whitney U tests comparing tetQ and E. coli levels present in the HSC of cases and non-cases demonstrated a significant difference only in the average level of tetQ for all three GI-illness categories (Table 5).
Two rounds of odds ratios were then performed in order to further measure the association between drinking water quality at the point of use (i.e., within canaries) and reported gastrointestinal illness. The first round was performed on each of the following three classes (diarrhoea, HCGI-BD, and HCGI-NBD) and with the following drinking water quality parameters: E. coli quartiles, presence of HF183, and presence of tetQ. Simple presence/absence of tetQ and HF183 genes copies were used in order to include all individuals who had any detectable amount of HF183 or tetQ in their drinking water (Table 6). Due to their non-normal distribution and in order to better view the risk associated with varying levels of potential faecal contamination, the E. coli concentration measures were divided and reported as quartile values. Because diarrhoeal disease symptoms were more heavily reported among younger individuals, the odds ratios were adjusted for age.
Table 5. Results of Mann-Whitney U tests of E. coli and tetQ concentrations between different types of gastrointestinal illness (diarrhoea, HCGI-BD, HCGI-NBD).
Table 5. Results of Mann-Whitney U tests of E. coli and tetQ concentrations between different types of gastrointestinal illness (diarrhoea, HCGI-BD, HCGI-NBD).
Gastrointestinal Illness Class (n = Cases/n = Non-Cases) 1Water Quality Parameter Medians & ( Means)CasesNon-Cases Yp-Value
Diarrhoea 2tetQ (gene copies/100 mL)7.5 (547.9)7.5 (278.5)0.0032 *
(52/347)E. coli (log CFU/100 mL)1.9 (2.0)2.2 (2.1)0.9405
HCGI-BD 3tetQ (gene copies/100 mL2310.6 (2310.6)7.5 (307.2)0.0194 *
(1/398)E. coli (log CFU/100 mL)1.11 (1.1)2.3 (2.1)0.2792
HCGI-NBD 4tetQ (gene copies/100 mL7.5 (773.2)7.5 (290.5)0.0021 *
(18/381)E. coli (log CFU/100 mL)1.6 (1.8)2.3 (2.1)0.2377
1 Total sample for surveyed individuals was 785, but water quality was only available for 399 individuals; 2 Case = any individual who reported experiencing diarrhoea during prior 30 days; 3 Case = any individual who reported experiencing bloody diarrhoea, stomach cramps & fever during prior 30 days; 4 Case = any individual who reported experiencing non-bloody diarrhoea, stomach cramps & fever during prior 30 days; Y Non-cases = any individual who did not meet the definitions defined above; * Statistically significant.
Table 6. Adjusted odds ratios for diarrhoea, HCGI-BD & HCGI-NBD associated with various exposures levels to E. coli, HF183, or tetQ.
Table 6. Adjusted odds ratios for diarrhoea, HCGI-BD & HCGI-NBD associated with various exposures levels to E. coli, HF183, or tetQ.
Genetic Marker or E. coli Quartile (Range log CFU/100 mL)DiarrhoeaHCGI with Bloody DiarrhoeaHCGI with Non-Bloody Diarrhoea
aOR 1 (95% CI)(p)aOR (95% CI)(p)aOR (95% CI)(p)
E. coli Quartile (0.30–1.23) 1.15 (0.57–2.31)0.13N/A 2-1.62 (0.61–4.92)0.35
E. coli Quartile (1.24–2.26)1.92 (0.93–3.42)0.05N/A-1.72 (0.63–5.08)0.30
E. coli Quartile (2.27–2.93)0.08 (0.93–3.42)0.05N/A-N/C-
E. coli Quartile (2.92–3.38)1.43 (0.78–2.98)0.31N/A-1.01 (0.32–3.22)0.95
HF1830.92 (0.16–3.18)0.91N/C 3-2.57 (0.5–12.07)0.21
tetQ2.48 (1.3–5.16)0.01 *N/A-3.01 (1.02–8.89)0.04 *
1 Odds ratio adjusted for age using Mantel-Haenszel method and null and alternative hypotheses are as follows, H0: OR = 1 versus H1: OR ≠ 1; 2 Not Available. There were only 3 cases of HCGI with bloody diarrhoea and in certain cases, ORs could not be calculated due to zero cell counts; 3 No cases exposed in this quartile; † E. coli concentration divided into quartiles to better demonstrate the varying risk with different contamination levels; inclusive cut-offs for each quartile; * Statistically significant confidence intervals above an OR of 1 or “no effect”.
Guided by the results of the Spearman Rank-Order analysis (inverse relationship between tetQ and E. coli) and the results of the first round of odds ratio calculations (increased odds of reporting gastrointestinal illness with the presence of tetQ in home drinking water), a second round of odds ratios was conducted using the same three case classes and placed them in four different water quality groups created based on the presence of tetQ and varying E. coli levels in HSC drinking water (Table 7). The highest statistically significant odds ratios occurred between diarrhoea and NCGI-NBD cases that had E. coli levels below the 1st quartile and tetQ present in their drinking water. Because few individuals reported having bloody diarrhoea, odds ratios for this case class could not be calculated. Interestingly, even when tetQ was present in the water, as the level of E. coli contamination increased above the first quartile, no cases of HCGI-NBD were observed.
Table 7. Adjusted odds ratios for diarrhoea, HCGI-BD & HCGI-NBD associated with microbial quality groups.
Table 7. Adjusted odds ratios for diarrhoea, HCGI-BD & HCGI-NBD associated with microbial quality groups.
Microbial Quality GroupDiarrhoeaHCGI-BDHCGI-NBD
aOR 1 (95% CI)(p)aOR (95% CI)(p)aOR (95% CI)(p)
Group 1 (tetQ & 1st Quartile E. coli) 2.95 (1.35–6.45)0.005 *N/A 2-5.31 (1.72–16.35)0.001 *
Group 2 (tetQ & 2nd Quartile E. coli)2.06 (0.43–9.76)0.248N/C-N/C-
Group 3 (tetQ & 3rd Quartile E. coli)0.48 (0.03–7.27)0.588N/C-N/C-
Group 4 (tetQ & 4th Quartile E. coli)N/C 3-N/C-N/C-
1 Odds ratio adjusted for age using Mantel-Haenszel method and null and alternative hypotheses are as follows, H0: OR = 1 versus H1: OR ≠ 1.; 2 Not Available. There were only 3 cases of HCGI with bloody diarrhoea and in certain cases, ORs were not able to be calculated due to zero cell counts; 3 No cases exposed in this quartile; E. coli concentration divided into quartiles to better demonstrate the varying risk with different contamination levels; * Statistically significant confidence intervals above an OR of 1 or “no effect”.

3.5. Discussion

The results from this study suggest that the greatest bacterial contamination of drinking water in the city of Maroua occurs within the household and that improvements of the originating source water quality deteriorate once the drinking water moves through the distribution system and is stored in the household. Despite the fact that a majority of the study population received their water from improved sources, 87% of drinking water samples taken from HSC surpassed the WHO’s “no action required” threshold for E. coli in drinking water. The tetQ positive samples also confirm that tetracycline-resistant bacteria are present within the study area, a steadily increasing trend in the developed and developing world [22,23]. tetQ had an interesting relationship between E. coli levels in HSC and this relationship provided a more demonstrable association with reported diarrhoeal disease than E. coli levels alone. This finding implies that adding additional screening factors, such as detection of antibacterial resistance genes, may provide improved assessment of the diarrhoeal risk associated with a drinking water source especially in tropical and semi-tropical regions of the world, like Maroua, where the traditional faecal indicators may not be as effective signalers of potential faecal contamination due to increased persistence of environmental presence [35,36,37].
This tetQ-E. coli relationship suggests that the growing problem of antibiotic resistant bacteria adds a new dimension to the kind of drinking water contamination that can occur. Antibiotic use is often uncontrolled in developing countries [38,39,40,41] leading to great concern as the number of organisms resistant to multiple types of antibiotics grows and is present in the greater environment. A study in Nepal demonstrated that even communal exposure to antibiotics increased the number of antibiotic resistant pathogens within an individual’s faeces [42]. In addition, animal studies have demonstrated that antibiotic use can lower the infectious dose of certain pathogens [43].
The presence of tetQ and of HF183 in drinking water is an interesting finding for two reasons. First, both genetic markers confirm that there is human faecal contamination (and/or possibly livestock in the case of tetQ) occurring within areas where drinking water is accessed and utilized in our study area. In addition, the near equal HF183 positive detection (Table 4) percentage among home and source samples and the higher tetQ positive detection in sources samples suggest that this specific type of contamination is coming from the greater environment and/or in addition to within the home. tetQ and HF183 were not found together in any of the samples, suggesting that tetQ genes could be potentially coming from non-human sources (i.e., livestock) within the environment. The detection of Campylobacter spp. also supports the possibility that contamination is coming from livestock or wildlife within the home and within the areas where drinking water is collected. In the urban environment of Maroua, livestock density is relatively high (specifically goats, sheep, and poultry) and animals mingle freely within homes, on the streets and frequently congregate near public stand taps (Figure 1). Lizards and birds are also common within household compounds.
Second, tetQ was detected in source samples at more than twice the positive percentage found in HSC samples, suggesting that tetracycline-resistant bacteria are present within the city distribution system (from either human or livestock sources) despite chlorinated water treatment. It is possible that the bacteria with this resistance are less susceptible to disinfection or that they are being introduced at the point of collection and there is not sufficient residual chlorination remaining to kill them.
The inverse relationship between tetQ and E. coli within canaries, in addition to the results of the second round of odds ratios, suggests that there may be an interaction between antibiotic-resistant bacteria and E. coli within drinking water that has a relationship to gastrointestinal illness. While the study design did not allow for identification of which bacteria were in the water when individuals became ill, the cause of the diarrheal illness, or if individuals were currently taking antibiotics (i.e., tetracycline), it seems that in our study area that tetracycline usage has caused an additional environmental risk factor to drinking water quality. And while there are some inherent limitations to using qPCR, namely lack of discrimination between viable and non-viable organisms and the potential for false detection within a mixed microbial community, the results of this study strengthen the suggestion that there may be a link between genetic determinants of antibiotic resistance and virulence such that fewer bacteria are necessary to create disease when resistance genes are present [44].

4. Conclusions

While our findings are exploratory and our sample sizes limited, our findings suggest that the use of antibiotics in humans or animals may potentiate an increased risk of gastrointestinal infections, especially for young children and infants, through increasing the selection for antibacterial resistant bacteria in the greater environment and that the likelihood of drinking water contamination in the home needs to be re-evaluated and further examined, taking into consideration how antibiotic use and zoonotic sources influence the microbial ecosystem of HSC and how interactions between microfauna affect human health.
Further work is warranted to better match the pathogenic organisms in the canaries with individuals within the household and to better assess the relationship between antimicrobial-resistant bacteria and other pathogens in micro-ecosystems within canaries and what this relationship’s impact is on drinking water quality.

Supplementary Files

Supplementary File 1

Acknowledgments

This project was supported by an R24-HD058484 from the Eunice Kennedy Shriver National Institute of Child Health and Human Development awarded to the Ohio State University Initiative in Population Research (IPR) Seed Grant. It was also partially supported by funds provided by an REU supplement to a grant from the Ecology and Evolution of Infectious Diseases (EEID) program at the National Science Foundation (DEB-10 15908), the Public Health Preparedness for Infectious Diseases (PHPID) programme (phpid.osu.edu), and the Casto Graduate Fund at the Ohio State University. We are grateful to the study participants who took time to participate in our study and provide us with their drinking water. We are also grateful to the research assistants, Kellou Djibrine, Olivier Dayang Ngaba, Ibrahim Tchari, and Assïatou Bouba Hamadou, from the Université de Maroua and interpreter, Moussa Haman, who helped to carry out the fieldwork portion of this project.

Author Contributions

Jessica Healy Profitós, Jiyoung Lee, Arabi Mouhaman, Mark Moritz, Rebecca Garabed, Barbara Piperata, and Joe Tien conceived and designed the study; Jessica Healy Profitós and Arabi Mouhaman performed the field work; Jessica Healy Profitós and Seungjun Lee performed the experiments; Jessica Healy Profitós and Jiyoung Lee analyzed the data; Jiyoung Lee contributed reagents/materials/analysis tools; Jessica Healy Profitós wrote the paper; and Jiyoung Lee, Arabi Mouhaman, Mark Moritz, Rebecca Garabed, Barbara Piperata, Joe Tien, Michael Bisesi and Seungjun Lee edited the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. The Top 10 Causes of Death; World Health Organization: Geneva, Switzerland, 2013. [Google Scholar]
  2. Lamberti, L.M.; Walker, C.L.F.; Black, R.E. Systematic review of diarrhea duration and severity in children and adults in low- and middle-income countries. BMC Public Health 2012, 12. [Google Scholar] [CrossRef]
  3. Liu, L.; Johnson, H.L.; Cousens, S.; Perin, J.; Scott, S.; Lawn, J.E.; Rudan, I.; Campbell, H.; Cibulskis, R.; Li, M.; et al. Global, regional, and national causes of child mortality: An updated systematic analysis for 2010 with time trends since 2000. Lancet 2012, 379, 2151–2161. [Google Scholar] [CrossRef] [PubMed]
  4. Cairncross, S.; Blumenthal, U.; Kolsky, P.; Moraes, L.; Tayeh, A. The public and domestic domains in the transmission of disease. Trop. Med. Int. Health 1996, 1, 27–34. [Google Scholar] [CrossRef] [PubMed]
  5. Enger, K.S.; Nelson, K.L.; Rose, J.B.; Eisenberg, J.N.S. The joint effects of efficacy and compliance: A study of household water treatment effectiveness against childhood diarrhea. Water Res. 2013, 47, 1181–1190. [Google Scholar] [CrossRef] [PubMed]
  6. Firth, J.; Balraj, V.; Muliyil, J.; Roy, S.; Rani, L.M.; Chandresekhar, R.; Kang, G. Point-of-use interventions to decrease contamination of drinking water: A randomized, controlled pilot study on efficacy, effectiveness, and acceptability of closed containers, Moringa oleifera, and in-home chlorination in rural south India. Am. J. Trop. Med. Hyg. 2010, 82, 759–765. [Google Scholar] [CrossRef] [PubMed]
  7. Brown, J.; Sobsey, M.D. Microbiological effectiveness of locally produced ceramic filters for drinking water treatment in Cambodia. J. Water Health 2010, 8, 1–10. [Google Scholar] [CrossRef] [PubMed]
  8. Clasen, T.F.; Bastable, A. Faecal contamination of drinking water during collection and household storage: The need to extend protection to the point of use. J. Water Health 2003, 1, 109–115. [Google Scholar] [PubMed]
  9. Jensen, P.K.; Ensink, J.H.J.; Jayasinghe, G.; van der Hoek, W.; Cairncross, S.; Dalsgaard, A. Domestic transmission routes of pathogens: The problem of in-house contamination of drinking water during storage in developing countries. Trop. Med. Int. Health 2002, 7, 604–609. [Google Scholar] [CrossRef] [PubMed]
  10. Mintz, E.; Bartram, J.; Lochery, P.; Wegelin, M. Not just a drop in the bucket: Expanding access to point-of-use water treatment systems. Am. J. Public Health 2001, 91, 1565–1570. [Google Scholar] [CrossRef] [PubMed]
  11. Roberts, L.; Chartier, Y.; Chartier, O.; Malenga, G.; Toole, M.; Rodka, H. Keeping clean water clean in a Malawi refugee camp: A randomized intervention trial. Bull. World Health Organ. 2001, 79, 280–287. [Google Scholar] [PubMed]
  12. Schmidt, W.-P.; Cairncross, S. Household water treatment in poor populations: Is there enough evidence for scaling up now? Environ. Sci. Technol. 2009, 43, 986–992. [Google Scholar] [CrossRef] [PubMed]
  13. VanDerslice, J.; Briscoe, J. All coliforms are not created equal: A comparison of the effects of water source and in-house water contamination on infantile diarrheal disease. Water Resour. Res. 1993, 29, 1983–1995. [Google Scholar] [CrossRef]
  14. Kjellén, M.; McGranahan, G. Informal Water Vendors and the Urban Poor; Human Settlements Discussion Paper Series; International Institute for Environment and Development: London, UK, 2006. [Google Scholar]
  15. Djaouda, M.; Gake, B.; Ebang, D.; Zebaze Togouet, S.H.; Nola, M.; Njine, T. Survival and growth of Vibrio cholerae, Escherichia coli, and Salmonella Spp. in well water used for drinking purposes in Garoua (North Cameroon). Int. J. Bacteriol. 2013, 2013. [Google Scholar] [CrossRef]
  16. Djaouda, M.; Njiné, T.; Liang, S.; Menye, D.E.; Gaké, B.; Togouet, S.H.Z.; Nola, M. Bacteriological quality of well waters in Garoua, North Cameroon. Water Qual. Expo. Health 2014, 6, 161–176. [Google Scholar] [CrossRef]
  17. Nola, M.; Nougang, M.E.; Noah Ewoti, O.V.; Moungang, L.M.; Krier, F.; Chihib, N.-E. Detection of pathogenic Escherichia coli strains in groundwater in the Yaoundé region (Cameroon, Central Africa). Water Environ. J. 2013, 27, 328–337. [Google Scholar]
  18. Blaise Nguendo Yongsi, H. Suffering for water, suffering from water: Access to drinking-water and associated health risks in Cameroon. J. Health Popul. Nutr. 2010, 28, 424–435. [Google Scholar] [PubMed]
  19. Luc, A.; Totouom, F.; Sikod, F.; Abba, I. Household choice of purifying drinking water in Cameroon. Environ. Manag. Sustain. Dev. 2012, 1, 101–115. [Google Scholar]
  20. Kometa, S.S.; Ebot, M.A.T.; Ngala, H.N.; Gur, A.S. Human health vulnerability to climate variability: The cases of Cholera and Meningistis in some urban areas of the far north region of Cameroon. J. Geogr. Geol. 2013, 5. [Google Scholar] [CrossRef]
  21. Cunin, P.; Tedjouka, E.; Germani, Y.; Ncharre, C.; Bercion, R.; Morvan, J.; Martin, P.M. An epidemic of bloody diarrhea: Escherichia coli O157 emerging in Cameroon? Emerg. Infect. Dis. 1999, 5, 285–290. [Google Scholar] [CrossRef] [PubMed]
  22. Germani, Y.; Cunin, P.; Tedjouka, E.; bou Ncharre, C.; Morvan, J.; Martin, P. Enterohaemorrhagic Escherichia coli in Ngoïla (Cameroon) during an outbreak of bloody diarrhoea. Lancet 1998, 352, 625–626. [Google Scholar] [CrossRef] [PubMed]
  23. Joséphine, N.; Véronique, K.K.B.; Luc, S.N.; Georges, E.; Awah, T.M. Water supply, sanitation and health risks in Douala, Cameroon. Afr. J. Environ. Sci. Technol. 2008, 2, 422–429. [Google Scholar]
  24. Gronewold, A.D.; Wolpert, R.L. Modeling the relationship between most probable number (MPN) and colony-forming unit (CFU) estimates of fecal coliform concentration. Water Res. 2008, 42, 3327–3334. [Google Scholar] [CrossRef] [PubMed]
  25. Bernhard, A.E.; Field, K.G. A PCR assay to discriminate human and ruminant feces on the basis of host differences in bacteroides-prevotella genes encoding 16S rRNA. Appl. Environ. Microbiol. 2000, 66, 4571–4574. [Google Scholar] [CrossRef] [PubMed]
  26. Van Dyke, M.I.; Morton, V.K.; McLellan, N.L.; Huck, P.M. The occurrence of Campylobacter in river water and waterfowl within a watershed in southern Ontario, Canada: Campylobacter in river water. J. Appl. Microbiol. 2010, 109, 1053–1066. [Google Scholar] [CrossRef] [PubMed]
  27. Postollec, F.; Falentin, H.; Pavan, S.; Combrisson, J.; Sohier, D. Recent advances in quantitative PCR (qPCR) applications in food microbiology. Food Microbiol. 2011, 28, 848–861. [Google Scholar] [CrossRef] [PubMed]
  28. Nikolich, M.; Hong, G.; Shoemaker, N.; Salyers, A. Evidence for natural horizontal transfer of tetQ between bacteria that normally colonize humans and bacteria that normally colonize livestock. Appl. Environ. Microbiol. 1994, 60, 3225–3260. [Google Scholar]
  29. Lee, C.; Agidi, S.; Marion, J.W.; Lee, J. Arcobacter in Lake Erie beach waters: An emerging gastrointestinal pathogen linked with human-associated fecal contamination. Appl. Environ. Microbiol. 2012, 78, 5511–5519. [Google Scholar] [CrossRef] [PubMed]
  30. Healy Profitós, J.; Moritz, M.; Garabed, R. What to do with chronically sick animals? Pastoralists’ management strategies in the far north region of Cameroon. Pastor. Res. Policy Pract. 2013, 3. [Google Scholar] [CrossRef]
  31. Auerbach, E.A.; Seyfried, E.E.; McMahon, K.D. Tetracycline resistance genes in activated sludge wastewater treatment plants. Water Res. 2007, 41, 1143–1151. [Google Scholar] [CrossRef] [PubMed]
  32. Bryan, A.; Shapir, N.; Sadowsky, M.J. Frequency and distribution of tetracycline resistance genes in genetically diverse, nonselected, and nonclinical Escherichia coli strains isolated from diverse human and animal sources. Appl. Environ. Microbiol. 2004, 70, 2503–2507. [Google Scholar] [CrossRef] [PubMed]
  33. Zhang, Y.; Zhang, C.; Parker, D.B.; Snow, D.D.; Zhou, Z.; Li, X. Occurrence of antimicrobials and antimicrobial resistance genes in beef cattle storage ponds and swine treatment lagoons. Sci. Total Environ. 2013, 463–464, 631–638. [Google Scholar] [CrossRef]
  34. World Health Organization (WHO). Guidelines for Drinking-Water Quality, 4th ed.; WHO: Geneva, Switzerland, 2011. [Google Scholar]
  35. Savichtcheva, O.; Okabe, S. Alternative indicators of fecal pollution: Relations with pathogens and conventional indicators, current methodologies for direct pathogen monitoring and future application perspectives. Water Res. 2006, 40, 2463–2476. [Google Scholar] [CrossRef] [PubMed]
  36. Savichtcheva, O.; Okayama, N.; Okabe, S. Relationships between Bacteroides 16S rRNA genetic markers and presence of bacterial enteric pathogens and conventional fecal indicators. Water Res. 2007, 41, 3615–3628. [Google Scholar] [CrossRef] [PubMed]
  37. Harris, A.R.; Davis, J.; Boehm, A.B. Mechanisms of post-supply contamination of drinking water in Bagamoyo, Tanzania. J. Water Health 2013, 11, 543–554. [Google Scholar] [CrossRef] [PubMed]
  38. Kimang’a, A.N. A situational analysis of antimicrobial drug resistance in Africa: Are we losing the battle? Ethiop. J. Health Sci. 2012, 22, 135–143. [Google Scholar] [PubMed]
  39. Okeke, I.N.; Fayinka, S.T.; Lamikanra, A. Antibiotic resistance in Escherichia coli from Nigerian students, 1986 1998. Emerg. Infect. Dis. 2000, 6, 393–396. [Google Scholar] [CrossRef] [PubMed]
  40. Okeke, I.N.; Lamikanra, A.; Edelman, R. Socioeconomic and behavioral factors leading to acquired bacterial resistance to antibiotics in developing countries. Emerg. Infect. Dis. 1999, 5, 18–27. [Google Scholar] [CrossRef] [PubMed]
  41. Okeke, I.N.; Laxminarayan, R.; Bhutta, Z.A.; Duse, A.G.; Jenkins, P.; O’Brien, T.F.; Pablos-Mendez, A.; Klugman, K.P. Antimicrobial resistance in developing countries. Part I: Recent trends and current status. Lancet Infect. Dis. 2005, 5, 481–493. [Google Scholar] [CrossRef] [PubMed]
  42. Walson, J.L.; Marshall, B.; Pokhrel, B.M.; Kafle, K.K.; Levy, S.B. Carriage of antibiotic-resistant fecal bacteria in Nepal reflects proximity to Kathmandu. J. Infect. Dis. 2001, 184, 1163–1169. [Google Scholar] [CrossRef] [PubMed]
  43. Hentges, D.J.; Stein, A.J.; Casey, S.W.; Que, J.U. Protective role of intestinal flora against infection with Pseudomonas aeruginosa in mice: Influence of antibiotics on colonization resistance. Infect. Immun. 1985, 47, 118–122. [Google Scholar] [PubMed]
  44. Thakur, S.; Putnam, M.; Fry, P.R.; Abley, M.; Gebreyes, W.A. Prevalence of antimicrobial resistance and association with toxin genes in Clostridium difficile in commercial swine. Am. J. Vet. Res. 2010, 71, 1189–1194. [Google Scholar] [CrossRef] [PubMed]

Share and Cite

MDPI and ACS Style

Profitós, J.M.H.; Mouhaman, A.; Lee, S.; Garabed, R.; Moritz, M.; Piperata, B.; Tien, J.; Bisesi, M.; Lee, J. Muddying the Waters: A New Area of Concern for Drinking Water Contamination in Cameroon. Int. J. Environ. Res. Public Health 2014, 11, 12454-12472. https://doi.org/10.3390/ijerph111212454

AMA Style

Profitós JMH, Mouhaman A, Lee S, Garabed R, Moritz M, Piperata B, Tien J, Bisesi M, Lee J. Muddying the Waters: A New Area of Concern for Drinking Water Contamination in Cameroon. International Journal of Environmental Research and Public Health. 2014; 11(12):12454-12472. https://doi.org/10.3390/ijerph111212454

Chicago/Turabian Style

Profitós, Jessica M. Healy, Arabi Mouhaman, Seungjun Lee, Rebecca Garabed, Mark Moritz, Barbara Piperata, Joe Tien, Michael Bisesi, and Jiyoung Lee. 2014. "Muddying the Waters: A New Area of Concern for Drinking Water Contamination in Cameroon" International Journal of Environmental Research and Public Health 11, no. 12: 12454-12472. https://doi.org/10.3390/ijerph111212454

Article Metrics

Back to TopTop