Next Article in Journal
The Role of Preventative Medicine Programs in Animal Welfare and Wellbeing in Zoological Institutions
Previous Article in Journal
Air Quality Assessment in Pig Farming: The Italian Classyfarm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Exploring the Milk Microbiota of Healthy and Mastitic Nili Ravi Buffalo Using 16S rRNA Gene Base Metagenomic Analysis

by
Mian Muhammad Salman
1,
Muhammad Nawaz
1,*,
Tahir Yaqub
1 and
Muhammad Hassan Mushtaq
2
1
Institute of Microbiology, University of Veterinary and Animal Sciences, Lahore 54000, Pakistan
2
Department of Epidemiology and Public Health, University of Veterinary and Animal Sciences, Lahore 54000, Pakistan
*
Author to whom correspondence should be addressed.
Animals 2023, 13(14), 2298; https://doi.org/10.3390/ani13142298
Submission received: 1 June 2023 / Revised: 10 July 2023 / Accepted: 12 July 2023 / Published: 13 July 2023
(This article belongs to the Section Animal Genetics and Genomics)

Abstract

:

Simple Summary

Mastitis is a prevalent issue worldwide among lactating animals. It continues to be a serious problem since it has an economic impact on farmers due to direct and indirect losses. The multifactorial nature of this disease, coupled with the limitations of classical culture-based methods to identify uncultivable bacteria under normal laboratory conditions, exacerbates the situation. In the current study, milk samples from the well-known buffalo breed (Nili Ravi) were tested to explore bacterial communities associated with different udder health statuses using the 16S rRNA gene-based metagenomics technique. The bacterial communities in buffaloes with different udder health statuses, such as healthy, clinical mastitis, and subclinical mastitis, exhibited varied abundance at different taxonomic levels. Additionally, the study concluded that bacterial diversity in milk samples decreases in animals suffering from clinical mastitis compared to those with a healthy or subclinical mastitis status. These findings will contribute to our understanding of bacterial diversity’s role in mastitis development.

Abstract

The Nili Ravi, a buffalo breed from Pakistan, significantly contributes to the dairy industry. Mastitis is one of the major challenges affecting milk production in this breed. The objective of the current study was to identify the bacterial communities and diversity in healthy and mastitic milk of this breed. Milk samples (n = 14) were collected from Nili Ravi buffaloes with different udder health statuses, i.e., healthy (5), subclinical mastitis (4), and clinical mastitis (5). The DNAs were extracted, subjected to partial amplification of 16S rDNA (V3 and V4 regions), and sequenced using the Illumina platform. The results revealed variations in the bacterial communities in the milk of animals with different udder health statuses. Proteobacteria was the predominant phylum in the healthy group, while clinical and subclinical mastitis milk had a higher abundance of Firmicutes. Dominant bacterial genera in the healthy group were Streptococcus (11.60%), Herbaspirillum (7.65%), and Staphylococcus (4.70%), whereas the clinical mastitis group was dominated by Streptococcus (33.96%), Staphylococcus (7.87%), and Corynebacterium (2.68%), and the subclinical mastitis group was dominated by Bacillus (15.70%), Corynebacterium (6.70%), and Staphylococcus (6.58%). Assignment of operational taxonomic units at the species level resulted in most species being assigned to uncultured or unknown bacteria or remaining unassigned. Alpha diversity indices indicated lower microbial diversity in the clinical mastitis group, while beta diversity indices showed a scattered pattern of sample clustering in PCA plots among different groups. It is concluded that bacterial diversity in the milk of Nili Ravi buffaloes suffering from clinical mastitis is lower compared to healthy and subclinical mastitis cases. It is concluded that the variations in the microbiota of healthy and mastitic milk may be further investigated and exploited as signature microbes associated with the udder health status of Nili Ravi buffalo.

1. Introduction

Buffaloes have been an important choice for farmers among bovines for a long time due to their proficiency in utilizing diets with high roughage content and meeting the demands for animal protein in an escalating global population [1]. Approximately 13% of milk produced worldwide is derived from buffalo [2]. The Asian water buffalo plays a crucial role as an animal resource in 67 countries, providing milk and meat and serving as a source of draught power. It is highly relied upon by people for their livelihood [3]. Buffaloes are an important contributor to the economy of Pakistan, as they account for 68% of the total milk produced in the country. Among the established breeds of buffaloes in Pakistan, the Nili Ravi is a prominent dairy animal, often referred to as “Black gold” due to its high milk production [4]. Milk is an important agricultural commodity for farmers’ incomes and a significant contributor to the livestock sector’s contribution to the national GDP. Pakistan ranks among the top five countries in the world in terms of milk production, with an annual production of approximately 65.74 million metric tons of milk [5]. There is substantial untapped potential for improving the production potential of different dairy breeds in Pakistan, but various challenges impede its progress. One of the significant global challenges faced by the dairy industry, including Pakistan, is mastitis [6,7]. Mastitis caused by antibiotic-resistant bacteria further escalates the problem and increases production losses [8,9,10].
Mastitis is a serious condition that affects one or more quarters of the mammary gland in bovines. It is a multi-etiological inflammatory condition of the mammary gland parenchyma [11,12]. Buffaloes have been considered less susceptible to mastitis than cattle [13], but it still remains a disease that negatively affects the economics of the dairy industry. The cause of mastitis can be multifactorial, with bacteria ranking as a major one [11]. Bacterial agents involved in mastitis can be classified into two major categories: contagious and environmental. Contagious agents include Staphylococcus aureus, Streptococcus agalactiae, and Corynebacterium bovis, while environmental agents include Coliforms (such as E. coli, Enterobacter, and Klebsiella), Streptococcus uberis, Streptococcus bovis, and Streptococcus dysgalactiae [14]. In addition to these mastitogens, the udder microbial community comprises a diverse bacterial population, including both commensal and opportunistic pathogens [15]. Culture-based techniques are considered the primary approaches for identifying the bacteria involved in mastitis. However, negative bacteriological milk cultures can still be used to identify the mastitogens using molecular techniques, i.e., PCR and sequencing [16]. Although molecular techniques, including PCR, sequencing, and metagenomics, are better choices for identifying mastitogens, these still have limited application in field and laboratory setups because of their cost [17]. Although the role of different pathogenic bacteria is known in the development of mastitis, the significance of commensal udder microbiota and its interaction with mastitogens and udder health is less explored and requires further investigation [18].
There is currently limited information available regarding the milk microbiota of buffaloes and its association with udder health. To the best of our knowledge, there is no data on the milk microbiota of Nili Ravi buffalo. Conducting a study in this area would provide valuable insights into the milk microbiota of Nili Ravi buffaloes and the role of different microbial taxa in maintaining udder health. It would also contribute to our broader understanding of various aspects associated with mastitis, including its diagnosis, treatment, and preventive measures. By expanding our knowledge in these areas, we can work towards improving the management and well-being of buffaloes and the dairy industry.

2. Materials and Methods

2.1. Sample Collection

The sampling for this study was conducted in the Lahore district of Punjab province from May–June 2022. Farms (n = 4) were selected, focusing on similarities in husbandry and management practices. Buffaloes between 3 and 6 years of age, having at least one lactation, and not having undergone any antibiotic treatment in the last 15 days were included in the study. Animals with any co-morbidities were excluded from the study. Milk samples for metagenomic analysis were randomly selected from healthy, clinical mastitis, and subclinical mastitis groups (as indicated in Supplementary Tables S1 and S2). The collection of milk samples followed the protocols listed in the National Mastitis Council guidelines [19]. Prior to milk sampling, the udder of each animal was cleaned to remove any attached dust particles and fecal material. Clean water was used to wash the udder, which was then dried with a towel. The udder and teats were physically examined for any signs of inflammation, and a few strips of milk were discarded.
The milk sample was visually observed for texture, abnormal color, and consistency. Aseptically, a 15 mL milk sample was taken in duplicate in sterile Falcon tubes and labeled appropriately. The milk samples were evaluated using the California mastitis test at the farm. The samples were transported to the Probiotics Research Laboratory, Institute of Microbiology, University of Veterinary and Animal Sciences, Lahore, at 4 °C for further processing. The somatic cell count of each sample was conducted using direct microscopic count. The criteria for classifying the samples into healthy, clinical mastitis, and subclinical mastitis groups are given in Table 1. The milk samples were stored at −80 °C until further processing.

2.2. DNA Extraction

The laboratory work was conducted in a controlled environment using the same biosafety cabinet, reagents, and kits, all handled by the same person to ensure consistency. Initially, the milk samples were taken out of the freezer and allowed to reach ambient temperature by keeping them at room temperature. A pellet-based method developed by Yap et al. [20] was employed to remove fats from the milk samples. This involved centrifuging 15 mL of the milk sample at 4500× g for 20 min at 4 °C and then twice at 13,000× g for 1 min at 4 °C. After each centrifugation step, the supernatant was aseptically removed, and sterile phosphate-buffered saline (PBS) was used for washing the retained pellet. DNA extraction was carried out on the pellet and a negative control (PBS) using the DNeasy PowerSoil Kit (Qiagen, Hilden, Germany) following the manufacturer’s guidelines. The extracted DNA was evaluated for purity and concentration (Supplementary Table S3) using a Multiskan Sky microplate spectrophotometer (Thermoscientific, Waltham, MA, USA). Samples with optical density (OD) readings falling between 1.6 and 1.9 at 260/280 nm were considered acceptable for further processing. Samples that met the criteria were labeled appropriately and sent to Macrogen (Seoul, South Korea) for 16S rRNA gene-based metagenomic sequencing.

2.3. DNA Quality Control and Sequence Library Preparation

Before sequencing, the quantity of DNA was assessed by processing it through vector 3 fluorometry (Waltham, MA, USA) with the use of DNA binding dye (Invitrogen, cat. #P7589). The 16S rRNA gene was amplified by specifically targeting its V3 and V4 regions by employing forward (TCGTCGGCAGCGTCAGATGTGTATAAGAGACAGCCTACGGGNGGCWGCAG) and reverse primers (GTCTCGTGGGCTCGGAGATGTGTATAAGAGACAGGACTACHVGGGTATCTAATCC) [21]. The library preparation for 2 × 300 bp MiSeq sequencing was performed using the Illumina DNA Prep Kit (Illumina, San Diego, CA, USA). The protocol followed for library preparation was in accordance with the guidelines provided in the Illumina 16S Metagenomic Sequencing Library Preparation Part #15044223 Rev. B document.
Out of the 15 selected samples (5 from each group), 14 successfully passed the library quality control (QC) assessment. However, one sample from the subclinical mastitis group did not meet the QC criteria and was rejected.

2.4. Bioinformatics Analysis of Sequences

The bioinformatics analysis was conducted using the Quantitative Insight into Microbial Ecology (QIIME 2) software package, specifically version 2.2020.6 [22]. The 16S rRNA gene sequences (demultiplexed, paired-end reads) were processed following the guidelines provided in the QIIME 2 tutorial. For importing the FASTQ reads, the manifest file import method outlined in the tutorial was utilized. This method allows the import of demultiplexed, paired-end reads into QIIME 2. To filter out noisy data, the denoising method q2-dada2, available as one of the options in QIIME 2, was employed. This method uses the DADA2 algorithm for denoising and quality filtering the sequencing data [23]. The read length chosen for further processing (trimming criteria) was set at 300 base pairs (bp), and any reads longer than this length and chimeric sequences were excluded. Frequency feature tables, representing the frequencies of operational taxonomic units (OTUs), were generated using a specific command-line approach. The assignment of taxonomic labels to the OTUs was performed using a machine learning technique called classify-sklearn, which utilizes a naive Bayes classifier. This classifier was trained using the pre-trained Silva database (Silva 138) and aligned with an identity threshold of 97% to create taxonomic tables [24]. The taxonomic composition of the samples was visualized at various taxonomic levels using heat maps and bar plots. The raw sequences have been deposited in the National Center for Biotechnology Information (NCBI) and are available under the accession number PRJNA977256.

2.5. Diversity Analysis

The relative abundance of different taxa at various taxonomic levels was determined by converting the frequencies of OTUs into percentages. To analyze differences in taxa at different taxonomic levels, an analysis of variance (ANOVA) was performed. The results were presented visually using graphs created with Microsoft Excel (Microsoft Corp., Redmond, WA, USA) and GraphPad Prism 8.0.1. (GraphPad Software, San Diego, CA, USA).
To explore microbial diversities, the core metrics phylogenetic method was employed through the QIIME q2-diversity plug-in. Rarefactions were conducted for all samples, setting the thresholds at the minimum value. Alpha diversity was assessed using several indices, including richness and evenness-based measures, such as the Shannon diversity index (H) and Simpson’s index (D), as well as richness-based measures, such as observed features and Chao 1 indices. These indices were compared using the Kruskal–Wallis test.
For beta diversity, which focuses on diversity between samples, various indices were used, including Jaccard distance, Bray Curtis, and weighted and unweighted UniFrac metrics. Principal Component Analysis (PCA) graphs were generated to visualize these metrics. The beta metrics were evaluated using permutational multivariate analysis of variance (PERMANOVA).

3. Results

The 14 samples from Nili Ravi milk were divided into three groups: healthy (H), subclinical mastitis (SCM), and clinical mastitis (CM). In total, these samples comprised 142,857 reads, with read counts ranging from 2011 to 8726 reads per sample and a median of 6005 reads per sample. The Healthy (H) group consisted of five samples with a total of 30,652 reads. The subclinical mastitis (SCM) group comprised four samples with a total of 27,586 reads. Lastly, the clinical mastitis (CM) group contained five samples with a total of 25,834 reads. A total of 24 phyla, 78 orders, 131 families, 209 genera, and 84 species in milk samples were detected.

3.1. Taxonomic Compositin at Different Level in Nili Ravi Milk

Among the 24 detected phyla, 8 major phyla (Actinobacteria, Bacteroidetes, Cyanobacteria, Firmicutes, Planctomycetes, Proteobacteria, TM7, and Verrucomicrobia) were shared between all groups (H, SCM, and CM). The H group contained four distinct phyla, while the clinical mastitis (CM) group had one distinct phylum (Figure 1a).
Five major phyla among the 24 detected contributed more than 95% to the overall abundance (Figure 2). The dominant phyla observed in all three groups were Proteobacteria and Firmicutes. In the H group, Proteobacteria was the dominant phylum, while in the SCM and CM groups, Firmicutes dominated the milk microbiota.
The percentage abundance of different phyla across the H group was as follows: Proteobacteria (52.58%), Firmicutes (28.65%), Actinobacteria (11.14%), Bacteroidetes (5.65%), and Cyanobacteria (0.38%). In the CM and SCM groups, a decrease in the abundance of Proteobacteria was observed compared to that of the H group, with abundance values of 26.05% and 27.69%, respectively. The CM group showed a higher abundance of Firmicutes (58.20%), while it was 49.12% in the SCM group. Actinobacteria abundance increased in the case of the SCM group (13.35%), while it decreased in the case of the CM group (7.70%). Bacteroidetes appeared as the fourth-most abundant phyla in all three groups, with the highest abundance recorded in the SCM group, followed by the CM group, and the lowest abundance observed in the H group. The abundance of Planctomycetes was consistently low across all groups (Table 2 and Figure 3).
Among the 66 families shared between the healthy (H), clinical mastitis (CM), and subclinical mastitis (SCM) groups, the H group had 20 distinct families, the CM group had 8 distinct families, and the SCM group had 13 distinct families. There were six families shared between all three groups, eight families shared between the H and SCM groups, and 10 families shared between the CM and SCM groups (Figure 1b). At the family level, the major families detected in all groups were Bacillaceae, Corynebacteriaceae, Lactobacillaceae, Moraxellaceae, Oxalobacteraceae, Staphylococcaceae, and Streptococcaceae (Supplementary Figure S1). The abundance of Bacillaceae (H = 4.22%, CM = 0.87%, SCM = 15.74%) and Lactobacillaceae (H = 1.08%, CM = 0.84%, SCM = 1.88%) increased in the SCM group but decreased in the CM group compared to the H group. Moraxellaceae showed a decreasing trend in both mastitic groups, with a percent abundance of H = 4.22%, CM = 0.98%, and SCM = 3.86%. Corynebacteriaceae had a higher abundance in mastitic groups, with the highest abundance in SCM (6.20%) compared to the H group (1.91%). Oxalobacteraceae showed lower abundance in the mastitic groups (CM = 2.50%, SCM = 2.49%) compared to the H group (9.90%). Staphylococcaceae was more abundant in the mastitis groups compared to the H group (4.52%), with slightly higher abundance in CM (8.21%) compared to SCM (7.52%). The most abundant family detected in the CM group (33.19%) was Streptococcaceae, with a higher abundance compared to the H (11.11%) and SCM (3.95%) groups (Supplementary Figure S1). Moraxellaceae showed a significant decrease (p < 0.05) in the subclinical mastitis group, while Oxalobacteraceae showed a significant increase (p < 0.05) in the healthy group compared to the other groups (Table 2).
The assessment of microbial diversity at the genus level in Nili Ravi buffalo milk revealed that 58 genera were shared between all groups. The highest number of genera (24) were shared between the mastitic groups, followed by 21 genera shared between the healthy (H) and subclinical mastitis (SCM) groups and 12 genera shared between the H and clinical mastitis (CM) groups (Figure 1c). Distinct genera were found in decreasing order in the H group (39), followed by the CM group (32), and then the SCM group (23). Genera that were detected in high abundance included Acinetobacter, Bacillus, Corynebacterium, Herbaspirillum, Lactobacillus, Pseudomonas, Staphylococcus, and Streptococcus, accounting for 33.58% of the H group, 48.61% of the CM group, and 40.76% of the SCM group out of the total detected genera (Supplementary Figure S2). At the genus level, Acinetobacter was recorded in the highest abundance in the H group (3.40%), while its abundance decreased in the CM group (0.79%) and the SCM group (2.61%). The SCM group was dominated by Bacillus (15.77%), Corynebacterium (6.70%), and Lactobacillus (2.13%), while the CM group was dominated by Pseudomonas (1.40%), Staphylococcus (7.87%), and Streptococcus (33.96%) genera (Table 2).
A high proportion of the species detected in our study fell into the unculturable group. In some cases, no taxonomy could be assigned, and those species were considered unknown. In other cases, the assigned taxonomy was at a higher level, such as uncultured bacterium or bacterium species. The resolution of species classification was not as accurate as other taxonomic levels in our study. Many species were not classified according to specific taxonomic ranks (Supplementary Figure S3). In the H group, important detected species included Acinetobacter baumannii, Acinetobacter lwoffii, Prevotella nanceiensis, Staphylococcus gelatinosus, Staphylococcus vesicularis, Staphylococcus caen, Streptococcus agalactiae, Bifidobacterium bifidum, and Lactobacillus delbrueckii. In the CM group, low abundances of species such as Acinetobacter lwoffii, E. adolescentis, Prevotella nanceiensis, Sciuri species, Staphylococcus xylosus, Staphylococcus australicum, Streptococcus agalactiae, Streptococcus dispar, Streptococcus dysgalactiae, and Lactobacillus helveticus were detected. In the SCM group, species like Acinetobacter granulosus, Acinetobacter lwoffii, Citrobacter hathewayi, Prevotella nanceiensis, Sciuri sp., Staphylococcus australicum, Staphylococcus caeni, Streptococcus agalactiae, Streptococcus dysgalactiae, and Lactobacillus helveticus were detected, but in low abundance. It is important to note that the species assignments and their abundance varied between the groups, and there were instances where species could not be classified at specific taxonomic ranks, such as phylum, class, order, and genus.

3.2. Differnces in Alpha and Beta Diversity Indices in Healthy and Mastitic Groups

3.2.1. Alpha Diversity Indices

Milk samples from animals diagnosed with clinical mastitis showed a reduction in both types of diversity indices compared to those of the healthy group. This reduction was observed numerically and graphically, indicating a decrease in microbial diversity. However, the difference was not statistically significant (Table 3). In contrast, the milk samples from the SCM group showed a slightly different trend. The Shannon and Simpson diversity indices exhibited a slight difference compared to the healthy group, suggesting a potential dysbiosis of the udder in this type of mastitis (Figure 4). When compared to the CM group, the indices were higher in the SCM group, but the difference was not statistically significant.

3.2.2. Beta Diversity Indices

The differences observed between the healthy and mastitic groups using beta diversity indices are depicted in the principal component analysis (PCA) plots (Figure 5). Across all indices, a scattered pattern was observed in the PCA plots. Principal component 1 (PC-1) and principal component 2 (PC-2) accounted for 9.3% and 12.1% of the variation in the Jaccard index, respectively. In the Jaccard index PCA plot, 40% of the H samples clustered with 75% of the SCM samples and 40% of the CM samples. The remaining samples exhibited a scattered pattern, with H and CM samples clustering along the axis at different points. The PC-1 and PC-2 contributed 10.3% and 15.1% to the total variation in the Bray–Curtis dissimilarity index PCA plot, respectively. In this plot, 60% of the samples were relatively far from the H group samples. For the unweighted UniFrac distance metric, PC-1 accounted for 20% of the variation, and PC-2 accounted for 13.3% of the variation. In the weighted UniFrac distance metric, PC-2 contributed 64.8% of the variation, while PC-1 contributed 17.3% of the variation. In the unweighted metric PCA plot, H samples (60%) clustered with SCM samples (25%) and M samples. In the weighted metric PCA plot, a mixed pattern of sample clustering was observed, with 60% of the samples from the CM group being comparatively far from the H group samples.

4. Discussion

The characterization of milk microbiota in cattle and buffalo breeds in Pakistan using the 16S rRNA gene-based metagenomics technique still needs to be explored. To the best of our knowledge, this study represents the first attempt to investigate the milk microbiota specifically in the Nili Ravi Buffalo breed. The multifactorial nature of mastitis, including the interplay between microorganisms and host defense mechanisms, as well as the potential influence of environmental factors on microbial dysbiosis and disease development, necessitates an exploration of the unculturable microbiota associated with mastitis. Traditional techniques relying on culture-based identification methods have limitations, as they can only identify approximately 1% of microorganisms, while the remaining 99% of bacteria are considered unculturable [25]. The development of next-generation sequencing techniques has opened new horizons for insight into the microbiota of different habitats by allowing the sequencing of DNA or RNA of microbes from complex samples [26,27].
In this study, we investigated the milk microbiota in relation to udder health status, including healthy, clinical mastitis, and subclinical mastitis, utilizing the 16S rRNA gene-based metagenomics technique. The selection of samples was conducted from farms having similar management and husbandry practices to minimize the potential impact of these variables on the results. Firmicutes was the dominant phylum in the clinical and subclinical mastitis groups, which is consistent with previous findings [28,29]. This study reports a higher abundance of Proteobacteria in the healthy group compared to clinical and subclinical mastitis groups, which is in contrast to a previous study [30]. A higher abundance of Proteobacteria can be attributed to common environmental pathogens, i.e., Escherichia, Klebsiella, Pseudomonas, and Enterobacter [31]. Although these Proteobacteria are considered mastitogens, their frequent isolation from healthy milk samples indicates their opportunistic nature and highlights the complexity of their involvement in mastitis [32].
At the family level, Staphylococcaceae and Streptococcaceae were detected in all three groups, but a trend of higher abundance of both of these families was observed in the clinical mastitis group since the members of these families are major etiological agents of mastitis [33,34], and their higher abundance has been previously reported [35]. Moraxellaceae have been observed in higher percentages in both healthy and subclinical mastitis samples. Previous studies have reported the presence of Moraxellaceae in milk and feces on farms, suggesting the possibility of transmission from feces to milk [36]. The observed pattern at the family level is consistent with the genus level analysis, particularly for Streptococcus, which was found to be more prevalent in the clinical mastitis and healthy groups compared to the subclinical mastitis group. Since Streptococcus is a diverse genus containing many commensal and pathogenic organisms, their abundance in healthy and clinical mastitis groups is not surprising. Discrimination at the species level can provide a better understanding of the complex role of commensal streptococci in the progression of mastitis [15]. Furthermore, the high abundance of streptococci in the healthy group indicates that some of the streptococci species may live as commensals in the udder.
Various species of Streptococcus and Staphylococcus were detected in all groups. However, due to limitations in resolution and classification, many species were assigned to uncultured and unknown taxa, which hampers a comprehensive understanding of the species composition. In line with a previous study, on bubaline mastitis, the presence of the Acinetobacter genus was observed in both healthy and subclinical mastitis samples [37]. The Acinetobacter genus is known to include opportunistic species that have been observed at the teat apex [38]. Although different species of Acinetobacter have previously been reported from mastitic samples, these are not considered common etiological agents [28,39]. In the current study, Pseudomonas was only detected in a few samples from the subclinical group. Pseudomonas has been reported as an etiological agent of mastitis in various domestic dairy animals [40].
The assessment of diversity within the groups using alpha diversity indices revealed that the clinical mastitis group exhibited lower diversity compared to the other groups, which aligns with findings from previous studies conducted on bovines [37,41]. Interestingly, in our study, the subclinical mastitis group exhibited the highest diversity, which is in contrast with previous findings in cattle and buffalo, where subclinical mastitis milk showed lower alpha diversity indices compared to those of healthy animals [30,37]. However, a study conducted on goats, where alpha diversity was assessed based on different udder health statuses, reported a similar pattern to what is observed in the current study and suggested that the higher diversity in subclinical mastitis samples is attributed to a slight dysbiosis leading to an imbalance in the microbial community [42]. The beta diversity indices in our study exhibited a mixed pattern, with no clear separation observed between the samples from different groups. These findings are consistent with those of previous studies conducted on goats and cattle [42,43,44]. The lack of distinct clustering suggests that there is an overlap in the microbial composition among the different groups, indicating potential similarities or shared microbial dynamics across udder health statuses.

5. Conclusions

It is concluded that the milk of healthy and mastitic Nili Ravi buffalo contains complex and diverse microbial communities. There is a reduced microbial richness in mastitic milk, which may indicate a possible role of other normal inhabitant and commensal bacteria in mastitis. The variations in microbiota of healthy and mastitic milk may be further investigated and exploited as signature microbes associated with the udder health status of Nili Ravi buffalo.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ani13142298/s1; Figure S1: Representation of family-level taxonomical composition in individual samples through heat map; Figure S2: Representation of genus-level taxonomical composition in individual samples through heat map; Figure S3: Representation of species-level taxonomical composition in individual samples through heat map; Table S1: Farm data from which samples were collected; Table S2 Animal data from which sample collection was conducted. Table S3: Concentration of extracted DNA from milk samples.

Author Contributions

Conceptualization, M.M.S. and M.N.; methodology, M.M.S.; software, T.Y. and M.H.M.; validation, T.Y. and M.H.M.; formal analysis, M.M.S. and M.N.; investigation, M.M.S.; resources, M.N.; writing—original draft preparation M.M.S.; writing—review and editing, M.N. and M.H.M.; supervision, M.N., T.Y., and M.H.M.; project administration, M.N. and T.Y.; funding acquisition, M.N. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Punjab Higher Education Commission, Project # PHEC/ARA/PIRCA/20211/9, titled as “Metagenomic analysis of udder microbiome and development of indigenous probiotics for control of bovine mastitis”.

Institutional Review Board Statement

This study was conducted according to the institutional guidelines after obtaining ethical approval from the “Ethical review committee, University of Veterinary and Animal Sciences Lahore” (No. DR/81 dated 14-01-2020).

Informed Consent Statement

Informed consent was obtained from all animal owners (farm owners) for collection of milk sample and for the use of Buffalo milk for this study.

Data Availability Statement

The datasets generated and/or analyzed during the current study are available in the National Center for Biotechnology Information (NCBI) under accessions number PRJNA977256 (https://www.ncbi.nlm.nih.gov/bioproject/?term=PRJNA977256).

Acknowledgments

We would like to acknowledge “ABO scientific” for their valuable assistance in transporting our samples for sequencing to Macrogen, Seoul, South Korea.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Deb, G.K.; Nahar, T.N.; Duran, P.G.; Presicce, G.A. Safe and sustainable traditional production: The water buffalo in Asia. Front. Environ. Sci. 2016, 4, 38. [Google Scholar] [CrossRef] [Green Version]
  2. FAOSTAT Database, 2020; Retrieved 26 March 2023; Food and Agriculture Organization of United States: Rome, Italy, 2023.
  3. Zhang, Y.; Colli, L.; Barker, J. Asian water buffalo: Domestication, history and genetics. Anim. Genet. 2020, 51, 177–191. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Bilal, M.; Suleman, M.; Raziq, A. Buffalo: Black gold of Pakistan. Livest. Res. Rural Dev. 2006, 18, 140–151. [Google Scholar]
  5. GOP. Econmic Survey of Pakistan 2021–2022. Ministry of Finance; Governemt of Pakistan: Islamabad, Pakistan, 2022. [Google Scholar]
  6. Bradley, A.J. Bovine mastitis: An evolving disease. Vet. J. 2002, 164, 116–128. [Google Scholar] [CrossRef]
  7. Liu, J.; Wang, X.; Bi, C.; Ali, F.; Saleem, M.U.; Qin, J.; Ashfaq, H.; Han, Z.; Alsayeqh, A.F. Epidemiological investigation of Staphylococcus aureus infection in dairy cattle in Anhui, China. Pak. Vet. J. 2022, 42, 580–583. [Google Scholar] [CrossRef]
  8. Ahmed, A.; Ijaz, M.; Khan, J.A.; Anjum, A.A. Molecular Characterization and Therapeutic Insights into Biofilm Positive Staphylococcus aureus Isolated from Bovine Subclinical Mastitis. Pak. Vet. J. 2022, 42, 584–590. [Google Scholar] [CrossRef]
  9. Javed, M.U.; Ijaz, M.; Fatima, Z.; Anjum, A.A.; Aqib, A.I.; Ali, M.M.; Rehman, A.; Ahmed, A.; Ghaffar, A. Frequency and Antimicrobial Susceptibility of Methicillin and Vancomycin-Resistant Staphylococcus aureus from Bovine Milk. Pak. Vet. J. 2021, 41, 463–468. [Google Scholar] [CrossRef]
  10. Guo, Y.; Qiu, P.; Su, H.; Li, Y.; Guo, Y.; Zhang, Z.; Liu, Y.; Liu, M.; Zhang, D. Antimicrobial Resistance and Virulence Genes Distribution in Trueperella pyogenes Isolated from Dairy Cows with Clinical Mastitis in Liaoning of China. Pak. Vet. J. 2021, 41, 329–334. [Google Scholar] [CrossRef]
  11. Sharun, K.; Dhama, K.; Tiwari, R.; Gugjoo, M.B.; Iqbal Yatoo, M.; Patel, S.K.; Pathak, M.; Karthik, K.; Khurana, S.K.; Singh, R. Advances in therapeutic and managemental approaches of bovine mastitis: A comprehensive review. Vet. Q. 2021, 41, 107–136. [Google Scholar] [CrossRef]
  12. Ijaz, M.; Manzoor, A.; Mohy-ud-Din, M.T.; Hassan, F.; Mohy-ud-Din, Z.; Ans, M.; Saleem, M.I.; Khan, H.H.; Khanum, F. An Economical Non-Antibiotic Alternative to Antibiotic Therapy for Subclinical Mastitis in Cows. Pak. Vet. J. 2021, 41, 475–480. [Google Scholar] [CrossRef]
  13. Bisla, A.; Yadav, V.; Dutt, R.; Singh, G.; Gahalot, S.C. Fertility Augmentation Approaches in Dairy Animals—A Review. Int. J. Curr. Microbiol. App. Sci. 2018, 7, 2995–3007. [Google Scholar] [CrossRef]
  14. Ashraf, A.; Imran, M. Causes, types, etiological agents, prevalence, diagnosis, treatment, prevention, effects on human health and future aspects of bovine mastitis. Anim. Health Res. Rev. 2020, 21, 36–49. [Google Scholar] [CrossRef]
  15. Derakhshani, H.; Fehr, K.B.; Sepehri, S.; Francoz, D.; De Buck, J.; Barkema, H.W.; Plaizier, J.C.; Khafipour, E. Invited review: Microbiota of the bovine udder: Contributing factors and potential implications for udder health and mastitis susceptibility. J. Dairy Sci. 2018, 101, 10605–10625. [Google Scholar] [CrossRef] [Green Version]
  16. Hiitiö, H.; Riva, R.; Autio, T.; Pohjanvirta, T.; Holopainen, J.; Pyörälä, S.; Pelkonen, S. Performance of a real-time PCR assay in routine bovine mastitis diagnostics compared with in-depth conventional culture. J. Dairy Res. 2015, 82, 200–208. [Google Scholar] [CrossRef]
  17. Gerace, E.; Mancuso, G.; Midiri, A.; Poidomani, S.; Zummo, S.; Biondo, C. Recent Advances in the Use of Molecular Methods for the Diagnosis of Bacterial Infections. Pathogens 2022, 11, 663. [Google Scholar] [CrossRef]
  18. Derakhshani, H.; Plaizier, J.C.; De Buck, J.; Barkema, H.W.; Khafipour, E. Composition and co-occurrence patterns of the microbiota of different niches of the bovine mammary gland: Potential associations with mastitis susceptibility, udder inflammation, and teat-end hyperkeratosis. Anim. Microbiome 2020, 2, 11. [Google Scholar] [CrossRef] [Green Version]
  19. NMC. Laboratory and Field Handbook on Bovine Mastitis; National Mastitis Council: Madison, WI, USA, 1999. [Google Scholar]
  20. Yap, M.; Gleeson, D.; O’Toole, P.W.; O’Sullivan, O.; Cotter, P.D. Seasonality and geography have a greater influence than the use of chlorine-based cleaning agents on the microbiota of bulk tank raw milk. Appl. Environ. Microbiol. 2021, 87, e01081-21. [Google Scholar] [CrossRef]
  21. Klindworth, A.; Pruesse, E.; Schweer, T.; Peplies, J.; Quast, C.; Horn, M.; Glöckner, F.O. Evaluation of general 16S ribosomal RNA gene PCR primers for classical and next-generation sequencing-based diversity studies. Nucleic Acids Res. 2013, 41, e1. [Google Scholar] [CrossRef]
  22. Bolyen, E.; Rideout, J.R.; Dillon, M.R.; Bokulich, N.A.; Abnet, C.C.; Al-Ghalith, G.A.; Alexander, H.; Alm, E.J.; Arumugam, M.; Asnicar, F. Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2. Nat. Biotechnol. 2019, 37, 852–857. [Google Scholar] [CrossRef]
  23. Callahan, B.J.; McMurdie, P.J.; Rosen, M.J.; Han, A.W.; Johnson, A.J.A.; Holmes, S.P. DADA2: High-resolution sample inference from Illumina amplicon data. Nat. Methods 2016, 13, 581–583. [Google Scholar] [CrossRef] [Green Version]
  24. Bokulich, N.A.; Kaehler, B.D.; Rideout, J.R.; Dillon, M.; Bolyen, E.; Knight, R.; Huttley, G.A.; Gregory Caporaso, J. Optimizing taxonomic classification of marker-gene amplicon sequences with QIIME 2′s q2-feature-classifier plugin. Microbiome 2018, 6, 90. [Google Scholar] [CrossRef] [PubMed]
  25. Torsvik, V.; Øvreås, L. Microbial diversity and function in soil: From genes to ecosystems. Curr. Opin. Microbiol. 2002, 5, 240–245. [Google Scholar] [CrossRef] [PubMed]
  26. Structure, function and diversity of the healthy human microbiome. Nature 2012, 486, 207–214. [CrossRef] [PubMed] [Green Version]
  27. Gilbert, J.A.; Jansson, J.K.; Knight, R. The Earth Microbiome project: Successes and aspirations. BMC Biol. 2014, 12, 69. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Catozzi, C.; Cuscó, A.; Lecchi, C.; De Carlo, E.; Vecchio, D.; Martucciello, A.; D’Angelo, L.; Francino, O.; Sanchez Bonastre, A.; Ceciliani, F. Impact of intramammary inoculation of inactivated Lactobacillus rhamnosus and antibiotics on the milk microbiota of water buffalo with subclinical mastitis. PLoS ONE 2019, 14, e0210204. [Google Scholar] [CrossRef]
  29. Tong, J.; Zhang, H.; Zhang, Y.; Xiong, B.; Jiang, L. Microbiome and metabolome analyses of milk from dairy cows with subclinical streptococcus agalactiae mastitis—Potential biomarkers. Front. Microbiol. 2019, 10, 2547. [Google Scholar] [CrossRef]
  30. Steinberg, R.S.; Silva e Silva, L.C.; de Souza, M.R.; Reis, R.B.; da Silva, P.C.; Lacorte, G.A.; Nicoli, J.R.; Neumann, E.; Nunes, Á.C. Changes in bovine milk bacterial microbiome from healthy and subclinical mastitis affected animals of the Girolando, Gyr, Guzera, and Holstein breeds. Int. Microbiol. 2022, 25, 803–815. [Google Scholar] [CrossRef]
  31. Hogan, J.; Gonzalez, R.; Harmon, R.; Nickerson, S.; Oliver, S.; Pankey, J.; Smith, K.L. Laboratory Handbook on Bovine Mastitis; National Mastitis Council: Madison, WI, USA, 1999; Volume 78, pp. 485–488. [Google Scholar]
  32. Schukken, Y.; Hertl, J.; Bar, D.; Bennett, G.; González, R.; Rauch, B.; Santisteban, C.; Schulte, H.; Tauer, L.; Welcome, F. Effects of repeated gram-positive and gram-negative clinical mastitis episodes on milk yield loss in Holstein dairy cows. J. Dairy Sci. 2009, 92, 3091–3105. [Google Scholar] [CrossRef] [Green Version]
  33. Keane, O.M. Symposium review: Intramammary infections—Major pathogens and strain-associated complexity. J. Dairy Sci. 2019, 102, 4713–4726. [Google Scholar] [CrossRef] [Green Version]
  34. Abdeen, E.E.; Mousa, W.S.; Abdel-Tawab, A.A.; El-Faramawy, R.; Abo-Shama, U.H. Phenotypic, genotypic and antibiogram among Staphylococcus aureus isolated from bovine subclinical mastitis. Pak. Vet. J. 2021, 41, 289–293. [Google Scholar]
  35. Fursova, K.; Sokolov, S.; Shchannikova, M.; Nikanova, D.; Artem’eva, O.; Kolodina, E.; Sorokin, A.; Dzhelyadin, T.; Shulcheva, I.; Shepelyakovskaya, A. Changes in the Microbiome of Milk in Cows with Mastitis. In Doklady Biochemistry and Biophysics; Springer: Berlin/Heidelberg, Germany, 2021; pp. 75–80. [Google Scholar]
  36. Du, B.; Meng, L.; Liu, H.; Zheng, N.; Zhang, Y.; Guo, X.; Zhao, S.; Li, F.; Wang, J. Impacts of milking and housing environment on milk microbiota. Animals 2020, 10, 2339. [Google Scholar] [CrossRef]
  37. Catozzi, C.; Sanchez Bonastre, A.; Francino, O.; Lecchi, C.; De Carlo, E.; Vecchio, D.; Martucciello, A.; Fraulo, P.; Bronzo, V.; Cuscó, A. The microbiota of water buffalo milk during mastitis. PLoS ONE 2017, 12, e0184710. [Google Scholar] [CrossRef] [Green Version]
  38. Braem, G.; De Vliegher, S.; Verbist, B.; Heyndrickx, M.; Leroy, F.; De Vuyst, L. Culture-independent exploration of the teat apex microbiota of dairy cows reveals a wide bacterial species diversity. Vet. Microbiol. 2012, 157, 383–390. [Google Scholar] [CrossRef]
  39. Kivaria, F.; Noordhuizen, J. A retrospective study of the aetiology and temporal distribution of bovine clinical mastitis in smallholder dairy herds in the Dar es Salaam region of Tanzania. Vet. J. 2007, 173, 617–622. [Google Scholar] [CrossRef]
  40. Hertl, J.; Schukken, Y.; Bar, D.; Bennett, G.; González, R.; Rauch, B.; Welcome, F.; Tauer, L.; Gröhn, Y. The effect of recurrent episodes of clinical mastitis caused by gram-positive and gram-negative bacteria and other organisms on mortality and culling in Holstein dairy cows. J. Dairy Sci. 2011, 94, 4863–4877. [Google Scholar] [CrossRef]
  41. Falentin, H.; Rault, L.; Nicolas, A.; Bouchard, D.S.; Lassalas, J.; Lamberton, P.; Aubry, J.-M.; Marnet, P.-G.; Le Loir, Y.; Even, S. Bovine teat microbiome analysis revealed reduced alpha diversity and significant changes in taxonomic profiles in quarters with a history of mastitis. Front. Microbiol. 2016, 7, 480. [Google Scholar] [CrossRef] [Green Version]
  42. Polveiro, R.C.; Vidigal, P.M.P.; Mendes, T.A.D.O.; Yamatogi, R.S.; Silva, L.; Fujikura, J.M.; Da Costa, M.M.; Moreira, M.A.S. Distinguishing the milk microbiota of healthy goats and goats diagnosed with subclinical mastitis, clinical mastitis, and gangrenous mastitis. Front. Microbiol. 2022, 13, 3227. [Google Scholar] [CrossRef]
  43. Sokolov, S.; Fursova, K.; Shulcheva, I.; Nikanova, D.; Artyemieva, O.; Kolodina, E.; Sorokin, A.; Dzhelyadin, T.; Shchannikova, M.; Shepelyakovskaya, A. Comparative analysis of milk microbiomes and their association with bovine mastitis in two farms in Central Russia. Animals 2021, 11, 1401. [Google Scholar] [CrossRef]
  44. Porcellato, D.; Meisal, R.; Bombelli, A.; Narvhus, J. A core microbiota dominates a rich microbial diversity in the bovine udder and may indicate presence of dysbiosis. Sci. Rep. 2020, 10, 21608. [Google Scholar] [CrossRef]
Figure 1. Representation of different taxa (distinct and shared) at different levels: (a) phylum, (b) family, (c) genus, in milk microbiota of Nili Ravi buffalo with different udder health statuses through Venn diagram.
Figure 1. Representation of different taxa (distinct and shared) at different levels: (a) phylum, (b) family, (c) genus, in milk microbiota of Nili Ravi buffalo with different udder health statuses through Venn diagram.
Animals 13 02298 g001
Figure 2. Representation of phylum level taxonomical composition in individual samples through heat map. Intensity of color shows the relative abundance of phyla in milk microbiota of Nili Ravi buffalo with different udder health statuses.
Figure 2. Representation of phylum level taxonomical composition in individual samples through heat map. Intensity of color shows the relative abundance of phyla in milk microbiota of Nili Ravi buffalo with different udder health statuses.
Animals 13 02298 g002
Figure 3. Representation of different phyla across different groups in milk microbiota of Nili Ravi buffalo using taxa bar plot.
Figure 3. Representation of different phyla across different groups in milk microbiota of Nili Ravi buffalo using taxa bar plot.
Animals 13 02298 g003
Figure 4. Diversity analysis using alpha diversity indices of microbiota of Nili Ravi buffalo milk with different udder health statuses: (a) Shannon diversity index, (b) Simpson diversity index, (c) Chao 1, (d) observed features.
Figure 4. Diversity analysis using alpha diversity indices of microbiota of Nili Ravi buffalo milk with different udder health statuses: (a) Shannon diversity index, (b) Simpson diversity index, (c) Chao 1, (d) observed features.
Animals 13 02298 g004
Figure 5. PCA plots representing beta diversity indices in Nili Ravi milk with different udder health statuses: (a) Jaccard index, (b) Bray-Curtis dissimilarity index, (c) unweighted, (d) weighted uniFrac metrics.
Figure 5. PCA plots representing beta diversity indices in Nili Ravi milk with different udder health statuses: (a) Jaccard index, (b) Bray-Curtis dissimilarity index, (c) unweighted, (d) weighted uniFrac metrics.
Animals 13 02298 g005
Table 1. Allocation criteria for samples into different groups.
Table 1. Allocation criteria for samples into different groups.
Udder Health StatusClinical SignsMilk CharacteristicsCMTSCC
HealthyAbsentNormalNegativeBelow 200,000 cells/mL
Subclinical MastitisAbsentNormalPositiveAbove 200,000 cells/mL
Clinical MastitisPresentAbnormalPositiveAbove 200,000 cells/mL
Clinical Signs: inflammatory signs in udder, milk characteristics = abnormalities in milk, CMT = California mastitis test, SCC = somatic cell count.
Table 2. Comparison of mean (% abundance) at different levels in healthy (H), subclinical mastitis (SCM) and clinical mastitis (CM) groups of Nili Ravi buffalo milk. Only significantly different taxa are denoted with letters.
Table 2. Comparison of mean (% abundance) at different levels in healthy (H), subclinical mastitis (SCM) and clinical mastitis (CM) groups of Nili Ravi buffalo milk. Only significantly different taxa are denoted with letters.
TaxaHealthy(H)Subclinical Mastitis (SCM)Clinical Mastitis (CM)
PhylumMeanSEM MeanSEM MeanSEM
Actinobacteria11.140.94ns13.554.49ns7.702.88ns
Bacteroidetes5.652.37ns6.912.25ns5.322.25ns
Cyanobacteria0.380.23ns0.560.23ns0.160.16ns
Firmicutes28.658.28ns49.1211.12ns58.2013.02ns
Planctomycetes0.000.00ns0.310.18ns0.110.09ns
Proteobacteria52.588.74ns27.6910.06ns26.058.88ns
FamilyMeanSEM MeanSEM MeanSEM
Bacillaceae4.221.47ns15.7415.23ns0.870.31ns
Corynebacteriaceae1.910.39ns6.203.89ns2.421.38ns
Lactobacillaceae1.080.52ns1.881.48ns0.840.61ns
Moraxellaceae4.280.76a3.860.80b0.980.43a
Oxalobacteraceae9.902.43a2.490.44b2.500.93b
Staphylococcaceae4.521.03ns7.524.80ns8.214.30ns
Streptococcaceae11.117.74ns3.951.81ns33.1918.82ns
GenusMeanSEM MeanSEM MeanSEM
Acinetobacter3.400.49a2.610.78b0.790.42ab
Bacillus1.710.88ns15.7715.39ns0.380.38ns
Corynebacterium2.090.40ns6.704.21ns2.681.51ns
Herbaspirillum7.653.73ns2.060.69ns0.610.38ns
Lactobacillus1.160.60ns2.131.70ns0.910.66ns
Pseudomonas1.270.71ns0.620.50ns1.400.91ns
Staphylococcus4.711.04ns6.584.20ns7.874.60ns
Streptococcus11.608.02ns4.291.90ns33.9618.78ns
Different letters (a,b) in the same rows denotes differences between means for p-value < 0.05. ns = non-significant.
Table 3. Bacterial diversity analysis using alpha diversity indices in healthy, subclinical, and clinical mastitis milk of Nili Ravi buffalo.
Table 3. Bacterial diversity analysis using alpha diversity indices in healthy, subclinical, and clinical mastitis milk of Nili Ravi buffalo.
Alpha Diversity IndexHealthy (H)
mean ± SEM
Subclinical Mastitis (SCM)
mean ± SEM
Clinical Mastitis (CM)
mean ± SEM
p-Value
Shannon diversity index6.242 ± 0.31506.790 ± 0.3845.506 ± 0.74610.1481
Simpson diversity index0.9805 ± 0.00470.9849 ± 0.00610.9526 ± 0.019760.1481
Chao1 index116.2 ± 22.42172 ± 27.06100.2 ± 30.630.1408
Observed features116.2 ± 22.42172 ± 27.06100.2 ± 30.630.1408
p-values were considered significant at p = 0.05, 0.01, 0.001.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Salman, M.M.; Nawaz, M.; Yaqub, T.; Mushtaq, M.H. Exploring the Milk Microbiota of Healthy and Mastitic Nili Ravi Buffalo Using 16S rRNA Gene Base Metagenomic Analysis. Animals 2023, 13, 2298. https://doi.org/10.3390/ani13142298

AMA Style

Salman MM, Nawaz M, Yaqub T, Mushtaq MH. Exploring the Milk Microbiota of Healthy and Mastitic Nili Ravi Buffalo Using 16S rRNA Gene Base Metagenomic Analysis. Animals. 2023; 13(14):2298. https://doi.org/10.3390/ani13142298

Chicago/Turabian Style

Salman, Mian Muhammad, Muhammad Nawaz, Tahir Yaqub, and Muhammad Hassan Mushtaq. 2023. "Exploring the Milk Microbiota of Healthy and Mastitic Nili Ravi Buffalo Using 16S rRNA Gene Base Metagenomic Analysis" Animals 13, no. 14: 2298. https://doi.org/10.3390/ani13142298

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop