Next Article in Journal
Molecular Investigation of Porcine Circovirus Type 3 Infection in Pigs in Namibia
Next Article in Special Issue
The Risk of False-Positive Serological Results for Paratuberculosis in Mycobacterium bovis-Infected Cattle
Previous Article in Journal
Silver Nanoparticles Conjugated with Contact Lens Solutions May Reduce the Risk of Acanthamoeba Keratitis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Review of Methods Used for Diagnosing Tuberculosis in Captive and Free-Ranging Non-Bovid Species (2012–2020)

1
School of Veterinary Medicine, University of Surrey, VSM Building, Daphne Jackson Road, Guildford, Surrey GU2 7AL, UK
2
School of Biosciences and Medicine, University of Surrey, Edward Jenner Building, Guildford, Surrey GU2 7XH, UK
*
Author to whom correspondence should be addressed.
Pathogens 2021, 10(5), 584; https://doi.org/10.3390/pathogens10050584
Submission received: 1 April 2021 / Revised: 6 May 2021 / Accepted: 7 May 2021 / Published: 11 May 2021

Abstract

:
The Mycobacterium tuberculosis complex (MTBC) is a group of bacteria that cause tuberculosis (TB) in diverse hosts, including captive and free-ranging wildlife species. There is significant research interest in developing immunodiagnostic tests for TB that are both rapid and reliable, to underpin disease surveillance and control. The aim of this study was to carry out an updated review of diagnostics for TB in non-bovid species with a focus predominantly on those based on measurement of immunity. A search was carried out to identify relevant papers meeting a pre-defined set of inclusion criteria. Forty-one papers were identified from this search, from which only twenty papers contained data to measure and compare diagnostic performance using diagnostic odds ratio. The diagnostic tests from each study were ranked based on sensitivity, specificity, and diagnostic odds ratio to define high performing tests. High sensitivity and specificity values across a range of species were reported for a new antigenic target, P22 complex, demonstrating it to be a reliable and accurate antigenic target. Since the last review of this kind was undertaken, the immunodiagnosis of TB in meerkats and African wild dogs was reported for the first time. Suid species showed the most consistent immunological responses and highlight a potential dichotomy between humoral and cellular immune responses.

1. Introduction

The Mycobacterium tuberculosis complex (MTBC) is a group of genetically similar bacteria that cause the disease tuberculosis (TB) in a range of hosts [1]. The MTBC comprises the major pathogenic mycobacteria species M. tuberculosis, M. bovis, M. africanum, M. canettii, M. microti, M. caprae, M. pinnipedii, M. mungi, M. suricattae, and M. orygis [2]. Cattle are considered the primary host of M. bovis; however, infection is not limited to livestock but also affects humans and many other free-ranging and captive wildlife species [3]. Notably, the European badger (Meles meles) in the United Kingdom, Brushtail possum (Trichosurus vulpecula) in New Zealand, and White-tailed deer (Odocoileus virginianus) in the United States are all species implicated in transmission of M. bovis to livestock [3]. As reviewed by Miller and Olea-Popelka, different control strategies for TB are implemented in different countries based on the level of disease transmission and prevalence within that country, and considering which species are infected or at risk of infection [4]. Common control strategies include surveillance, culling of reservoirs and infected animals, increased biosecurity and vaccination underpinned by diagnostic testing [5].
Zoonotic transmission of TB may be more likely in zoos due to the close contact of staff with animals, as well as the potential for transmission of infection from human to animal, although this is very rare [6]. In addition, zoos may find it problematic to maintain biodiversity and conserve valuable or endangered species and to exchange genetic resources and animals with one another where TB outbreaks occur, as reviewed by Lécu and Ball [7]. Accurate diagnosis of TB in captive wildlife is therefore important but challenging, given the diversity of species susceptible to the MTBC.
Conventional diagnostic tests for TB are considered the gold-standard and comprise of bacterial culture, histopathology, and post-mortem examination [8]. Often, these conventional tests are used in combination with one another or are used as a confirmatory test for newer immunological diagnostics, as discussed by Salfinger and Pfyffer [9]. Culture and post-mortem examinations are relatively expensive tests that require laboratory facilities for isolation and identification of mycobacteria. Culture is the primary gold-standard test for TB. However, as mycobacteria are slow growing, culture can be protracted as well as being liable to cross-contamination with other environmental bacteria [10]. Culture also varies in sensitivity depending upon the type of sample used [11].
Immunological diagnostics based on the humoral immune response rely on the detection of antibodies specific to MTBC antigens. Whilst easy to perform, they may be a poor indicator of TB infection because antibody titers tend to increase as disease progresses [12]. Hence, the humoral response is less reliable for the detection of asymptomatic cases or cases early on in infection but can be used to monitor the progress of infection, as reviewed in Pollock et al., 2001 [13]. Efforts to increase the sensitivity of antibody-based tests have included the use of multiple antigens, most recently, the P22 complex, made up of 118 different antigenic targets, including MPB83, MPB70 and ESAT-6 [14].
In contrast, the cell-mediated immune (CMI) response is characterized by the production of cytokines, such as IFN-γ released by stimulated lymphocytes. As discussed in the Pollock et al. review, relative to antibody production, the CMI response generally occurs earlier after infection and is considered to play a major role in controlling TB [13]. The intradermal delayed-type hypersensitivity tuberculin skin test (TST) involves intradermal injection of tuberculin, a complex mix of antigens derived from M. bovis‑purified protein derivative (PPD) and measurement of swelling at the injection site usually 72 hrs later [15]. The TST is generally unreliable in most non-bovine species, such as European badgers, producing a weak response, which can be altered by the stress of capture [15,16]. In addition, the TST is often considered impractical for free-ranging wildlife because of the need to capture and retain the animal to read the test, as discussed and reviewed by De Lisle et al. [15].
Indicators often used to measure diagnostic test performance include, but are not limited to, sensitivity and specificity, predictive values, likelihood ratios, and receiver operating characteristic curve (ROC curve) analysis. Another, but less used, method is the diagnostic odds ratio (DOR). The DOR is a single indicator of test performance, being a ratio of the odds of a positive result in a diseased individual relative to the odds of a positive result in a non-diseased individual [17]. DOR can range from 0 to infinity, but a value of 1 demonstrates that the test has no discrimination between an individual with and without disease. The higher the DOR value, the better able a test is in discriminating infected from non-infected individuals [17].
The aim of the current project was to perform a review of diagnostics used for the detection of TB in free-ranging and captive wildlife species with a focus predominantly on those based on measurement of immunity, updating on previous reviews published in 2009 and 2013 [18,19]. Different studies identifying new or modified immunological targets and techniques in either known or novel wildlife reservoirs were identified and explored to evaluate the performance of the diagnostic technique and approaches used. The DOR was used to determine the performance of diagnostic tests for TB, not having previously been used for this purpose in animal studies.

2. Results

2.1. Summary of Reported Techniques and Species since 2012

A total of 41 papers were identified and considered as relevant. Table 1 shows the test employed, test target, MTBC species, the nature of infection (natural or experimental), and the species of animal being observed for these 41 papers.
Using the data from Table 1, the most frequently used diagnostic tests, target antigens, and studied species were identified. First, it was noted that the most common species studied were wild boar (Sus scrofa), deer, and badgers (Meles meles), with each species appearing in seven individual studies (16.7% each of the total), closely followed by warthogs (Phacochoerus africanus), which appeared in six studies (14.3%) (Table 1). The animals of these species were a range of wild and captive animals, with the deer being a mix of red deer (Cervus elaphus) and white-tailed deer (Odocoileus virginianus). Species which appeared in fewer studies included elephants (Elephas maximus and Loxodonta africana), lions (Panthera leo) and rhinoceros (Ceratotherium simum). Meerkats (Suricata suricatta) and African wild dog (Lycaon pictus) were reported for the first time in this context, each being the focus of one study (Table 1).
The most common techniques used within the 41 studies were ELISAs and Lateral Flow devices (LFD), consisting of INgezim TB-CROM (Eurofins Technologies Ingenasa, Madrid, Spain), STAT-PAK (Chembio Diagnostic Systems, Inc., Hauppauge, NY, USA), and Dual Path Platform (DPP) VetTB assay (Chembio Diagnostic Systems, Inc.). Other tests included tests of CMI, such as the Interferon-Gamma Release Assay (IGRA) and TST (both the Comparative Intradermal Tuberculin Test (CITT) and the Single Intradermal Tuberculin Test (SITT)) (Table 1). However, it was evident that serological tests were more frequently selected approaches than those based on CMI.
In parallel with the most common techniques used, the most recurrent antigenic targets were revealed. Most tests used the same or similar antigens, or a mixture of recombinant proteins (Table 1). For instance, bPPD, MPB70, MPB83, ESAT-6, and CFP10 were commonly used as either individual targets or mixed as a cocktail of either ESAT-6 and CFP10 or MPB70 and MPB83. The P22 complex protein [14] was used in a range of lateral flow assays or a ‘P22 ELISA’.

2.2. Statistical Analysis

From the 41 papers, 20 contained data with which to carry out statistical analysis, calculating, if not stated, sensitivity, specificity, negative and positive predictive values (NPV, PPV), DOR, and where suitable the corresponding 95% confidence intervals (95% CI). The false negative and false positive (FN, FP), true negative and true positive (TN, TP) rates were calculated and used in a statistical test to create another set of data (Table 2) that could be used to compare diagnostic performance. The DOR was used as a measure of diagnostic performance, being the ratio of the odds of a positive result in a diseased individual relative to the odds of a positive result in a non-diseased individual [17]. The remaining 22 papers were evaluated, but no statistical analysis was conducted because the appropriate information was missing from the paper, such as true infection status.

2.3. Analyzing Diagnostic Performance

Diagnostic performance was compared across all tests from the twenty studies in Table 2. Data were ordered to find the top ten best performing and lowest ten performing tests based on sensitivity, specificity, and DOR, individually (Table 3 and Table 4). The 95% CI overlapped for nearly all diagnostic tests as many DOR calculations had a large 95% CI; therefore, the tests were simply ranked based on the calculated DOR. Fifty-three% of top-ranking tests were carried out in wild boar, with 8/10 (80%) of the DOR top ranking tests used in suid species. The INgezim TB Porcine test used for wild boar had the highest sensitivity (100%), specificity (100%), and DOR (3111) of any test (Table 3). This was followed by the DPP VetTB assay and an in-house ELISA [49] based on antibody recognition of the P22 protein complex, also tested in suid species. The most frequently used antigenic targets in the top-ranking tests were MPB83, MPB70, P22 complex, ESAT-6, and CFP10. In contrast, the lower ranking tests consisted of more CMI diagnostics, such as the TST. Based on the DOR, the worst performing test were an LFD using an IgG cocktail of commercial anti-mouse IgG and anti-rabbit IgG [42] (DOR, 1.1) and both CITT and SITT. Antigenic targets among the more poorly performing tests included bPPD and MPB83, although MPB83 featured infrequently in comparison to bPPD. Additionally, the lowest ranking tests were carried out on deer, badgers, and lions, with a few studies on warthogs and wild boar. Notably, the TB ELISA-VK using bPPD as a target [33] was ranked within the top 10 for sensitivity but within the lowest 10 for specificity and did not appear among either of the rankings according to DOR.

2.4. Importance of Gold-Standard Testing and Knowledge of Infection Status

Through critical analysis of the papers examined, it was apparent that the estimated test performance was dependent on whether the diagnostic samples were derived from naturally or experimentally infected animals, and on the definition of infection status (i.e., the gold-standard applied in the study). An example of the importance of the former was the study by Fresco-Taboada et al. [49], in which they tested a series of techniques separately using experimental samples and field samples. As shown in Table 2 and Table 3, tests on the field samples showed greater accuracy in comparison to the experimental samples, ranking higher in the data analysis. With respect to the gold-standard of infection, the study by King et al. [27], which was excluded from analysis due to not using culture as the gold-standard to define true infection status, is illustrative. In that study, the diagnostic performance of three tests (IGRA; STAT-PAK; and qPCR) was assessed. The study did not use a true gold-standard test but instead interchangeably trialled the STAT-PAK and IGRA, as gold-standards together to form one gold standard, and as indiviudal gold standards. When calculating DOR, because there was no measure to identify TN, FN, TP, and TN, a DOR of 1.0 was generated for each test, no matter which ‘gold standard’ method was used, rendering it impossible to determine the true diagnostic value of any of the tests.

3. Discussion

This study was intended as a review of the tests available for diagnosing TB in non-bovid species, focusing on immunological tests and highlighting any advances from previous reviews undertaken in 2009 and 2012 [18,19]. Common indicators of diagnostic performance include sensitivity, specificity, PPV, and NPV; however, these factors are insufficient to demonstrate diagnostic performance alone [17]. Sensitivity and specificity indicators are based on a proportion of results showing positive or negative results among diseased or healthy individuals and do not consider cut off values [17]. NPV and PPV are generally not good indicators of diagnostic performance per se as they are dependent on the prevalence of infection and therefore assess diagnostic performance in a context-dependent situation [17,62]. For this study, DOR was chosen as the primary method of evaluating diagnostic performance because it serves as a single measure of test performance independent of disease prevalence [17], making comparisons across studies more straightforward. This is the first study to use DOR to assess diagnostic test performance in animals, although it has been used to assess the performance of TB tests in humans, e.g., [63].
Wild boar, badger, and deer were the most common species used in studies, with 27.5% of studies carried out in suid species (pigs, wild boar, and warthogs). Wild boar, badger and white-tailed deer are all significant maintenance hosts of TB in different countries [3]. Wild boars have been documented across Europe showing marked increase in numbers [64]. Throughout Europe, wild boar are showing higher levels of transmission of TB, without the requirement of livestock to maintain infection in the ecosystem, as reviewed in Gortázar et al., 2012 [65]. This has an impact on the population of wild boar itself but also increases the chance of transmitting the disease to other wildlife [66]. The increased awareness of wild boar as an important vector of animal TB is reflected the increase in the number of papers reporting the use of immunodiagnostics for suids, 14 papers in this report in comparison to only three papers covering a similar span of time in the last review [19]. The performance of diagnostic tests was reported in two new species since the previous reviews: meerkat and African wild dog, both being the focus of one study each. TB in meerkats is similar to that in other mammalian species [67], and their study has shed light on the behaviors and social interactions that may affect transmission of TB within social mammal species [68]. African Wild Dogs are classed as a threatened species that are currently under high pressure of infection which may impact their long-term survival and conservation [50]. A study looked at 21 packs of wild dog in Kruger National Park, where TB is endemic in African buffaloes and found using an IGRA that 20/21 of the packs studied had been sensitized to M. bovis, showing an 83% prevalence of infection [50]. Despite these results, the species is currently considered stable but highlights the potential threat that could occur with changes in biological and environmental factors such as habitat availability and reproductive rates [50].
Antigenic targets identified frequently in this study were ESAT-6, CFP10, MPB83 and MPB70. Recombinant proteins like CFP10/ESAT-6 have demonstrated high sensitivity and specificity for TB detection in people in comparison to conventional CMI diagnostics like the TST [69]. CFP10 and ESAT-6 may also be the target of strong antibody-positive responses when included in serology tests for both elephants and wild boar [52,54] but show poor diagnostic performance in badgers, with no significant increase in antibody response associated with disease progression [70]. Therefore, the diagnostic performance of CFP10 and ESAT-6 antigens cannot be generalized across species, as is the case with many antigenic targets, but does demonstrate potential for accurate detection of TB in certain species. Individually, MPB83 induces high antibody responses across a range of species including cattle, badger, deer, wild boar, and primates [49,71,72,73]. P22 was described in 2017 [14], and therefore, was not reviewed previously. P22 complex is a mix of 118 different proteins, some of the most abundant being MPB70, MPB83, and ESAT-6 [14]. P22 complex was reported to have reduced cross-reactivity with Mycobacterium avium, having greater sensitivity than other antigenic targets, like bPPD, [14] in different species, including llamas, cattle, goats, pigs, and sheep [74,75]. In our review, although MPB83 and P22 appeared most frequently as antigenic targets in the top-ranking tests according to sensitivity, specificity, or DOR, they did not appear any more frequently than would be expected by chance, their appearance among the best performing tests more likely indicating how commonly these antigens are used. Nonetheless, both antigens gave good performance in a variety of test platforms against a range of non-bovid species. P22 as an antigenic target gave sensitivity and specificity values of 70.1–96.7% and 75.0–100.0%, respectively, across studies in wild boar, pig, deer, and badgers. Interestingly, the inclusion of multiple antigens usually increases the likelihood of FP occurring, but this was not seen with P22, despite it being a complex of 118 different antigens. When a P22-based ELISA was compared to the diagnostic performance of MPB83 as a target, it produced similar diagnostic results; however, when used in parallel, sensitivity was increased [76]; some infected animals were only detectable using MPB83 antigen, whilst others were only detectable using the P22 complex [76]. This was surprising since MPB83 is an abundant component of P22. Consequently, when used in parallel, a greater range of animal species were detected. More research is required using field samples to compare and validate the potential of P22 across a wider array of species to confirm the findings above.
Serological diagnostics were more common in the present study than CMI tests, with more serological tests appearing in the top ten. Generally, CMI tests are considered to give high sensitivity; however, this was not seen in this review as CMI tests did not appear among the tests with the highest DOR values. In general, the CMI tests were not carried out in suid species but instead in lions and deer, and this could explain the cause of their lower apparent performance, particularly as the high performing tests were carried out in suid species. Suid species are noted to have a detectable humoral response soon after M. bovis exposure which is maintained with disease progression, allowing for rapid detection [54,77]. Moreover, as reviewed by Berger, in most species, the humoral antibody response is dependent upon the cell-mediated response initiating a T helper cell response to activate macrophages and other essential cytokines for antibody activation [78]. However, it has been suggested that suid species have a dichotomy between the humoral and CMI response, meaning that a strong humoral response can occur independently of a cell-mediated response [79,80,81].
Despite a test having a high accuracy, it did not always correlate with high diagnostic performance, based on DOR. For example, TB ELISA-VK [37], t-bPPD [37], and bPPD2 [37] were all ranked among the top ten performing tests according to DOR but did not appear in the top ten for either sensitivity or specificity. Conversely, the Ingezim TB-CROM [49], Indirect PPD ELISA [33], and TB ELISA-VK [33] appeared in either or both top ten for specificity and sensitivity but not DOR. We reason that DOR is a better metric for assessing the performance of a diagnostic test since sensitivity and specificity (as pooled or indiviudal indicators) do not represent discriminatory performance, since a high sensitivity can be accompanied by a low specificity, as shown particularly for the TB ELISA-VK [33]. In contrast, DOR is a combination of both sensitivity and specificity, increasing when they become near perfect.

4. Materials and Methods

4.1. Literature Search and Exclusion Criteria

Using NCBI PubMed, we identified appropriate papers written in English from 2012, when the last review [19] was carried out. A total of 162 papers were found using the search criteria: ((((wild*) AND (mycobacteri*)) AND (diagnos*)) AND ((“2012/09/01”[Date‑Publication]: “3000”[Date‑Publication]))) AND (immun*). For each of the 162 papers, the abstracts were reviewed, looking for details of the use of (immuno)diagnostics for MTBC infection in non-bovid species. Papers were excluded if they were exclusively based on bovid species, mycobacteria that do not cause TB infection such as Mycobacterium avium subspecies paratuberculosis or used exclusively non-immunological based diagnostic tests, with the exception of Stewart et al. [42] as it reported a novel immunochromatographic lateral flow assay specific for Mycobacterium bovis cells. Additionally, previous review articles were excluded from data collection and statistical analysis but were recorded and reviewed for completeness.
From this, forty-one papers were recorded as relevant from which data were collected, including the species under study, whether TB was experimentally or naturally induced, the mycobacterium species, the test used and how it was employed, the target of the test (i.e., antigen(s)), sample size and type of sample, relative sensitivity and specificity of the diagnostic technique, the NPV and PPV, and the associated cut-off values. If any of the information was not present or had not been mentioned, this was noted.

4.2. Statistical Analysis

Using the sample size and infection status, TP and TN, and FP and FN values were calculated from the 41 papers where possible, if not already stated. Studies with missing values, e.g., for sensitivity, specificity, PPV, and NPV, were calculated where possible from the reported data using the following formulae:
sensitivity = TP/(TP + FN)
specificity = TN/(TN + FP)
NPV = TN/(TN + FN)
PPV = TP/(TP + FP)
Following this, the 95% CI surrounding the sensitivity and specificity were noted, if available, or calculated if not. The DOR for each individual test was calculated using the formula:
DOR = (TP/FN)/(FP/TN)
The DOR was then adjusted, by adding 0.5 to each of the cells in the contingency table, to account for the tests that had ‘0′ values in any of the TN, TP, FP, FN values. The DOR adjustment was applied across all studies to prevent introducing bias to the data. The adjusted DOR was then used to calculate the 95% CI using the formulae below. All calculations were rounded to 1 decimal place. All formulae for the calculations outlined were sourced from [17].
Standard   Error   ( SE )   ( lnDOR ) = 1 T P + 1 F N + 1 F P + 1 T N ,
95% CI = lnDOR ± 1.96 × SE (lnDOR)
True 95% CI = ‘=EXP(±CI)’
The most common species, techniques, and antigenic targets were noted, and the data used to rank the tests in order of sensitivity, specificity, and DOR. All study data included in statistical analysis involving test sensitivity and specificity were established using culture as a gold-standard to confirm infection status.

5. Conclusions

In conclusion, a variety of diagnostic tests are now available for an array of wildlife species, with increasing variety of species being studied. The focus of this review was on diagnostic tests that detect or measure the host immune response to infection. From the current review, it was evident that serological tests are surpassing tests like the TST and even other CMI-based tests, such as IGRA for diagnostic performance. Obtaining proof of high accuracy in tests is still an issue, restricting validation of many tests. The current review used DOR to evaluate diagnostic performance, which to the best of our knowledge has not been used previously for assessing TB diagnostic tests in animals. P22 complex was identified as a promising, new antigenic target, which alongside MPB83 demonstrated potential for use as an accurate seroantigenic target. We believe these conclusions to be consistent with the evidence and arguments presented.

Author Contributions

Conceptualization, M.C.; methodology, R.T. and M.C.; formal analysis, R.T.; data curation, R.T.; writing—original draft preparation, R.T.; writing—review and editing, M.C.; supervision, M.C.; project administration, M.C. Both authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are either contained within the article or relate to 3rd Party Data. Full references are provided for these 3rd Party Data but restrictions may apply to their availability.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gagneux, S. Host-pathogen coevolution in human tuberculosis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2012, 367, 850–859. [Google Scholar] [CrossRef] [Green Version]
  2. Brites, D.; Loiseau, C.; Menardo, F.; Borrell, S.; Boniotti, M.B.; Warren, R.; Dippenaar, A.; Parsons, S.D.C.; Beisel, C.; Behr, M.A.; et al. A new phylogenetic framework for the animal-adapted Mycobacterium tuberculosis complex. Front. Microbiol. 2018, 9, 2820. [Google Scholar] [CrossRef] [Green Version]
  3. Palmer, M.V. Mycobacterium bovis: Characteristics of wildlife reservoir hosts. Transbound. Emerg. Dis. 2013, 60, 1–13. [Google Scholar] [CrossRef]
  4. Miller, M.; Olea-Popelka, F. One health in the shrinking world: Experiences with tuberculosis at the human-livestock-wildlife interface. Comp. Immunol. Microbiol. Infect. Dis. 2013, 36, 263–268. [Google Scholar] [CrossRef] [PubMed]
  5. Fitzgerald, S.D.; Kaneene, J.B. Wildlife reservoirs of bovine tuberculosis worldwide: Hosts, pathology, surveillance, and control. Vet. Pathol. 2013, 50, 488–499. [Google Scholar] [CrossRef] [PubMed]
  6. Dalovisio, J.R.; Stetter, M.; Mikota-Wells, S. Rhinoceros’ rhinorrhea: Cause of an outbreak of infection due to airborne Mycobacterium bovis in zookeepers. Clin. Infect. Dis. 1992, 15, 598–600. [Google Scholar] [CrossRef]
  7. Lécu, A.; Ball, R. Mycobacterial infections in zoo animals: Relevance, diagnosis and management. Int. Zoo Yearb. 2011, 45, 183–202. [Google Scholar] [CrossRef]
  8. Silva, D.A.V.D.; Siconelli, M.J.L.; Bürger, K.P.; Keid, L.B. Comparison between tests for tuberculosis diagnosis in slaughtered bovines. Arq. Inst. Biológico 2018, 85, 85. [Google Scholar] [CrossRef] [Green Version]
  9. Salfinger, M.; Pfyffer, G.E. The new diagnostic mycobacteriology laboratory. Eur. J. Clin. Microbiol. Infect. Dis. 1994, 13, 961–979. [Google Scholar] [CrossRef]
  10. Pfyffer, G.E. Mycobacterium: General characteristics, laboratory detection, and staining procedures. In Manual of Clinical Microbiology, 11th ed.; Jorgensen, J.H., Pfaller, M.A., Carroll, K.C., Funke, G., Landry, M.L., Richter, S.S., Warnock, D.W., Eds.; ASM Press: Washington, DC, USA, 2015; Volume 1, pp. 536–569. [Google Scholar]
  11. Hines, N.; Payeur, J.B.; Hoffman, L.J. Comparison of the recovery of Mycobacterium bovis isolates using the BACTEC MGIT 960 system, BACTEC 460 system, and Middlebrook 7H10 and 7H11 solid media. J. Vet. Diag. Investig. 2006, 18, 243–250. [Google Scholar] [CrossRef] [Green Version]
  12. Welsh, M.D.; Cunningham, R.T.; Corbett, D.M.; Girvin, R.M.; McNair, J.; Skuce, R.A.; Bryson, D.G.; Pollock, J.M. Influence of pathological progression on the balance between cellular and humoral immune responses in bovine tuberculosis. Immunology 2005, 114, 101–111. [Google Scholar] [CrossRef] [PubMed]
  13. Pollock, J.M.; McNair, J.; Welsh, M.D.; Girvin, R.M.; Kennedy, H.E.; Mackie, D.P.; Neill, S.D. Immune responses in bovine tuberculosis. Tuberculosis 2001, 81, 103–107. [Google Scholar] [CrossRef] [PubMed]
  14. Infantes-Lorenzo, J.A.; Moreno, I.; Risalde, M.L.A.; Roy, A.; Villar, M.; Romero, B.; Ibarrola, N.; de la Fuente, J.; Puentes, E.; de Juan, L.; et al. Proteomic characterisation of bovine and avian purified protein derivatives and identification of specific antigens for serodiagnosis of bovine tuberculosis. Clin. Proteom. 2017, 14, 36. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. de Lisle, G.W.; Bengis, R.G.; Schmitt, S.M.; O’Brien, D.J. Tuberculosis in free-ranging wildlife: Detection, diagnosis and management. Rev. Sci. Tech. 2002, 21, 317–334. [Google Scholar] [CrossRef]
  16. Higgins, D.A. The skin inflammatory response of the badger (Meles meles). Br. J. Exp. Pathol. 1985, 66, 643–653. [Google Scholar]
  17. Glas, A.S.; Lijmer, J.G.; Prins, M.H.; Bonsel, G.J.; Bossuyt, P.M. The diagnostic odds ratio: A single indicator of test performance. J. Clin. Epidemiol. 2003, 56, 1129–1135. [Google Scholar] [CrossRef]
  18. Chambers, M.A. Review of the diagnosis and study of tuberculosis in non-bovine wildlife species using immunological methods. Transbound. Emerg. Dis. 2009, 56, 215–227. [Google Scholar] [CrossRef]
  19. Chambers, M.A. Review of the diagnosis of tuberculosis in non-bovid wildlife species using immunological methods—An update of published work since 2009. Transbound. Emerg. Dis. 2013, 60, 14–27. [Google Scholar] [CrossRef] [Green Version]
  20. Chu, C.S.; Yu, C.Y.; Chen, C.T.; Su, Y.C. Mycobacterium tuberculosis and M. bovis infection in Feedlot Deer (Cervus unicolor swinhoei and C. nippon taiouanus) in Taiwan. J. Microbiol. Immunol. Infect. 2012, 45, 426–434. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Lyashchenko, K.P.; Greenwald, R.; Esfandiari, J.; O’Brien, D.J.; Schmitt, S.M.; Palmer, M.V.; Waters, W.R. Rapid detection of serum antibody by dual-path platform VetTB assay in white-tailed deer infected with Mycobacterium bovis. Clin. Vaccine Immunol. 2013, 20, 907–911. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Morar, D.; Schreuder, J.; Meny, M.; van Kooten, P.J.; Tijhaar, E.; Michel, A.L.; Rutten, V.P. Towards establishing a rhinoceros-specific interferon-gamma (IFN-gamma) assay for diagnosis of tuberculosis. Transbound. Emerg. Dis. 2013, 60, 60–66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Richomme, C.; Boadella, M.; Courcoul, A.; Durand, B.; Drapeau, A.; Corde, Y.; Hars, J.; Payne, A.; Fediaevsky, A.; Boschiroli, M.L. Exposure of wild boar to Mycobacterium tuberculosis complex in France since 2000 is consistent with the distribution of bovine tuberculosis outbreaks in cattle. PLoS ONE 2013, 8, e77842. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Wadhwa, A.; Johnson, R.E.; Mackintosh, C.G.; Griffin, J.F.; Waters, W.R.; Bannantine, J.P.; Eda, S. Use of ethanol extract of Mycobacterium bovis for detection of specific antibodies in sera of farmed red deer (Cervus elaphus) with bovine tuberculosis. BMC Vet. Res. 2013, 9, 256. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Wadhwa, A.; Johonson, R.E.; Eda, K.; Waters, W.R.; Palmer, M.V.; Bannantine, J.P.; Eda, S. Evaluation of ethanol vortex ELISA for detection of bovine tuberculosis in cattle and deer. BMC Vet. Res. 2014, 10, 147. [Google Scholar] [CrossRef] [Green Version]
  26. Che’ Amat, A.; Gonzalez-Barrio, D.; Ortiz, J.A.; Diez-Delgado, I.; Boadella, M.; Barasona, J.A.; Bezos, J.; Romero, B.; Armenteros, J.A.; Lyashchenko, K.P.; et al. Testing Eurasian wild boar piglets for serum antibodies against Mycobacterium bovis. Prev. Vet. Med. 2015, 121, 93–98. [Google Scholar] [CrossRef] [Green Version]
  27. King, H.C.; Murphy, A.; James, P.; Travis, E.; Porter, D.; Sawyer, J.; Cork, J.; Delahay, R.J.; Gaze, W.; Courtenay, O.; et al. Performance of a noninvasive test for detecting Mycobacterium bovis shedding in european badger (Meles meles) populations. J. Clin. Microbiol. 2015, 53, 2316–2323. [Google Scholar] [CrossRef] [Green Version]
  28. Miller, M.A.; Greenwald, R.; Lyashchenko, K.P. Potential for serodiagnosis of tuberculosis in black rhinoceros (Diceros bicornis). J. Zoo Wildl. Med. 2015, 46, 100–104. [Google Scholar] [CrossRef]
  29. Tomlinson, A.J.; Chambers, M.A.; McDonald, R.A.; Delahay, R.J. Association of quantitative interferon-gamma responses with the progression of naturally acquired Mycobacterium bovis infection in wild European badgers (Meles meles). Immunology 2015, 144, 263–270. [Google Scholar] [CrossRef] [Green Version]
  30. Vogelnest, L.; Hulst, F.; Thompson, P.; Lyashchenko, K.P.; Herrin, K.A. Diagnosis and management of tuberculosis (Mycobacterium tuberculosis) in an Asian elephant (Elephas maximus) with a newborn calf. J. Zoo Wildl. Med. 2015, 46, 77–85. [Google Scholar] [CrossRef]
  31. Clarke, C.; Patterson, S.J.; Drewe, J.A.; van Helden, P.D.; Miller, M.A.; Parsons, S.D. Development and evaluation of a diagnostic cytokine-release assay for Mycobacterium suricattae infection in meerkats (Suricata suricatta). BMC Vet. Res. 2017, 13, 2. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Miller, M.; Buss, P.; de Klerk-Lorist, L.M.; Hofmeyr, J.; Hausler, G.; Lyashchenko, K.; Lane, E.P.; Botha, L.; Parsons, S.; van Helden, P. Application of rapid serologic tests for detection of Mycobacterium bovis infection in free-ranging warthogs (Phacochoerus africanus)—Implications for antemortem disease screening. J. Wildl. Dis. 2016, 52, 180–182. [Google Scholar] [CrossRef]
  33. Roos, E.O.; Buss, P.; de Klerk-Lorist, L.M.; Hewlett, J.; Hausler, G.A.; Rossouw, L.; McCall, A.J.; Cooper, D.; van Helden, P.D.; Parsons, S.D.C.; et al. Test performance of three serological assays for the detection of Mycobacterium bovis infection in common warthogs (Phacochoerus africanus). Vet. Immunol. Immunopathol. 2016, 182, 79–84. [Google Scholar] [CrossRef]
  34. Yakubu, Y.; Ong, B.L.; Zakaria, Z.; Hassan, L.; Mutalib, A.R.; Ngeow, Y.F.; Verasahib, K.; Razak, M.F. Evidence and potential risk factors of tuberculosis among captive Asian elephants and wildlife staff in Peninsular Malaysia. Prev. Vet. Med. 2016, 125, 147–153. [Google Scholar] [CrossRef] [PubMed]
  35. Busch, F.; Bannerman, F.; Liggett, S.; Griffin, F.; Clarke, J.; Lyashchenko, K.P.; Rhodes, S. Control of bovine tuberculosis in a farmed red deer herd in England. Vet. Rec. 2017, 180, 68. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Buzdugan, S.N.; Chambers, M.A.; Delahay, R.J.; Drewe, J.A. Quantitative interferon-gamma responses predict future disease progression in badgers naturally infected with Mycobacterium bovis. Epidemiol. Infect. 2017, 145, 3204–3213. [Google Scholar] [CrossRef] [Green Version]
  37. Cardoso-Toset, F.; Luque, I.; Carrasco, L.; Jurado-Martos, F.; Risalde, M.A.; Venteo, A.; Infantes-Lorenzo, J.A.; Bezos, J.; Rueda, P.; Tapia, I.; et al. Evaluation of five serologic assays for bovine tuberculosis surveillance in domestic free-range pigs from southern Spain. Prev. Vet. Med. 2017, 137, 101–104. [Google Scholar] [CrossRef]
  38. Perez de Val, B.; Napp, S.; Velarde, R.; Lavin, S.; Cervera, Z.; Singh, M.; Allepuz, A.; Mentaberre, G. Serological Follow-up of Tuberculosis in a Wild Boar Population in Contact with Infected Cattle. Transbound. Emerg. Dis. 2017, 64, 275–283. [Google Scholar] [CrossRef] [PubMed]
  39. Olivier, T.T.; Viljoen, I.M.; Hofmeyr, J.; Hausler, G.A.; Goosen, W.J.; Tordiffe, A.S.W.; Buss, P.; Loxton, A.G.; Warren, R.M.; Miller, M.A.; et al. Development of a gene expression assay for the diagnosis of Mycobacterium bovis infection in african lions (Panthera leo). Transbound. Emerg. Dis. 2017, 64, 774–781. [Google Scholar] [CrossRef] [PubMed]
  40. Parsons, S.D.C.; Morar-Leather, D.; Buss, P.; Hofmeyr, J.; McFadyen, R.; Rutten, V.; van Helden, P.D.; Miller, M.A.; Michel, A.L. The kinetics of the humoral and interferon-gamma immune responses to experimental Mycobacterium bovis infection in the white rhinoceros (Ceratotherium simum). Front. Immunol. 2017, 8, 1831. [Google Scholar] [CrossRef] [Green Version]
  41. Rosen, L.E.; Hanyire, T.G.; Dawson, J.; Foggin, C.M.; Michel, A.L.; Huyvaert, K.P.; Miller, M.A.; Olea-Popelka, F.J. Tuberculosis serosurveillance and management practices of captive African elephants (Loxodonta africana) in the Kavango-Zambezi Transfrontier Conservation Area. Transbound. Emerg. Dis. 2018, 65, 344–354. [Google Scholar] [CrossRef] [Green Version]
  42. Stewart, L.D.; Tort, N.; Meakin, P.; Argudo, J.M.; Nzuma, R.; Reid, N.; Delahay, R.J.; Ashford, R.; Montgomery, W.I.; Grant, I.R. Development of a novel immunochromatographic lateral flow assay specific for Mycobacterium bovis cells and its application in combination with immunomagnetic separation to test badger faeces. BMC Vet. Res. 2017, 13, 131. [Google Scholar] [CrossRef] [Green Version]
  43. Roos, E.O.; Olea-Popelka, F.; Buss, P.; de Klerk-Lorist, L.M.; Cooper, D.; Warren, R.M.; van Helden, P.D.; Parsons, S.D.C.; Miller, M.A. IP-10: A potential biomarker for detection of Mycobacterium bovis infection in warthogs (Phacochoerus africanus). Vet. Immunol. Immunopathol. 2018, 201, 43–48. [Google Scholar] [CrossRef]
  44. Roos, E.O.; Olea-Popelka, F.; Buss, P.; de Klerk-Lorist, L.M.; Cooper, D.; van Helden, P.D.; Parsons, S.D.C.; Miller, M.A. Seroprevalence of Mycobacterium bovis infection in warthogs (Phacochoerus africanus) in bovine tuberculosis-endemic regions of South Africa. Transbound. Emerg. Dis. 2018, 65, 1182–1189. [Google Scholar] [CrossRef]
  45. Roos, E.O.; Olea-Popelka, F.; Buss, P.; Hausler, G.A.; Warren, R.; van Helden, P.D.; Parsons, S.D.C.; de Klerk-Lorist, L.M.; Miller, M.A. Measuring antigen-specific responses in Mycobacterium bovis-infected warthogs (Phacochoerus africanus) using the intradermal tuberculin test. BMC Vet. Res. 2018, 14, 360. [Google Scholar] [CrossRef] [PubMed]
  46. Santos, N.; Nunes, T.; Fonseca, C.; Vieira-Pinto, M.; Almeida, V.; Gortazar, C.; Correia-Neves, M. Spatial analysis of wildlife tuberculosis based on a serologic survey using dried blood spots, portugal. Emerg. Infect. Dis. 2018, 24, 2169–2175. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Chileshe, J.; Roos, E.O.; Goosen, W.J.; Buss, P.; Hausler, G.; Rossouw, L.; Manemela, T.; van Helden, P.; Warren, R.; Parsons, S.D.; et al. An interferon-gamma release assay for the diagnosis of the Mycobacterium bovis infection in white rhinoceros (Ceratotherium simum). Vet. Immunol. Immunopathol. 2019, 217, 109931. [Google Scholar] [CrossRef] [PubMed]
  48. Dalley, D.; Lesellier, S.; Salguero, F.J.; Chambers, M.A. Purification and characterisation of badger IgA and its detection in the context of tuberculosis. Vet. Sci. 2019, 6, 89. [Google Scholar] [CrossRef] [Green Version]
  49. Fresco-Taboada, A.; Risalde, M.A.; Gortazar, C.; Tapia, I.; Gonzalez, I.; Venteo, A.; Sanz, A.; Rueda, P. A lateral flow assay for the rapid diagnosis of Mycobacterium bovis infection in wild boar. Transbound. Emerg. Dis. 2019, 66, 2175–2179. [Google Scholar] [CrossRef]
  50. Higgitt, R.L.; Louis van Schalkwyk, O.; de Klerk-Lorist, L.M.; Buss, P.E.; Caldwell, P.; Rossouw, L.; Manamela, T.; Hausler, G.A.; Hewlett, J.; Mitchell, E.P.; et al. Mycobacterium bovis infection in african wild dogs, kruger national park, south africa. Emerg. Infect. Dis. 2019, 25, 1425–1427. [Google Scholar] [CrossRef] [Green Version]
  51. Infantes-Lorenzo, J.A.; Dave, D.; Moreno, I.; Anderson, P.; Lesellier, S.; Gormley, E.; Dominguez, L.; Balseiro, A.; Gortazar, C.; Dominguez, M.; et al. New serological platform for detecting antibodies against Mycobacterium tuberculosis complex in European badgers. Vet. Med. Sci. 2019, 5, 61–69. [Google Scholar] [CrossRef] [Green Version]
  52. Kerr, T.J.; de Waal, C.R.; Buss, P.E.; Hofmeyr, J.; Lyashchenko, K.P.; Miller, M.A. Seroprevalence of Mycobacterium tuberculosis complex in free-ranging african elephants (Loxodonta africana) in kruger national park, south africa. J. Wildl. Dis. 2019, 55, 923–927. [Google Scholar] [CrossRef]
  53. Miller, M.A.; Buss, P.; Sylvester, T.T.; Lyashchenko, K.P.; deKlerk-Lorist, L.M.; Bengis, R.; Hofmeyr, M.; Hofmeyr, J.; Mathebula, N.; Hausler, G.; et al. Mycobacterium Bovis in free-ranging lions (Panthera Leo)—Evaluation of serological and tuberculin skin tests for detection of infection and disease. J. Zoo Wildl. Med. 2019, 50, 7–15. [Google Scholar] [CrossRef] [PubMed]
  54. Miller, M.A.; Gortazar, C.; Roos, E.O.; Risalde, M.A.; Johnathan-Lee, A.; Sridhara, A.A.; Lyashchenko, K.P. Serological reactivity to MPB83 and CFP10/ESAT-6 antigens in three suid hosts of Mycobacterium bovis infection. Vet. Microbiol. 2019, 235, 285–288. [Google Scholar] [CrossRef]
  55. Richomme, C.; Courcoul, A.; Moyen, J.L.; Reveillaud, E.; Maestrini, O.; de Cruz, K.; Drapeau, A.; Boschiroli, M.L. Tuberculosis in the wild boar: Frequentist and Bayesian estimations of diagnostic test parameters when Mycobacterium bovis is present in wild boars but at low prevalence. PLoS ONE 2019, 14, e0222661. [Google Scholar] [CrossRef] [PubMed]
  56. Roos, E.O.; Scott, L.A.; Ndou, S.; Olea-Popelka, F.; Buss, P.E.; de Klerk-Lorist, L.M.; Warren, R.M.; van Helden, P.D.; Sylvester, T.T.; Miller, M.A.; et al. Cytokine gene expression assay as a diagnostic tool for detection of Mycobacterium bovis infection in warthogs (Phacochoerus africanus). Sci. Rep. 2019, 9, 16525. [Google Scholar] [CrossRef]
  57. Thomas, J.; Infantes-Lorenzo, J.A.; Moreno, I.; Cano-Terriza, D.; de Juan, L.; Garcia-Bocanegra, I.; Dominguez, L.; Dominguez, M.; Gortazar, C.; Risalde, M.A. Validation of a new serological assay for the identification of Mycobacterium tuberculosis complex-specific antibodies in pigs and wild boar. Prev. Vet. Med. 2019, 162, 11–17. [Google Scholar] [CrossRef] [PubMed]
  58. Thomas, J.; Infantes-Lorenzo, J.A.; Moreno, I.; Romero, B.; Garrido, J.M.; Juste, R.; Dominguez, M.; Dominguez, L.; Gortazar, C.; Risalde, M.A. A new test to detect antibodies against Mycobacterium tuberculosis complex in red deer serum. Vet. J. 2019, 244, 98–103. [Google Scholar] [CrossRef]
  59. Vicente, J.; Martinez-Guijosa, J.; Tvarijonaviciute, A.; Fernandez-de Mera, I.G.; Gortazar, C.; Ceron, J.J.; Martinez-Subiela, S. Serum haptoglobin response in red deer naturally infected with tuberculosis. Comp. Immunol. Microbiol. Infect. Dis. 2019, 64, 25–30. [Google Scholar] [CrossRef]
  60. Viljoen, I.M.; Sylvester, T.T.; Parsons, S.D.C.; Millar, R.P.; Helden, P.D.V.; Miller, M.A. Performance of the tuberculin skin test in Mycobacterium Bovis-exposed and -unexposed african lions (Panthera Leo). J. Wildl. Dis. 2019, 55, 537–543. [Google Scholar] [CrossRef]
  61. Goosen, W.J.; Cooper, D.; Warren, R.M.; Miller, M.A.; van Helden, P.D.; Parsons, S.D. The evaluation of candidate biomarkers of cell-mediated immunity for the diagnosis of Mycobacterium bovis infection in African buffaloes (Syncerus caffer). Vet. Immunol. Immunopathol. 2014, 162, 198–202. [Google Scholar] [CrossRef]
  62. Altman, D.G.; Bland, J.M. Diagnostic tests 2: Predictive values. BMJ 1994, 309, 102. [Google Scholar] [CrossRef] [Green Version]
  63. Greco, S.; Girardi, E.; Navarra, A.; Saltini, C. Current evidence on diagnostic accuracy of commercially based nucleic acid amplification tests for the diagnosis of pulmonary tuberculosis. Thorax 2006, 61, 783–790. [Google Scholar] [CrossRef] [Green Version]
  64. Massei, G.; Kindberg, J.; Licoppe, A.; Gacic, D.; Sprem, N.; Kamler, J.; Baubet, E.; Hohmann, U.; Monaco, A.; Ozolins, J.; et al. Wild boar populations up, numbers of hunters down? A review of trends and implications for Europe. Pest. Manag. Sci. 2015, 71, 492–500. [Google Scholar] [CrossRef] [PubMed]
  65. Gortázar, C.; Delahay, R.J.; McDonald, R.A.; Boadella, M.; Wilson, G.J.; Gavier-Widen, D.; Acevedo, P. The status of tuberculosis in European wild mammals. Mammal. Rev. 2012, 42, 193–206. [Google Scholar] [CrossRef]
  66. Barasona, J.A.; Gortazar, C.; de la Fuente, J.; Vicente, J. Host richness increases tuberculosis disease risk in game-managed areas. Microorganisms 2019, 7, 182. [Google Scholar] [CrossRef] [Green Version]
  67. Drewe, J.A.; Foote, A.K.; Sutcliffe, R.L.; Pearce, G.P. Pathology of Mycobacterium bovis infection in wild meerkats (Suricata suricatta). J. Comp. Pathol. 2009, 140, 12–24. [Google Scholar] [CrossRef] [PubMed]
  68. Drewe, J.A. Who infects whom? Social networks and tuberculosis transmission in wild meerkats. Proc. Biol. Sci. 2010, 277, 633–642. [Google Scholar] [CrossRef]
  69. Hemmati, M.; Seghatoleslam, A.; Rasti, M.; Ebadat, S.; Mosavari, N.; Habibagahi, M.; Taheri, M.; Sardarian, A.R.; Mostafavi-Pour, Z. Expression and purification of recombinant Mycobacterium tuberculosis (TB) antigens, ESAT-6, CFP-10 and ESAT- 6/CFP-10 and their diagnosis potential for detection of TB patients. Iran. Red Crescent Med. J. 2011, 13, 556–563. [Google Scholar]
  70. Ashford, R.T.; Anderson, P.; Waring, L.; Dave, D.; Smith, F.; Delahay, R.J.; Gormley, E.; Chambers, M.A.; Sawyer, J.; Lesellier, S. Evaluation of the dual path platform (DPP) VetTB assay for the detection of Mycobacterium bovis infection in badgers. Prev. Vet. Med. 2020, 180, 105005. [Google Scholar] [CrossRef]
  71. Lyashchenko, K.P.; Greenwald, R.; Esfandiari, J.; Greenwald, D.; Nacy, C.A.; Gibson, S.; Didier, P.J.; Washington, M.; Szczerba, P.; Motzel, S.; et al. PrimaTB STAT-PAK assay, a novel, rapid lateral-flow test for tuberculosis in nonhuman primates. Clin. Vaccine Immunol. 2007, 14, 1158–1164. [Google Scholar] [CrossRef] [Green Version]
  72. Waters, W.R.; Palmer, M.V.; Bannantine, J.P.; Whipple, D.L.; Greenwald, R.; Esfandiari, J.; Andersen, P.; McNair, J.; Pollock, J.M.; Lyashchenko, K.P. Antigen recognition by serum antibodies in white-tailed deer (Odocoileus virginianus) experimentally infected with Mycobacterium bovis. Clin. Diagn. Lab. Immunol. 2004, 11, 849–855. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  73. Waters, W.R.; Palmer, M.V.; Thacker, T.C.; Bannantine, J.P.; Vordermeier, H.M.; Hewinson, R.G.; Greenwald, R.; Esfandiari, J.; McNair, J.; Pollock, J.M.; et al. Early antibody responses to experimental Mycobacterium bovis infection of cattle. Clin. Vaccine Immunol. 2006, 13, 648–654. [Google Scholar] [CrossRef] [Green Version]
  74. Infantes-Lorenzo, J.A.; Moreno, I.; Roy, A.; Risalde, M.A.; Balseiro, A.; de Juan, L.; Romero, B.; Bezos, J.; Puentes, E.; Akerstedt, J.; et al. Specificity of serological test for detection of tuberculosis in cattle, goats, sheep and pigs under different epidemiological situations. BMC Vet. Res. 2019, 15, 70. [Google Scholar] [CrossRef] [Green Version]
  75. Infantes-Lorenzo, J.A.; Whitehead, C.E.; Moreno, I.; Bezos, J.; Roy, A.; Dominguez, L.; Dominguez, M.; Salguero, F.J. Development and evaluation of a serological assay for the diagnosis of tuberculosis in alpacas and llamas. Front. Vet. Sci. 2018, 5, 189. [Google Scholar] [CrossRef] [Green Version]
  76. Arrieta-Villegas, C.; Infantes-Lorenzo, J.A.; Bezos, J.; Grasa, M.; Vidal, E.; Mercader, I.; Singh, M.; Domingo, M.; de Juan, L.; Perez de Val, B. Evaluation of P22 antigenic complex for the immuno-diagnosis of tuberculosis in BCG vaccinated and unvaccinated goats. Front. Vet. Sci. 2020, 7, 374. [Google Scholar] [CrossRef] [PubMed]
  77. Barasona, J.A.; Barroso-Arevalo, S.; Rivera, B.; Gortazar, C.; Sanchez-Vizcaino, J.M. Detection of Antibodies against Mycobacterium bovis in Oral Fluid from Eurasian Wild Boar. Pathogens 2020, 9, 242. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Berger, A. Th1 and Th2 responses: What are they? BMJ 2000, 321, 424. [Google Scholar] [CrossRef] [Green Version]
  79. Boadella, M.; Lyashchenko, K.; Greenwald, R.; Esfandiari, J.; Jaroso, R.; Carta, T.; Garrido, J.M.; Vicente, J.; de la Fuente, J.; Gortazar, C. Serologic tests for detecting antibodies against Mycobacterium bovis and Mycobacterium avium subspecies paratuberculosis in Eurasian wild boar (Sus scrofa scrofa). J. Vet. Diagn. Investig. 2011, 23, 77–83. [Google Scholar] [CrossRef] [Green Version]
  80. De Bruin, M.G.; De Visser, Y.E.; Kimman, T.G.; Bianchi, A.T. Time course of the porcine cellular and humoral immune responses in vivo against pseudorabies virus after inoculation and challenge: Significance of in vitro antigenic restimulation. Vet. Immunol. Immunopathol. 1998, 65, 75–87. [Google Scholar] [CrossRef]
  81. Kimman, T.G.; De Bruin, T.M.; Voermans, J.J.; Peeters, B.P.; Bianchi, A.T. Development and antigen specificity of the lymphoproliferation responses of pigs to pseudorabies virus: Dichotomy between secondary B- and T-cell responses. Immunology 1995, 86, 372–378. [Google Scholar]
Table 1. Summary of forty-one relevant results from a PubMed search identifying papers from 2012 to present, looking at diagnostic tests for TB in free-ranging and captive non-bovid wildlife.
Table 1. Summary of forty-one relevant results from a PubMed search identifying papers from 2012 to present, looking at diagnostic tests for TB in free-ranging and captive non-bovid wildlife.
Mycobacterium SpeciesNatural (N) or Experimental (E) Infection 1SpeciesTechnique
Employed
TargetReference
M. tuberculosis and M. bovisN (333)Deer (Cervus unicolor swinhoei and
C. nippon taiouanus)
Culture, mnPCR, SITT, Acid fast stainNA[20]
M. bovisN (483) + E (31)White-Tailed Deer
(Odocoileus virginianus)
DPP VetTB AssayMPB83, CFP10, ESAT-6[21]
M. bovisN (75)White Rhinoceros (Ceratotherium simum)IGRAbPPD, aPPD[22]
MTBCN (2080)Wild boar
(Sus scrofa)
bPPD ELISANA[23]
M. bovisN (5) + E (15)Red Deer
(Cervus elaphus)
EVELISANA[24]
M. bovisN (7) + E (9)White-Tailed Deer (Odocoileus virginianus)EVELISAMPB83[25]
M. bovisN (126)Wild Boar (Sus scrofa)DPP VetTB, ELISA IgG, ELISA DR, ELISA IgM, CultureMPB70, MPB83, CFP10, ESAT-6, bPPD, IgG, IgM[26]
M. bovisN (ND)European Badger
(Meles meles)
STAT-PAK, IGRA, qPCR, CultureMPB83, ESAT-6, CFP10, bPPD, aPPD[27]
M. tuberculosisN (1)Black Rhinoceros (Diceros bicornis)STAT-PAK, DPP VetTB, MAPIAMPB83, ESAT-6, CFP10[28]
M. bovisN (751)European Badger
(Meles meles)
IGRA, STAT-PAK AssaysbPPD, aPPD, MPB83, ESAT-6, CFP10, MPB70[29]
M. tuberculosisN (5)Asian elephant
(Elephas maximus)
DPP VetTB Assay, STAT-PAKMPB83, ESAT-6, CFP10[30]
M. suricattaeN (111)Meerkat
(Suricata suricatta)
Cytokine Release AssayPC-HP peptide pool[31]
M. bovisN (3)Warthog
(Phacochoerus africanus)
DPP VetTB Assay MPB83, CFP10, ESAT-6[32]
M. bovisN (35)Warthog
(Phacochoerus africanus)
Indirect PPD ELISA, TB ELISA-VK, DPP VetTB AssaybPPD, MPB83, ESAT-6, CFP10 [33]
M. tuberculosisN (ND)Asian Elephant (Loxodonta africana)STAT-PAK, DPP VetTB AssayMPB83, ESAT-6, CFP10[34]
M. bovisN (474)Red Deer
(Cervus elaphus)
STAT-PAK, DPP VetTB, MAPIAMPB83, ESAT-6, CFP10, bPPD, MPB70[35]
M. bovisN (550)European Badger
(Meles meles)
IGRA, STAT-PAK, CulturebPPD, aPPD, MPB83, ESAT-6, CFP10[36]
MTBCN (217)Domestic Pig 2
(Sus scrofa domesticus)
bPPD ELISA, INgezim TB Porcine, INgezim TB-CROMMPB70, MPB83, bPPD[37]
MTBCN (173)European Badger
(Meles meles)
IgG ELISAMPB83, Rv2873[38]
M. bovisN (14)African Lion
(Panthera leo)
qPCRMIG/CXCL9, ESAT-6, CFP-10[39]
M. bovisE (3)White Rhinoceros (Ceratotherium simum)PPD ELISA, TB STAT-PAK, DPP VetTB AssaybPPD, aPPD, MPB83, ESAT-6, CFP10, MPB70[40]
MTBC N (35)African elephant (Loxodonta africana)Elephant TB STAT-PAK, DPP VetTB AssayMPB83, ESAT-6, CFP10[41]
M. bovisN (541)European Badger
(Meles meles)
IMS LFA, qPCR, CultureM. bovis whole cells[42]
M. bovisN (88)Warthog
(Phacochoerus africanus)
Cytokine Release AssayESAT-6, CFP-10, TB7.7 peptides[43]
M. bovisN (170)Warthog
(Phacochoerus africanus)
Indirect PPD ELISA, TB ELISA-VKbPPD[44]
M. bovisN (34)Warthog
(Phacochoerus africanus)
SITT, CITTbPPD, aPPD[45]
M. bovisN (678)Wild Boar (Sus scrofa)bPPD ELISAbPPD[46]
M. bovisN (131) + E (2)White Rhinoceros (Ceratotherium simum)IGRAESAT-6, CFP10[47]
M. bovisE (ND)European Badger
(Meles meles)
MPB83-IgA ELISAMPB83 specific-IgA[48]
M. bovisN (55) + E (51)Wild Boar (Sus scrofa)INgezim TB CROM (LFA), INgezim TB Porcine and INgezim Tuberculosis DR, Indirect ELISAMPB83, MPB70, P22 complex[49]
M. bovisN (40)African wild dog (Lycaon pictus)IGRA ESAT-6, CFP10[50]
MTBCN (85) + E (36)European Badger
(Meles meles)
P22 ELISAP22 complex[51]
MTBCN (222)African Elephant (Loxodonta africana)STAT-PAK Assay, DPP Vet TB AssayMPB83, ESAT-6, CFP10[52]
M. bovisN (326)Lion (Panthera leo)STAT-PAK, DPP Vet TB, SITTMPB83, ESAT-6, CFP10, bPPD[53]
M. bovisN (79)Wild Boar (Sus scrofa), Warthog
(Phacochoerus africanus)
DPP VetTB AssayIgG, MPB83, CFP10, ESAT-6[54]
M. bovisN (495)Wild Boar (Sus scrofa)PCR, IDEXX Ab test, INgezim TB porcine, TB ELISA-VK bPPD, MPB83, MPB70[55]
M. bovisN (15)Warthog
(Phacochoerus africanus)
GEAESAT-6, CFP10[56]
MTBCN (277)Wild Boar (Sus scrofa)P22 ELISA, bPPD ELISAP22 complex, bPPD[57]
MTBCN (221)Red Deer
(Cervus elaphus)
P22 ELISA, bPPD ELISAP22 complex, bPPD[58]
MTBCN (88)Red Deer
(Cervus elaphus)
CITT, Serum HpHp[59]
M. bovisN (62)African Lion
(Panthera leo)
CITT, GEAbPPD, aPPD [60]
1 Number in parenthesis indicates samples size, ND indicates precise number could not be determined from the paper, e.g., specify trapping events rather than individuals. 2 Domestic pigs were exceptionally included here as the study was carried out on domestic free-range Iberian pigs reared outdoors and sharing natural resources with other wild and domestic animals, including cattle and wildlife. mn, Multiplex nested; q, real-time; PCR, Polymerase Chain Reaction; SITT, Single Intradermal Tuberculin Test; CITT, Comparative Intradermal Tuberculin Test; DPP, Dual Platform Pathway; PC-HP peptide pool, contains ESAT-6 and CFP¬10 peptides and antigens derived from the gene Rv3615c and an additional three genes [61]; IGRA, Interferon-Gamma Release Assay; ELISA, Enzyme-linked Immunosorbent Assay; EVELISA, Ethanol Vortex ELISA; STAT-PAK (Chembio Diagnostic Systems, Inc.)/LFA, Lateral Flow Assay; MAPIA, Multi-antigen Print Immunoassay; (b)PPD, (Bovine) Purified Protein Derivative; IMS, Immunomagnetic Separation; GEA, Gene Expression Assay; Hp, Haptoglobin; NA = Not Applicable, was not indicated in the study.
Table 2. Summary of forty-one relevant results from a PubMed search identifying papers from 2012 to present, looking at diagnostic tests for TB in free-ranging and captive non-bovid wildlife.
Table 2. Summary of forty-one relevant results from a PubMed search identifying papers from 2012 to present, looking at diagnostic tests for TB in free-ranging and captive non-bovid wildlife.
SpeciesTestNPVPPVSens (%)
(95% CI)
Spec (%)
(95% CI)
DORDOR
95% CI
Reference
DeermnPCR0.5 10.783.3
(60.0–104.0%)
28.6
(−4.8–62.0%)
1.90.2–14.6[20]
Acid-fast Stain0.61.066.7
(49.0–93.3%)
100.0
(100.0%)
28.31.3–618.0
DeerDPP VetTB
(Experimental)
0.80.958.1
(39.3–74.9%)
98.4
(90.3–99.9%)
57.19.8–333.5[21]
DPP VetTB (Natural)0.90.771.9
(53.0–85.6%)
98.22
(96.4–99.2%)
129.146.8–355.8
DPP VetTB (Combined)0.90.765.1
(51.9–76.4%)
97.8
(96.5–98.6%)
79.540.5–156.1
DeerEVELISA0.90.986.7
(70.0–103.0%)
93.3
(80.7–105.0%)
52.26.0–450.7[24]
DeerEVELISA0.91.087.5
(71.0–103.0%)
100.0
(100%)
295.813.3–6593.1[25]
WarthogIndirect PPD ELISA0.90.987.5
(62.0–98.0%)
89.5
(67.0–99.0%)
40.66.2–267.7[33]
TB ELISA-VK0.90.887.5
(62.0–98.0%)
78.9
(54.0–94.0%)
20.03.6–109.8
DPP VetTB0.80.975.0
(49.0–93.0%)
89.5
(67.0–99.0%)
19.43.5–107.3
PigINgezim TB Porcine0.91.078.0
(65.3–87.7%)
100.0
(95.9-100.0%)
609.735.4–10486.8[37]
INgezim TB-CROM0.90.974.6
(61.6–85.0%)
98.9
(93.8–100.0%)
167.530.2–930.0
TB ELISA-VK0.81.072.9
(59.7–83.6%)
100.0
(93.8–100.0 %)
466.627.3–7961.8
t-bPPD ELISA0.81.071.2
(57.9–82.2%)
100.0
(95.9–100.0%)
429.925.2–7319.7
In-house ELISA0.81.066.1
(52.6–77.9%)
100.0
(95.9–100%)
341.020.1–5781.6
Wild BoarMPB83 IgG ELISA0.91.086.4
(72.0–100.0%)
100.0
(100.0%)
484.723.9–9843.4[38]
BadgerLFD0.50.58.1
(2.7–17.8%)
92.6
(83.7–97.6%)
1.10.3–3.8[42]
PCR0.60.658.1
(44.9–70.5%)
70.6
(58.3–81.1%)
3.31.6–6.7
WarthogIP-10 Assay0.90.668.4
(46.0–85.0%)
83.7
(71.0–91.0%)
10.13.1–33.4[43]
WarthogSITT0.81.068.8
(41.0–89.0%)
100.0
(81.0–100.0%)
77.43.9–1534.1[45]
CITT0.91.081.3
(54.0–96.0%)
100.0
(81.0–100.0%)
142.76.8–2998.9
RhinocerosIGRA0.90.878.4
(52.3–93.5%)
92.2
(63.9–99.8%)
38.613.7–108.8[47]
Wild BoarINgezim TB CROM Ab (Experimental)0.61.090.2
(78.6–96.7%)
100.0
(66.2–100.0%)
160.68.2–3156.4[49]
INgezim TB Porcine (Experimental)0.71.092.2
(81.1–97.8%)
100.0
(66.2–100.0%)
200.69.9–4043.2
INgezim Tuberculosis DR (Experimental)0.61.086.3
(73.7–94.3%)
100.0
(66.2–100.0%)
112.75.9–2147.9
In-house ELISA (Experimental)0.51.084.3
(71.4–93.0%)
100.0
(66.2–100.0%)
97.25.2–1834.4
INgezim TB CROM Ab (Field)0.90.993.3
(77.9–99.0%)
96.0
(79.6–99.3%)
186.222.9–1513.1
INgezim TB Porcine (Field)1.01.0100.0
(88.3–100.0%)
100.0
(86.2–100.0%)
3111.059.6–162400.9
INgezim Tuberculosis DR (Field)0.91.093.3
(77.9–99.0%)
100.0
(86.2–100.0%)
581.426.6–12689.2
In-house ELISA (Field)0.91.096.7
(82.7–99.4%)
100.0
(86.2–100.0%)
100339.1–25719.3
BadgerIndirect ELISA0.90.781.4
(71.4–91.3)
75.0
(66.3–83.6%)
12.55.7–27.5[51]
Competitive ELISA0.90.878.0 (67.0–88.0%)89.6 (83.0–95.6%)28.411.7–68.5
LionSTAT-PAK0.81.062.5
(35.0–85.0%)
100.0
(78.0–100.0%)
69.53.6–1353.5[53]
SITT0.80.772.7
(39.0–94.0%)
80.0
(52.0–96.0%)
8.71.6–48.4
Warthog,
Wild Boar
DPP VetTB Assay (Wild Boar)0.70.980.4
(68.0–88.0%)
96.7
(81.9–100.0%)
77.813.3–453.8[54]
DPP VetTB Assay (Warthog)0.90.982.6
(62.3–93.6%)
91.4
(76.9–97.8%)
40.28.9–181.3
Wild BoarPCR0.90.362.5
(24.6–91.5%)
97.1
(94.8–98.5%)
50.211.6–216.9[55]
TB ELISA-VK (0.2 Cut-off)1.00.185.7
(42.1–99.6%)
87.5
(83.7–90.6%)
30.04.9–181.5
TB ELISA-VK (0.5 Cut-off)0.90.485.7
(42.1–99.6%)
97.3
(95.2–98.7%)
150.823.1–987.0
IDEXX1.00.375
(34.9–96.8%)
96.7
(94.7–98.1%)
74.115.9–345.5
INgezim TB Porcine0.90.375
(34.9–96.8%)
96.9
(94.9–98.3%)
79.116.9–370.4
WarthogGEA (CXCL9)0.70.960.0
(32.0–84.0%)
94.1
(71.0–100.0%)
16.12.3–112.6[56]
GEA (CXCL10)0.90.986.7
(60.0–98.0%)
94.1
(71.0–100.0%)
59.46.9–509.1
GEA (CXCL11)0.71.053.3
(27.0–79.0%)
100.0
(80.0–100.0%)
39.72.0–779.2
GEA (TNF-α)0.80.873.3
(45.0–92.0%)
88.2
(64.0–99.0%)
15.82.8–88.8
GEA (IFN-γ)0.80.880.0
(52.0–96.0%)
82.4
(57.0–96.0%)
14.82.8–78.1
Wild Boar, PigP22 ELISA0.90.984.1
(79.3–98.4%)
98.4
(96.5–99.4%)
291.0125.7–673.6[57]
bPPD ELISA0.80.977.3
(71.9–82.1%)
97.3
(95.0–98.3%)
114.758.4–225.2
DeerP22 ELISA0.81.070.1
(63.6–76.0%)
99.0
(96.5–99.8%)
189.452.7–681.1[58]
bPPD ELISA0.70.970.1
(63.6–76.0%)
91.6
(86.9–95.0%)
25.114.2–44.2
DeerCITT0.80.525.0
(−5.0–55.0%)
92.0
(81.3–102.6%)
3.60.5–25.6[59]
Hp0.90.762.5
(28.9–96.0%)
92.0
(81.0–102.0%)
14.82.3–95.8
1 Shaded cells indicate values that were calculated by us and not provided in the original study.
Table 3. The ten best performing tests in non-bovid wildlife ranked based on highest values for sensitivity, specificity, and diagnostic odds ratio (DOR).
Table 3. The ten best performing tests in non-bovid wildlife ranked based on highest values for sensitivity, specificity, and diagnostic odds ratio (DOR).
RankingTop 10 Tests—SensitivityTop 10 Tests—SpecificityTop 10 Tests—DOR
PositionTestSpeciesAgTestSpeciesAgTestSpeciesAg
1INgezim TB Porcine (F 1) [49]Wild BoarMPB83/ 70INgezim TB Porcine (F) [49]Wild BoarMPB83/ 70INgezim TB Porcine (F) [49]Wild BoarMPB83/70
2In-house ELISA (F) [49]Wild BoarP22 complexIn-house ELISA (F) [49]Wild BoarP22 complexDPP VetTB Assay [54]PigMPB83/ESAT-6/CFP10
3DPP VetTB Assay [54]PigMPB83/ESAT-6/CFP10DPP VetTB Assay [54]PigMPB83/ ESAT-6/ CFP10In-house ELISA (F) [49]Wild BoarP22 complex
4INgezim TB-CROM (F) [49]Wild BoarMPB83INgezim Tuberculosis DR (F) [49]Wild BoarMPB83INgezim TB Porcine [37]PigMPB83/70
5INgezim Tuberculosis DR (F) [49]Wild BoarMPB83INgezim TB Porcine (E) [49]Wild BoarMPB83/ 70INgezim Tuberculosis DR (F) [49]Wild BoarMP83
6INgezim TB Porcine (E 2) [49]Wild BoarMPB83/ 70INgezim TB-CROM (E) [49]Wild BoarMPB83MPB83 IgG ELISA [38]BadgerMPB83
7INgezim TB-CROM (E) [49]Wild BoarMPB83EVELISA [25]DeerMPB83TB ELISA-VK [37]PigbPPD
8EVELISA [25]DeerMPB83MPB83 IgG ELISA [38]BadgerMPB83t-bPPD In-house ELISA [37]PigTreated bPPD
9Indirect PPD ELISA [33]WarthogbPPDINgezim Tuberculosis DR (E) [49]Wild BoarMPB83bPPD2 In-house ELISA [37]PigbPPD
10TB ELISA-VK [33]WarthogbPPDIn-house ELISA (E) [49]Wild BoarP22 complexEVELISA [25]DeerMPB83
1 F = field samples. 2 E = experimental samples.
Table 4. The ten lowest performing tests in non-bovid wildlife ranked based on lowest values for sensitivity, specificity, and diagnostic odds ratio (DOR), with position ‘1’ being the lowest value out of the ten tests.
Table 4. The ten lowest performing tests in non-bovid wildlife ranked based on lowest values for sensitivity, specificity, and diagnostic odds ratio (DOR), with position ‘1’ being the lowest value out of the ten tests.
RankingLowest 10 Tests—SensitivityLowest 10 Tests—SpecificityLowest 10 Tests—DOR
PositionTestSpeciesAgTestSpeciesAgTestSpeciesAg
1LFD [42]BadgerM. bovis whole cellsmnPCR [20]DeerNA 1LFD [42]BadgerM. bovis whole cells
2CITT [59]Deera/b PPDPCR [42]BadgerM. bovis whole cellsmnPCR [20]DeerNA
3GEA CXCL11 [56]WarthogESAT-6/CFP10Indirect ELISA [51]BadgerP22 complexPCR [42]BadgerM. bovis whole cells
4DPP VetTB assay [21]DeerMPB83/CFP10/ESAT-6TB ELISA-VK [33]WarthogbPPDCITT [59]Deera/b PPD
5PCR [42]BadgerM. bovis whole cellsSITT [53]LionbPPDSITT [53]LionbPPD
6GEA CXCL9 [56]WarthogESAT-6/CFP10GEA IFNγ [56]WarthogESAT-6/ CFP10IP-10 assay [43]WarthogESAT-6, CFP-10, TB7.7 peptides
7Phase Range Serum Hp [59]DeerHpIP-10 assay [43]WarthogESAT-6, CFP-10, TB7.7 peptidesIndirect ELISA [51]BadgerP22 complex
8PCR [55]Wild BoarNATB ELISA-VK [55]Wild BoarbPPDPhase Range Serum Hp [59]DeerHp
9STAT-PAK [53]LionNAGEA TNFα [56]WarthogESAT-6/CFP10GEA IFNγ [56]WarthogESAT-6/CFP10
10DPP VetTB assay [21]DeerMPB83/CFP10/ESAT-6DPP VetTB assay [33]WarthogMPB83/ESAT-6/CFP10GEA TNFα [56]WarthogESAT-6/CFP10
1 NA = Not Applicable, was not indicated in the study. As P22 complex and MPB83 appeared in 20/51 of the tests studied (39.2%), with 10% of DOR top-ranking tests using P22 complex and 60% using MPB83, we asked whether they were genuinely better antigens of choice, testing the hypothesis that either MPB83 or P22 were over-represented more than expected by chance alone in the best performing tests using the Fisher’s exact test. The p values for a two-tailed test showed that neither P22 (p = 0.67) nor MPB83 (p = 1.08) appeared more often in the top-ranking tests than would be expected by chance. Therefore, there was no evidence to indicate they were superior antigens but simply a reflection of how commonly they were used.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Thomas, R.; Chambers, M. Review of Methods Used for Diagnosing Tuberculosis in Captive and Free-Ranging Non-Bovid Species (2012–2020). Pathogens 2021, 10, 584. https://doi.org/10.3390/pathogens10050584

AMA Style

Thomas R, Chambers M. Review of Methods Used for Diagnosing Tuberculosis in Captive and Free-Ranging Non-Bovid Species (2012–2020). Pathogens. 2021; 10(5):584. https://doi.org/10.3390/pathogens10050584

Chicago/Turabian Style

Thomas, Rebecca, and Mark Chambers. 2021. "Review of Methods Used for Diagnosing Tuberculosis in Captive and Free-Ranging Non-Bovid Species (2012–2020)" Pathogens 10, no. 5: 584. https://doi.org/10.3390/pathogens10050584

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop