Next Article in Journal
Antimicrobial Resistance and Virulence Characteristics of Klebsiella pneumoniae Isolates in Kenya by Whole-Genome Sequencing
Next Article in Special Issue
Mycobacterium tuberculosis Rv2387 Facilitates Mycobacterial Survival by Silencing TLR2/p38/JNK Signaling
Previous Article in Journal
Antibiotic Resistance in Non-Typhoidal Salmonella enterica Strains Isolated from Chicken Meat in Indonesia
Previous Article in Special Issue
The Origin and Maintenance of Tuberculosis Is Explained by the Induction of Smear-Negative Disease in the Paleolithic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Peripheral Blood Markers Correlate with the Progression of Active Tuberculosis Relative to Latent Control of Mycobacterium tuberculosis Infection in Macaques

1
Southwest National Primate Research Center, Texas Biomedical Research Institute, San Antonio, TX 78227, USA
2
Tulane University Health Science Center, New Orleans, LA 70112, USA
3
Department of Biostatistics and Bioinformatics, School of Public Health and Tropical Medicine, Tulane University, New Orleans, LA 70112, USA
4
Tulane National Primate Research Center, Covington, LA 70433, USA
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Pathogens 2022, 11(5), 544; https://doi.org/10.3390/pathogens11050544
Submission received: 25 January 2022 / Revised: 23 April 2022 / Accepted: 26 April 2022 / Published: 5 May 2022
(This article belongs to the Special Issue Pathogenicity of Mycobacterium tuberculosis)

Abstract

:
Despite a century of research into tuberculosis (TB), there is a dearth of reproducible, easily quantifiable, biomarkers that can predict disease onset and differentiate between host disease states. Due to the challenges associated with human sampling, nonhuman primates (NHPs) are utilized for recapitulating the closest possible modelling of human TB. To establish a predictive peripheral biomarker profile based on a larger cohort of rhesus macaques (RM), we analyzed results pertaining to peripheral blood serum chemistry and cell counts from RMs that were experimentally exposed to Mtb in our prior studies and characterized as having either developed active TB (ATB) disease or latent TB infection (LTBI). We compared lung CFU burdens and quantitative pathologies with a number of measurables in the peripheral blood. Based on our results, the investigations were then extended to the study of specific molecules and cells in the lung compartments of a subset of these animals and their immune responses. In addition to the elevated serum C-reactive protein (CRP) levels, frequently used to discern the level of Mtb infection in model systems, reduced serum albumin-to-globulin (A/G) ratios were also predictive of active TB disease. Furthermore, higher peripheral myeloid cell levels, particularly those of neutrophils, kynurenine-to-tryptophan ratio, an indicator of induced expression of the immunosuppressive molecule indoleamine dioxygenase, and an influx of myeloid cell populations could also efficiently discriminate between ATB and LTBI in experimentally infected macaques. These quantifiable correlates of disease were then used in conjunction with a regression-based analysis to predict bacterial load. Our results suggest a potential biomarker profile of TB disease in rhesus macaques, that could inform future NHP–TB research. Our results thus suggest that specific biomarkers may be developed from the myeloid subset of peripheral blood or plasma with the ability to discriminate between active and latent Mtb infection.

1. Introduction

Tuberculosis (TB), caused by Mycobacterium tuberculosis (Mtb), is one of the deadliest infectious diseases facing humanity, leading to ~10 million new cases and ~1.6 million deaths annually, as per a recent report from 2021 [1]. Studies that have attempted to devise efficient, cost effective, accurate, non-invasive, forms of diagnosis experience their own set of drawbacks. In part, this is due to the fact that Mtb infection can have a spectrum of different outcomes inside a human host, ranging from a lifelong asymptomatic infection, termed latent tuberculosis infection (LTBI), to a reactivation of LTBI. TB can present as slowly progressing chronic pulmonary TB, rapidly fulminant pulmonary TB, as well as extra-pulmonary TB [2]. In each of these instances, the level of bacterial burden and the extent of the granulomatous pathology can differ significantly. Due to the variability of infection and host response, accurately diagnosing TB through the use of a single method is an ambitious undertaking. It is particularly difficult to identify TB positive patients in high burden areas where the specificity of routine tests is undermined by extensive BCG vaccination and the high burden of environmental mycobacteria. Despite advances in TB diagnostics, a definitive set of biomarkers for diagnosis of disease and monitoring of disease progression has not yet been identified [3].
Rhesus and cynomolgus macaques have proven excellent models of human Mtb infection [4,5]. Experimental infection of macaques can result in a plurality of outcomes [6], and the lungs of these animals exhibit a wide variety of pathological lesions reminiscent of human TB [5]. We have therefore employed the macaque model of TB to study various aspects of the host immune function [7,8,9,10,11,12,13,14,15,16,17,18,19,20], as well as the role of the bacterial virulence factors [6,19,21,22]. We have collected clinical data from rhesus macaques which progressed to active pulmonary TB disease, or which exhibited immune control over infection, which was characterized by lower bacillary burdens, indicative of LTBI.
The macaque model allows longitudinal collection of both lung and peripheral samples as well as the associated data on a repeated basis, from animals with precise infection. Thus, we can collect accurate lung tissue CFUs and determine lung pathology with a degree of precision, that is impossible with infected humans due to a variety of reasons. It is therefore critical to identify surrogate markers in the blood, which correlate with active TB, rather than infection (or BCG vaccination). Ideally, such markers would discriminate between the onset of active TB (ATB), characterized by high lung burdens and pathology, and LTBI. It may be possible to retrospectively analyze samples from a large cohort of animals and identify correlates of risk of acquiring active TB. This current study represents a preliminary step in this direction. We have collected clinical data from different cohorts of animals, which did or did not exhibit clinical TB due to immune control of infection.
In our current analysis, we examine if complete blood cell counts, serum chemistry markers, cell populations, and tryptophan metabolism correlate with ATB versus LTBI. The levels of serum C-reactive protein (CRP) are known to correlate highly with pulmonary TB in macaques. Based on accumulating data in the field, we hypothesized that other peripheral blood-based markers, including both the accumulation of myeloid cells, as well as the myeloid cell expression of specific protein markers of immune dysfunction and/or inflammation, would also differentiate the onset of ATB versus LTBI. CRP is a marker for systemic inflammation that is produced by several cell types, most notably macrophages, lymphocytes, and endothelial cells. CRP is involved in several inflammatory pathways, including nitric oxide production and cytokine secretion [23]. The use of CRP to detect active TB was proposed previously, although several other inflammatory disorders were found to confound results in humans [24,25]. Here, we show data that the use of serum CRP levels can be coupled with other blood chemistry parameters, such as serum albumin-to-globulin (A/G) ratios and cell counts to significantly discriminate between Mtb infection and the onset of disease. We also found distinct differences between cell populations and tryptophan availability between ATB and LTBI primates. These results build on several observations in previous studies with humans, as well as animal models, suggesting that the timely advent of T cell recruitment correlates with control of infection, while uncontrolled infection is characterized by greater myeloid cell influx to the site of infection.

2. Results

2.1. Establishing Lung Mtb Burdens and Pathology for ATB and LTBI in NHPs

Previous studies have found that lung Mtb burden (determined by averaging the number of bacilli recovered from a large number of randomly collected samples off a grid during necropsy) and the extent of quantifiable lung pathology (scored by morphometrics also on random samples derived at necropsy), best define the outcome of experimental infections in susceptible NHP hosts [7,12,15,17,18,19,22]. We have accumulated data from macaques with either active (ATB, n = 140) or latent (LTBI, n = 85) TB infections. These NHPs were infected with Mtb within the seven-year span of 2007–2014, and endpoint lung bacterial burdens and pathology scores were assessed. The lung bacterial burden for animals with ATB ranged from 3.1 × 103–1 × 107 CFU/gm of tissue, with 4 × 105 CFU/gm being the mean bacterial burden in the lung (Figure 1A). NHPs that exhibited either LTBI or chronic asymptomatic TB, as characterized by clinical measures, had significantly lower lung burdens (Figure 1A). The burden in LTBI NHPs ranged from 1 × 100–1 × 103CFU/gm with a mean value of < 1 × 102 CFU/gm (Figure 1A). The difference in CFU counts were highly statistically significant when comparing ATB with LTBI (p = 4.484 × 10−6, Table 1) (Figure 1A). The percentage of lung area involved in pathology amongst ATB NHPs typically ranged from 5.3–69.3% with a mean of 29.2% (Figure 1B), whereas LTBI NHPs ranged from 0–5.8% with a mean of 1.8%. These differences were highly statistically significant when adjudged using a Welch’s t test (p < 0.0001, Figure 1B). Our results show that lung burden and pathology distinguish the two main outcomes of pulmonary Mtb infection; however, these two measures of disease require extensive sampling of the lung tissue that is generally only possible post-mortem.

2.2. Serum CRP Levels Compared between ATB and LTBI

We observed that the elevation of serum CRP levels and serum A/G ratios in macaques with Mtb infection corresponded with either lung bacterial burdens or pulmonary pathology. Serum CRP levels serve as excellent markers of inflammation. In previous studies with both rhesus and cynomolgus macaques experimentally infected with Mtb, CRP has served as a specific measure to identify correlates of TB disease progression [6,7,8,9,11,12,17,21,22,26,27,28,29]. Some reports suggest that high CRP levels correlate with TB in human patients, but due to a variety of confounding factors, serum CRP levels are insufficient by themselves as biomarker of human disease. We found that CRP-peak levels were significantly different when comparing ATB with LTBI (p = 2.30 × 10−29, Table 1). Whereas previous studies have always found a significant difference between ATB and LTBI CRP levels, the degree of difference between the CRP values alone is not deterministic of disease progression.
We observed a significant elevation of endpoint serum CRP levels in animals with active TB (n = 134, Figure 2A). In contrast, the levels of endpoint serum CRP remained at or very close to baseline, in animals with LTBI (n = 80, Figure 2A). The difference between pre-infection serum CRP levels and ATB endpoint levels was highly statistically significant when compared (p ≤ 0.0001). In contrast, the difference between pre-infection values and the endpoint values of animals with LTBI was not significant (p = 0.859) (Figure 2A). Highly significant differences were observed between the endpoint serum CRP values of ATB and LTBI animals (p = 6.88 × 10−27, Table 1, Figure 2A). The levels of peak CRP, regardless of whether they occurred at the endpoint or earlier, were higher in animals which were euthanized due to ATB, relative to animals that developed LTBI (Supplementary Material Figure S1). These results expand on our previously published observations, that serum CRP levels remained at baseline during LTBI in macaques [7]. Following these initial results, we sought to understand if serum CRP levels statistically significantly correlated with disease parameters, such as lung bacterial burden.
We utilized Pearson’s r coefficient analysis to determine significant correlates of bacterial burden (Table 2 and Table 3). Coefficient analysis was also performed on base 10 log of CFU/gm. Calculating the log10(CFU/gm) acted as a form of normalization for easier comparison between CFU/gm values and the measured correlates of disease which had values that were much smaller in magnitude than CFU/gm. CRP peak and endpoint measurements recorded a statistically significant moderate positive correlation to both CFU/gm and CFUlog10 counts for LTBI and ATB cohorts; due to this we looked closer at CRP correlations to other metrics of disease (Table 2 and Table 3). We found that for the ATB group, CRP values correlated negatively to A/G ratio (bottom, endpoint) and lymphocyte percentages (bottom, peak, endpoint); in contrast LTBI and CRP correlated positively to lymphocyte percentages at bottom, peak, and endpoint (Supplementary Data File). For both ATB and LTBI, CRP correlated positively to monocyte and neutrophil percentages. The strength of LTBI and CRP correlations was much weaker than that of ATB, with LTBI having fewer correlations throughout when compared with ATB (Supplementary Data File).

2.3. Serum Albumin-to-Globulin (A/G) Ratios Compared between ATB and LTBI

Previous studies have suggested that serum A/G ratio correlates with the development of ATB, but similarly to CRP, it is a non-specific marker of inflammation, and other confounding factors could interfere [30]. A/G ratios were calculated from serum albumin and globulin levels taken prior to infection and necropsy. A significant reduction in A/G ratio, driven by higher serum globulin levels, was observed in animals with active TB (Figure 2B). A/G ratios for macaques with LTBI were only marginally reduced. The differences in endpoint A/G ratios for the ATB and the LTBI groups were statistically significant (p = 3.43 × 10−36, Table 1, Figure 2B). The A/G ratios for animals with ATB ranged from 0.3–1.6 with mean values of 0.64, whereas the corresponding ratios for animals with LTBI were between 0.7–2.0 with mean values 1.4. The mean ratio for naive animals was 1.56 (range 0.6–2.3). The reduction in A/G ratio during ATB was highly statistically significant relative to pre-infection values (p < 0.0001). The endpoint A/G levels for animals with LTBI were themselves statistically significant in that they were different from the baseline (pre-infection) samples (p < 0.01). This finding allows us to differentiate LTBI from naïve or healthy individuals; however, this can also be triggered by mild inflammations and other opportunistic infections, and therefore, an antigen specific test is necessary for confirmation. We also observed a statistically significant difference between ATB and LTBI for A/G ratios at peak and bottom concentrations (p = 0.001, 5.43 × 10−28, Table 1). Given the significant differences found between disease conditions, A/G ratios, and CRP levels, we hypothesized that a correlation between the lung specific data from Mtb infection and clinical data that can be obtained from blood samples would better differentiate between active and latent infection. We found that A/G ratio bottom and endpoint values negatively correlated to CFU/gm and (CFU/gm)log10 for LTBI but only showed significant correlation in ATB group when correlated to (CFU/gm)log10 (Table 2 and Table 3). Based on these results we performed regression analysis to determine the predictive capabilities of our most relevant correlates.
Linear regression analysis was performed using a combined dataset of LTBI and ATB. We found that log10(CFU/gm) as our dependent variable was a relatively more accurate predictor of disease outcome when compared with CFU/gm. The poor predictive power of CFU/gm was seen due to the small magnitude of independent variable values coupled with the larger magnitude values from CFU/gm, which was the dependent variable; therefore, the log10(CFU/gm) was utilized. We found the A/G ratios and CRP levels taken at endpoint are moderately able to predict log10(CFU/gm) with an R-squared value of 0.69 (Figure 3). The addition of endpoint monocyte, lymphocyte, and/or neutrophil counts as dependent variables increased the predictive power from a range of R-squared 0.69 ± 0.0059. The minimum and most predictive independent variables needed to predict disease outcome was determined to be the A/G ratios and CRP levels. These results further support our initial observations, that A/G ratio and CRP values can predict host disease state.

2.4. Myeloid and Lymphoid Cell Counts Compared between ATB and LTBI

Myeloid cells, such as monocytes and neutrophils, act as both sites of replication for the Mtb bacilli and are responsible for the release of CRP and changes in A/G ratio. Lymphocytes are thought to be a strong correlate of protection from Mtb infection and are essential for clearance [31]. Given the important role of each cell type in the immune response to Mtb infection, we studied monocytes, neutrophils, and lymphocytes accumulating in the peripheral blood as a percentage of all blood cells, in the animals with the two disparate clinical outcomes (Figure 4, Supplementary Figure S2).
Lymphocytes. We observed distinct differences in lymphocyte percentages between pre-infection and ATB samples as well as between ATB and LTBI. The percentage of lymphocytes in the peripheral blood of uninfected animals ranged from 13.8–78.0%, with a mean value of 40%, whereas animals at endpoint with ATB exhibited values ranged from 6.0–47.3% with a mean of 20%, and LTBI values ranged from 8.3–66.8% (range) with a mean of 34.5%. The differences between lymphocyte percentage at pre-infection and at LTBI endpoint were only marginally significant (p = 0.01), but the differences between pre-infection and ATB were found to be far more significant (p = 0.0001, Figure 4, Supplementary Figure S2). The bottom and endpoint lymphocyte percentages in animals with ATB were very significantly different from LTBI (p = 2.44 × 10−07, 2.40 × 10−15, Figure 4, Table 1). We found that the percentage of lymphocytes in the blood of macaques trended towards lower percentages for ATB animals when compared with pre-infection, whereas LTBI stayed roughly the same when compared with pre-infection (Figure 4, Supplementary Figure S2). Correlation analysis revealed that lymphocyte bottom and endpoint percentages positively correlated with CFU/gm, and (CFU/gm)log10 counts for LTBI and ATB NHPs, though the significance and correlation were marginal (p < 0.01, Table 2 and Table 3).
Monocytes. The percentage of monocytes present in blood prior to infection ranged from 1.5–10.2%, with a mean value of 4.3% (Figure 4, Supplementary Figure S2). Overall monocyte values for both disease states maintained a similar trend; ATB had a range of 0.1–22% and a mean of 6.21%, whereas LTBI had a range of 1.8–11.2% and a mean of 5% (Figure 4). The differences between pre-infection and the ATB values were marginally significant (p = 0.02); however, the differences between pre-infection and LTBI (p = 0.11) were not significant. For both bottom and endpoint values, ATB and LTBI were statistically significantly different (p = 0.045, 0.001, Figure 4, Table 1). Overall, our results show that no significant changes in monocyte levels occur when comparing pre-infection to LTBI, in contrast ATB experiences a marginal increase in the percentage of monocytes. Further analysis showed that monocyte peak and endpoint counts positively correlated to CFU/gm counts for the LTBI group only, and correlation was lost when transformed into base 10 logarithm, referred to as (CFU/gm)log10 (Table 2 and Table 3).
Neutrophils. Similar to lymphocytes, neutrophil percentages in the peripheral blood display a distinct trend in ATB primate group. The mean pre-infection value for neutrophils was 52.2%, with a range of 14.7-83%. During ATB infection, the endpoint mean for animals increased to 72% with a range of 40.3–91%; this increase was highly statistically significant from pre-infection (p < 0.0001, Figure 4, Supplementary Figure S2). The mean endpoint value for animals with LTBI was 56.3%, with a range of 23.6–88.5%. The percentage of neutrophils at the LTBI endpoint was marginally different when compared with pre-infection (p = 0.012). When comparing LTBI and ATB at endpoint and peak, we found significant differences between the two groups (p = 2.03 × 10−14, 3.38 × 10−06, Figure 3, Supplementary Figures S2 and S3, Table 1). Our results show that ATB was characterized by significantly higher percentages of neutrophilia in the peripheral blood as compared with LTBI (Figure 4). On the contrary, the percentages of lymphocytes were significantly lower in the ATB, relative to the LTBI group. in conjunction with lower lymphocyte percentage (Figure 4). Similar to monocyte correlations, neutrophil peak and endpoint percentages had a positive correlation with CFU/gm for ATB only (Table 2 and Table 3). Overall, we found the LTBI cell population correlations to be more tenuous when compared with the strength of the ATB correlations, with LTBI correlations having less statistical significance and frequency.
Through our examination of our correlation matrix, we identified strong correlations between pre-infection and post-infection values for A/G ratio and lymphocyte percentages in both ATB and LTBI groups (Supplementary Data File). Having observed this relationship, we applied a univariate linear regression to determine if pre-infection was deterministic of post-infection. Though all combinations were analyzed, we found that pre-infection most accurately predicted peak values for A/G ratio (R2 = 0.40, Figure 5A) and lymphocyte percentage (R2 = 0.67, Figure 5B), although these correlations are of moderate strength at best. For monocyte (R2 = 0.41) and neutrophil (R2 = 0.55) percentages, pre-infection best predicted bottom values, though the power of the regression was significantly weaker than that of the lymphocyte regression.
Cell ratios. Ratios of monocytes-to-lymphocytes (M/L) and neutrophils-to-lymphocytes (N/L) were compared between active and latent infections. Ratios were calculated using cell identifiers (bottom, peak, endpoint) for both the numerator and denominator of the ratio; for instance, the M/L peak was calculated by dividing monocyte peak value by lymphocyte peak value. Presenting the ratios in this manner allows us to emphasize the maximal magnitude of monocyte and neutrophil influxes, as compared with lymphocytes, as well as overcome the difference in sample timings across such a large sample size. Cell ratios are often used as a metric for determining the severity of infection from peripheral blood and the risk of disease progression in latent TB cases [32,33,34]. We found that for both M/L and N/L ratios, ATB and LTBI were significantly different at peak, bottom, and endpoint measures (Figure 6). M/L and N/L ratios were significantly higher in ATB than LTBI for all measures except pre-infection. Although LTBI ratios remained consistently the same from pre-infection to endpoint, ATB ratios fluctuated upwards from pre-infection to endpoint (Figure 6). This increase in M/L and N/L ratio values found in ATB, but not LTBI, is due to high lymphocyte percentages and low monocyte and neutrophil percentages in LTBI when compared with ATB (Figure 6). This data agrees with previous findings and supports claims that M/L and N/L ratios can be versatile tools for diagnosis or treatment [35,36].
Kynurenine and Tryptophan Ratios. Having established that the levels of myeloid cells (monocytes as well as lymphocytes) are increased in the peripheral blood as a function of active disease, we next studied the expression of known markers of myeloid cell immune suppression in the peripheral blood on a subset of each group, LTBI (n = 29) and ATB (n = 29). We found that kynurenine-to-tryptophan ratios were a strong determinant of active TB infection (Figure 7). Previous studies have found that K/T ratio increased in a bacterial burden–dependent manner, due to increased production and availability of IDO (indoleamine 2,3-dioxygenase) [26,37]. IDO is an enzyme that catabolizes tryptophan to kynurenine, and this enzyme is primarily expressed by professional antigen presenting cells [38]. The host initially increases IDO in effort to starve the tubercule bacillus of tryptophan, an essential amino acid for the bacillus, but Mtb is capable of synthesizing its own tryptophan when under stress [39,40]. Our study found that the levels of tryptophan in ATB host’s plasma was significantly lower than that of LTBI, but that there was not a cognate, significant difference in kynurenine availability between the two groups (Figure 7, Table 1). As a result, K/T ratios were significantly higher for ATB relative to LTBI samples (Figure 7C, Table 1). These results confirm our earlier finding that during active TB infection, there are increased amounts of IDO present in the periphery. To further quantify the relationship between bacterial burden and K/T ratio we performed correlation analysis. We found that K/T ratios were significantly positively correlated to CFU/gm for both ATB and LTBI (Table 2 and Table 3). ATB was observed to have moderate positive correlations to (CFU/gm)log10 for both kynurenine and K/T ratio, whereas LTBI had positive correlations to CFU/gm and log10CFU/g for K/T ratios only (Table 2 and Table 3, Figure 7). The absence of a significant correlation between tryptophan and bacterial load indicates that the likely driving force behind the correlation between K/T ratio and host disease state is the rate-limiting enzyme in the tryptophan catabolism pathway—IDO. It appears, based on these results, that the correlative relationship between IDO and bacterial load is further strengthened as the bacterial load increases, as evidenced by a lack of correlation between kynurenine and LTBI bacterial load, and as a correlation kynurenine is present in ATB. Based on this analysis and other similar works, IDO inhibitors are currently being investigated as possible host directed therapies for TB [26].
Myeloid Population. Given the strength of the differences within the myeloid population seen in our data (Figure 3 and Figure 6, Supplementary Figure S2), we decided to perform flow cytometry on a representative subset of animals, ATB (n=6) and LTBI (n=5). Lung tissue, bronchoalveolar lavage cells, and peripheral blood were processed to single-cell suspension and analyzed using flow cytometry. Flow cytometry analysis was conducted by gating first on live leukocytes using the Live/Dead stain and CD45, then lymphocytes were gated out by using CD3 and CD20 lineage markers. The remaining cells were gated on HLA-DR+ subset for the selection of myeloid subsets: CD163+ 206- interstitial macrophages (IM) and CD163+ 206+ alveolar (AM) macrophages, CD163- CD123+ plasmacytoid (pDC), and CD163- CD11C classical (cDC) dendritic cells. In PBMCs, the HLA-DR+ subset was gated on CD14 and CD16 to identify CD16+ non-classical (non-cMo), CD14+ classical (cMo), and CD14+CD16+ inflammatory (iMo) monocytes, followed by CD123+ (pDC) and CD11C+ gating on the double negative CD14-CD16- subset. We found distinct myeloid populations in lung tissue, BAL, and the periphery (Figure 8, Supplementary Figures S3 and S4). Similar to our previously published findings, significant remodeling of myeloid populations was observed between ATB and LTBI animals [41]. In both lung tissue and BAL cells, in the case of all except BAL AM (alveolar macrophages), ATB cell percentages significantly exceed that of LTBI (Figure 8A, Table 4). The majority of cells in lung tissue were AMs and cDCs (conventional dendritic cells), with a range of 18.1–28.8%, 19.0–28.3% for ATB, and 5.71–13.90, 4.97–14.3% for LTBI, respectively. In BAL cells, the population was predominantly IM (interstitial macrophages) and cDC for ATB, and AM and cDC for LTBI (Figure 8B). Similar to lung tissue, IM and cDC percentages in ATB BAL significantly exceeds that of LTBI. In BAL, IM cells range from 2.21–9.77% in LTBI and 11.1–22.9 in ATB. cDC cells range from 9.5–18.9% in LTBI and 26–49.3% in ATB. In BAL, AM cells range from 82.4–95.6% in LTBI and 54.1–72.7% in ATB. We found that the PBMC population was majority cMo (classical monocytes) and cDC (Figure 8C). In LTBI animals, cMo and cDC cells ranged from 41.9–65.40% and 42.70–54.10%, respectively. Although ATB animals saw a significant increase in average cMo, and a lower average cDC in PBMCs which ranged from 72.40–85.30% and 28.10-67.00%, respectively (Figure 8C, Table 4), the increase in periphery cMo is significantly positively correlated to increasing iMo in ATB; however, in LTBI, cMo is significantly negatively correlated to non-cMo (Supplementary Data File). This indicates a change in relationship between cell populations based on infection state.
All PBMC and myeloid subpopulations were significantly different with the exclusion of cDC, in which Welch’s t test results were skewed slightly by a single outlier due to a smaller group size (Table 4). There was a distinct shift in magnitude of cell populations when comparing ATB with LTBI, and when comparing the relationship between cell types within each condition, as seen in the shift in BAL cells between AM and IM. Overall, we observed an acute change in peripheral and lung cell profile, with an observed influx of myeloid cells to the alveolar space from the periphery. Based on these results, further correlation analysis was performed, which showed that LTBI lung alveolar macrophages (Lung.AM) were strongly negatively correlated to (CFU/gm)log10 (Table 3, Figure 8A). This is in contrast to visual interpretations which show ATB primates, which carry a much higher bacterial load than LTBI, having increased amounts of AMs in comparison to LTBI. This unique correlation between alveolar macrophages is quite significant and has a strong negative correlation coefficient (Table 3, Figure 8A). Lung alveolar cells also had a negative correlation to K/T ratio for ATB animals but not LTBI (p = 0.012, Pearson’s r = −0.91, Supplementary Data File). Given our sample size we will need to further explore the implications of these relationships in the future.

3. Methods

3.1. Study Design

To establish a reference peripheral biomarker profile of ATB vs LTBI in the RM model of TB we performed a retrospective observational analysis based on a larger cohort of Indian-origin rhesus macaques (Macaca mulatta) that were experimentally infected with Mtb by our group either CDC1551 (n = 207), Erdman (n = 12), or H37Rv (n = 6) strains during 2007–2014. Peripheral biomarkers originating from serum biochemistry and complete blood count were correlated with lung pathogenic burden and pathology to draw correlations which were then validated using cryopreserved samples.

3.2. Data Acquisition

Clinical data stored in the Animal Records System (ARS) at the Tulane National Primate Research Center (TNPRC) was utilized for this study. This data was specific to animals assigned to the various projects in either the Kaushal or the Mehra labs. Animals were chosen if they were experimentally infected with Mtb (either CDC1551, Erdman or H37Rv strains). Animals had been infected with Mtb as if they were specific pathogen-free and mycobacteria-naïve. These infections occurred between the years of 2007–2014. We have excluded data from animals coinfected or treated for disease. Methods for quantification of lung bacterial burdens (CFU/gm) and pathology have been described earlier [4,5,6,7,8,9]. Bacterial burden and immunologic response were determinants for classification to either active (ATB, n = 140) or latent (LTBI, n = 85) infected groups. Animals with consecutively (three weeks) higher than normal serum CRP levels, higher than a score of 1 on chest X-rays, or the presence of viable Mtb bacilli in BAL were deemed to have ATB. Animals were deemed to have LTBI if they tested positive for tuberculin skin after experimental Mtb infection without radiological and microbiological evidence of TB. Through the use of serum chemistry, serum CRP levels and A/G ratios were obtained, using a Beckman Coulter AU 480 fully automated chemistry analyzer. Blood cell levels for monocytes, lymphocytes, and neutrophils were also quantified as percentages of complete blood cell counts (EDTA blood) from the animals at that time-point. For validation, cryopreserved samples were used to enumerate cell fractions by flow cytometry and estimate Kynurenine and Tryptophan (K/T) ratio in plasma, methods for which are described in detail in previous publications [4,5,6,7,8,9]. Post-infection minimal and maximal values observed throughout the experiment until necropsy were denoted as bottom and peak, respectively, and used throughout the data processing.

3.3. Kynurenine and Tryptophan Ratios in Plasma

A subset of NHPs from both ATB (n = 29) and LTBI(n = 29) groups were selected to evaluate the enzymatic activity of indoleamine 2,3-dioxygenase (IDO) in plasma through the observation of its substrate and product. We used a kynurenine and tryptophan ELISA kit (Immusmol, ISE-2227). The lower range of sensitivity of detection for kynurenine and tryptophan were between <47.5 ng/mL and <2.5 μg/mL, respectively, and K/T ratios calculated.

3.4. Flow Cytometry

Flow cytometry was performed on lung tissue, whole-blood, and BAL (bronchoalveolar lavage) cell samples obtained from a subset of 11 animals, using methods previously described in earlier publications [6,9]. For myeloid phenotyping, the following antibodies were used: Live/Dead FVS440, CD45 BUV396 (D0581283), HLA-DR APC-Cy7(L243), CD3 Alexa fluor (SP34-2), CD206 BV421(19.2), CD163 PE(GHI/61), CD123 PerCP-Cv5-5(7G3), CD11c BV711(3.9), CD16 (BV480), and CD14 APC (M5E2). All were purchased from BD Biosciences (San Jose, CA, USA). Flow cytometry analysis was conducted by gating first on live leukocytes using Live/Dead stain and CD45, then lymphocytes were gated out by using CD3 and CD20 lineage markers. The remaining cells were gated on HLA-DR+ subset for the selection of myeloid subsets: CD163+ 206- interstitial macrophages (IM) and CD163+ 206+ alveolar (AM) macrophages, CD163- CD123+ plasmacytoid (pDC), and CD163- CD11C classical (cDC) dendritic cells. In PBMCs, HLA-DR+ subset was gated on CD14 and CD16 to identify CD16+ non-classical (non-cMo), CD14+ classical (cMo), and CD14+CD16+ inflammatory (iMo) monocytes, followed by CD123+ (pDC) and CD11C+ gating on a double negative CD14-CD16- subset.

3.5. Difference Analysis

Welch’s t tests and ordinary one-way ANOVA were performed to compare ATB (n = 140) and LTBI (n = 85) datasets. T-tests were run on CFU/gm and (CFU/gm)log10 counts obtained from lung at endpoint as well as on CRP values. A/G ratio, Lymphocyte, Monocyte, and Neutrophil percentages at pre-infection, peak, bottom, and endpoint were compared between ATB and LTBI. Pre-infection sampling was conducted one or two weeks prior to experimental Mtb infection and are indicative of healthy TB naïve animals. The endpoint was governed by experimental protocol unless the clinical state of the NHP required humane euthanasia based on pre-specified endpoint criteria that were evaluated and decided by one or more board-certified veterinary clinicians. Peak and bottom levels were based on obtained longitudinal data. Welch’s t tests were performed using R with RStudio interface and ordinary one-way ANOVA using GraphPad Prism 8. The Shapiro–Wilk test was performed to ascertain the normality of the data.

3.6. Correlation

Pearson correlation analysis was performed using R programming language with RStudio as interface. Post and pre-infection, LTBI and ATB datasets were analyzed. To fully demonstrate quantifiable differences between ATB and LTBI disease states, analysis was performed within either the LTBI or ATB dataset, not on an aggregate dataset. We observed distinct correlative patterns that were present regardless of level of bacterial burden and correlative patterns isolated to individual disease states.

3.7. Linear Regression

Using R and the Excel extension StatPlus we performed linear regression analysis of our data with the purpose of determining which biomarkers would best predict the outcome of disease. We utilized an aggregate dataset of both LTBI and ATB, unlike correlation analysis which were performed on separated LTBI and ATB datasets. For this analysis, it was important that a single regression predict bacterial burden regardless of disease classification. Statistically significant correlations were used to direct which independent variables were best suited to generate CFU/gm predictive linear regressions. Multilinear and univariate linear regressions were applied utilizing all metrics as independent variables with an emphasis on R-squared as the deterministic factor.

4. Discussion

Previous human studies have found that C-reactive protein [42,43,44], and A/G ratio [45] are differentially expressed in ATB patients when compared with LTB. Our current results, obtained using the human-like NHP model of TB, support these earlier findings. This is unsurprising given that we have previously demonstrated a relationship between serum CRP levels and TB progression in NHPs’ progression [6,7,8,9,11,12,17,21,22,26,27,28,29]. LTBI values for both CRP and A/G ratios remained at similar levels to that of pre-infection, whereas in animals with ATB, there were elevated levels of serum CRP and a lowered A/G ratio when compared with LTBI. Previous studies have found that in active TB disease cases in human beings, albumin levels decrease whereas globulin levels increase, leading to low A/G ratios [43]. We also observed a higher K/T ratio in ATB than in LTBI. This last aspect is particularly interesting. We have previously shown [26] that IDO expression is induced in macrophages of both rodent and primate origin immediately after Mtb infection. IDO is chiefly catabolic in function and leads to the generation of kynurenine. Tryptophan is an essential amino acid for most pathogens, and therefore, the immune mechanism to induce IDO and starve the pathogen of such an essential nutrient is successful [46]. In the case of Mtb, however, Zhang et al. have shown that this remarkable pathogen is able to anabolize its own tryptophan [40]. Furthermore, we have shown that the tryptophan biosynthetic machinery is induced in NHP TB granulomas, indicating that tryptophan is produced by intra-granulomatous Mtb [21]. For this reason, the immune strategy to starve Mtb of tryptophan is unsuccessful. Additionally, tryptophan is required for the rapid proliferation of T cell responses, and the high IDO expression precludes this, as shown in Gautam et al. IDO is transcriptionally regulated by both Type I (α, β) and Type III (γ) interferons in a context dependent manner [47]. Both types of interferon signaling pathways are induced by Mtb infection, likely leading to the induction of IDO (and a high K/T ratio in ATB) during Mtb infection. Our earlier work first identified that IDO was intensely expressed in the TB granuloma [13,20,26]. More recently, we have conclusively shown that the majority of IDO mRNA expression in the host granuloma occurs on interstitial, inflammatory, IFN-responsive macrophages that are recruited to the lung post-infection [41] The majority of these cells are present in the inner myeloid ring of the lesion. More recently, our investigations into the role of Myeloid-derived Suppressor Cells (MDSCs) during experimental Mtb infections in macaques has revealed that IDO is also expressed in these cells at the granuloma periphery, although the majority of IDO expression occurs on interstitial macrophages. Studies from human samples from TB patients and household contacts also show the recruitment of MDSCs to the lungs [48,49,50]. Clearly, spatial expression of IDO in the various regions of the granuloma is an important event that promotes Mtb persistence. These results are now supported by high-dimension, multiplexed imaging studies of human granulomas, which are characterized by high levels of expression of two immunoregulatory proteins IDO and PD-LI [51]
Serum CRP levels, A/G ratios, and K/T ratios are influenced heavily by the recruitment of myeloid cells. Our results may also indicate massive neutrophil accumulation in the periphery and myeloid cellular influx from periphery to lungs in animals with ATB, relative to LTBI. It has recently been shown using single cell technologies, that myeloid cells recruited to the lung may promote inflammatory, interferon (IFN) responses [41]. In conjunction, K/T ratios have been shown to cause increased T regulatory cells and decreased T effector memory cells which may impair host response during active infection [52]. More recently, we have shown in the NHP model of Mtb/SIV co-infection, that myeloid cell turnover is directly correlated with uncontrolled immune activation and reactivation of TB [28,53,54]. A recent multiplexed imaging study also indicates that expression of IDO on myeloid cells is a key feature of human TB granulomas [51]. Taken together, our results could suggest that myeloid mediated inflammation may be a key event in active TB that could be further leveraged to develop human-specific TB biomarkers. If validated in a human clinical setting, these results may have the potential to simplify detection of TB disease, thus providing rapid access to the patients that need it the most. These results could also be applied to future NHP studies as a non-invasive way to monitor host disease status.
Macaques with LTBI exhibited a higher percentage of lymphocytes, a lower percentage of neutrophils, and a slightly lower percentage of monocytes in the blood. We found that a higher bacterial burden, as experienced by NHPs with ATB, resulted in a greater influence over host response. This was evident in ATB correlations, which were more frequent, as well as significant, when compared with LTBI correlations. Through our exploration of this correlative pattern, we were able to generate two linear regressions in which pre-infection values were able to predict post-infection values (A/G ratio, lymphocyte percentages). The predictive capabilities of pre-infection disposition will require more exploration in the future with a larger dataset, but it is a very interesting finding nonetheless. Our lower powered regressions, which predicted bacterial load through the use of total BAL cells, total PBMCs, and BAL cDCs, indicated a possible strong relationship that will need a larger sample size to explore more thoroughly. CRP values and A/G ratios have been used as an indicator of infection and inflammation. Utilizing multilinear regression guided by correlation, we were able to use CRP and A/G ratio values and predict bacterial burden. Due to the similarity between pre-infection and LTBI values, an accurate distinction between the two host states is difficult and may require additional or different biomarkers. Though the distinction between LTBI and pre-infection was imprecise, the differences between LTBI and ATB were clearer and could be characterized through multilinear regression. This regression may be expanded in the future with the potential addition of larger datasets and different biomarkers, as well as its application for new and foreign datasets as a predictive formula.
Overall, we observed correlational changes in cell percentage, CRP, A/G ratio, and K/T ratio. We have characterized cell subsets of the periphery and the lung, and highlighted those differences found between ATB and LTBI. These results may allow for the development of a unique pattern of correlates, which could accurately predict the host disease state between ATB and LTBI. These correlations may have strong potential application for both future NHP and human clinical studies. One potential limitation of our study is that most of the differences that we documented mark the acute form of the disease, which has other manifestations that can be clinically measured; however, growing evidence suggests that Mtb infection is not only characterized by two extremes of LTBI and ATB, but that it represents a spectrum. As such, identification of preliminary pathways and segments of the immune system, which can be used to differentiate such specific outcomes of infection, is important. NHP models can play an important role in this since they recapitulate many aspects of the human TB syndrome.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/pathogens11050544/s1, Figure S1: CRP values at Pre-Infection, Peak, and Endpoint; Figure S2: Pre-infection and Endpoint Cell Percentages; Figure S3: Flow cytometry gating strategy for PBMCs; Figure S4: Flow cytometry gating strategy for BAL and Lung tissue cells. Also included is the Supplementary Data File, an .xlsx file that contains all correlations performed.

Author Contributions

Conceptualization: Methodology: S.M., D.K.S. and M.G.; Investigation: M.G., D.K.S., C.M., D.K., N.A.G. and S.M.; Validation and formal analysis: M.G., D.K.S., C.M. and T.N.; Data curation: M.G. and T.N.; Writing original draft preparation: S.M. and D.K.; Writing review and editing: M.G., D.K.S., D.K. and S.M.; Project administration: N.A.G., D.K. and S.M.; Funding: D.K. and S.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by NIH awards to S.M. (AI127160, AI127222 and AI128130) and D.K. (AI089323, HL106790, AI111914, AI111943, AI123047, AI134240) and institutional awards (OD011133 and OD011104). M.G. is supported by an NIH Diversity Supplement AI123047-S1.

Institutional Review Board Statement

The animal study protocol was reviewed at approved by the Tulane National Primate Research Center Institutional Animal Care and Use Committee and Tulane University Institutional Biosafety Committee.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is available at GPL10183.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. WHO. Global Tuberculosis Report 2021. Available online: http://www.who.int/tb/publications/global_report/en/ (accessed on 23 April 2019).
  2. Berry, M.P.R.; Graham, C.M.; McNab, F.W.; Xu, Z.; Bloch, S.A.A.; Oni, T.; Wilkinson, K.A.; Banchereau, R.; Skinner, J.; Wilkinson, R.J.; et al. An interferon-inducible neutrophil-driven blood transcriptional signature in human tuberculosis. Nature 2010, 466, 973–977. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. MacLean, E.; Broger, T.; Yerlikaya, S.; Fernandez-Carballo, B.L.; Pai, M.; Denkinger, C.M. A systematic review of biomarkers to detect active tuberculosis. Nat. Microbiol. 2019, 4, 748–758. [Google Scholar] [CrossRef] [PubMed]
  4. Kaushal, D.; Mehra, S. Faithful Experimental Models of Human Mycobacterium Tuberculosis Infection. Mycobact. Dis. Tuberc. Lepr. 2012, 2, e108. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Kaushal, D.; Mehra, S.; Didier, P.J.; Lackner, A.A. The non-human primate model of tuberculosis. J. Med. Primatol. 2012, 41, 191–201. [Google Scholar] [CrossRef] [Green Version]
  6. Mehra, S.; Foreman, T.W.; Didier, P.J.; Ahsan, M.H.; Hudock, T.A.; Kissee, R.; Golden, N.A.; Gautam, U.S.; Johnson, A.M.; Alvarez, X.; et al. The DosR Regulon Modulates Adaptive Immunity and Is Essential for Mycobacterium tuberculosis Persistence. Am. J. Respir. Crit. Care Med. 2015, 191, 1185–1196. [Google Scholar] [CrossRef] [Green Version]
  7. Mehra, S.; Golden, N.A.; Dutta, N.K.; Midkiff, C.C.; Alvarez, X.; Doyle, L.A.; Asher, M.; Russell-Lodrigue, K.; Monjure, C.; Roy, C.J.; et al. Reactivation of latent tuberculosis in rhesus macaques by coinfection with simian immunodeficiency virus. J. Med. Primatol. 2011, 40, 233–243. [Google Scholar] [CrossRef] [Green Version]
  8. Foreman, T.W.; Mehra, S.; LoBato, D.N.; Malek, A.; Alvarez, X.; Golden, N.A.; Bucşan, A.N.; Didier, P.J.; Doyle-Meyers, L.A.; Russell-Lodrigue, K.E.; et al. CD4+ T-cell–independent mechanisms suppress reactivation of latent tuberculosis in a macaque model of HIV coinfection. Proc. Natl. Acad. Sci. USA 2016, 113, E5636–E5644. [Google Scholar] [CrossRef] [Green Version]
  9. Phillips, B.L.; Mehra, S.; Ahsan, M.H.; Selman, M.; Khader, S.A.; Kaushal, D. LAG3 Expression in Active Mycobacterium tuberculosis Infections. Am. J. Pathol. 2015, 185, 820–833. [Google Scholar] [CrossRef] [Green Version]
  10. Danilchanka, O.; Pavlenok, M.; Niederweis, M. Role of Porins for Uptake of Antibiotics by Mycobacterium smegmatis. Antimicrob. Agents Chemother. 2008, 52, 3127–3134. [Google Scholar] [CrossRef] [Green Version]
  11. Kaushal, D.; Foreman, T.W.; Gautam, U.S.; Alvarez, X.; Adekambi, T.; Rangel-Moreno, J.; Golden, N.A.; Johnson, A.M.F.; Phillips, B.L.; Ahsan, M.H.; et al. Mucosal vaccination with attenuated Mycobacterium tuberculosis induces strong central memory responses and protects against tuberculosis. Nat. Commun. 2015, 6, 8533. [Google Scholar] [CrossRef] [Green Version]
  12. Luo, Q.; Mehra, S.; Golden, N.A.; Kaushal, D.; Lacey, M.R. Identification of biomarkers for tuberculosis susceptibility via integrated analysis of gene expression and longitudinal clinical data. Front. Genet. 2014, 5, 240. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Levine, D.M.; Dutta, N.K.; Eckels, J.; Scanga, C.; Stein, C.; Mehra, S.; Kaushal, D.; Karakousis, P.C.; Salamon, H. A tuberculosis ontology for host systems biology. Tuberculosis 2015, 95, 570–574. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Slight, S.R.; Rangel-Moreno, J.; Gopal, R.; Lin, Y.; Junecko, B.A.F.; Mehra, S.; Selman, M.; Becerril-Villanueva, E.; Baquera-Heredia, J.; Pavon, L.; et al. CXCR5+ T helper cells mediate protective immunity against tuberculosis. J. Clin. Investig. 2013, 123, 712–726. [Google Scholar] [CrossRef] [Green Version]
  15. Darrah, P.A.; Bolton, D.L.; Lackner, A.A.; Kaushal, D.; Aye, P.P.; Mehra, S.; Blanchard, J.L.; Didier, P.J.; Roy, C.J.; Rao, S.S.; et al. Aerosol Vaccination with AERAS-402 Elicits Robust Cellular Immune Responses in the Lungs of Rhesus Macaques but Fails To Protect against High-Dose Mycobacterium tuberculosis Challenge. J. Immunol. 2014, 193, 1799–1811. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Dutta, N.K.; McLachlan, J.; Mehra, S.; Kaushal, D. Humoral and lung immune responses to Mycobacterium tuberculosis infection in a primate model of protection. Trials Vaccinol. 2014, 3, 47–51. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Mehra, S.; Alvarez, X.; Didier, P.J.; Doyle, L.A.; Blanchard, J.L.; Lackner, A.A.; Kaushal, D. Granuloma Correlates of Protection Against Tuberculosis and Mechanisms of Immune Modulation by Mycobacterium tuberculosis. J. Infect. Dis. 2013, 207, 1115–1127. [Google Scholar] [CrossRef]
  18. Gopal, R.; Monin, L.; Torres, D.; Slight, S.; Mehra, S.; McKenna, K.C.; Fallert Junecko, B.A.; Reinhart, T.A.; Kolls, J.; Báez-Saldaña, R.; et al. S100A8/A9 Proteins Mediate Neutrophilic Inflammation and Lung Pathology during Tuberculosis. Am. J. Respir. Crit. Care Med. 2013, 188, 1137–1146. [Google Scholar] [CrossRef] [Green Version]
  19. Dutta, N.K.; Mehra, S.; Martinez, A.N.; Alvarez, X.; Renner, N.A.; Morici, L.A.; Pahar, B.; MacLean, A.G.; Lackner, A.A.; Kaushal, D. The Stress-Response Factor SigH Modulates the Interaction between Mycobacterium tuberculosis and Host Phagocytes. PLoS ONE 2012, 7, e28958. [Google Scholar] [CrossRef]
  20. Mehra, S.; Pahar, B.; Dutta, N.K.; Conerly, C.N.; Philippi-Falkenstein, K.; Alvarez, X.; Kaushal, D. Transcriptional Reprogramming in Nonhuman Primate (Rhesus Macaque) Tuberculosis Granulomas. PLoS ONE 2010, 5, e12266. [Google Scholar] [CrossRef] [Green Version]
  21. Hudock, T.A.; Foreman, T.W.; Bandyopadhyay, N.; Gautam, U.S.; Veatch, A.V.; LoBato, D.N.; Gentry, K.M.; Golden, N.A.; Cavigli, A.; Mueller, M.; et al. Hypoxia Sensing and Persistence Genes Are Expressed during the Intragranulomatous Survival of Mycobacterium tuberculosis. Am. J. Respir. Cell Mol. Biol. 2017, 56, 637–647. [Google Scholar] [CrossRef] [Green Version]
  22. Dutta, N.K.; Mehra, S.; Didier, P.J.; Roy, C.J.; Doyle, L.A.; Alvarez, X.; Ratterree, M.; Be, N.A.; Lamichhane, G.; Jain, S.K.; et al. Genetic Requirements for the Survival of Tubercle Bacilli in Primates. J. Infect. Dis. 2010, 201, 1743–1752. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Sproston, N.R.; Ashworth, J.J. Role of C-Reactive Protein at Sites of Inflammation and Infection. Front. Immunol. 2018, 9, 754. [Google Scholar] [CrossRef] [PubMed]
  24. Yoon, C.; Chaisson, L.H.; Patel, S.M.; Drain, P.K.; Wilson, D.; Cattamanchi, A. Diagnostic accuracy of C-reactive protein for active pulmonary tuberculosis: A systematic review and meta-analysis. Int. J. Tuberc. Lung Dis. Off. J. Int. Union Tuberc. Lung Dis. 2017, 21, 1013–1019. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Geluk, A.; Corstjens, P. CRP: Tell-tale biomarker or common denominator? Lancet Infect. Dis. 2017, 17, 1225–1227. [Google Scholar] [CrossRef]
  26. Gautam, U.S.; Foreman, T.W.; Bucsan, A.N.; Veatch, A.V.; Alvarez, X.; Adekambi, T.; Golden, N.A.; Gentry, K.M.; Doyle-Meyers, L.A.; Russell-Lodrigue, K.E.; et al. In Vivo inhibition of tryptophan catabolism reorganizes the tuberculoma and augments immune-mediated control of Mycobacterium tuberculosis. Proc. Natl. Acad. Sci. USA 2018, 115, E62–E71. [Google Scholar] [CrossRef] [Green Version]
  27. Foreman, T.W.; Veatch, A.V.; LoBato, D.N.; Didier, P.J.; Doyle-Meyers, L.A.; Russell-Lodrigue, K.E.; Lackner, A.A.; Kousoulas, K.G.; Khader, S.A.; Kaushal, D.; et al. Nonpathologic Infection of Macaques by an Attenuated Mycobacterial Vaccine Is not Reactivated in the Setting of HIV Co-Infection. Am. J. Pathol. 2017, 187, 2811–2820. [Google Scholar] [CrossRef] [Green Version]
  28. Kuroda, M.J.; Sugimoto, C.; Cai, Y.; Merino, K.M.; Mehra, S.; Araínga, M.; Roy, C.J.; Midkiff, C.C.; Alvarez, X.; Didier, E.S.; et al. High Turnover of Tissue Macrophages Contributes to Tuberculosis Reactivation in Simian Immunodeficiency Virus-Infected Rhesus Macaques. J. Infect. Dis. 2018, 217, 1865–1874. [Google Scholar] [CrossRef]
  29. Mehra, S.; Golden, N.A.; Stuckey, K.; Didier, P.J.; Doyle, L.A.; Russell-Lodrigue, K.E.; Sugimoto, C.; Hasegawa, A.; Sivasubramani, S.K.; Roy, C.J.; et al. The Mycobacterium tuberculosis stress response factor SigH is required for bacterial burden as well as immunopathology in primate lungs. J. Infect. Dis. 2012, 205, 1203–1213. [Google Scholar] [CrossRef]
  30. Wang, C.; Wei, L.-L.; Shi, L.-Y.; Pan, Z.-F.; Yu, X.-M.; Li, T.-Y.; Liu, C.M.; Ping, Z.P.; Jiang, T.T.; Chen, Z.L.; et al. Screening and identification of five serum proteins as novel potential biomarkers for cured pulmonary tuberculosis. Sci. Rep. 2015, 5, 15615. [Google Scholar] [CrossRef] [Green Version]
  31. Saunders, B.M.; Frank, A.A.; Orme, I.M.; Cooper, A.M. CD4 is required for the development of a protective granulomatous response to pulmonary tuberculosis. Cell. Immunol. 2002, 216, 65–72. [Google Scholar] [CrossRef]
  32. Naranbhai, V.; Hill, A.V.S.; Abdool Karim, S.S.; Naidoo, K.; Abdool Karim, Q.; Warimwe, G.M.; McShane, H.; Fletcher, H. Ratio of Monocytes to Lymphocytes in Peripheral Blood Identifies Adults at Risk of Incident Tuberculosis Among HIV-Infected Adults Initiating Antiretroviral Therapy. J. Infect. Dis. 2014, 209, 500–509. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Wang, J.; Yin, Y.; Wang, X.; Pei, H.; Kuai, S.; Gu, L.; Xing, H.; Zhang, Y.; Huang, Q.; Guan, B. Ratio of monocytes to lymphocytes in peripheral blood in patients diagnosed with active tuberculosis. Braz. J. Infect. Dis. 2015, 19, 125–131. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Miyahara, R.; Piyaworawong, S.; Naranbhai, V.; Prachamat, P.; Kriengwatanapong, P.; Tsuchiya, N.; Wongyai, J.; Bupachat, S.; Yamada, N.; Summanapan, S.; et al. Predicting the risk of pulmonary tuberculosis based on the neutrophil-to-lymphocyte ratio at TB screening in HIV-infected individuals. BMC Infect. Dis. 2019, 19, 667. [Google Scholar] [CrossRef] [PubMed]
  35. Mayito, J.; Meya, D.B.; Rhein, J.; Sekaggya-Wiltshire, C. Utility of the monocyte to lymphocyte ratio in diagnosing latent tuberculosis among HIV-infected individuals with a negative tuberculosis symptom screen. PLoS ONE 2020, 15, e0241786. [Google Scholar] [CrossRef]
  36. Rakotosamimanana, N.; Richard, V.; Raharimanga, V.; Gicquel, B.; Doherty, T.M.; Zumla, A.; Razanamparany, V.R. Biomarkers for risk of developing active tuberculosis in contacts of TB patients: A prospective cohort study. Eur. Respir. J. 2015, 46, 1095–1103. [Google Scholar] [CrossRef]
  37. Collins, J.M.; Siddiqa, A.; Jones, D.P.; Liu, K.; Kempker, R.R.; Nizam, A.; Shah, N.S.; Ismail, N.; Ouma, S.G.; Tukvadze, N.; et al. Tryptophan catabolism reflects disease activity in human tuberculosis. JCI Insight 2020, 5, e137131. [Google Scholar] [CrossRef]
  38. Wu, H.; Gong, J.; Liu, Y. Indoleamine 2, 3-dioxygenase regulation of immune response (Review). Mol. Med. Rep. 2018, 17, 4867–4873. [Google Scholar] [CrossRef] [Green Version]
  39. Thomas, S.M.; Garrity, L.F.; Brandt, C.R.; Schobert, C.S.; Feng, G.S.; Taylor, M.W.; Carlin, J.M.; Byrne, G.I. IFN-gamma-mediated antimicrobial response. Indoleamine 2,3-dioxygenase-deficient mutant host cells no longer inhibit intracellular Chlamydia spp. or Toxoplasma growth. J. Immunol. 1993, 150, 5529–5534. [Google Scholar]
  40. Zhang, Y.J.; Reddy, M.C.; Ioerger, T.R.; Rothchild, A.C.; Dartois, V.; Schuster, B.M.; Trauner, A.; Wallis, D.; Galaviz, S.; Huttenhower, C.; et al. Tryptophan biosynthesis protects mycobacteria from CD4 T cell-mediated killing. Cell 2013, 155, 1296–1308. [Google Scholar] [CrossRef] [Green Version]
  41. Esaulova, E.; Das, S.; Singh, D.K.; Choreño-Parra, J.A.; Swain, A.; Arthur, L.; Rangel-Moreno, J.; Ahmed, M.; Singh, B.; Gupta, A.; et al. The immune landscape in tuberculosis reveals populations linked to disease and latency. Cell Host Microbe 2021, 29, 165–178.e8. [Google Scholar] [CrossRef]
  42. Adu-Gyamfi, C.G.; Snyman, T.; Makhathini, L.; Otwombe, K.; Darboe, F.; Penn-Nicholson, A.; Fisher, M.; Savulescu, D.; Hoffmann, C.; Chaisson, R.; et al. Diagnostic accuracy of plasma kynurenine/tryptophan ratio, measured by enzyme-linked immunosorbent assay, for pulmonary tuberculosis. Int. J. Infect. Dis. 2020, 99, 441–448. [Google Scholar] [CrossRef] [PubMed]
  43. Delemarre, E.M.; van Hoorn, L.; Bossink, A.W.; Drylewicz, J.; Joosten, S.A.; Ottenhoff, T.H.; Akkerman, O.W.; Goletti, D.; Petruccioli, E.; Navarra, A.; et al. Serum Biomarker Profile Including CCL1, CXCL10, VEGF, and Adenosine Deaminase Activity Distinguishes Active From Remotely Acquired Latent Tuberculosis. Front. Immunol. 2021, 12, 725447. [Google Scholar] [CrossRef] [PubMed]
  44. Sullivan, Z.A.; Wong, E.B.; Ndung'u, T.; Kasprowicz, V.O.; Bishai, W.R. Latent and Active Tuberculosis Infection Increase Immune Activation in Individuals Co-Infected with HIV. eBioMedicine 2015, 2, 334–340. [Google Scholar] [CrossRef] [Green Version]
  45. Shingdang, J.; Bot, Y.; Ojo, O.I.; Edeh, O.; Essien, C.; Bwende, E.; Okolie, C.; Ekwempu, A.I. Serum Albumin/Globulin ratio in Tuberculosis and HIV Patients any Relationship? Mycobact. Dis. 2016, 6, 199. [Google Scholar]
  46. Popov, A.; Abdullah, Z.; Wickenhauser, C.; Saric, T.; Driesen, J.; Hanisch, F.G.; Domann, E.; Raven, E.L.; Dehus, O.; Hermann, C.; et al. Indoleamine 2,3-dioxygenase-expressing dendritic cells form suppurative granulomas following Listeria monocytogenes infection. J. Clin. Investig. 2006, 116, 3160–3170. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Puccetti, P. On watching the watchers: IDO and type I/II IFN. Eur. J. Immunol. 2007, 37, 876–879. [Google Scholar] [CrossRef]
  48. Wong, C.T.; Saha, N. Serum immunoglobulin and acute phase protein concentrations in pulmonary tuberculosis patients in Singapore. Trop. Geogr. Med. 1989, 41, 218–221. [Google Scholar] [PubMed]
  49. Dorhoi, A.; Du Plessis, N. Monocytic Myeloid-Derived Suppressor Cells in Chronic Infections. Front. Immunol. 2017, 8, 1895. [Google Scholar] [CrossRef] [Green Version]
  50. Du Plessis, N.; Loebenberg, L.; Kriel, M.; von Groote-Bidlingmaier, F.; Ribechini, E.; Loxton, A.G.; van Helden, P.D.; Lutz, M.B.; Walzl, G. Increased frequency of myeloid-derived suppressor cells during active tuberculosis and after recent mycobacterium tuberculosis infection suppresses T-cell function. Am. J. Respir. Crit. Care Med. 2013, 188, 724–732. [Google Scholar] [CrossRef]
  51. McCaffrey, E.F.; Donato, M.; Keren, L.; Chen, Z.; Delmastro, A.; Fitzpatrick, M.B.; Gupta, S.; Greenwald, N.F.; Baranski, A.; Graf, W.; et al. The immunoregulatory landscape of human tuberculosis granulomas. Nat. Immunol. 2022, 23, 318–329. [Google Scholar] [CrossRef]
  52. Hornyák, L.; Dobos, N.; Koncz, G.; Karányi, Z.; Páll, D.; Szabó, Z.; Halmos, G.; Székvölgyi, L. The Role of Indoleamine-2,3-Dioxygenase in Cancer Development, Diagnostics, and Therapy. Front. Immunol. 2018, 9, 151. [Google Scholar] [CrossRef] [PubMed]
  53. Ganatra, S.R.; Bucşan, A.N.; Alvarez, X.; Kumar, S.; Chatterjee, A.; Quezada, M.; Fish, A.; Singh, D.K.; Singh, B.; Sharan, R.; et al. Anti-retroviral therapy does not reduce tuberculosis reactivation in a tuberculosis-HIV co-infection model. J. Clin. Investig. 2020, 130, 5171–5179. [Google Scholar] [CrossRef] [PubMed]
  54. Sharan, R.; Ganatra, S.R.; Bucsan, A.N.; Cole, J.; Singh, D.K.; Alvarez, X.; Gough, M.; Alvarez, C.; Blakley, A.; Ferdin, J.; et al. Antiretroviral therapy timing impacts latent tuberculosis infection reactivation in a tuberculosis/simian immunodeficiency virus coinfection model. J. Clin. Investig. 2021, 132, e153090. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Bacterial Burdens (Log10CFU) and Percent Lung Pathology. Bacterial burdens (A) were determined from animals described in the study protocol that had been designated to either have active TB disease based on clinical attributes (red) or LTBI/control of infection (blue). (****, p-value of < 0.0001). (B) The percentage of lung pathology was computed using the previously described morphometric techniques in the animals described in the study protocol that had been designated to either have active TB disease based on clinical attributes (red) or LTBI/control of infection (blue). (****, p-value of < 0.0001). T-test was used to identify statistically significant differences.
Figure 1. Bacterial Burdens (Log10CFU) and Percent Lung Pathology. Bacterial burdens (A) were determined from animals described in the study protocol that had been designated to either have active TB disease based on clinical attributes (red) or LTBI/control of infection (blue). (****, p-value of < 0.0001). (B) The percentage of lung pathology was computed using the previously described morphometric techniques in the animals described in the study protocol that had been designated to either have active TB disease based on clinical attributes (red) or LTBI/control of infection (blue). (****, p-value of < 0.0001). T-test was used to identify statistically significant differences.
Pathogens 11 00544 g001
Figure 2. Serum CRP (A) and A/G Ratios (B) at Endpoint. Endpoint serum CRP values (A) and A/G ratios (B) were similar between pre-infection (black) and LTBI (blue), but were significantly different between ATB (red) and LTBI. (****, p-value of < 0.0001). Each dot represents one animal.
Figure 2. Serum CRP (A) and A/G Ratios (B) at Endpoint. Endpoint serum CRP values (A) and A/G ratios (B) were similar between pre-infection (black) and LTBI (blue), but were significantly different between ATB (red) and LTBI. (****, p-value of < 0.0001). Each dot represents one animal.
Pathogens 11 00544 g002
Figure 3. Linear Regression Models for Predicting log10CFU Counts at Endpoint. Utilizing multilinear regression analysis, we found that CRP at endpoint and A/G ratio at endpoint were able to accurately predict log10CFU counts at endpoint, allowing us to determine if the host was actively or latently infected.
Figure 3. Linear Regression Models for Predicting log10CFU Counts at Endpoint. Utilizing multilinear regression analysis, we found that CRP at endpoint and A/G ratio at endpoint were able to accurately predict log10CFU counts at endpoint, allowing us to determine if the host was actively or latently infected.
Pathogens 11 00544 g003
Figure 4. Percentage of specific WBCs at Endpoint, of complete blood cell counts. Endpoint cell counts between ATB (red) and LTBI (blue) were different across all cell types measured. (ns, p-value of > 0.05; *, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ***, p-value of ≤ 0.001; ****, p-value of < 0.0001).
Figure 4. Percentage of specific WBCs at Endpoint, of complete blood cell counts. Endpoint cell counts between ATB (red) and LTBI (blue) were different across all cell types measured. (ns, p-value of > 0.05; *, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ***, p-value of ≤ 0.001; ****, p-value of < 0.0001).
Pathogens 11 00544 g004
Figure 5. Linear Regression Models for A/G Ratio (A) and Lymphocyte Percentages (B) at Peak. Utilizing univariate linear regression, we determined that for A/G ratio (A) and lymphocyte percentages (B) at peak, pre-infection values could be used to determine post-infection response.
Figure 5. Linear Regression Models for A/G Ratio (A) and Lymphocyte Percentages (B) at Peak. Utilizing univariate linear regression, we determined that for A/G ratio (A) and lymphocyte percentages (B) at peak, pre-infection values could be used to determine post-infection response.
Pathogens 11 00544 g005
Figure 6. Monocyte-to-Lymphocyte (A) and Neutrophil-to-Lymphocyte (B) Cell Ratios. Cell ratios were utilized as a simple, standardized biomarkers that were able to differentiate between ATB and LTBI. (*, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ****, p-value of < 0.0001).
Figure 6. Monocyte-to-Lymphocyte (A) and Neutrophil-to-Lymphocyte (B) Cell Ratios. Cell ratios were utilized as a simple, standardized biomarkers that were able to differentiate between ATB and LTBI. (*, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ****, p-value of < 0.0001).
Pathogens 11 00544 g006
Figure 7. Kynurenine-to-Tryptophan Ratio. ELISA was performed to determine the levels of kynurenine (A), and Tryptophan (B), and through these calculate kynurenine-to-tryptophan ratio (C), allowing us to extrapolate the amount of the enzyme, IDO, which converts tryptophan to kynurenine within the cell. (***, p-value of ≤ 0.001).
Figure 7. Kynurenine-to-Tryptophan Ratio. ELISA was performed to determine the levels of kynurenine (A), and Tryptophan (B), and through these calculate kynurenine-to-tryptophan ratio (C), allowing us to extrapolate the amount of the enzyme, IDO, which converts tryptophan to kynurenine within the cell. (***, p-value of ≤ 0.001).
Pathogens 11 00544 g007
Figure 8. Myeloid Cell Populations. Cell populations were determined using flow cytometry in lung (A), BAL cells (B)_and PBMCs (C) from a subset of macaques with ATB and LTBI, and a full gating strategy is available in supplementary Figures S4 and S5. AM (alveolar macrophages), IM (interstitial macrophages), pDC (plasmacytoid dendritic cells), cDC (conventional dendritic cells), iMo (intermediate monocytes), cMo (classical monocytes), and non cMo (Non-classical monocytes). (*, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ***, p-value of ≤ 0.001; ****, p-value of < 0.0001).
Figure 8. Myeloid Cell Populations. Cell populations were determined using flow cytometry in lung (A), BAL cells (B)_and PBMCs (C) from a subset of macaques with ATB and LTBI, and a full gating strategy is available in supplementary Figures S4 and S5. AM (alveolar macrophages), IM (interstitial macrophages), pDC (plasmacytoid dendritic cells), cDC (conventional dendritic cells), iMo (intermediate monocytes), cMo (classical monocytes), and non cMo (Non-classical monocytes). (*, p-value of ≤ 0.05; **, p-value of ≤ 0.01; ***, p-value of ≤ 0.001; ****, p-value of < 0.0001).
Pathogens 11 00544 g008
Table 1. Welch’s t Test. Empty spaces indicate differences were not statistically significant.
Table 1. Welch’s t Test. Empty spaces indicate differences were not statistically significant.
Welch’s t Test ATB v. LTBI
p-Value
CFU4.48 × 10−06
CFU-log10.3.31 × 10−44
CRP-pre
CRP-peak2.30 × 10−29
CRP-endpt6.99 10−27
A/G-pre
A/G-peak0.001
A/G-bottom5.43 × 10−28
A/G-endpt3.43 × 10−36
Lympho-pre
Lympho-peak
Lympho-bottom2.44 × 10−07
Lympho-endpt2.40 × 10−15
Mono-pre
Mono-peak
Mono-bottom0.045
Mono-endpt0.001
Neutro-pre
Neutro-peak3.38 × 10−06
Neutro-bottom
Neutro-endpt2.03 × 10−14
L/M-pre
L/M-peak0.012
L/M-bottom0.004
L/M-endpt0.013
N/M-pre
N/M-peak
N/M-bottom
N/M-endpt
N/L-pre
N/L-peak0.021
N/L-bottom9.27 × 10−05
N/L-endpt2.02 × 10−15
M/L-pre
M/L-peak0.007
M/L-bottom2.48 × 10−08
M/L-endpt8.62 × 10−19
Kynurenine
Tryptophan2.82 × 10−04
K/T9.21 × 10−04
Table 2. ATB CFU and log10CFU Pearson Correlations. Empty spaces indicate differences were not statistically significant. #N/A: not available (for correlation to self value).
Table 2. ATB CFU and log10CFU Pearson Correlations. Empty spaces indicate differences were not statistically significant. #N/A: not available (for correlation to self value).
A. ATB CFU CorrelationsB. ATB log10CFU Correlations
p-ValueCoefficient p-ValueCoefficient
CFU-endpt#N/A#N/ACFU-endpt0.0000.671
CFU-endptlog100.0000.671CFU-endptlog10#N/A#N/A
CRP-pre CRP-pre0.004−0.243
CRP-peak1.43 × 10−080.458CRP-peak2.17 × 10−120.549
CRP-endpt2.72 × 10−080.450CRP-endpt9.66 × 10−140.576
A/G-bottom A/G-bottom0.024−0.192
A/G-endpt A/G-endpt0.003−0.250
Lympho-bottom0.014−0.209Lympho-bottom0.014−0.208
Lympho-endpt0.013−0.212Lympho-endpt
Mono-peak Mono-peak
Mono-endpt Mono-endpt
Neutro-peak0.0250.191Neutro-peak
Neutro-endpt0.0120.213Neutro-endpt
LM-endpt0.0370.178LM-endpt
NM-bottom0.0290.186NM-bottom
NM-endpt0.0120.212NM-endpt
ML-pre0.0360.178ML-pre0.0450.170
kyn_ng_ml kyn_ng_ml0.0140.453
K_T_ng_ug K_T_ng_ug0.0270.411
kyn_ug_ml kyn_ug_ml0.0140.453
K_T K_T0.0270.411
Lung.AM Lung.AM
Table 3. LTBI CFU and log10CFU Pearson Correlations. #N/A: not available (for correlation to self value).
Table 3. LTBI CFU and log10CFU Pearson Correlations. #N/A: not available (for correlation to self value).
A. LTBI CFU CorrelationsB. LTBI log10CFU Correlations
p-ValueCoefficient p-ValueCoefficient
CFU-endpt#N/A#N/ACFU-endpt1.26 × 10−130.703
CFU-endptlog101.26 × 10−130.703CFU-endptlog10#N/A#N/A
CRP-pre0.0440.224CRP-pre
CRP-peak0.0240.251CRP-peak0.0010.365
CRP-endpt0.0250.248CRP-endpt0.0280.244
A/G-bottom A/G-bottom0.015−0.268
A/G-endpt4.89 × 10−04−0.377A/G-endpt3.90 × 10−04−0.383
Lympho-bottom Lympho-bottom
Lympho-endpt Lympho-endpt
Mono-peak0.0340.234Mono-peak
Mono-endpt0.0500.217Mono-endpt
Neutro-peak Neutro-peak
Neutro-endpt Neutro-endpt
LM-endpt LM-endpt
NM-bottom NM-bottom
NM-endpt NM-endpt
ML-pre ML-pre
kyn_ng_ml kyn_ng_ml
K_T_ng_ug0.0430.385K_T_ng_ug0.0100.480
kyn_ug_ml kyn_ug_ml
K_T0.0430.385K_T0.0100.480
Lung.AM Lung.AM0.004−0.978
Table 4. Welch’s t Test Myeloid Cell Populations.
Table 4. Welch’s t Test Myeloid Cell Populations.
Welch’s T Test ATB v. LTBI
p-Value
LungBALPBMC
AM5.44 × 10−041.35 × 10−04
IM5.23 × 10−033.27 × 10−03
pDC7.58 × 10−055.26 × 10−033.99 × 10−02
cDC4.24 × 10−046.99 × 10−04
iMO 5.32 × 10−04
cMO 1.79 × 10−03
non-cMO 2.14 × 10−02
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Gough, M.; Singh, D.K.; Moodley, C.; Niu, T.; Golden, N.A.; Kaushal, D.; Mehra, S. Peripheral Blood Markers Correlate with the Progression of Active Tuberculosis Relative to Latent Control of Mycobacterium tuberculosis Infection in Macaques. Pathogens 2022, 11, 544. https://doi.org/10.3390/pathogens11050544

AMA Style

Gough M, Singh DK, Moodley C, Niu T, Golden NA, Kaushal D, Mehra S. Peripheral Blood Markers Correlate with the Progression of Active Tuberculosis Relative to Latent Control of Mycobacterium tuberculosis Infection in Macaques. Pathogens. 2022; 11(5):544. https://doi.org/10.3390/pathogens11050544

Chicago/Turabian Style

Gough, Maya, Dhiraj K. Singh, Chivonne Moodley, Tianhua Niu, Nadia A. Golden, Deepak Kaushal, and Smriti Mehra. 2022. "Peripheral Blood Markers Correlate with the Progression of Active Tuberculosis Relative to Latent Control of Mycobacterium tuberculosis Infection in Macaques" Pathogens 11, no. 5: 544. https://doi.org/10.3390/pathogens11050544

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop