Next Article in Journal
The Coxsackievirus and Adenovirus Receptor Has a Short Half-Life in Epithelial Cells
Next Article in Special Issue
Factors Possibly Associated with Mortality in Intubated COVID-19 Patients: A Retrospective Study
Previous Article in Journal
Enterotoxigenic Escherichia coli Heat-Stable Toxin and Ebola Virus Delta Peptide: Similarities and Differences
Previous Article in Special Issue
Modulation of Production of Th1/Th2 Cytokines in Peripheral Blood Mononuclear Cells and Neutrophils by Hepatitis C Virus Infection in Chronically Infected Patients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Exploring Rapid and Effective Screening Methods for Anti-SARS-CoV-2 Neutralizing Antibodies in COVID-19 Convalescent Patients and Longitudinal Vaccinated Populations

1
State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, National Medical Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou 310003, China
2
State Key Laboratory for Infectious Disease Prevention and Control, National Center for AIDS/STD Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, China
3
Guangxi Key Laboratory of AIDS Prevention and Treatment & Guangxi Universities Key Laboratory of Prevention and Control of Highly Prevalent Disease, School of Public Health, Guangxi Medical University, Nanning 530021, China
4
Gobond Testing Technology (Beijing) Co., Ltd., Beijing 102629, China
*
Authors to whom correspondence should be addressed.
Pathogens 2022, 11(2), 171; https://doi.org/10.3390/pathogens11020171
Submission received: 6 December 2021 / Revised: 22 January 2022 / Accepted: 25 January 2022 / Published: 27 January 2022
(This article belongs to the Special Issue Viral Pathogenesis and Immunity)

Abstract

:
Assessing the duration of neutralizing antibodies (nAbs) following SARS-CoV-2 infection or vaccination is critical to evaluate the protective immunity and formulate public health strategies. In this study, SARS-CoV-2 Ab ELISA (enzyme-linked immunosorbent assay), chemiluminescent microparticle immunoassay (CMIA), as well as pseudovirus neutralization test (PVNT) were performed in two cohorts, convalescent patients (CP) from coronavirus disease 2019 (COVID-19) and BBIBP-CorV vaccinated population. It was found that nAbs and binding antibodies emerged at 14 days post the 1st dose of vaccination, reached peaks at 28 days after 2nd dose vaccination and then gradually declined over time. CP-6M (convalescent patients up to 6 months) from COVID-19 presented stronger nAbs or binding antibodies responses than vaccinees 90 days or 180 days after 2nd dose vaccination. CMIA or SARS-CoV-2 Ab ELISA correlated well with PVNT with high consistency in the two cohorts. It shown that nAbs and binding antibodies can keep 6 months both in CP and vaccinees. Most importantly, our data show the application of using CMIA and SARS-CoV-2 Ab ELISA as rapid screening tests for nAb titer and could be used as alternative strategies for quickly evaluating SARS-CoV-2 nAbs responses in vaccine research.

1. Introduction

Globally, as of 14 January 2022, 318,648,834 confirmed cases of COVID-19, including 5,518,343 deaths were reported by WHO. A total of 9,283,076,642 vaccine doses have been administered. Inactivated vaccine BBIBP-CorV (China Sinopharm Bio-Beijing Company) was the first vaccine approved for emergency use by WHO on 7 May 2021and is widely vaccinated in China. All BBIBP-CorV-vaccinated individuals seroconverted successfully by 42 days after the 1st dose vaccination [1]. A phase 3 clinical trial also confirmed the protection of the BBIBP-CorV vaccine with an efficacy of 78.1% reduction of asymptomatic illness [2].
Anti-SARS-CoV-2 nAbs could inhibit the binding of virus spike protein to ACE2 on the surface of host cell, thereby blocking viral entry [3,4,5,6]. NAb level has been used to estimate acquired immunity at individual and population level [7,8,9,10,11]. A large multi-center prospective cohort study observed an 84% reduction in the risk of reinfection in antibody-positive population compared with antibody-negative cohort [10]. Thus, evaluating the duration and intensity of nAbs post SARS-CoV-2 infection and vaccination is essential for making public health policies to combat COVID-19.
Several studies have found that the nAbs titers in CP from COVID-19 could maintain for 6 or even 12 months [12,13,14,15,16,17,18]. However, researches on nAbs titers induced by inactivated vaccines are still limited [1,2,19,20,21,22]. Moreover, the comparison of the nAbs titers between CP and vaccinees may have some guiding significance for the formulation of SARS-CoV-2 vaccine policy.
Many methods for the detection of SARS-CoV-2 nAb have been described previously [17,22,23,24,25], e.g., plaque reduction neutralization test (PRNT), cytopathic effect (CPE) of live SARS-CoV-2 and pseudovirus neutralization tests (PVNT), which are cost- and time-consuming, and cannot be widely implemented [26,27,28,29]. To date, most serology tests mainly detect IgM or IgG antibodies against SARS-CoV-2. Due to the variety of antibody detection methods, the results were always different [24,25,30,31].
Alternative serology assays mainly include the enzyme-linked immunosorbent assays (ELISA) that can detect SARS-CoV-2-specific antibodies and the competition ELISAs that evaluate anti-RBD (receptor binding domain) antibodies competing with host cell receptor angiotensin-converting enzyme 2 (ACE2) [32,33]. After evaluating the sensitivity, specificity and consistency of several methods including RBD-IgG (coated) ELISA, nucleocapsid (N)-IgG (coated) ELISA, WANTAI SARS-CoV-2 Ab ELISA kit and chemiluminescent microparticle immunoassay (CMIA) with PVNT, we selected CMIA and WANTAI SARS-CoV-2 Ab ELISA kits for further study. CMIA can detect antibody responses to RBD against ACE2 receptor by using a competitive-ELISA method. The weaker chemiluminescence value indicates a higher antibody level. It is automated and easy to operate and could tests up to 150 samples in one hour simultaneously. The SARS-CoV-2 Ab ELISA kit uses a double RBD antigen sandwich enzyme-linked immunoassay method to detect antibodies in the sample and the entire experiments process could completed within only two hours. Herein, we explored two simple, rapid and accurate screening strategies, CMIA and SARS-CoV-2 Ab ELISA for predicting SARS-CoV-2 nAbs.

2. Results

2.1. General Characteristics of Convalescent Patients up to 6 Months (CP-6M) from COVID-19

In cohort 1, 40 individuals who had recovered from COVID-19 approximately six months (158–198 days) were recruited (Figure 1). The clinical data were described in Table 1. Three immunoassays, including CMIA, PVNT and SARS-CoV-2 Ab ELISA were used to detect the levels of binding and neutralizing antibodies in CP. The median (interquartile range, IQR) value of PVNT50 was 240.5 (114–452), S/CO of CMIA was 0.052 (0.01–0.18) and OD450 values of SARS-CoV-2 Ab ELISA was 3.83 (3.77–3.86). The cutoff values of PVNT50, SARS-CoV-2 Ab ELISA and CMIA were 20, 0.19 and 1.00 separately, and nAbs responses showed no difference among subgroups divided by gender, age, and disease severity (Figure 2).

2.2. The Seropositivity and Antibody Levels over Times in Vaccinated Population

In order to explore the antibody response induced by the BBIBP-CorV vaccination, 23 healthy people (17 females and 6 males, with a median (IQR) age of 27.2 (26.3–39.5) years old) who completed two doses of BBIBP-CorV vaccination were included in cohort 2. PVNT, CMIA and SARS-CoV-2 Ab ELISA were performed before vaccination, 14 days after the first vaccination and 28 days, 90 days and 180 days after the second dose of vaccination, respectively. The time points of vaccination and blood sampling are marked in Figure 1. In this cohort, the seroprevalences of PVNT were as follows: 14 days (42.1%), 28 days (95.7%), 90 days (95.0%) and 180 days (56.3%) after the second vaccination; the seroprevalences of SARS-CoV-2 Ab ELISA were as follows: 14 days (52.6%), 28 days (95.7%), 90 days (90.0%) and 180 days (87.5%); the seroprevalences of CMIA were 14 days (52.6%), 28 days (95.7%), 90 days (75.0%), and 180 days (68.8%) (Figure 3a). Before vaccination, the PVNT50 samples were all less than 20, and the median of OD450 values and S/CO were 0.002 (0.001–0.003) and 1.4 (1.3–1.5), respectively. The results indicated that the population had no neutralization activity and binding ability before vaccination. The antibody appeared at 14 days after the first dose of vaccination, reached peaks at 28 days after the second dose of vaccination and then gradually vanished over time (Table 2, Figure 3). At 180 days post the 2nd immunization, 43.8% and 31.3% of the population did not present nAbs by PVNT and CMIA, respectively. Meanwhile, 12.5% of the population did not show RBD-binding antibodies by SARS-CoV-2 Ab ELISA. Dynamic changes of neutralizing antibody and binding antibody against SARS-CoV-2 were exhibited in Figure 3.

2.3. Comparisons of Antibody Responses in Two Cohorts

Next, we then compared the nAbs and RBD-binding antibodies responses between the two cohorts (Figure 4). The nAbs and binding antibodies of the pre-vaccination group were significantly lower than those at 28 days after the second vaccination and the CP-6M group; the p-values of three serum immunological assays were all less than 0.0001. In Table 2, the median nAbs titers of the PVNT in the CP-6M group were 2.8-fold that of 28 days after the second vaccination, 4.7-fold that of 90 days after the second vaccination, and 7.8-fold that of 180 days after the second vaccination. The median S/CO value of the CMIA in the CP-6M group was 8.1-fold lower than that of 90 days after the second vaccination, 13.8-fold lower than that of 180 days after the second vaccination. The lower values of CMIA mean higher neutralization activity, the nAbs titers of the CP-6M group were still highest than other groups. The median anti-RBD antibody of the SARS-CoV-2 in the CP-6M group was 1.1-fold that of 28 days after the second vaccination, 1.5-fold that of 90 days after the second vaccination, and 2.6-fold that of 180 days after the second vaccination. The statistical differences were shown among the CP-6M and 90 days or 180 days after the 2nd dose of vaccination by PVNT, CMIA and SARS-CoV-2 Ab ELISA assays (Figure 4).

2.4. The Correlation of Antibody Response between CMIA or SARS-CoV-2 Ab ELISA with PVNT Method

The results of SARS-CoV-2 Ab ELISA and CMIA were further compared between PVNT50 ≥ 20 and PVNT50 < 20 groups (Table 3, Figure 5). Among the convalescent population, the sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and consistency of CMIA and SARS-CoV-2 Ab ELISA are all 100%, which finely correlated with the PVNT results possibly due to a 95% seropositivity rate in this group. The correlation between PVNT50 and S/CO is: S/CO = −0.76 × Log10(PVNT50) +1.93, R2 is 0.73 and the p-value is less than 0.0001; the correlation between PVNT50 and OD450 is as follows: 0D450 = 1.56 × Log10(PVNT50) + 0.01, R2 is 0.60 and the p-value is less than 0.0001(Figure 5a,d). Among the vaccinated population, for SARS-CoV-2 Ab ELISA and CMIA, the sensitivities are 91.8% and 85.7%, the specificities are 80.6% and 83.3%, and the consistencies are 0.73 and 0.69 with PVNT, respectively. The correlation between PVNT50 and S/CO is S/CO = −0.89 × Log10(PVNT50) + 2.13, R2 is 0.64 and the p-value is less than 0.0001; the correlation between PVNT50 and OD450 is OD450 = 2.58 × Log10(PVNT50) −2.34, R2 is 0.72 and the p-value was less than 0.0001 (Figure 5b,e). Combined with the two cohorts, the sensitivities of SARS-CoV-2 Ab ELISA and CMIA are 95.1% and 91.3%, the specificities are 71.1% and 80.0% and the consistencies are 0.70 and 0.71, respectively. The correlation between PVNT50 and S/CO is: S/CO= −0.79 × Log10(PVNT50) + 1.99, R2 is 0.70 and the p-value is less than 0.0001. The correlation between PVNT50 and OD450 values of RBD-IgG titers is OD450 = 2.33 × Log10(PVNT50) −1.89, R2 is 0.73 and the p-value is less than 0.0001(Figure 5c,f). Notably, both SARS-CoV-2 Ab ELISA and CMIA have significant correlations with PVNT no matter in the population of convalescents, vaccinated or two cohorts combined (R2 > 0.5 and p < 0.05).

3. Discussion

The presence of nAbs had been reported correlating closely with protection from infection, reinfection and breakthrough infection with SARS-CoV-2 by several studies [7,10,11]. Thus, understanding the duration and levels of nAbs during SARS-CoV-2 infection and vaccination is essential for scientifically combating COVID-19. In this study, we found that there were no differences in age, gender, and disease stages in antibody responses. This result is consistent with the previous longitudinal study [12,34,35]. Seropositivity rate (99.5%) was found at 6 months after infection [12], and 95.8% was identified in the follow-up 10 months after infection [13]. Similarly, a high nAbs seroprevalence rate (95.0%) was observed in our study. The antibody levels of most convalescent COVID-19 subjects reached a sustained plateau at 6 months and remained stable [12,13,14,15].
Although two doses BBIBP-CorV vaccination provided 100% of seroconversion rate and 78.1% efficacy against symptomatic illness separately, the follow-up duration of the two trials were short, and the median time were only 42 days and 77 days respectively [2,19]. In our study, 200 days follow-up was conducted to demonstrate nAbs dynamics and binding antibodies responses in consecutive samples after SARS-CoV-2 vaccination. Same as convalescent patients, a high seroconversion (95.7%) was showed in vaccinated individuals at 28 days after the 2nd immunization, but PVNT50 in nearly half of this population were below 20 at 180 days after 2nd vaccination. Nevertheless, weak antibody titers do not mean that the vaccine is ineffective. Studies have shown that the nAbs titers of breakthrough infection cases were significantly lower than those in the control group. Infection after vaccination is generally mild or asymptomatic, which may be related to the memory immunity in the body [7,11,36,37].
We also found that the results of CMIA or SARS-CoV-2 Ab ELISA correlated well with PVNT and had a high consistency with the PVNT, no matter in the population of convalescents, vaccinated or two cohorts combined. The excellent results may be due to the antibody detection experiments based on the S antigen or RBD molecules on the surface of SARS-CoV-2. The neutralization mechanism of plasma or antibodies is to block SARS-CoV-2 from entering the host cell by binding to the RBD [23,24,38]. Compared with the 48-hour process of PVNT, these two methods are simple to operate, time-saving, labor-saving and effective, which can be served as alternative methods for quickly evaluating nAbs activity in SARS-Cov-2 infected or vaccinated population. These results were applicable not only to the BBIBP-CorV vaccine, but also to other type vaccines such as mRNA or adenovirus-based vaccines.
Numerous variants of SARS-CoV-2-harboring mutations in spike (both RBD and non-RBD mutations) have been reported in last year, especially the variants of concern (VOCs) e.g., Alpha, Beta, Gamma, Delta and Omicron. Compared with wildtype, a reduction of neutralization activity against VOCs was observed in vaccinees, not only in the BBIBP-CorV, but also in the BNT162b2 or mRNA-1273 vaccines [39,40,41]. For cases infected with the VOCs, commercial kits and pseudovirus neutralization test should be modified on the spike protein/RBD of variants. Therefore, the correlation between SARS-CoV-2 Ab ELISA, CMIA and PVNT mentioned in this paper may need to be further explored for VOCs.
Our study has several limitations. First, although we have conducted at least six months follow-up on populations who have recovered from COVID-19 and vaccinated, the numbers of cases were relatively small. Second, the article was focused to compare nAbs and anti-S-binding antibodies in the recovered and vaccinated populations. The protective mechanisms of nAb has not been studied; however, several studies had already proved the nAbs can prevent future infections in most individuals [7,10]. Third, the research on B lymphocyte immunity has not been carried out, but it is already on the schedule.

4. Materials and Methods

4.1. Study Participants

Two cohorts were included in this study. Cohort 1 was CP after SARS-CoV-2 infection, and blood samples of 40 patients were collected approximately 6 months (158–198 days). Seven specimens were collected approximately 12 months (355–387 days) after being discharged from the First Affiliated Hospital, Zhejiang University School of Medicine, China. All patients had negative nucleic acid results by reversing real-time polymerase chain reaction (RT-PCR). According to the New Coronavirus Pneumonia Diagnosis and Treatment Program (the 8th edition) published by the National Health Commission of China, clinical classification of COVID-19 pneumonia [42]. We combined mild and moderate patients into a non-severe group and severe and critical patients into the severe group. Cohort 2 included 23 healthy people who have completed two doses of BBIBP-CorV vaccination. All participants had negative nucleic acid results for SARS-CoV-2 by RT-PCR. Informed consent was obtained before all subjects participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of First Affiliated Hospital, Zhejiang University School of Medicine (Reference Number 2020433 and 2021376, respectively).

4.2. WANTAI SARS-CoV-2 Ab Enzyme-Linked Immunosorbent Assay (ELISA)

The anti-RBD antibodies of SARS-CoV-2 were measured using SARS-CoV-2 Ab ELISA kit and the experimental operation was carried out in accordance with the instructions (Wantai Biological Pharmacy, China). Briefly, 96-well plates were pre-coated with 2019-nCoV-RBD antigen. 100 μL plasma samples were added and incubated 0.5 h at 37 °C and washed. Then, 100 μL HRP labeled 2019-nCoV-Ag were incubated for 0.5 h at 37 °C and washed. Then 100 μL of substrate was added in each well for 15 min at 37 °C. The reaction was stopped by adding 50 μL of 1 nm H2SO4 to each well, and the reading was taken at 450 nm.

4.3. Chemiluminescent Microparticle Immunoassay (CMIA)

The COVID-19 nAbs detection kits (Hotgen, Beijing, China, batch number: 21010115) were based on chemiluminescent microparticle immunoassay (CMIA), which used a competitive-ELISA method to detect nAbs of SARS-CoV-2 in samples. In short, the test was performed by reacting the sample with alkaline phosphatase (ALP)-labeled S-RBD antigen complex. Biotin-labeled receptor protein ACE2 and magnetic microspheres encapsulated with streptavidin were added to promote attachment of the ACE2-S-RBD antigen complex to the magnetic microspheres by specific binding of biotin and streptavidin. Matched automatic chemiluminescence immunoassay analyzer was used to analyze nAb levels, which were presented as the chemiluminescence signal values divided by the cutoff (absorbance/cutoff, S/CO). All operations were carried out in strict accordance with the instructions of the reagent manufacturer. An amount of 100 μL of plasma sample was added, and the whole process took about 30 minutes. The S/CO < 1 was considered positive, S/CO ≥ 1 was negative.

4.4. Pseudovirus Neutralization Test (PVNT)

Briefly, 150 µL serial dilutions of human sera (4 serial 3-fold dilutions in Dulbecco’s minimum essential medium (DMEM) with an initial dilution (1:20)) were added into 96-well plates. Then, 50 µL pseudoviruses of SARS-CoV-2(1300 TCID50/mL) were added to the plates, followed by incubation at 37 °C for 1 h. Afterward, Hu-h7 cells were added to the plates (1.5 × 104 cells/100 µL cells per well), followed by incubation at 37 °C in a humidified atmosphere with 5% CO2. Chemiluminescence detection was performed after 48 hours of incubation. The Reed–Muench method was used to calculate the virus neutralization titers. The result was reported as half maximal inhibitory concentration of PVNT (PVNT50).

4.5. Statistical Analysis

A descriptive analysis was carried out using frequencies and median (interquartile range, IQR) quartiles. Two-tailed, nonparametric Dunn’s Kruskal–Wallis test was performed on numerical data, while the chi-square test and Fisher’s exact tests were carried out for the categorical variables. Non-linear regression models were applied to evaluate the correlation between the nAbs and binding antibodies. Graphs and statistical analyses were conducted using GraphPad Prism (version 8.0.2) and SPSS software (version 23.0). p-values of less than 0.05 were considered statistically significant.

5. Conclusions

In this study, the immune persistency, dynamics of nAbs and binding antibodies were analyzed in convalescents recovered from COVID-19 and vaccinated population. We found that CMIA and SARS-CoV-2 Ab ELISA kits could be used as alternative methods for quickly evaluating nAbs levels in CPs and vaccinees, which is of great significance for assessing vaccine immunization efficacy and herd immunity.

Author Contributions

Conceptualization, C.H., D.L. and Y.S.; Funding acquisition, D.L., Z.W., B.Z. and Y.S.; Methodology, C.H., Z.L., L.R., M.Z. and Q.L.; Resources, J.S. and B.Z.; Software, Y.F.; Writing—original draft, C.H. and Z.L.; Writing—review and editing, D.L., Z.W. and Y.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China under Grant 20A20362; State Key Laboratory of Infections Disease Prevention and Control under Grant 2020SKLD305 and 2020SKLID102; Science and Technology Project of Beijing under Grant Z211100002521024, and Beijing Natural Science Fundation (M21015).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of First Affiliated Hospital, Zhejiang University School of Medicine (Reference Number 2020433 and 2021376, respectively).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patient(s) to publish this paper” if applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank all study participants. We are grateful for Hotgen, Beijing and Wantai Biological Pharmacy, China, for providing the chemiluminescent microparticle immunoassay SARS-CoV-2 nAbs detection kits and SARS-CoV-2 Ab ELISA kits, respectively.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xia, S.; Zhang, Y.; Wang, Y.; Wang, H.; Yang, Y.; Gao, G.F.; Tan, W.; Wu, G.; Xu, M.; Lou, Z.; et al. Safety and immunogenicity of an inactivated SARS-CoV-2 vaccine, BBIBP-CorV: A randomised, double-blind, placebo-controlled, phase 1/2 trial. Lancet Infect. Dis. 2021, 21, 39–51. [Google Scholar] [CrossRef]
  2. Al Kaabi, N.; Zhang, Y.; Xia, S.; Yang, Y.; Al Qahtani, M.M.; Abdulrazzaq, N.; Al Nusair, M.; Hassany, M.; Jawad, J.S.; Abdalla, J.; et al. Effect of 2 Inactivated SARS-CoV-2 Vaccines on Symptomatic COVID-19 Infection in Adults: A Randomized Clinical Trial. JAMA 2021, 326, 35–45. [Google Scholar] [CrossRef] [PubMed]
  3. McAndrews, K.M.; Dowlatshahi, D.P.; Dai, J.; Becker, L.M.; Hensel, J.; Snowden, L.M.; Leveille, J.M.; Brunner, M.R.; Holden, K.W.; Hopkins, N.S.; et al. Heterogeneous antibodies against SARS-CoV-2 spike receptor binding domain and nucleocapsid with implications for COVID-19 immunity. JCI Insight 2020, 5, e142386. [Google Scholar] [CrossRef] [PubMed]
  4. Hu, B.; Guo, H.; Zhou, P.; Shi, Z.L. Characteristics of SARS-CoV-2 and COVID-19. Nat. Rev. Microbiol. 2021, 19, 141–154. [Google Scholar] [CrossRef]
  5. Yuan, M.; Wan, Y.; Liu, C.; Li, Y.; Liu, Z.; Lin, C.; Chen, J. Identification and characterization of a monoclonal antibody blocking the SARS-CoV-2 spike protein-ACE2 interaction. Cell. Mol. Immunol. 2021, 18, 1562–1564. [Google Scholar] [CrossRef]
  6. Yao, H.; Song, Y.; Chen, Y.; Wu, N.; Xu, J.; Sun, C.; Zhang, J.; Weng, T.; Zhang, Z.; Wu, Z.; et al. Molecular Architecture of the SARS-CoV-2 Virus. Cell 2020, 183, 730–738.e13. [Google Scholar] [CrossRef]
  7. Khoury, D.S.; Cromer, D.; Reynaldi, A.; Schlub, T.E.; Wheatley, A.K.; Juno, J.A.; Subbarao, K.; Kent, S.J.; Triccas, J.A.; Davenport, M.P. Neutralizing antibody levels are highly predictive of immune protection from symptomatic SARS-CoV-2 infection. Nat. Med. 2021, 27, 1205–1211. [Google Scholar] [CrossRef]
  8. Wang, X.; Guo, X.; Xin, Q.; Pan, Y.; Hu, Y.; Li, J.; Chu, Y.; Feng, Y.; Wang, Q. Neutralizing Antibody Responses to Severe Acute Respiratory Syndrome Coronavirus 2 in Coronavirus Disease 2019 Inpatients and Convalescent Patients. Clin. Infect. Dis. Off. Publ. Infect. Dis. Soc. Am. 2020, 71, 2688–2694. [Google Scholar] [CrossRef]
  9. Rogers, T.F.; Zhao, F.; Huang, D.; Beutler, N.; Burns, A.; He, W.T.; Limbo, O.; Smith, C.; Song, G.; Woehl, J.; et al. Rapid isolation of potent SARS-CoV-2 neutralizing antibodies and protection in a small animal model. Science 2020, 369, 956–963. [Google Scholar] [CrossRef]
  10. Hall, V.J.; Foulkes, S.; Charlett, A.; Atti, A.; Monk, E.J.M.; Simmons, R.; Wellington, E.; Cole, M.J.; Saei, A.; Oguti, B.; et al. SARS-CoV-2 infection rates of antibody-positive compared with antibody-negative health-care workers in England: A large, multicentre, prospective cohort study (SIREN). Lancet 2021, 397, 1459–1469. [Google Scholar] [CrossRef]
  11. Bergwerk, M.; Gonen, T.; Lustig, Y.; Amit, S.; Lipsitch, M.; Cohen, C.; Mandelboim, M.; Gal Levin, E.; Rubin, C.; Indenbaum, V.; et al. Covid-19 Breakthrough Infections in Vaccinated Health Care Workers. N. Engl. J. Med. 2021, 385, 1474–1484. [Google Scholar] [CrossRef] [PubMed]
  12. L’Huillier, A.G.; Meyer, B.; Andrey, D.O.; Arm-Vernez, I.; Baggio, S.; Didierlaurent, A.; Eberhardt, C.S.; Eckerle, I.; Grasset-Salomon, C.; Huttner, A.; et al. Antibody persistence in the first 6 months following SARS-CoV-2 infection among hospital workers: A prospective longitudinal study. Clin. Microbiol. Infect. Off. Publ. Eur. Soc. Clin. Microbiol. Infect. Dis. 2021, 27, 784.e1–784.e8. [Google Scholar] [CrossRef] [PubMed]
  13. Wang, H.; Yuan, Y.; Xiao, M.; Chen, L.; Zhao, Y.; Haiwei, Z.; Long, P.; Zhou, Y.; Xu, X.; Lei, Y.; et al. Dynamics of the SARS-CoV-2 antibody response up to 10 months after infection. Cell. Mol. Immunol. 2021, 18, 1832–1834. [Google Scholar] [CrossRef] [PubMed]
  14. He, Z.; Ren, L.; Yang, J.; Guo, L.; Feng, L.; Ma, C.; Wang, X.; Leng, Z.; Tong, X.; Zhou, W.; et al. Seroprevalence and humoral immune durability of anti-SARS-CoV-2 antibodies in Wuhan, China: A longitudinal, population-level, cross-sectional study. Lancet 2021, 397, 1075–1084. [Google Scholar] [CrossRef]
  15. Tan, Y.; Liu, F.; Xu, X.; Ling, Y.; Huang, W.; Zhu, Z.; Guo, M.; Lin, Y.; Fu, Z.; Liang, D.; et al. Durability of neutralizing antibodies and T-cell response post SARS-CoV-2 infection. Front. Med. 2020, 14, 746–751. [Google Scholar] [CrossRef] [PubMed]
  16. Wu, J.; Liang, B.; Chen, C.; Wang, H.; Fang, Y.; Shen, S.; Yang, X.; Wang, B.; Chen, L.; Chen, Q.; et al. SARS-CoV-2 infection induces sustained humoral immune responses in convalescent patients following symptomatic COVID-19. Nat. Commun. 2021, 12, 1813. [Google Scholar] [CrossRef] [PubMed]
  17. Choe, P.G.; Kim, K.H.; Kang, C.K.; Suh, H.J.; Kang, E.; Lee, S.Y.; Kim, N.J.; Yi, J.; Park, W.B.; Oh, M.D. Antibody Responses 8 Months after Asymptomatic or Mild SARS-CoV-2 Infection. Emerg. Infect. Dis. 2021, 27, 928–931. [Google Scholar] [CrossRef]
  18. Pirofski, L.A. Disease severity and durability of the SARS-CoV-2 antibody response: A view through the lens of the second year of the pandemic. Clin. Infect. Dis. Off. Publ. Infect. Dis. Soc. Am. 2021, 73, e1345–e1347. [Google Scholar] [CrossRef]
  19. Jeewandara, C.; Aberathna, I.S.; Pushpakumara, P.D.; Kamaladasa, A.; Guruge, D.; Jayathilaka, D.; Gunasekara, B.; Tanussiya, S.; Kuruppu, H.; Ranasinghe, T.; et al. Antibody and T cell responses to Sinopharm/BBIBP-CorV in naïve and previously infected individuals in Sri Lank. medRxiv 2021. [Google Scholar] [CrossRef]
  20. Wang, H.; Zhang, Y.; Huang, B.; Deng, W.; Quan, Y.; Wang, W.; Xu, W.; Zhao, Y.; Li, N.; Zhang, J.; et al. Development of an Inactivated Vaccine Candidate, BBIBP-CorV, with Potent Protection against SARS-CoV-2. Cell 2020, 182, 713–721.e9. [Google Scholar] [CrossRef]
  21. Pan, H.; Wu, Q.; Zeng, G.; Yang, J.; Jiang, D.; Deng, X.; Chu, K.; Zheng, W.; Zhu, F.; Yu, H.; et al. Immunogenicity and safety of a third dose, and immune persistence of CoronaVac vaccine in healthy adults aged 18–59 years: Interim results from a double-blind, randomized, placebo-controlled phase 2 clinical trial. medRxiv 2021. [Google Scholar] [CrossRef]
  22. Lim, W.W.; Mak, L.; Leung, G.M.; Cowling, B.J.; Peiris, M. Comparative immunogenicity of mRNA and inactivated vaccines against COVID-19. Lancet Microbe 2021, 2, e423. [Google Scholar] [CrossRef]
  23. Riepler, L.; Rossler, A.; Falch, A.; Volland, A.; Borena, W.; von Laer, D.; Kimpel, J. Comparison of Four SARS-CoV-2 Neutralization Assays. Vaccines 2020, 9, 13. [Google Scholar] [CrossRef] [PubMed]
  24. von Rhein, C.; Scholz, T.; Henss, L.; Kronstein-Wiedemann, R.; Schwarz, T.; Rodionov, R.N.; Corman, V.M.; Tonn, T.; Schnierle, B.S. Comparison of potency assays to assess SARS-CoV-2 neutralizing antibody capacity in COVID-19 convalescent plasma. J. Virol. Methods 2021, 288, 114031. [Google Scholar] [CrossRef] [PubMed]
  25. Mendrone-Junior, A.; Dinardo, C.L.; Ferreira, S.C.; Nishya, A.; Salles, N.A.; de Almeida Neto, C.; Hamasaki, D.T.; Facincani, T.; de Oliveira Alves, L.B.; Machado, R.R.G.; et al. Correlation between SARS-CoV-2 antibody screening by immunoassay and neutralizing antibody testing. Transfusion 2021, 61, 1181–1190. [Google Scholar] [CrossRef] [PubMed]
  26. Zhou, P.; Yang, X.L.; Wang, X.G.; Hu, B.; Zhang, L.; Zhang, W.; Si, H.R.; Zhu, Y.; Li, B.; Huang, C.L.; et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature 2020, 579, 270–273. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Nie, J.; Li, Q.; Wu, J.; Zhao, C.; Hao, H.; Liu, H.; Zhang, L.; Nie, L.; Qin, H.; Wang, M.; et al. Establishment and validation of a pseudovirus neutralization assay for SARS-CoV-2. Emerg. Microbes Infect. 2020, 9, 680–686. [Google Scholar] [CrossRef] [Green Version]
  28. Kinsley, R.; Pronost, S.; De Bock, M.; Temperton, N.; Daly, J.M.; Paillot, R.; Scott, S. Evaluation of a Pseudotyped Virus Neutralisation Test for the Measurement of Equine Influenza Virus-Neutralising Antibody Responses Induced by Vaccination and Infection. Vaccines 2020, 8, 466. [Google Scholar] [CrossRef]
  29. Nie, J.; Li, Q.; Wu, J.; Zhao, C.; Hao, H.; Liu, H.; Zhang, L.; Nie, L.; Qin, H.; Wang, M.; et al. Quantification of SARS-CoV-2 neutralizing antibody by a pseudotyped virus-based assay. Nat. Protoc. 2020, 15, 3699–3715. [Google Scholar] [CrossRef]
  30. Valdivia, A.; Torres, I.; Latorre, V.; Frances-Gomez, C.; Albert, E.; Gozalbo-Rovira, R.; Alcaraz, M.J.; Buesa, J.; Rodriguez-Diaz, J.; Geller, R.; et al. Inference of SARS-CoV-2 spike-binding neutralizing antibody titers in sera from hospitalized COVID-19 patients by using commercial enzyme and chemiluminescent immunoassays. Eur. J. Clin. Microbiol. Infect. Dis. Off. Publ. Eur. Soc. Clin. Microbiol. 2021, 40, 485–494. [Google Scholar] [CrossRef]
  31. Tang, M.S.; Case, J.B.; Franks, C.E.; Chen, R.E.; Anderson, N.W.; Henderson, J.P.; Diamond, M.S.; Gronowski, A.M.; Farnsworth, C.W. Association between SARS-CoV-2 neutralizing antibodies and commercial serological assays. Clin. Chem. 2020, 66, 1538–1547. [Google Scholar] [CrossRef]
  32. Rowntree, L.C.; Chua, B.Y.; Nicholson, S.; Koutsakos, M.; Hensen, L.; Douros, C.; Selva, K.; Mordant, F.L.; Wong, C.Y.; Habel, J.R.; et al. Robust correlations across six SARS-CoV-2 serology assays detecting distinct antibody features. Clin. Transl. Immunol. 2021, 10, e1258. [Google Scholar] [CrossRef] [PubMed]
  33. Taylor, S.C.; Hurst, B.; Charlton, C.L.; Bailey, A.; Kanji, J.N.; McCarthy, M.K.; Morrison, T.E.; Huey, L.; Annen, K.; DomBourian, M.G.; et al. A New SARS-CoV-2 Dual-Purpose Serology Test: Highly Accurate Infection Tracing and Neutralizing Antibody Response Detection. J. Clin. Microbiol. 2021, 59, e02438–20. [Google Scholar] [CrossRef] [PubMed]
  34. den Hartog, G.; Vos, E.R.A.; van den Hoogen, L.L.; van Boven, M.; Schepp, R.M.; Smits, G.; van Vliet, J.; Woudstra, L.; Wijmenga-Monsuur, A.J.; van Hagen, C.C.E.; et al. Persistence of antibodies to SARS-CoV-2 in relation to symptoms in a nationwide prospective study. Clin. Infect. Dis. Off. Publ. Infect. Dis. Soc. Am. 2021, 73, 2155–2162. [Google Scholar] [CrossRef] [PubMed]
  35. Achiron, A.; Gurevich, M.; Falb, R.; Dreyer-Alster, S.; Sonis, P.; Mandel, M. SARS-CoV-2 antibody dynamics and B-cell memory response over time in COVID-19 convalescent subjects. Clin. Microbiol. Infect. Off. Publ. Eur. Soc. Clin. Microbiol. Infect. Dis. 2021, 27, 1349.e1–1349.e6. [Google Scholar] [CrossRef]
  36. Bartsch, Y.C.; Fischinger, S.; Siddiqui, S.M.; Chen, Z.; Yu, J.; Gebre, M.; Atyeo, C.; Gorman, M.J.; Zhu, A.L.; Kang, J.; et al. Discrete SARS-CoV-2 antibody titers track with functional humoral stability. Nat. Commun. 2021, 12, 1018. [Google Scholar] [CrossRef]
  37. Gaebler, C.; Wang, Z.; Lorenzi, J.C.C.; Muecksch, F.; Finkin, S.; Tokuyama, M.; Cho, A.; Jankovic, M.; Schaefer-Babajew, D.; Oliveira, T.Y.; et al. Evolution of antibody immunity to SARS-CoV-2. Nature 2021, 591, 639–644. [Google Scholar] [CrossRef]
  38. Li, Y.; Lai, D.Y.; Zhang, H.N.; Jiang, H.W.; Tian, X.; Ma, M.L.; Qi, H.; Meng, Q.F.; Guo, S.J.; Wu, Y.; et al. Linear epitopes of SARS-CoV-2 spike protein elicit neutralizing antibodies in COVID-19 patients. Cell. Mol. Immunol. 2020, 17, 1095–1097. [Google Scholar] [CrossRef]
  39. Dupont, L.; Snell, L.B.; Graham, C.; Seow, J.; Merrick, B.; Lechmere, T.; Maguire, T.J.A.; Hallett, S.R.; Pickering, S.; Charalampous, T.; et al. Neutralizing antibody activity in convalescent sera from infection in humans with SARS-CoV-2 and variants of concern. Nat. Microbiol. 2021, 6, 1433–1442. [Google Scholar] [CrossRef]
  40. Huang, B.; Dai, L.; Wang, H.; Hu, Z.; Yang, X.; Tan, W.; Gao, G.F. Serum sample neutralisation of BBIBP-CorV and ZF2001 vaccines to SARS-CoV-2 501Y.V2. Lancet Microbe 2021, 2, e285. [Google Scholar] [CrossRef]
  41. Garcia-Beltran, W.F.; Lam, E.C.; St Denis, K.; Nitido, A.D.; Garcia, Z.H.; Hauser, B.M.; Feldman, J.; Pavlovic, M.N.; Gregory, D.J.; Poznansky, M.C.; et al. Multiple SARS-CoV-2 variants escape neutralization by vaccine-induced humoral immunity. Cell 2021, 184, 2372–2383.e9. [Google Scholar] [CrossRef] [PubMed]
  42. China NHCo New Coronavirus Pneumonia Prevention and Control Program (8th). Available online: http://www.nhc.gov.cn/xcs/zhengcwj/202104/7de0b3837c8b4606a0594aeb0105232b/files/f192ac6e5567469db4f0a8691ca18907.pdf (accessed on 1 December 2021).
Figure 1. Blood specimen collection and vaccination schedules for the two cohorts. The blood samples were collected from convalescent patients recovered from COVID-19 and vaccinated population. The interval between two vaccinations is 21 days. In the figure, 0 days refers to the day before vaccination; 14 days refers to the days post 1st dose vaccination; 49 days, 111 days and 201 days refers to 28, 90 and 180 days after 2nd vaccination (fully vaccination), respectively. The icons of vaccination and blood sampling were represented by blood drops and syringes, respectively.
Figure 1. Blood specimen collection and vaccination schedules for the two cohorts. The blood samples were collected from convalescent patients recovered from COVID-19 and vaccinated population. The interval between two vaccinations is 21 days. In the figure, 0 days refers to the day before vaccination; 14 days refers to the days post 1st dose vaccination; 49 days, 111 days and 201 days refers to 28, 90 and 180 days after 2nd vaccination (fully vaccination), respectively. The icons of vaccination and blood sampling were represented by blood drops and syringes, respectively.
Pathogens 11 00171 g001
Figure 2. Pseudovirus neutralization test (a); chemiluminescent microparticle immunoassay (b); WANTAI SARS-CoV-2 Ab ELISA (c) were indicated by 50% effective inhibitory concentration, chemiluminescence signal value divided by cutoff (absorbance/cutoff, S/CO) and OD450 value of SARS-CoV-2 RBD-binding antibodies respectively. The dotted line represents the cutoff values of these detections. Two-tailed p value were determined using nonparametric Dunn’s Kruskal-Wallis test. The top of boxs display the median and the bars indicate IQR. Each hollow diagram represents a data. ns, no significance.
Figure 2. Pseudovirus neutralization test (a); chemiluminescent microparticle immunoassay (b); WANTAI SARS-CoV-2 Ab ELISA (c) were indicated by 50% effective inhibitory concentration, chemiluminescence signal value divided by cutoff (absorbance/cutoff, S/CO) and OD450 value of SARS-CoV-2 RBD-binding antibodies respectively. The dotted line represents the cutoff values of these detections. Two-tailed p value were determined using nonparametric Dunn’s Kruskal-Wallis test. The top of boxs display the median and the bars indicate IQR. Each hollow diagram represents a data. ns, no significance.
Pathogens 11 00171 g002
Figure 3. The seropositivity and antibodies level against SARS-CoV-2 in vaccinated population; (a) shows the seropositivity of CMIA, SARS-CoV-2 Ab ELISA and PVNT in vaccinated population at a longitudinal follow-up. nAb levels were detected by pseudovirus neutralization test (PVNT) (b) and chemiluminescent microparticle immunoassay (CMIA) (d); RBD-binding antibody level was detected by SARS-CoV-2 Ab enzyme-linked immunosorbent Assay (SARS-CoV-2 Ab ELISA) (c); the various line colors in the picture represent different individuals.
Figure 3. The seropositivity and antibodies level against SARS-CoV-2 in vaccinated population; (a) shows the seropositivity of CMIA, SARS-CoV-2 Ab ELISA and PVNT in vaccinated population at a longitudinal follow-up. nAb levels were detected by pseudovirus neutralization test (PVNT) (b) and chemiluminescent microparticle immunoassay (CMIA) (d); RBD-binding antibody level was detected by SARS-CoV-2 Ab enzyme-linked immunosorbent Assay (SARS-CoV-2 Ab ELISA) (c); the various line colors in the picture represent different individuals.
Pathogens 11 00171 g003
Figure 4. Antibodies response was compared by PVNT, CMIA and SARS-CoV-2 Ab ELISA between vaccinated and convalescent populations. NAb levels were detected by pseudovirus neutralization test (PVNT) (a) and chemiluminescent microparticle immunoassay (CMIA) (b); RBD-binding antibody level was detected by SARS-CoV-2 Ab enzyme-linked immunosorbent Assay (SARS-CoV-2 Ab ELISA) (c); Two-tailed, nonparametric Dunn’s Kruskal–Wallis test was used for multiple comparisons. The bars displayed the median and IQR. Part of the results between groups is shown in the figure. * p < 0.05; *** p < 0.0001. Each hollow circle represents data.
Figure 4. Antibodies response was compared by PVNT, CMIA and SARS-CoV-2 Ab ELISA between vaccinated and convalescent populations. NAb levels were detected by pseudovirus neutralization test (PVNT) (a) and chemiluminescent microparticle immunoassay (CMIA) (b); RBD-binding antibody level was detected by SARS-CoV-2 Ab enzyme-linked immunosorbent Assay (SARS-CoV-2 Ab ELISA) (c); Two-tailed, nonparametric Dunn’s Kruskal–Wallis test was used for multiple comparisons. The bars displayed the median and IQR. Part of the results between groups is shown in the figure. * p < 0.05; *** p < 0.0001. Each hollow circle represents data.
Pathogens 11 00171 g004
Figure 5. The correlations between PVNT50 with OD450 and S/CO; The correlations between PVNT50 with OD450 values of SARS-CoV-2 Ab ELISA and S/CO of CMIA in convalescent patients (a,d), vaccinated population (b,e) and combination of the two cohorts (c,f) were analyzed by non-linear regression models. A scatter point represents a record, and the brown error band represents the 95% confidence interval. R2 represents the degree of linear deviation obtained by fitting the experimental data. The p-value tests whether the regression equation is significant. The larger R2, the smaller the p-value. When R2 is greater than 0.5 and p-value less than 0.05, this linear model can be considered valuable.
Figure 5. The correlations between PVNT50 with OD450 and S/CO; The correlations between PVNT50 with OD450 values of SARS-CoV-2 Ab ELISA and S/CO of CMIA in convalescent patients (a,d), vaccinated population (b,e) and combination of the two cohorts (c,f) were analyzed by non-linear regression models. A scatter point represents a record, and the brown error band represents the 95% confidence interval. R2 represents the degree of linear deviation obtained by fitting the experimental data. The p-value tests whether the regression equation is significant. The larger R2, the smaller the p-value. When R2 is greater than 0.5 and p-value less than 0.05, this linear model can be considered valuable.
Pathogens 11 00171 g005
Table 1. Clinical characteristics of CP-6M from COVID-19.
Table 1. Clinical characteristics of CP-6M from COVID-19.
CharacteristicsAll Patients (n = 40)
Age, y
Median (IQR)52.0 (38.3–59.8)
≤6030
>6010
Gender
Male24
Female16
Disease severity
Non-severe
Mild3
Moderate12
Severe
Severe17
Critical8
Comorbidities
Liver diseases19
Hypertension11
Diabetes5
Cardiovascular diseases5
Pulmonary diseases5
Rheumatic immune diseases1
Without Comorbidities9
Table 2. Antibody activity in vaccinated population and convalescent patients.
Table 2. Antibody activity in vaccinated population and convalescent patients.
PVNT, Median (IQR)CMIA, Median (IQR)SARS-CoV-2 Ab ELISA, Median (IQR)
Before vaccination<20 (/)1.41 (1.26–1.51)0.002 (0.001–0.003)
14 days after 1st vaccination<20 (<20–36)0.99 (0.67–1.37)0.43 (0.124–2.04)
28 days after 2nd vaccination86 (45–190)0.05 (0.01–0.30)3.41(1.01–3.63)
90 days after 2nd vaccination51(31–103)0.42 (0.173–1.229)2.56 (0.84–3.62)
180 days after 2nd vaccination31 (<20–42.5)0.72 (0.59–1.10)1.47 (0.37–2.31)
Convalescent, 6 months recovered from COVID-19240.5 (114–452)0.052 (0.01–0.18)3.83 (3.77–3.86)
Table 3. The detection values of the SARS-CoV-2 Ab ELISA and CMIA in the PVNT50 ≥20 and PVNT50 < 20 groups.
Table 3. The detection values of the SARS-CoV-2 Ab ELISA and CMIA in the PVNT50 ≥20 and PVNT50 < 20 groups.
SARS-CoV-2 Ab ELISACMIA
ConvalescentsVaccinated PopulationConvalescents and Vaccinated PopulationConvalescentsVaccinated
Population
Convalescents and Vaccinated Population
Sensitivity100%91.8%95.1%100%85.7%91.3%
Specificity100%80.6%71.1%100%83.3%80.0%
NPV100%87.9%86.5%100%81.1%80.0%
PPV100%86.5%88.3%100%87.5%91.3%
Consistency1.000.730.701.000.690.71
NPV: negative predictive value; PPV: positive predictive value; Chi-square test and Fisher’s exact tests were carried out to evaluate the detection values of SARS-CoV-2 Ab ELISA and CMIA in the PVNT50 ≥ 20 and PVNT50 < 20 groups.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hu, C.; Li, D.; Liu, Z.; Ren, L.; Su, J.; Zhu, M.; Feng, Y.; Wang, Z.; Liu, Q.; Zhu, B.; et al. Exploring Rapid and Effective Screening Methods for Anti-SARS-CoV-2 Neutralizing Antibodies in COVID-19 Convalescent Patients and Longitudinal Vaccinated Populations. Pathogens 2022, 11, 171. https://doi.org/10.3390/pathogens11020171

AMA Style

Hu C, Li D, Liu Z, Ren L, Su J, Zhu M, Feng Y, Wang Z, Liu Q, Zhu B, et al. Exploring Rapid and Effective Screening Methods for Anti-SARS-CoV-2 Neutralizing Antibodies in COVID-19 Convalescent Patients and Longitudinal Vaccinated Populations. Pathogens. 2022; 11(2):171. https://doi.org/10.3390/pathogens11020171

Chicago/Turabian Style

Hu, Caiqin, Dan Li, Zhanmou Liu, Li Ren, Junwei Su, Meiling Zhu, Yi Feng, Zheng Wang, Qiang Liu, Biao Zhu, and et al. 2022. "Exploring Rapid and Effective Screening Methods for Anti-SARS-CoV-2 Neutralizing Antibodies in COVID-19 Convalescent Patients and Longitudinal Vaccinated Populations" Pathogens 11, no. 2: 171. https://doi.org/10.3390/pathogens11020171

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop