Next Article in Journal
Design and Synthesis of Small Molecule Probes of MDA-9/Syntenin
Previous Article in Journal
Chemical and Biological Characterization of Metabolites from Silene viridiflora Using Mass Spectrometric and Cell-Based Assays
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Enzyme-Linked ImmunoSpot Analytic Method for the Detection of Human IFN-γ from Peripheral Blood Mononuclear Cells in Response to the SARS-CoV-2 Spike Protein

by
Laura E. Carreto-Binaghi
1,
Milton Nieto-Ponce
1,
Andrea Palencia-Reyes
1,
Rodolfo L. Chávez-Domínguez
1,
Jessica Blancas-Zaragoza
1,
Pablo Franco-Mendoza
1,
Montserrat A. García-Ramos
1,
Claudia I. Hernández-Lázaro
2,
Martha Torres
1,* and
Claudia Carranza
1,*
1
Laboratorio de Inmunobiología de la Tuberculosis, Instituto Nacional de Enfermedades Respiratorias (INER) Ismael Cosío Villegas, Mexico City 14080, Mexico
2
Laboratorio Clinico, Instituto Nacional de Enfermedades Respiratorias (INER) “Ismael Cosío Villegas”, Mexico City 14080, Mexico
*
Authors to whom correspondence should be addressed.
Biomolecules 2024, 14(10), 1286; https://doi.org/10.3390/biom14101286
Submission received: 30 August 2024 / Revised: 25 September 2024 / Accepted: 1 October 2024 / Published: 11 October 2024
(This article belongs to the Section Biological Factors)

Abstract

:
COVID-19 vaccine evaluations are mainly focused on antibody analyses, but there is growing interest in measuring the cellular immune responses from the researchers evaluating these vaccines. The cellular responses to several COVID-19 vaccines have been studied using the enzyme-linked immunospot (ELISPOT) assay for IFN-γ. However, the ELISPOT assay is no longer used only for research purpose and so the performance of this assay must be validated. Since the bioanalytical validation of ELISPOT-IFN-γ is essential for evaluating the method’s effectiveness and establishing confidence in a vaccine’s immunogenicity, the present work validates the ELISPOT-IFN-γ assay’s performance in determining the frequency of IFN-γ-producing cells after stimulation with the SARS-CoV-2 spike protein. The validation was performed in peripheral blood mononuclear cells from volunteers immunized with anti-COVID-19 vaccines. According to the findings, the LOD was 17 SFU and the LLOQ was 22 SFU, which makes the method highly sensitive and suitable for evaluating low levels of cellular responses. The procedure’s accuracy is confirmed by the correlation coefficients for the spike protein and anti-CD3+, being 0.98 and 0.95, respectively. The repeatability and intermediate precision tests were confirmed to be reliable by obtaining a coefficient of variation of ≤25%. The results obtained in this validation enable the assay to be employed for studying antigen-specific cells and evaluating cellular responses to vaccines.

1. Introduction

For the first time in history, different anti-COVID vaccine platforms were established in record time, including vaccines composed of viral mRNA or DNA, protein subunits, attenuated or inactivated viruses, viral vectors, and virus-like particles [1]. One of the main target epitopes is the SARS-CoV-2 spike protein, a surface homotrimer built from two subunits (S1 and S2), which binds to the angiotensin-converting enzyme 2 (ACE2) receptor in human cells and is critical in viral entry and replication during the infection [2,3].
In general, an important caveat in the evaluation of viral vaccines, including COVID-19, is the lack of an appropriate immune correlate of protection, a defined biomarker that would indicate vaccine-induced protection from natural infection [4]. Neutralizing antibodies are generally recommended as the primary correlate of protection [5]; they prevent infection and/or severe disease, and the methodology used for their detection might be easily reproduced in different settings to facilitate comparisons between the data collected in clinical trials using diverse vaccine platforms [6]. Most SARS-CoV-2 vaccines induce specific neutralizing antibodies against the spike protein, therefore blocking its interaction with the ACE2 receptor and preventing the virus from entering into the cell [7]. However, immune protection against viral infections goes beyond the production of antibodies. Cell-mediated immunity largely contributes to long-term responses to viruses, mainly through the recognition of viral proteins for cytokine secretion [8,9,10].
In the context of vaccines, the evaluation of memory T cell responses might be performed by distinct assays, such as proliferation, differentiation towards specific subsets, and the production and release of cytokines upon stimulation with specific antigens [11,12]. SARS-CoV-2 vaccines predominantly induce Th1 responses, characterized by the release of pro-inflammatory cytokines such as tumor necrosis factor alpha (TNFα), interleukin 2 (IL-2), and interferon gamma (IFNγ) [13]. The production and release of IFNγ by effector memory CD4+ and CD8+ T cells is key for the immunoregulatory and antiviral functions of host defense. In this regard, the IFNγ enzyme-linked immunospot assay (ELISPOT-IFNγ) has been routinely used to evaluate cellular responses to various vaccine candidates [14], including those against human immunodeficiency virus [15,16] and SARS-CoV-2 [17,18].
For this purpose, the study of the immune response to specific antigens in clinical trials requires the validation of the technique to assert the reliability of the results in ex vivo tests. However, validation is generally performed for quantitative biomarker detection assays [19], and scarcely for semi-quantitative techniques evaluating cellular responses, such as ELISPOT-IFNγ.
Validation of ELISPOT-IFNγ assay is particularly relevant for assessing the efficacy of the method and its correlation with additional tests for vaccine immunogenicity. Additionally, full compliance with Good Laboratory Practices must always be ensured. To validate a bioanalytical assay, several parameters should be evaluated according to the intended application of the technique and the biological limits of the assay [19].
The upper and lower limits of quantification (LLOQ) represent the range in which the analyte might be measured with accuracy and precision, whereas the limit of detection (LOD) is the minimum concentration of analyte that produces a significantly different signal to the background [20]. Specificity is the ability of the test to identify the analyte from other components and accuracy is the highest approximation of the results with the reference values.
The precision profile of the method is depicted by the coefficient of variation (CV), which relies on repeatability (intra-assay precision), reproducibility (inter-assay or cross validation), and intermediate precision (non-significant changes in the assay conditions) [21]. Depending on the type of assay employed, either dilution linearity or parallelism will determine its accuracy on multiple dilutions of the study sample. Finally, the robustness of the assay indicates the overall reliability of the obtained results regardless of predetermined changes in the procedure.
In the present work we describe the validation of the ELISPOT-IFNγ technique, an ex vivo assay intended to assess the frequency of IFNγ-producing cells after stimulation with the SARS-CoV-2 spike protein, primarily focused on evaluating vaccine-induced T cell-mediated immunity.

2. Materials and Methods

2.1. Sample Collection

Peripheral blood samples were obtained by venipuncture from healthy donors with an age range of 30–50 years with a previous SARS-CoV-2 infection and complete vaccination with the COVID-19 mRNA vaccine (Pfizer, New York, NY, USA). At the time of venipuncture, the donors presented no symptoms of acute SARS-CoV-2 infection. Considering that specific T cell responses might develop in a volunteer-dependent way, before performing the validation assay, we tested the ELISPOT-IFNγ assay on 10 healthy volunteers. Volunteers with a prior SARS-CoV-2 vaccination and previously confirmed SARS-CoV-2 infection were chosen to ensure that their T cells would show a response to the recombinant Spike S1 protein of SARS-CoV-2 (RayBiotech, Peachtree Corner, GA, USA. The participants were recruited at the National Institute of Respiratory Diseases (INER) in Mexico City. The Institutional Ethics and Research Committee approved this study, and all participants provided written informed consent, per the Declaration of Helsinki.

2.2. Isolation and Freezing of Peripheral Blood Mononuclear Cells (PBMCs)

For the validation, we selected the four volunteers with the best responses, whose data are presented in this manuscript. Within the first 2 h after blood collection, PBMCs were isolated as previously described [22]. In brief, whole blood was diluted at a 1:1 ratio with RPMI-1640 medium (Lonza, Walkersville, MD, USA) supplemented with L-glutamine (Lonza, Walkersville, MD, USA) and gentamicin (Gibco, Waltham, MD, USA). The PBMCs were purified using Lymphoprep (Serumwerk, Bernburg, Germany) through a density gradient by centrifugation. The viability of the PBMC always exceeded 98% and was evaluated by manual counting using trypan blue (Sigma, Burlington, MA, USA). Then, the cells were frozen at a concentration of 10 × 106 cells/mL in fetal bovine serum (FBS) (Gibco, Waltham, MA, USA) with 10% of dimethyl sulfoxide (Sigma, Burlington, MA, USA). The vials were placed in a freezing container (Nalgene, Rochester, NY, USA) overnight at −80 °C and then transferred to their definitive storage location at −80 °C until used.

2.3. Thawing of PBMC

The PBMCs were thawed using a water bath (Thermo Scientific, Winchester, VA, USA) at 37 °C. They were slowly diluted in 5 mL of OPTmizer-CTS medium (Gibco, Waltham, MA, USA) supplemented with L-glutamine (Lonza, Walkersville, MD, USA) and gentamicin (Gibco, Waltham, MD, USA), which was previously warmed to 37 °C. Following thawing, the PBMCs were centrifuged at 316 rcf for 10 min at room temperature (RT) and resuspended in 1 mL of medium for manual counting using trypan blue (Sigma, Burlington, MA, USA). The cell viability was greater than 98% and their recovery always exceeded 85%. The PBMCs suspension was adjusted to a final concentration of 2 × 106 cells/mL with supplemented OPTmizer-CTS medium (Gibco, Waltham, MA, USA).

2.4. Preparation of Stimuli

Stimuli were prepared before starting the assay. Recombinant Spike S1 protein was employed as the target stimulus at a concentration of 5 μg/mL in supplemented OPTmizer-CTS (Gibco, Waltham, MA, USA) medium and Phytohemagglutinin (PHA) (Sigma, Burlington, MA, USA) was used as a positive control at a concentration of 5 μg/mL. This stimulus was tested since it is widely employed to stimulate PBMCs in assays such as ELISAs that quantify IFNγ production [23].
The optimal concentration of the stimuli was determined in previous titration experiments. Additionally, the human anti-CD3+ monoclonal antibody included in the ELISpot PRO Kit (Mabtech AB, Stockholm, Sweden) was used as an internal control at a dilution of 1:1000 as recommended by the manufacturer. Supplemented OPTmizer-CTS medium was used as a negative control.

2.5. Human IFNγ ELISpot Assay

The ELISPOT-IFNγ assay was performed using the ELISPOT-IFNγ PRO human IFNγ Kit 3420-ehst-10 (Mabtech AB, Stockholm, Sweden) as the antibody platform. In brief, 96-well plates pre-sensitized with human IFNγ antibody were washed 4 times with phosphate-buffered saline (PBS) (Lonza, Walkersville, MD, USA). The plates were then blocked with 200 μL of supplemented OPTmizer CTS medium per well for 30 min at RT. The medium was removed by inversion and 100 μL of the Spike, PHA, and anti-CD3+ stimuli were added to each well according to the plate design. Then, a different number of cells per well were added. Plates were incubated at 37 °C and 5% CO2 for 20 h.
After incubation, the cells were removed by inversion and the plates were washed 5 times with PBS; 100 μL per well of the detection monoclonal antibody anti IFNg (Mabtech AB, Stockholm, Sweden) diluted 1:200 in PBS with 0.5% FBS was added and plates were incubated for 2 h at RT, protected from light. Following incubation, the plates were washed 5 times with PBS and 100 μL of the tetramethylbenzidine (TMB, Mabtech AB, Stockholm, Sweden) substrate was added per well. The plates were incubated for 5 min protected from light, followed by 6 washes with deionized water. Finally, the plates were gently dried with a nonabrasive cellulose-fiber wiper and left to dry for 24–48 h protected from light at RT.

2.6. Data Acquisition

The ELISPOT-IFNγ plates were acquired 2 days after performing the assay using the CTL ImmunoSpot® M6 automated analyzer (CTL, Cleveland, OH, USA) and later analyzed using the ImmunoSpot® Software version 7.1.
After image acquisition, the spot-forming units (SFU) were counted using the automatically adjusted settings of the software (raw results), followed by the Quality Control function to eliminate artifacts. The counting parameters used were sensitivity 145, background balance 80, minimum spot size 0.00050 mm3, maximum spot size 9.6203 mm3, and spot separation 3. Absolute counting results were exported as individual Excel files for each plate.

2.7. Validation Protocol Design

For the validation of the ELISPOT-IFNγ analytic method, the linearity assay was performed using three replicates of increasing amounts of PBMCs (5 × 104, 1 × 105, 1.5 × 105, 2 × 105, 2.5 × 105, 3 × 105, and 3.5 × 105 cells per well) from one of the volunteers. All experiments were performed in triplicate. After obtaining the results from this assay, we decided to use 2 × 105 PBMCs for the rest of the experiments.
Intermediate precision, LOD, and LLOQ were evaluated through 10 replicates from each of the three donors for intermediate precision, and another operator assessed the same samples in the same conditions on a different day. The LLOQ was calculated according to the following equation [24]
LLOQ = mean + (3 × DS)

2.8. Statistical Analysis

The normality of the data was evaluated by using a Shapiro–Wilk test using the GraphPad Prism V9 software. To demonstrate the linearity of the method, we calculated the mean of the three determinations of SFUs in response to the Spike stimulus and their correlation with their corresponding cell density. The method was considered valid when it reached a multiple determination coefficient (r2) ≥ 0.93.
For repeatability and intermediate precision, we calculated the arithmetic mean and standard deviation (SD) of the 10 determinations of SFC in response to the Spike stimulus and then calculated the CV of each repetition of the three volunteers. The method was considered to be valid when it reached a cut-off CV ≤ 25 [25,26] in the overall results from the three volunteers. In the repeatability assay, data obtained from anti-CD3+ and PHA exposure were compared using a Student’s t-test. A value of p < 0.05 was considered statistically significant.
For the lower detection limit, we calculated the mean and standard deviation (SD) of the 10 determinations of SFC in response to the medium stimulus to obtain the CV of each result of the three volunteers.

3. Results

So far, there are no internationally accepted standardized operational procedures to validate the ELISPOT-IFNγ assay. Therefore, our laboratory required a validation design focused on the needs of our assay and the specific experimental conditions that needed to be validated. This design was based on the main parameters that contribute to the variability of the assay such as the LOD, LLOQ, linearity, repeatability, and intermediate precision. By validating these parameters, we could ensure that the results were reliable. The results were reported as spots produced by cells (2 × 105/well).
To validate the ELISPOT-IFNγ, we considered parameters such as, linearity, LOD, LLOQ, and intermediate precision. An ELISPOT-IFNγ assay should be sensitive, precise, reproducible among operators, specific, and semi-quantitative. Additionally, it is required to show acceptable detection and quantification limits despite small variations in operating conditions.

3.1. Linearity

Linearity evaluates the ability of an assay to give results that are directly proportional to the concentration of the analyte being measured. In the case of ELISPOT-IFNγ, the number of IFNγ spots obtained should be directly proportional to the number of PBMCs placed in the wells. For the evaluation of linearity, PBMC from a single donor were used, evaluating nine replicates at seven different cellular densities (5 × 104, 1 × 105, 1.5 × 105, 2 × 105, 2.5 × 105, 3 × 105, and 3.5 × 105 PBMC). The PBMC swere stimulated with the recombinant S1 protein (Table 1) and with anti-CD3+ antibody as positive control (Table 2). The results showed a significant linear relationship to produce IFNγ after stimulating the PBMC with the recombinant S1 protein (r2 = 0.98, p < 0.0001), or anti-CD3 antibody (r2 = 0.95, p < 0.001) as shown in Figure 1.

3.2. Limit of Detection (LOD)

In ELISPOT-IFNγ, the LOD is defined as the minimum number of spots that can be detected in the unstimulated condition (OPTmizer medium). As ELISPOT-IFNγ is highly sensitive, we calculated the LOD by counting the non-specific background signals under non-stimulation conditions, i.e., the number of spots produced by cells in the OPTmizer medium. The PBMCs from three volunteers were analyzed, performing 10 replicates in duplicate (2 × 105 cells/well). The immune response of volunteers accounted for the variability of the results obtained. The limit of detection was calculated according to Lee et al. [20] as:
LOD = O + 2SD(O)
where O is the average number of spots obtained in each well and SD is the standard deviation of the assay (Table 3). Using the LOD formula, the limits of detection was 26.51, 4.30, and 20.32 spots from donors A, B, and D, respectively. In this setting, the average of the detection limits of each volunteer resulted in a detection limit of 17 spots/well (Figure 2). In addition, the LLOQ was calculated by employing the results obtained from the LOD assay, corresponding to a value of 22 spots/well.

3.3. Repeatability

The repeatability of the analytical method was evaluated to demonstrate the accuracy of the assay. Repeatability indicates the variability in the results of successive measurements of the same sample and is usually expressed as the standard deviation or the CV. Measurements were performed in a standardized manner under the same operational conditions, including the same operator, equipment, laboratory, batch of reagents, and day.
For donor A, the coefficients of variation were 20.43, 18.41, and 8.89% for the Spike, PHA, and anti-CD3+ stimuli, respectively. In donor B, the coefficients of variation were 19.13, 10.21, and 17.73% for the Spike, PHA, and anti-CD3+ stimuli, respectively. Finally, in donor C, the coefficients of variation were 14.86, 15.40, and 8.00% for the same stimuli, respectively (Table 4, Figure 3).

3.4. Intermediate Precision

Intermediate precision indicates the reproducibility of the method when changes are applied to the analysis conditions. The intermediate precision of ELISPOT-IFNγ is a measure of the robustness and reliability of the method. This evaluation is fundamental to assessing the degree of uncertainty associated with the results and to ensure the comparability of the data obtained under different working conditions within the same laboratory. The intermediate precision was carried out in a standardized manner with two different operators and on different days. Three volunteers were analyzed, with 10 repetitions and each one in duplicate (2 × 105 cells/well). The acceptance criterion for the CV was established at a value of less than or equal to 25% (CV ≤ 25%). The results represent the number of spots obtained from the analysis of three samples from donors stimulated with the Spike, PHA, and anti-CD3+ antibody. Intermediate precision contributes to ensuring data quality in terms of reproducibility.
From donor A, the coefficients of variation were 20.43, 18.41, and 8.89% for the Spike, PHA, and anti-CD3+ stimuli, respectively (Table 5). For donor B, the coefficients of variation were 19.13, 10.21, and 17.73% for the Spike, PHA, and anti-CD3+ stimuli, respectively (Table 6). In the case of donor C, the coefficients of variation were 14.86, 15.40, and 8.00% for the same stimuli, respectively (Table 7).
Intermediate precision evaluates the reproducibility of the method. In our results, we obtained a CV ≤ 21%, which indicates that the method is reliable and robust enough for application in biomedical research.

4. Discussion

ELISPOT-IFNγ is a functional assay used to evaluate the frequency of T cells that recognize a specific antigen. It is a semiquantitative and highly sensitive technique used to evaluate the immune response to infectious diseases, as well as the immune response induced by vaccines, including the SARS-CoV-2 vaccine [14,27]. However, the reproducibility and reliability of the results depend on factors such as the experience of the operators, especially of handling primary blood cells and reagents, as well as the instruments and equipment used [28].
ELISPOT-IFNγ is not only used for research or exploration purposes; it is widely employed in various preclinical or clinical studies, in which it has proven to be a useful tool for biomarker detection in diagnostics, immunotherapies, and vaccine evaluation [28,29].
Despite its extensive use in research and in clinical settings, ELISPOT-IFNγ does not have a regulatory guide available to develop and validate this type of assay. In addition, there are no appropriate reference standards or positive control samples that guarantee the certainty of the results. This creates the need to validate the method according to the objectives of each scientific protocol.
Since the ELISPOT-IFNγ assay must be sensitive, precise, reproducible, specific, and semi-quantitative, we assessed the suitability of the assay through these parameters.
Regarding the limit of detection, our results showed an LOD of 17 SFC (Table 1). The of LOD in our study was determined by counting non-specific background signals under non-stimulation conditions, using PBMCs from three volunteers. We performed 10 replicates in duplicate for each volunteer, analyzing 2 × 105 cells per well. The LOD values for donors A, B, and C were 26.51, 4.30, and 20.32 spots, respectively, resulting in an average detection limit of 17 spots per well. The variation in the LOD between donors highlights individual differences in background immune activity, which is expected given the natural variability in immune responses across individuals. This variability is a crucial factor to account for, as it ensures the assay is sensitive enough to detect low levels of antigen-specific T cell responses, even in individuals with inherently higher baseline reactivity.
This LOD is lower than that reported by Schmittel et al. [29] suggesting that our technique is highly sensitive, suitable for evaluating low levels of cellular responses [17,18]. The obtained LOD was established as a negative control. Since the response of T cells can vary across healthy, sick, or immunosuppressed individuals [30,31], it is advisable to establish the LOD for the population to be studied.
Using the data obtained from the LOD calculations, we determined the Lower Limit of Quantification (LLOQ) to be 22 spots per well. In practical terms, the LLOQ ensures that even low-level immune responses to SARS-CoV-2 spike protein can be consistently measured, which is critical in assessing vaccine efficacy, particularly in populations with weaker immune responses such as the elderly or immunocompromised individuals.
Linearity indicates the number of cells that we should use for a reliable result [29,32]. In our linearity analysis, seven cell densities were tested, from 50,000 to 350,000 cells after stimulating the PBMCs with the S1 (Spike) protein and with the anti-CD3+ antibody. Correlation coefficients of r2 = 0.98 and r2 = 0.95 were obtained for the recombinant S1 protein and anti-CD3+, respectively, as shown in Figure 1. These results are in line with those reported by Waerlop [32], which confirms the accuracy of the procedure. The choice of the dilution factor is fundamental to ensure an adequate number of points for the calculation of other parameters.
Precision is defined as the proximity of values obtained across a series of measurements performed from the same sample under certain conditions [33]. We established the precision of the method through repeatability and intermediate precision tests. We performed repeatability tests with PBMC samples from three volunteers and 10 replicates. The intermediate precision tests were performed on different days and by different operators. The values obtained from repeatability tests showed a range of 675.25 to 1564.05 SFU, with a range from 579.25 to 2312.55 SFU for intermediate precision. The variation coefficients were ≤25%, both in the repeatability and intermediate precision tests, confirming the reliability of the results. These results demonstrate that the analytical method employing the ELISPOT-IFNγ assay is precise, since the criteria for evaluating repeatability and intermediate precision were met.
In our validation protocol, we incorporated the use of PHA, as an additional positive control, since it stimulates the production of IFNγ in PBMCs [23,34]. Surprisingly, lower levels of spots were detected after PHA stimulation when compared with the anti-CD3+ antibody, and significant differences were found when comparing the SFUs after PHA or CD3+ exposure in each donor (p < 0.0001).
The ELISPOT-IFNγ is a functional, highly quantitative assay with a wide range of detection limits. This makes the assay suitable for the study of antigen-specific cells and the evaluation of cellular responses to vaccines [35,36].

5. Conclusions

Cell-mediated memory responses play an important role in viral infections. In COVID-19, the T cell response to SARS-CoV-2 in patients and vaccinated subjects has been shown to contribute to disease and infection control [1]. The use of ELISPOT-IFNγ to study T lymphocyte responses in clinical trials has created the need for a proper validation method that supports its value in the development of new drugs and vaccines against infectious diseases.

Author Contributions

Conceptualization, C.C. and M.T.; methodology, L.E.C.-B. and M.N.-P.; data analysis, A.P.-R., R.L.C.-D., J.B.-Z. and C.I.H.-L.; writing—original draft preparation, P.F.-M., L.E.C.-B., M.A.G.-R., C.C. and M.T.; writing—review and editing, C.C.; funding acquisition, M.T. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the Instituto Nacional de Enfermedades Respiratorias (INER) Ismael Cosío Villegas (C54-21) had no role in the study design, collection, analysis, and interpretation of data, the report’s writing, or the decision to submit the article for publication.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the institutional review boards (permit number C53-21, Approval date: 15 February 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used to support the findings of this study are included within the article.

Acknowledgments

We are very grateful to Francisco E. Camacho-Mezquita for your support in English editing; Jesica Lopez Torres for your administrative support and Veronica Solano Olivares for your support as a laboratory assistant.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Miao, G.; Chen, Z.; Cao, H.; Wu, W.; Chu, X.; Liu, H.; Zhang, L.; Zhu, H.; Cai, H.; Lu, X.; et al. From Immunogen to COVID-19 vaccines: Prospects for the post-pandemic era. Biomed. Pharmacother. 2023, 158, 114208. [Google Scholar] [CrossRef] [PubMed]
  2. Qian, J.; Zhang, S.; Wang, F.; Li, J.; Zhang, J. What makes SARS-CoV-2 unique? Focusing on the spike protein. Cell Biol. Int. 2024, 48, 404–430. [Google Scholar] [CrossRef] [PubMed]
  3. Jackson, C.B.; Farzan, M.; Chen, B.; Choe, H. Mechanisms of SARS-CoV-2 entry into cells. Nat. Rev. Mol. Cell Biol. 2022, 23, 3–20. [Google Scholar] [CrossRef] [PubMed]
  4. Plotkin, S.A. Correlates of Protection Induced by Vaccination. Clin. Vaccine Immunol. 2010, 17, 1055–1065. [Google Scholar] [CrossRef] [PubMed]
  5. Sherman, A.C.; Desjardins, M.; Baden, L.R. Vaccine-Induced Severe Acute Respiratory Syndrome Coronavirus 2 Antibody Response and the Path to Acceleratisng Development (Determining a Correlate of Protection). Clin. Lab. Med. 2022, 42, 111–128. [Google Scholar] [CrossRef]
  6. Chi, W.-Y.; Li, Y.-D.; Huang, H.-C.; Chan, T.E.H.; Chow, S.-Y.; Su, J.-H.; Ferrall, L.; Hung, C.-F.; Wu, T.-C. COVID-19 vaccine update: Vaccine effectiveness, SARS-CoV-2 variants, boosters, adverse effects, and immune correlates of protection. J. Biomed. Sci. 2022, 29, 82. [Google Scholar] [CrossRef]
  7. Liu, L.; Wang, P.; Nair, M.S.; Yu, J.; Rapp, M.; Wang, Q.; Luo, Y.; Chan, J.F.-W.; Sahi, V.; Figueroa, A.; et al. Potent neutralizing antibodies against multiple epitopes on SARS-CoV-2 spike. Nature 2020, 584, 450–456. [Google Scholar] [CrossRef]
  8. Liu, J.; Chandrashekar, A.; Sellers, D.; Barrett, J.; Jacob-Dolan, C.; Lifton, M.; McMahan, K.; Sciacca, M.; VanWyk, H.; Wu, C.; et al. Vaccines elicit highly conserved cellular immunity to SARS-CoV-2 Omicron. Nature 2022, 603, 493–496. [Google Scholar] [CrossRef]
  9. Yoon, S.-W.; Widyasari, K.; Jang, J.; Lee, S.; Kang, T.; Kim, S. Kinetics of adaptive immune responses after administering mRNA-Based COVID-19 vaccination in individuals with and without prior SARS-CoV-2 infections. BMC Infect. Dis. 2023, 23, 732. [Google Scholar] [CrossRef]
  10. Zhang, Z.; Mateus, J.; Coelho, C.H.; Dan, J.M.; Moderbacher, C.R.; Gálvez, R.I.; Cortes, F.H.; Grifoni, A.; Tarke, A.; Chang, J.; et al. Humoral and cellular immune memory to four COVID-19 vaccines. Cell 2022, 185, 2434–2451.e17. [Google Scholar] [CrossRef]
  11. Bercovici, N.; Duffour, M.-T.; Agrawal, S.; Salcedo, M.; Abastado, J.-P. New Methods for Assessing T-Cell Responses. Clin. Diagn. Lab. Immunol. 2000, 7, 859–864. [Google Scholar] [CrossRef] [PubMed]
  12. Leehan, K.M.; Koelsch, K.A. T Cell ELISPOT: For the Identification of Specific Cytokine-Secreting T Cells. In Western Blotting; Kurien, B.T., Scofield, R.H., Eds.; Methods in Molecular Biology; Springer: New York, NY, USA, 2015; Volume 1312, pp. 427–434. ISBN 978-1-4939-2693-0. [Google Scholar]
  13. Wang, C.; Yang, S.; Duan, L.; Du, X.; Tao, J.; Wang, Y.; Yang, J.; Lv, Y.; Li, J.; Zhang, C.; et al. Adaptive immune responses and cytokine immune profiles in humans following prime and boost vaccination with the SARS-CoV-2 CoronaVac vaccine. Virol. J. 2022, 19, 223. [Google Scholar] [CrossRef] [PubMed]
  14. Slota, M.; Lim, J.-B.; Dang, Y.; Disis, M.L. ELISpot for measuring human immune responses to vaccines. Expert Rev. Vaccines 2011, 10, 299–306. [Google Scholar] [CrossRef]
  15. Streeck, H.; Frahm, N.; Walker, B.D. The role of IFN-γ Elispot assay in HIV vaccine research. Nat. Protoc. 2009, 4, 461–469. [Google Scholar] [CrossRef] [PubMed]
  16. Boaz, M.J.; Hayes, P.; Tarragona, T.; Seamons, L.; Cooper, A.; Birungi, J.; Kitandwe, P.; Semaganda, A.; Kaleebu, P.; Stevens, G.; et al. Concordant Proficiency in Measurement of T-Cell Immunity in Human Immunodeficiency Virus Vaccine Clinical Trials by Peripheral Blood Mononuclear Cell and Enzyme-Linked Immunospot Assays in Laboratories from Three Continents. Clin. Vaccine Immunol. 2009, 16, 147–155. [Google Scholar] [CrossRef] [PubMed]
  17. Wagenhäuser, I.; Almanzar, G.; Förg, F.B.; Stein, A.; Eiter, I.; Reusch, J.; Mees, J.; Herzog, A.; Vogel, U.; Frey, A.; et al. Heterologous and homologous COVID-19 mRNA vaccination schemes for induction of basic immunity show similar immunogenicity regarding long-term spike-specific cellular immunity in healthcare workers. Vaccine 2024, 42, 126132. [Google Scholar] [CrossRef]
  18. Konuma, T.; Hamatani-Asakura, M.; Nagai, E.; Adachi, E.; Kato, S.; Isobe, M.; Monna-Oiwa, M.; Takahashi, S.; Yotsuyanagi, H.; Nannya, Y. Cellular and humoral immunogenicity against SARS-CoV-2 vaccination or infection is associated with the memory phenotype of T- and B-lymphocytes in adult allogeneic hematopoietic cell transplant recipients. Int. J. Hematol. 2024, 120, 229–240. [Google Scholar] [CrossRef]
  19. Andreasson, U.; Perret-Liaudet, A.; Van Waalwijk Van Doorn, L.J.C.; Blennow, K.; Chiasserini, D.; Engelborghs, S.; Fladby, T.; Genc, S.; Kruse, N.; Kuiperij, H.B.; et al. A Practical Guide to Immunoassay Method Validation. Front. Neurol. 2015, 6, 179. [Google Scholar] [CrossRef]
  20. Lee, J.W.; Devanarayan, V.; Barrett, Y.C.; Weiner, R.; Allinson, J.; Fountain, S.; Keller, S.; Weinryb, I.; Green, M.; Duan, L.; et al. Fit-for-Purpose Method Development and Validation for Successful Biomarker Measurement. Pharm. Res. 2006, 23, 312–328. [Google Scholar] [CrossRef]
  21. Malyguine, A.M.; Strobl, S.; Dunham, K.; Shurin, M.R.; Sayers, T.J. ELISPOT Assay for Monitoring Cytotoxic T Lymphocytes (CTL) Activity in Cancer Vaccine Clinical Trials. Cells 2012, 1, 111–126. [Google Scholar] [CrossRef]
  22. Carranza, C.; Juárez, E.; Torres, M.; Ellner, J.J.; Sada, E.; Schwander, S.K. Mycobacterium tuberculosis Growth Control by Lung Macrophages and CD8 Cells from Patient Contacts. Am. J. Respir. Crit. Care Med. 2006, 173, 238–245. [Google Scholar] [CrossRef] [PubMed]
  23. Vivekanandan, M.M.; Adankwah, E.; Aniagyei, W.; Acheampong, I.; Minadzi, D.; Yeboah, A.; Arthur, J.F.; Lamptey, M.; Abass, M.K.; Kumbel, F.; et al. Impaired T-cell response to phytohemagglutinin (PHA) in tuberculosis patients is associated with high IL-6 plasma levels and normalizes early during anti-mycobacterial treatment. Infection 2023, 51, 1013–1023. [Google Scholar] [CrossRef]
  24. Pérez-Barrios, Y.; Aranguren-Mazorra, Y.; Zayas-Vignier, C.; Blain-Torres, K.; Hernández-Cedeño, M.; Rodríguez-Hernández, Y.; Álvarez-Tito, M.; Nuñez-Martínez, D.; González-Aznar, E.; Soubal-Mora, J.P.; et al. Estandarización de un ELISA para la cuantificación de anticuerpos IgG contra vesículas de membrana externa de Salmonella Paratyphi A. Vaccimonitor 2018, 27, 76–83. [Google Scholar]
  25. Corsaro, B.; Yang, T.; Murphy, R.; Sonderegger, I.; Exley, A.; Bertholet, S.; Dakappagari, N.; Dessy, F.; Garofolo, F.; Kierstead, L.; et al. 2020 White Paper on Recent Issues in Bioanalysis: Vaccine Assay Validation, qPCR Assay Validation, QC for CAR-T Flow Cytometry, NAb Assay Harmonization and ELISpot Validation (Part 3 –Recommendations on Immunogenicity Assay Strategies, NAb Assays, Biosimilars and FDA/EMA Immunogenicity Guidance/Guideline, Gene & Cell Therapy and Vaccine Assays). Bioanalysis 2021, 13, 415–463. [Google Scholar] [CrossRef] [PubMed]
  26. Islam, R.; Vance, J.; Poirier, M.; Zimmer, J.; Khadang, A.; Williams, D.; Zemo, J.; Lester, T.; Fjording, M.; Hays, A.; et al. Recommendations on ELISpot Assay Validation by the GCC. Bioanalysis 2022, 14, 187–193. [Google Scholar] [CrossRef] [PubMed]
  27. Deng, Y.; Li, Y.; Yang, R.; Tan, W. SARS-CoV-2-specific T cell immunity to structural proteins in inactivated COVID-19 vaccine recipients. Cell Mol. Immunol. 2021, 18, 2040–2041. [Google Scholar] [CrossRef] [PubMed]
  28. Janetzki, S.; Rueger, M.; Dillenbeck, T. Stepping up ELISpot: Multi-Level Analysis in FluoroSpot Assays. Cells 2014, 3, 1102–1115. [Google Scholar] [CrossRef] [PubMed]
  29. Schmittel, A.; Keilholz, U.; Scheibenbogen, C. Evaluation of the interferon-γ ELISPOT-assay for quantification of peptide specific T lymphocytes from peripheral blood. J. Immunol. Methods 1997, 210, 167–174. [Google Scholar] [CrossRef]
  30. Tary-Lehmann, M.; Hamm, C.D.; Lehmann, P.V. Validating Reference Samples for Comparison in a Regulated ELISPOT Assay. In Validation of Cell-Based Assays in the GLP Setting; Prabhakar, U., Kelley, M., Eds.; Wiley: Hoboken, NJ, USA, 2008; pp. 127–146. ISBN 978-0-470-02876-6. [Google Scholar]
  31. Samri, A.; Durier, C.; Urrutia, A.; Sanchez, I.; Gahery-Segard, H.; Imbart, S.; Sinet, M.; Tartour, E.; Aboulker, J.-P.; Autran, B.; et al. Evaluation of the Interlaboratory Concordance in Quantification of Human Immunodeficiency Virus-Specific T Cells with a Gamma Interferon Enzyme-Linked Immunospot Assay. Clin. Vaccine Immunol. 2006, 13, 684–697. [Google Scholar] [CrossRef]
  32. Waerlop, G.; Leroux-Roels, G.; Lambe, T.; Bellamy, D.; Medaglini, D.; Pettini, E.; Cox, R.J.; Trieu, M.-C.; Davies, R.; Bredholt, G.; et al. Harmonization and qualification of an IFN-γ Enzyme-Linked ImmunoSpot assay (ELISPOT) to measure influenza-specific cell-mediated immunity within the FLUCOP consortium. Front. Immunol. 2022, 13, 984642. [Google Scholar] [CrossRef]
  33. Körber, N.; Behrends, U.; Hapfelmeier, A.; Protzer, U.; Bauer, T. Validation of an IFNγ/IL2 FluoroSpot assay for clinical trial monitoring. J. Transl. Med. 2016, 14, 175. [Google Scholar] [CrossRef] [PubMed]
  34. Yang, H.; Sun, J.; Li, Y.; Duan, W.-M.; Bi, J.; Qu, T. Human umbilical cord-derived mesenchymal stem cells suppress proliferation of PHA-activated lymphocytes in vitro by inducing CD4+CD25highCD45RA+ regulatory T cell production and modulating cytokine secretion. Cell. Immunol. 2016, 302, 26–31. [Google Scholar] [CrossRef] [PubMed]
  35. Zhang, W.; Caspell, R.; Karulin, A.Y.; Ahmad, M.; Haicheur, N.; Abdelsalam, A.; Johannesen, K.; Vignard, V.; Dudzik, P.; Georgakopoulou, K.; et al. ELISPOT assays provide reproducible results among different laboratories for T-cell immune monitoring--even in hands of ELISPOT-inexperienced investigators. J. Immunotoxicol. 2009, 6, 227–234. [Google Scholar] [CrossRef] [PubMed]
  36. Ponce-de-León, S.; Torres, M.; Soto-Ramírez, L.E.; Calva, J.J.; Santillán-Doherty, P.; Carranza-Salazar, D.E.; Carreño, J.M.; Carranza, C.; Juárez, E.; Carreto-Binaghi, L.E.; et al. Interim safety and immunogenicity results from an NDV-based COVID-19 vaccine phase I trial in Mexico. NPJ Vaccines 2023, 8, 67. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Linearity of the ELISPOT-IFNγ assay. The linearity of the method was evaluated in PBMCs from a single donor following 18 h of incubation with medium, Spike S1 protein, or anti-CD3+ antibody (positive control). (a) Scanned images of SFUs/well for PBMCs. The 95% confidence intervals (CIs) are shown in (b).
Figure 1. Linearity of the ELISPOT-IFNγ assay. The linearity of the method was evaluated in PBMCs from a single donor following 18 h of incubation with medium, Spike S1 protein, or anti-CD3+ antibody (positive control). (a) Scanned images of SFUs/well for PBMCs. The 95% confidence intervals (CIs) are shown in (b).
Biomolecules 14 01286 g001
Figure 2. IFN-γ LOD and LLOQ characterization. The PBMC of three donors were cultured in OPTmizer medium and analyzed 10 times. Using the average of the results of each volunteer, the LOD of 17 spots/well (dotted gray line) and LLOQ of 22 spots/well (dotted green line) were calculated. Data are shown as the mean of the SFUs of each donor.
Figure 2. IFN-γ LOD and LLOQ characterization. The PBMC of three donors were cultured in OPTmizer medium and analyzed 10 times. Using the average of the results of each volunteer, the LOD of 17 spots/well (dotted gray line) and LLOQ of 22 spots/well (dotted green line) were calculated. Data are shown as the mean of the SFUs of each donor.
Biomolecules 14 01286 g002
Figure 3. Repeatability assay of IFN-γ-producing PBMCs. The repeatability of the ELISPOT-IFNγ assay was evaluated by one analyst using PBMCs from three distinct donors. The PBMCs were exposed to Spike protein, PHA, or anti-CD3+ activating antibody. Data are shown as the mean of the SFUs. The significant differences in the SFUs after PHA or CD3+ exposure in each donor are indicated with asterisks (**** p < 0.0001).
Figure 3. Repeatability assay of IFN-γ-producing PBMCs. The repeatability of the ELISPOT-IFNγ assay was evaluated by one analyst using PBMCs from three distinct donors. The PBMCs were exposed to Spike protein, PHA, or anti-CD3+ activating antibody. Data are shown as the mean of the SFUs. The significant differences in the SFUs after PHA or CD3+ exposure in each donor are indicated with asterisks (**** p < 0.0001).
Biomolecules 14 01286 g003
Table 1. Linearity of ELISPOT-IFNγ assay following exposure to Spike S1 protein.
Table 1. Linearity of ELISPOT-IFNγ assay following exposure to Spike S1 protein.
ReplicatePBMC Density
5 × 1041 × 1051.5 × 1052 × 1052.5 × 1053 × 1053.5 × 105
11833715738678731054925
22014484956549699981030
3224296567729908808962
417142760588495812141325
520257768097192611901472
613852662975493711421366
7148463424592708909923
8145320599779521816891
920335553267481810611254
Mean SFU179.44420.33567.11767.11846.771021.331127.55
PBMC: Peripherical blood mononuclear cells; SFU: spot-forming units; mean of duplicates.
Table 2. Linearity of the ELISPOT-IFNγ assay following anti-CD3+ stimulation.
Table 2. Linearity of the ELISPOT-IFNγ assay following anti-CD3+ stimulation.
ReplicatePBMC Density
5 × 1041 × 1051.5 × 1052 × 1052.5 × 1053 × 1053.5 × 105
1924144413941744185023272058
2906139914621668183218632105
3840150816261908210820101913
41098140614131688173923572616
51085150513161743190618402323
61019147115422028180418082650
71042132215602341238428732190
81048133114371643171518352183
9978136115211717163816452102
Mean (SFU)993.331416.331474.551831.111886.222062.002237.77
PBMC: Peripherical blood mononuclear cells; SFU: spot-forming units; mean of duplicates.
Table 3. LOD and LLOQ results of ELISPOT-IFNγ assay.
Table 3. LOD and LLOQ results of ELISPOT-IFNγ assay.
ReplicateDonor ADonor BDonor D
14.50.519
25.514.5
331.55.5
493.51.5
5153.56
6310.54.5
710.516.5
89.53.516.5
910.5214.5
1071.56.5
Mean (SFU)10.551.858.5
SD (SFU)7.9811.2265.911
LOD (SFU)26.5114.30220.323
LLOQ (SFU)34.495.5226.23
SFU: spot-forming units.
Table 4. Summary of the repeatability of the ELISPOT-IFNγ assay performed by operator 1.
Table 4. Summary of the repeatability of the ELISPOT-IFNγ assay performed by operator 1.
ReplicateDonor
ABCABCABC
SpikePHAanti-CD3+
11566.58151024.5825.568410131634.512061417.5
211801055.51018.5638777807.51502.513651561
3108312691079.5703.5630.5811.5167413491299.5
41369.511831054.5894.5649802.517641300.51262
513451041.5991.5824570792.51705.513681344
6915.5895.57306827008671456.512551266.5
71039.5966738573.565588116201329.51304.5
81065.5756.5794589.58001227.51523.51332.51508
9977684.5808.5945.56388461467.51143.51258
10808937914.5608.564910551312.514041433
Mean (SFU)1134.95960.35915.35728.45675.25910.351566.051305.31365.4
SD (SFU)231.908183.797136.06134.12169.009143.293137.32781.011108.727
%CV20.43319.13814.86418.41110.21915.7408.7696.2067.963
SFU: Spot-forming units; mean of duplicates SD: standard deviation; CV: Coefficient of variation.
Table 5. Intermediate precision in donor A.
Table 5. Intermediate precision in donor A.
ReplicateOperator 1 (Day 1)Operator 2 (Day 2)
SpikePHAAnti-CD3+SpikePHAanti-CD3+
11566.5825.51634.51120.5686.51672
211806381502.51259509.51595.5
31083703.5167412334771592
41369.5894.517641202.5486.51617
513458241705.51267.5428.51656
6915.56821456.51244616.51691.5
71039.5573.516201087.55621793
81065.5589.51523.511317081770.5
9977945.51447.51215.56731662
10808608.51312.51041.56451593.5
Mean (SFU)1134.95728.451564.051180.2579.251664.3
SD (SFU)231.909134.122139.05779.05599.73671.435
%CV20.43318.4128.8916.69817.2184.292
SFU: Spot-forming units; mean of duplicates; SD: standard deviation; CV: coefficient of variation.
Table 6. Intermediate precision in donor B.
Table 6. Intermediate precision in donor B.
ReplicateOperator 1 (Day 1)Operator 2 (Day 2)
SpikePHAAnti-CD3+SpikePHAanti-CD3+
18156841206126010991845.5
21055.577713651285973.51761
31269630.5134912381003.51670.5
411836491300.51259.5943.51716.5
51041.557013681074907.51735
6895.57001255109110721784
79666551329.59609971842.5
8756.58001332.51097.511351692
9684.5638643.510261000.51758
109376491404885.59031694.5
Mean (SFU)960.35675.251255.31117.651003.451749.95
SD (SFU)183.79769.009222.577138.66178.15360.671
%CV19.13810.21917.73012.4067.7883.467
SFU: Spot-forming units; mean of duplicates; SD: standard deviation; CV: coefficient of variation.
Table 7. Intermediate precision in donor C.
Table 7. Intermediate precision in donor C.
ReplicateOperator 1 (Day 1)Operator 2 (Day 2)
SpikePHAAnti-CD3+SpikePHAanti-CD3+
11024.510131417.581117492608.5
21018.5807.51561882.51698.51692
31079.5811.51299.5923.519312141.5
41054.5802.512629191836.52201
5991.5792.513447901751.52112.5
67308671266.5671.51844.52114.5
77388811304.5685.51803.52462.5
8794727.51508822.521922461
9808.5846125358416972420.5
10914.55251433907.52266.52910
Mean (SFU)915.35807.351364.9799.718772312.4
SD (SFU)136.06124.332109.286117.747199.54334.454
%CV14.86415.48.00614.72310.6314.463
SFU: Spot-forming units; mean of duplicates SD: standard deviation; CV: coefficient of variation.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Carreto-Binaghi, L.E.; Nieto-Ponce, M.; Palencia-Reyes, A.; Chávez-Domínguez, R.L.; Blancas-Zaragoza, J.; Franco-Mendoza, P.; García-Ramos, M.A.; Hernández-Lázaro, C.I.; Torres, M.; Carranza, C. Validation of the Enzyme-Linked ImmunoSpot Analytic Method for the Detection of Human IFN-γ from Peripheral Blood Mononuclear Cells in Response to the SARS-CoV-2 Spike Protein. Biomolecules 2024, 14, 1286. https://doi.org/10.3390/biom14101286

AMA Style

Carreto-Binaghi LE, Nieto-Ponce M, Palencia-Reyes A, Chávez-Domínguez RL, Blancas-Zaragoza J, Franco-Mendoza P, García-Ramos MA, Hernández-Lázaro CI, Torres M, Carranza C. Validation of the Enzyme-Linked ImmunoSpot Analytic Method for the Detection of Human IFN-γ from Peripheral Blood Mononuclear Cells in Response to the SARS-CoV-2 Spike Protein. Biomolecules. 2024; 14(10):1286. https://doi.org/10.3390/biom14101286

Chicago/Turabian Style

Carreto-Binaghi, Laura E., Milton Nieto-Ponce, Andrea Palencia-Reyes, Rodolfo L. Chávez-Domínguez, Jessica Blancas-Zaragoza, Pablo Franco-Mendoza, Montserrat A. García-Ramos, Claudia I. Hernández-Lázaro, Martha Torres, and Claudia Carranza. 2024. "Validation of the Enzyme-Linked ImmunoSpot Analytic Method for the Detection of Human IFN-γ from Peripheral Blood Mononuclear Cells in Response to the SARS-CoV-2 Spike Protein" Biomolecules 14, no. 10: 1286. https://doi.org/10.3390/biom14101286

APA Style

Carreto-Binaghi, L. E., Nieto-Ponce, M., Palencia-Reyes, A., Chávez-Domínguez, R. L., Blancas-Zaragoza, J., Franco-Mendoza, P., García-Ramos, M. A., Hernández-Lázaro, C. I., Torres, M., & Carranza, C. (2024). Validation of the Enzyme-Linked ImmunoSpot Analytic Method for the Detection of Human IFN-γ from Peripheral Blood Mononuclear Cells in Response to the SARS-CoV-2 Spike Protein. Biomolecules, 14(10), 1286. https://doi.org/10.3390/biom14101286

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop