1. Introduction
For the first time in history, different anti-COVID vaccine platforms were established in record time, including vaccines composed of viral mRNA or DNA, protein subunits, attenuated or inactivated viruses, viral vectors, and virus-like particles [
1]. One of the main target epitopes is the SARS-CoV-2 spike protein, a surface homotrimer built from two subunits (S1 and S2), which binds to the angiotensin-converting enzyme 2 (ACE2) receptor in human cells and is critical in viral entry and replication during the infection [
2,
3].
In general, an important caveat in the evaluation of viral vaccines, including COVID-19, is the lack of an appropriate immune correlate of protection, a defined biomarker that would indicate vaccine-induced protection from natural infection [
4]. Neutralizing antibodies are generally recommended as the primary correlate of protection [
5]; they prevent infection and/or severe disease, and the methodology used for their detection might be easily reproduced in different settings to facilitate comparisons between the data collected in clinical trials using diverse vaccine platforms [
6]. Most SARS-CoV-2 vaccines induce specific neutralizing antibodies against the spike protein, therefore blocking its interaction with the ACE2 receptor and preventing the virus from entering into the cell [
7]. However, immune protection against viral infections goes beyond the production of antibodies. Cell-mediated immunity largely contributes to long-term responses to viruses, mainly through the recognition of viral proteins for cytokine secretion [
8,
9,
10].
In the context of vaccines, the evaluation of memory T cell responses might be performed by distinct assays, such as proliferation, differentiation towards specific subsets, and the production and release of cytokines upon stimulation with specific antigens [
11,
12]. SARS-CoV-2 vaccines predominantly induce Th1 responses, characterized by the release of pro-inflammatory cytokines such as tumor necrosis factor alpha (TNFα), interleukin 2 (IL-2), and interferon gamma (IFNγ) [
13]. The production and release of IFNγ by effector memory CD4+ and CD8+ T cells is key for the immunoregulatory and antiviral functions of host defense. In this regard, the IFNγ enzyme-linked immunospot assay (ELISPOT-IFNγ) has been routinely used to evaluate cellular responses to various vaccine candidates [
14], including those against human immunodeficiency virus [
15,
16] and SARS-CoV-2 [
17,
18].
For this purpose, the study of the immune response to specific antigens in clinical trials requires the validation of the technique to assert the reliability of the results in ex vivo tests. However, validation is generally performed for quantitative biomarker detection assays [
19], and scarcely for semi-quantitative techniques evaluating cellular responses, such as ELISPOT-IFNγ.
Validation of ELISPOT-IFNγ assay is particularly relevant for assessing the efficacy of the method and its correlation with additional tests for vaccine immunogenicity. Additionally, full compliance with Good Laboratory Practices must always be ensured. To validate a bioanalytical assay, several parameters should be evaluated according to the intended application of the technique and the biological limits of the assay [
19].
The upper and lower limits of quantification (LLOQ) represent the range in which the analyte might be measured with accuracy and precision, whereas the limit of detection (LOD) is the minimum concentration of analyte that produces a significantly different signal to the background [
20]. Specificity is the ability of the test to identify the analyte from other components and accuracy is the highest approximation of the results with the reference values.
The precision profile of the method is depicted by the coefficient of variation (CV), which relies on repeatability (intra-assay precision), reproducibility (inter-assay or cross validation), and intermediate precision (non-significant changes in the assay conditions) [
21]. Depending on the type of assay employed, either dilution linearity or parallelism will determine its accuracy on multiple dilutions of the study sample. Finally, the robustness of the assay indicates the overall reliability of the obtained results regardless of predetermined changes in the procedure.
In the present work we describe the validation of the ELISPOT-IFNγ technique, an ex vivo assay intended to assess the frequency of IFNγ-producing cells after stimulation with the SARS-CoV-2 spike protein, primarily focused on evaluating vaccine-induced T cell-mediated immunity.
2. Materials and Methods
2.1. Sample Collection
Peripheral blood samples were obtained by venipuncture from healthy donors with an age range of 30–50 years with a previous SARS-CoV-2 infection and complete vaccination with the COVID-19 mRNA vaccine (Pfizer, New York, NY, USA). At the time of venipuncture, the donors presented no symptoms of acute SARS-CoV-2 infection. Considering that specific T cell responses might develop in a volunteer-dependent way, before performing the validation assay, we tested the ELISPOT-IFNγ assay on 10 healthy volunteers. Volunteers with a prior SARS-CoV-2 vaccination and previously confirmed SARS-CoV-2 infection were chosen to ensure that their T cells would show a response to the recombinant Spike S1 protein of SARS-CoV-2 (RayBiotech, Peachtree Corner, GA, USA. The participants were recruited at the National Institute of Respiratory Diseases (INER) in Mexico City. The Institutional Ethics and Research Committee approved this study, and all participants provided written informed consent, per the Declaration of Helsinki.
2.2. Isolation and Freezing of Peripheral Blood Mononuclear Cells (PBMCs)
For the validation, we selected the four volunteers with the best responses, whose data are presented in this manuscript. Within the first 2 h after blood collection, PBMCs were isolated as previously described [
22]. In brief, whole blood was diluted at a 1:1 ratio with RPMI-1640 medium (Lonza, Walkersville, MD, USA) supplemented with L-glutamine (Lonza, Walkersville, MD, USA) and gentamicin (Gibco, Waltham, MD, USA). The PBMCs were purified using Lymphoprep (Serumwerk, Bernburg, Germany) through a density gradient by centrifugation. The viability of the PBMC always exceeded 98% and was evaluated by manual counting using trypan blue (Sigma, Burlington, MA, USA). Then, the cells were frozen at a concentration of 10 × 10
6 cells/mL in fetal bovine serum (FBS) (Gibco, Waltham, MA, USA) with 10% of dimethyl sulfoxide (Sigma, Burlington, MA, USA). The vials were placed in a freezing container (Nalgene, Rochester, NY, USA) overnight at −80 °C and then transferred to their definitive storage location at −80 °C until used.
2.3. Thawing of PBMC
The PBMCs were thawed using a water bath (Thermo Scientific, Winchester, VA, USA) at 37 °C. They were slowly diluted in 5 mL of OPTmizer-CTS medium (Gibco, Waltham, MA, USA) supplemented with L-glutamine (Lonza, Walkersville, MD, USA) and gentamicin (Gibco, Waltham, MD, USA), which was previously warmed to 37 °C. Following thawing, the PBMCs were centrifuged at 316 rcf for 10 min at room temperature (RT) and resuspended in 1 mL of medium for manual counting using trypan blue (Sigma, Burlington, MA, USA). The cell viability was greater than 98% and their recovery always exceeded 85%. The PBMCs suspension was adjusted to a final concentration of 2 × 106 cells/mL with supplemented OPTmizer-CTS medium (Gibco, Waltham, MA, USA).
2.4. Preparation of Stimuli
Stimuli were prepared before starting the assay. Recombinant Spike S1 protein was employed as the target stimulus at a concentration of 5 μg/mL in supplemented OPTmizer-CTS (Gibco, Waltham, MA, USA) medium and Phytohemagglutinin (PHA) (Sigma, Burlington, MA, USA) was used as a positive control at a concentration of 5 μg/mL. This stimulus was tested since it is widely employed to stimulate PBMCs in assays such as ELISAs that quantify IFNγ production [
23].
The optimal concentration of the stimuli was determined in previous titration experiments. Additionally, the human anti-CD3+ monoclonal antibody included in the ELISpot PRO Kit (Mabtech AB, Stockholm, Sweden) was used as an internal control at a dilution of 1:1000 as recommended by the manufacturer. Supplemented OPTmizer-CTS medium was used as a negative control.
2.5. Human IFNγ ELISpot Assay
The ELISPOT-IFNγ assay was performed using the ELISPOT-IFNγ PRO human IFNγ Kit 3420-ehst-10 (Mabtech AB, Stockholm, Sweden) as the antibody platform. In brief, 96-well plates pre-sensitized with human IFNγ antibody were washed 4 times with phosphate-buffered saline (PBS) (Lonza, Walkersville, MD, USA). The plates were then blocked with 200 μL of supplemented OPTmizer CTS medium per well for 30 min at RT. The medium was removed by inversion and 100 μL of the Spike, PHA, and anti-CD3+ stimuli were added to each well according to the plate design. Then, a different number of cells per well were added. Plates were incubated at 37 °C and 5% CO2 for 20 h.
After incubation, the cells were removed by inversion and the plates were washed 5 times with PBS; 100 μL per well of the detection monoclonal antibody anti IFNg (Mabtech AB, Stockholm, Sweden) diluted 1:200 in PBS with 0.5% FBS was added and plates were incubated for 2 h at RT, protected from light. Following incubation, the plates were washed 5 times with PBS and 100 μL of the tetramethylbenzidine (TMB, Mabtech AB, Stockholm, Sweden) substrate was added per well. The plates were incubated for 5 min protected from light, followed by 6 washes with deionized water. Finally, the plates were gently dried with a nonabrasive cellulose-fiber wiper and left to dry for 24–48 h protected from light at RT.
2.6. Data Acquisition
The ELISPOT-IFNγ plates were acquired 2 days after performing the assay using the CTL ImmunoSpot® M6 automated analyzer (CTL, Cleveland, OH, USA) and later analyzed using the ImmunoSpot® Software version 7.1.
After image acquisition, the spot-forming units (SFU) were counted using the automatically adjusted settings of the software (raw results), followed by the Quality Control function to eliminate artifacts. The counting parameters used were sensitivity 145, background balance 80, minimum spot size 0.00050 mm3, maximum spot size 9.6203 mm3, and spot separation 3. Absolute counting results were exported as individual Excel files for each plate.
2.7. Validation Protocol Design
For the validation of the ELISPOT-IFNγ analytic method, the linearity assay was performed using three replicates of increasing amounts of PBMCs (5 × 104, 1 × 105, 1.5 × 105, 2 × 105, 2.5 × 105, 3 × 105, and 3.5 × 105 cells per well) from one of the volunteers. All experiments were performed in triplicate. After obtaining the results from this assay, we decided to use 2 × 105 PBMCs for the rest of the experiments.
Intermediate precision, LOD, and LLOQ were evaluated through 10 replicates from each of the three donors for intermediate precision, and another operator assessed the same samples in the same conditions on a different day. The LLOQ was calculated according to the following equation [
24]
2.8. Statistical Analysis
The normality of the data was evaluated by using a Shapiro–Wilk test using the GraphPad Prism V9 software. To demonstrate the linearity of the method, we calculated the mean of the three determinations of SFUs in response to the Spike stimulus and their correlation with their corresponding cell density. The method was considered valid when it reached a multiple determination coefficient (r2) ≥ 0.93.
For repeatability and intermediate precision, we calculated the arithmetic mean and standard deviation (SD) of the 10 determinations of SFC in response to the Spike stimulus and then calculated the CV of each repetition of the three volunteers. The method was considered to be valid when it reached a cut-off CV ≤ 25 [
25,
26] in the overall results from the three volunteers. In the repeatability assay, data obtained from anti-CD3
+ and PHA exposure were compared using a Student’s
t-test. A value of
p < 0.05 was considered statistically significant.
For the lower detection limit, we calculated the mean and standard deviation (SD) of the 10 determinations of SFC in response to the medium stimulus to obtain the CV of each result of the three volunteers.
3. Results
So far, there are no internationally accepted standardized operational procedures to validate the ELISPOT-IFNγ assay. Therefore, our laboratory required a validation design focused on the needs of our assay and the specific experimental conditions that needed to be validated. This design was based on the main parameters that contribute to the variability of the assay such as the LOD, LLOQ, linearity, repeatability, and intermediate precision. By validating these parameters, we could ensure that the results were reliable. The results were reported as spots produced by cells (2 × 105/well).
To validate the ELISPOT-IFNγ, we considered parameters such as, linearity, LOD, LLOQ, and intermediate precision. An ELISPOT-IFNγ assay should be sensitive, precise, reproducible among operators, specific, and semi-quantitative. Additionally, it is required to show acceptable detection and quantification limits despite small variations in operating conditions.
3.1. Linearity
Linearity evaluates the ability of an assay to give results that are directly proportional to the concentration of the analyte being measured. In the case of ELISPOT-IFNγ, the number of IFNγ spots obtained should be directly proportional to the number of PBMCs placed in the wells. For the evaluation of linearity, PBMC from a single donor were used, evaluating nine replicates at seven different cellular densities (5 × 10
4, 1 × 10
5, 1.5 × 10
5, 2 × 10
5, 2.5 × 10
5, 3 × 10
5, and 3.5 × 10
5 PBMC). The PBMC swere stimulated with the recombinant S1 protein (
Table 1) and with anti-CD3
+ antibody as positive control (
Table 2). The results showed a significant linear relationship to produce IFNγ after stimulating the PBMC with the recombinant S1 protein (r
2 = 0.98,
p < 0.0001), or anti-CD3 antibody (r
2 = 0.95,
p < 0.001) as shown in
Figure 1.
3.2. Limit of Detection (LOD)
In ELISPOT-IFNγ, the LOD is defined as the minimum number of spots that can be detected in the unstimulated condition (OPTmizer medium). As ELISPOT-IFNγ is highly sensitive, we calculated the LOD by counting the non-specific background signals under non-stimulation conditions, i.e., the number of spots produced by cells in the OPTmizer medium. The PBMCs from three volunteers were analyzed, performing 10 replicates in duplicate (2 × 10
5 cells/well). The immune response of volunteers accounted for the variability of the results obtained. The limit of detection was calculated according to Lee et al. [
20] as:
where O is the average number of spots obtained in each well and SD is the standard deviation of the assay (
Table 3). Using the LOD formula, the limits of detection was 26.51, 4.30, and 20.32 spots from donors A, B, and D, respectively. In this setting, the average of the detection limits of each volunteer resulted in a detection limit of 17 spots/well (
Figure 2). In addition, the LLOQ was calculated by employing the results obtained from the LOD assay, corresponding to a value of 22 spots/well.
3.3. Repeatability
The repeatability of the analytical method was evaluated to demonstrate the accuracy of the assay. Repeatability indicates the variability in the results of successive measurements of the same sample and is usually expressed as the standard deviation or the CV. Measurements were performed in a standardized manner under the same operational conditions, including the same operator, equipment, laboratory, batch of reagents, and day.
For donor A, the coefficients of variation were 20.43, 18.41, and 8.89% for the Spike, PHA, and anti-CD3
+ stimuli, respectively. In donor B, the coefficients of variation were 19.13, 10.21, and 17.73% for the Spike, PHA, and anti-CD3
+ stimuli, respectively. Finally, in donor C, the coefficients of variation were 14.86, 15.40, and 8.00% for the same stimuli, respectively (
Table 4,
Figure 3).
3.4. Intermediate Precision
Intermediate precision indicates the reproducibility of the method when changes are applied to the analysis conditions. The intermediate precision of ELISPOT-IFNγ is a measure of the robustness and reliability of the method. This evaluation is fundamental to assessing the degree of uncertainty associated with the results and to ensure the comparability of the data obtained under different working conditions within the same laboratory. The intermediate precision was carried out in a standardized manner with two different operators and on different days. Three volunteers were analyzed, with 10 repetitions and each one in duplicate (2 × 105 cells/well). The acceptance criterion for the CV was established at a value of less than or equal to 25% (CV ≤ 25%). The results represent the number of spots obtained from the analysis of three samples from donors stimulated with the Spike, PHA, and anti-CD3+ antibody. Intermediate precision contributes to ensuring data quality in terms of reproducibility.
From donor A, the coefficients of variation were 20.43, 18.41, and 8.89% for the Spike, PHA, and anti-CD3
+ stimuli, respectively (
Table 5). For donor B, the coefficients of variation were 19.13, 10.21, and 17.73% for the Spike, PHA, and anti-CD3
+ stimuli, respectively (
Table 6). In the case of donor C, the coefficients of variation were 14.86, 15.40, and 8.00% for the same stimuli, respectively (
Table 7).
Intermediate precision evaluates the reproducibility of the method. In our results, we obtained a CV ≤ 21%, which indicates that the method is reliable and robust enough for application in biomedical research.
4. Discussion
ELISPOT-IFNγ is a functional assay used to evaluate the frequency of T cells that recognize a specific antigen. It is a semiquantitative and highly sensitive technique used to evaluate the immune response to infectious diseases, as well as the immune response induced by vaccines, including the SARS-CoV-2 vaccine [
14,
27]. However, the reproducibility and reliability of the results depend on factors such as the experience of the operators, especially of handling primary blood cells and reagents, as well as the instruments and equipment used [
28].
ELISPOT-IFNγ is not only used for research or exploration purposes; it is widely employed in various preclinical or clinical studies, in which it has proven to be a useful tool for biomarker detection in diagnostics, immunotherapies, and vaccine evaluation [
28,
29].
Despite its extensive use in research and in clinical settings, ELISPOT-IFNγ does not have a regulatory guide available to develop and validate this type of assay. In addition, there are no appropriate reference standards or positive control samples that guarantee the certainty of the results. This creates the need to validate the method according to the objectives of each scientific protocol.
Since the ELISPOT-IFNγ assay must be sensitive, precise, reproducible, specific, and semi-quantitative, we assessed the suitability of the assay through these parameters.
Regarding the limit of detection, our results showed an LOD of 17 SFC (
Table 1). The of LOD in our study was determined by counting non-specific background signals under non-stimulation conditions, using PBMCs from three volunteers. We performed 10 replicates in duplicate for each volunteer, analyzing 2 × 10
5 cells per well. The LOD values for donors A, B, and C were 26.51, 4.30, and 20.32 spots, respectively, resulting in an average detection limit of 17 spots per well. The variation in the LOD between donors highlights individual differences in background immune activity, which is expected given the natural variability in immune responses across individuals. This variability is a crucial factor to account for, as it ensures the assay is sensitive enough to detect low levels of antigen-specific T cell responses, even in individuals with inherently higher baseline reactivity.
This LOD is lower than that reported by Schmittel et al. [
29] suggesting that our technique is highly sensitive, suitable for evaluating low levels of cellular responses [
17,
18]. The obtained LOD was established as a negative control. Since the response of T cells can vary across healthy, sick, or immunosuppressed individuals [
30,
31], it is advisable to establish the LOD for the population to be studied.
Using the data obtained from the LOD calculations, we determined the Lower Limit of Quantification (LLOQ) to be 22 spots per well. In practical terms, the LLOQ ensures that even low-level immune responses to SARS-CoV-2 spike protein can be consistently measured, which is critical in assessing vaccine efficacy, particularly in populations with weaker immune responses such as the elderly or immunocompromised individuals.
Linearity indicates the number of cells that we should use for a reliable result [
29,
32]. In our linearity analysis, seven cell densities were tested, from 50,000 to 350,000 cells after stimulating the PBMCs with the S1 (Spike) protein and with the anti-CD3
+ antibody. Correlation coefficients of r
2 = 0.98 and r
2 = 0.95 were obtained for the recombinant S1 protein and anti-CD3
+, respectively, as shown in
Figure 1. These results are in line with those reported by Waerlop [
32], which confirms the accuracy of the procedure. The choice of the dilution factor is fundamental to ensure an adequate number of points for the calculation of other parameters.
Precision is defined as the proximity of values obtained across a series of measurements performed from the same sample under certain conditions [
33]. We established the precision of the method through repeatability and intermediate precision tests. We performed repeatability tests with PBMC samples from three volunteers and 10 replicates. The intermediate precision tests were performed on different days and by different operators. The values obtained from repeatability tests showed a range of 675.25 to 1564.05 SFU, with a range from 579.25 to 2312.55 SFU for intermediate precision. The variation coefficients were ≤25%, both in the repeatability and intermediate precision tests, confirming the reliability of the results. These results demonstrate that the analytical method employing the ELISPOT-IFNγ assay is precise, since the criteria for evaluating repeatability and intermediate precision were met.
In our validation protocol, we incorporated the use of PHA, as an additional positive control, since it stimulates the production of IFNγ in PBMCs [
23,
34]. Surprisingly, lower levels of spots were detected after PHA stimulation when compared with the anti-CD3
+ antibody, and significant differences were found when comparing the SFUs after PHA or CD3
+ exposure in each donor (
p < 0.0001).
The ELISPOT-IFNγ is a functional, highly quantitative assay with a wide range of detection limits. This makes the assay suitable for the study of antigen-specific cells and the evaluation of cellular responses to vaccines [
35,
36].