Next Article in Journal
IFN-I Independent Antiviral Immune Response to Vesicular Stomatitis Virus Challenge in Mouse Brain
Next Article in Special Issue
Potency of an Inactivated Influenza Vaccine against a Challenge with A/Swine/Missouri/A01727926/2015 (H4N6) in Mice for Pandemic Preparedness
Previous Article in Journal
Liver Stiffness Hinders Normalization of Systemic Inflammation and Endothelial Activation after Hepatitis C Virus (HCV) Eradication in HIV/HCV Coinfected Patients
Previous Article in Special Issue
Influenza Anti-Stalk Antibodies: Development of a New Method for the Evaluation of the Immune Responses to Universal Vaccine
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 8
Issue 2
10.3390/vaccines8020325
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Immunogenicity Measures of Influenza Vaccines: A Study of 1164 Registered Clinical Trials

by
Alexander Domnich
1,*,
Ilaria Manini
1,
Donatella Panatto
2,
Giovanna Elisa Calabrò
3 and
Emanuele Montomoli
1,4
1
Department of Molecular and Developmental Medicine, University of Siena, Via Aldo Moro 2, 53100 Siena (SI), Italy
2
Department of Health Sciences, University of Genoa, Via Pastore 1, 16132 Genova (GE), Italy
3
Section of Hygiene, Institute of Public Health, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
4
VisMederi srl, Strada del Petriccio e Belriguardo 35, 53100 Siena (SI), Italy
*
Author to whom correspondence should be addressed.
Vaccines 2020, 8(2), 325; https://doi.org/10.3390/vaccines8020325
Submission received: 27 May 2020 / Revised: 8 June 2020 / Accepted: 17 June 2020 / Published: 19 June 2020
(This article belongs to the Special Issue Progress on Seasonal and Pandemic Influenza Vaccines)
Versions Notes

Abstract

:
Influenza carries an enormous burden each year. Annual influenza vaccination is the best means of reducing this burden. To be clinically effective, influenza vaccines must be immunogenic, and several immunological assays to test their immunogenicity have been developed. This study aimed to describe the patterns of use of the various immunological assays available to measure the influenza vaccine-induced adaptive immune response and to determine its correlates of protection. A total of 76.5% of the studies included in our analysis measured only the humoral immune response. Among these, the hemagglutination-inhibition assay was by far the most widely used. Other, less common, humoral immune response assays were: virus neutralization (21.7%), enzyme-linked immunosorbent (10.1%), single radial hemolysis (4.6%), and assays able to quantify anti-neuraminidase antibodies (1.7%). By contrast, cell-mediated immunity was quantified in only 23.5% of studies. Several variables were significantly associated with the use of single assays. Specifically, some influenza vaccine types (e.g., adjuvanted, live attenuated and cell culture-derived or recombinant), study phase and study sponsorship pattern were usually found to be statistically significant predictors. We discuss the principal findings and make some suggestions from the point of view of the various stakeholders.

1. Introduction

Influenza is the leading infectious disease worldwide from the point of view of both attack rate and socioeconomic burden [1]. Together with some general preventive strategies (e.g., frequent hand-washing, social distancing, etc.), influenza vaccination (IV) is a cornerstone public health intervention and can substantially reduce the burden of disease [2].
To be clinically effective, vaccines must, first of all, be immunogenic. Almost all currently available vaccines, including IVs, work through serum or mucosal antibodies that can block infection or bacteremia/viremia; the antibody level therefore predicts protection [3]. In these situations, a precise, widely recognized threshold of the magnitude of antibody levels (as determined through a well-standardized immunological assay) may constitute the so-called “correlate of protection” (CoP). According to a definition by Plotkin [3], a CoP is “an immune response that is responsible for and statistically interrelated with protection”.
The immune response to an IV can be measured by means of a variety of immunological assays, the most common being the hemagglutination-inhibition (HAI) assay [4]. The almost ubiquitous use of the HAI assay is probably due to several factors. First of all, this assay is simple, rapid and inexpensive [4,5]. Second, it is/was required by the principal regulatory agencies, such as the United States (US) Food and Drug Administration (FDA) [6] and the European Medicines Agency (EMA) [7], in order to register and/or update annual IV formulations. Third, unlike many other immunological assays, the HAI assay has a universally accepted CoP threshold (≥1:40) that is assumed to indicate a 50% reduction in the risk of acquiring laboratory-confirmed influenza [4,5,6,7]. This estimate comes from an old challenge study conducted in the early ‘70s [8]. More recent studies have tried to verify the previously established ≥1:40 threshold of the HAI titer as a CoP. Some investigations have mostly corroborated this threshold [9,10], while others have underlined the age-dependence of this cut-off [11]. Indeed, it seems that children need a higher HAI titer (at least 1:110) in order to be protected.
Single radial hemolysis (SRH) is another immunological assay used to determine the immunogenicity of IVs. An SRH output of ≥25 mm2 lysis zone roughly corresponds to the HAI cut-off titer of ≥1:40 [12]. Of note, the SRH assay has been officially recognized as a CoP by the EMA [7] but not by the FDA [6].
Apart from HAI and SRH, other tests are commonly used and may provide some additional and useful immunogenicity information. Specifically, virus neutralization (VN) assays quantify neutralizing antibodies, are among the only tests that measure the so-called “functional” antibodies directly [5], and may therefore predict vaccine effectiveness better [13]. VN assays, however, are more laborious and time-consuming and less standardized than HAI; moreover, although HAI and VN titers usually show a high correlation, agreement in terms of nominal titers has been found to be relatively low [14]. No universally recognized VN titer for 50% protection has been established so far [15].
The enzyme-linked immunosorbent assay (ELISA), by contrast, is able to measure several class-specific antibodies (including IgM, IgA and IgG) in both serum and oropharyngeal/nasal wash samples [5]. ELISA correlates well with the output of HAI, SRH and VN [5]. However, it has the advantages of: (i) quantifying hemagglutinin (HA) stalk-specific antibodies, and (ii) assessing the immunogenicity of novel universal IV candidates. This is why ELISA is particularly suitable for large studies, as it can yield relatively unbiased results in little time, being fully automatic [5].
The quantification of anti-neuraminidase (NA) antibodies is becoming more common. After HA, NA is the second most abundant surface glycoprotein and allows the virus, in general terms, to spread the viral progeny from the infected host cell to uninfected cells [16]. Nevertheless, the NA antigen has been somewhat neglected in recent decades [17]. However, IVs containing optimal quantities of NA may be particularly useful in order to counteract the phenomena of viral drift and shift, given that NA immunity can offer broader protection [17].
Finally, only the humoral adaptive immunity assays have so far been discussed. However, cell-mediated immunity (CMI) plays an important role in the host immune response in protecting against virus-related illness and in establishing long-term immunological memory. Although correlates of protection are not currently available for CMI, it would be advisable to investigate this kind of immunological response with a view to evaluating next-generation vaccines [18].
The objectives of this study were to summarize current patterns of the use of the various available immunological assays for measuring the IV-induced immune response and to identify the determinants of their use.

2. Materials and Methods

2.1. Search Strategy, Eligibility Criteria and Data Extraction

In the present study, clinical trials of interest were sought from the freely available US-based prospective registry of studies ClinicalTrials.gov [19], which is the largest in the world.
In order to ensure the maximum number of potentially eligible items, we searched only for the term “Influenza” in the field “Condition or disease”. Adding the more colloquial word “Flu” did not increase the search output. No filters were used.
To be included in the study, clinical trials had both to be composed of vaccinees in at least one study arm and to use at least one immunological assay to quantify IV-induced immunogenicity. Studies were excluded if the actual enrollment was zero, as these trials probably never started. No other restrictions were applied.
The search output (all available columns) was downloaded in a comma-separated values (csv) file on 23 April 2020. Data of interest were then extracted in an ad hoc spreadsheet. If any information was unclear and/or missing, we consulted (whenever possible) publications of the results in peer-reviewed journals that are automatically linked to that particular study by the ClinicalTrials.gov unique identifier.

2.2. Study Variables

As per our main objective, the study outcome was the relative distribution of immunological assays used to quantify IV-induced immunogenicity. On the basis of our previous experience, the following outcomes were set a priori: HAI, VN, ELISA, SRH, anti-NA and any CMI assays.
The independent variables of interest were categorized in three domains, namely: spatiotemporal, design-related and IV-related. The first included the start year and location of the study. The study location was categorized in macro-areas as follows: (i) Europe; (ii) US and Canada; (iii) Asia and Pacific; (iv) rest of the world (RoW); and (v) “Multicontinental”. This last category included multicenter trials conducted in different parts of the world.
Attributes regarding the study design included: (i) age-class of the study population; (ii) study type; (iii) study phase; (iv) sponsorship characteristics; and (v) sample size. As per ClinicalTrials.gov, three principle age-groups were defined: children (<18 years), adults (18–64 years) and the elderly (≥65 years). Study type was either interventional or observational, while the study phase was I to IV. Regarding the latter variable, observational research was attributed to phase IV. Studies of phase I/II and II/III were classified as phase II and phase III, respectively. Regarding study sponsorship characteristics, we dichotomized this variable into “industry-sponsored” if a for-profit organization was the study (co)-sponsor, and “non-industry-sponsored” otherwise. The study sample size was the size on enrollment and was readily available in the downloaded file.
The IVs used were classified according to their valence [mono- (usually (pre)-pandemic), tri- and quadrivalent], production platform (traditional egg-based or cell culture-derived/recombinant), presence of adjuvants, mode of administration (e.g., intramuscular/subcutaneous, intradermal, intranasal) and virulence-related issues (inactivated and live attenuated). The inactivated IVs included whole-virion, split or subunit formulations. Moreover, a dummy variable of the universal/supra-seasonal vaccine candidates (e.g., peptide-based, DNA-based) was also created. Virosomal and virus-like particle vaccines were included in the category of adjuvanted IVs [20]. As almost all intranasally administered IVs were live attenuated, these two attributes were analyzed as the single dummy variable “live/intranasal” IVs. Of note, single studies could use different IV types.

2.3. Data Analysis

For descriptive purposes, the study outcome of the use of immunological assays was expressed as proportions with 95% confidence intervals (CIs).
In order to identify potential predictors of the use of single immunological assays, we implemented a set of multivariable logistic regression models in which the outcome was a binary variable concerning the use of a given immunological assay (0 = No, 1 = Yes). The potential predictors were the variables described in the above subsection. We implemented both the fully-adjusted models and models selected on the basis of the Bayesian Information Criterion (BIC) minimization approach. The regression outputs were expressed as adjusted odds ratios (aORs) with their corresponding 95% CIs.
In our models, almost all independent variables were dichotomous. The only exception was the study sample size, which was continuous. This latter variable was highly right-skewed (skewness coefficient: 12.7) with an average of 649 (standard deviation: 1855) and a median of 180 (interquartile range: 78–471). For modeling purposes, we split the median. Indeed, the use of the continuous variable worsened the model fits.
P-values of < 0.050 were deemed statistically significant. McKelvey–Zavoina’s pseudo-R2 was used to quantify the explained variability. The Hosmer–Lemeshov test was performed to test the goodness-of-fit. Other model diagnostics included a formal check for multicollinearity; indeed, some potential predictors (e.g., study phase and sample size) could be highly correlated. Multicollinearity was tested by verifying the variance inflation factor (VIF).
All analyses were performed in R stats packages, version 4.0.0 [21].

3. Results

3.1. Selection of Clinical Trials and Immunological Assays Used

In total, 2294 search items were available on the date of retrieval. Of these, 1186 met the inclusion criteria. Another 22 studies reported zero enrollment and were excluded. Thus, 1164 (50.7%) trials were analyzed.
As expected, the HAI assay was used in the majority (80.6%) of studies, and about half of the studies used only this test. Other, less-commonly used humoral immunity assays were distributed as follows: VN (21.7%), ELISA (10.1%) and SRH (4.6%). Anti-NA antibodies were quantified only in 20 trials (1.7%). CMI was measured in 273 [23.5% (95% CI: 21.1–26.0%)] trials. About 60% of the studies included employed a single assay. Table 1 reports the descriptive statistics on the immunological assays used across the trials.

3.2. Determinants of the Immunological Assays Used

As HAI was used in most of the studies included, it was deemed useless to establish its correlates.
The results of the multivariable models predicting the assessment of neutralizing antibodies are reported in Table 2. Compared with the fully-adjusted model, the best-subset model was associated with a significant (−6.5%) BIC reduction; however, the model fit of the latter was poor (Hosmer–Lemeshov test: p = 0 043). By contrast, the fully adjusted model fitted well (Hosmer–Lemeshov test: p = 0.90); we therefore retained this latter model for interpretation. From the point of view of the vaccine characteristics, monovalent, adjuvanted and cell culture-derived/recombinant IV formulations were significantly associated with a higher use of VN. There was also some increase in VN use as age increased; however, the effect was not significant in the mixed age-classes. Each additional year was associated with about a 7% increase (p = 0.016) in the odds of performing a VN. By contrast, studies (co)-sponsored by an industry and those conducted in the RoW were associated with lower odds of using VN assays. Moreover, the later phases of clinical development (phases III and IV) correlated negatively with the use of VN. The model explained 35.3% of variance.
Factors associated with the use of ELISA are described in Table 3. Both models showed similar results, fit reasonably well (Hosmer–Lemeshov test: p ≥ 0.80) and explained up to 42% of variance. Live attenuated/intransal (OR = 8.28) and cell-derived/recombinant (OR = 2.41) IVs were positively associated with ELISA testing. By contrast, the use of adjuvanted IV formulations was a significant negative predictor. Compared with phase I clinical trials, those of phases II to IV were associated with a 64–90% lower rate of ELISA testing. Analogously, trials involving industry made less use of ELISA.
CMI was among the outcomes in 273 of the trials included [23.5% (95% CI: 21.1–26.0%)]. The results of the adjusted logistic models with the outcome of CMI assays are reported in Table 4. On the basis of goodness-of-fit, only the fully adjusted model was retained (Hosmer–Lemeshov test: p = 0.61) since the best-subset model proved to have a poor fit (Hosmer–Lemeshov test: p = 0.002). Trials investigating adjuvanted, live attenuated/intranasal IVs and, especially, universal vaccine candidates displayed significantly higher odds of quantifying CMI. As in the previously described models, industry co-sponsored trials and phase III studies reported a lower use of CMI assays. Moreover, larger studies were also associated with 38% lower odds of the model outcome.
In none of the models reported in Table 2, Table 3 and Table 4 did multicollinearity issues emerge: no VIF exceeded the nominal value of 5.
Finally, the outcomes of SRH and anti-NA assay use were relatively infrequent, and thus displayed a low event-per-predictor ratio. We therefore decided against the multivariable regression approach. However, two notable features regarding the SRH assay emerged: (i) all [100% (95% CI: 93.4–100%)] studies were industry sponsored and (ii) two thirds [66.7% (95% CI: 52.5–78.9%)] were conducted in Europe. By contrast, most [65.0% (95% CI: 40.8–84.6%)] anti-NA antibody testing was performed in the US.

4. Discussion

To our knowledge, the present paper is the first to describe and analyze the use of the available immunological assays for quantifying the immunogenicity of the currently licensed IVs and vaccine candidates. Several findings emerged from the present analysis. First (and not to our surprise), we found that most of the studies included used only one assay, which in most cases was the HAI. Second, we found that some IV formulations and some study design attributes, such as phase or sponsorship, were associated with the patterns of use of particular immunological assays. We will now discuss our principal findings.
Regarding IV valence characteristics, we did not generally find any meaningful correlation, the only exception being the significantly higher probability of neutralizing antibody quantification in trials involving monovalent IVs. In our study, most monovalent IVs were either pandemic A(H1N1)pdm09 or pre-pandemic vaccines against several avian type A subtypes with pandemic potential [e.g., A(H5N1), A(H7N9)]. Indeed, VN has proved to be particularly useful in studying the serology of avian type A strains, and several studies have documented the unsuitability of HAI for the detection of antibodies against these viruses [22,23,24]. Moreover, the pattern observed may be somehow linked to antigen-sparing as a strategy for pandemic preparedness promoted by the World Health Organization [25]. Indeed, in the present analysis, many (pre)-/pandemic studies were dose-finding. Compared with HAI, VN can detect antibodies at lower titers, distinguish better between small differences (e.g., less than two-fold) in pre- and post-vaccination titers, and requires a lower concentration in order to yield a judgment of protection (though no formally established threshold has been universally recognized) [24,26,27,28,29].
Adjuvanted IVs (including virosomal and virus-like particle formulations) were associated with a higher use of both VN and CMI assays. Adjuvanted IVs have been systematically shown to induce both stronger and broader humoral immune responses [30,31]. However, widespread use of the standard HAI assay may downplay some important potential advantages of the adjuvanted formulations, such as cross-protection and immunological memory. According to the FDA’s Center for Biologics Evaluation and Research (CBER) guidelines [6] despite the public health advantage of adjuvants in terms of dose-sparing, some safety issues may arise; however, the subsequent risk–benefit assessment asserts that “meaningful differences may also include a demonstration of cross-reactivity against drifted strains” [6]. In such situations, VN assays may provide an advantage: they identify a wide range of antibodies, including those that neutralize the virus by inhibiting its entry/replication in mammalian cells, while HAI only measures antibodies against HA, which act by preventing the agglutination of red blood cells [24]. Ansaldi et al. [32], for example, showed that in elderly subjects immunized with an adjuvanted trivalent IV, the correlation coefficient r between the mean-fold increase in neutralizing antibody titers (from pre- to post-vaccination) and the antigenic distance of several drifted A(H3N2) strains was substantially higher than the r between the corresponding mean-fold increase in HAI titers (0.701 vs. 0.501). Analogously, the use of CMI, which plays a crucial role in protecting against influenza by establishing the long-term immunological memory [18], may also positively “differentiate” the adjuvanted formulations from their non-adjuvanted counterparts. For instance, Zedda et al. [33] found that adding an adjuvant to standard IVs induced a larger expansion of vaccine-specific CD4+ cells, and that this advantage was evident with regard to the drifted heterologous strains. To summarize, our results suggest that measuring neutralizing antibodies and CMI may constitute the so-called “correlates of adjuvanticity” [34]; it is therefore advisable to better standardize protocols for these assays, in order to reduce intra- and inter-laboratory variation, and to revise the current immunogenicity guidelines [24].
Intranasal IV formulations (mostly live attenuated) proved more likely to be tested in ELISA, with a huge effect size of 8.3. The use of intranasal IV formulations also was also seen to be a positive predictor of CMI assays. The standard HAI assay is often judged poorly suitable for live attenuated IVs [24] and, unlike in the case of inactivated IVs, no CoPs have been established for live IVs [35]. For instance, in their challenge study, Wright et al. [36] showed that some traditional measurements of immune response, such as HAI, did not correlate with protection provided by a live attenuated IV. Indeed, live attenuated IV formulations are believed to induce multifaceted immunogenicity ascribable to both local/mucosal immunoglobulins and T cell responses [37]. In an analysis of three clinical studies, Ambrose et al. [38] found that nasal wash IgA measured by means of ELISA contributed to the efficacy of live IV in young children. Nasal wash IgG and IgM may also increase in recipients of live IV [38]. With regard to CMI, Forrest et al. [39] showed that this may have greater importance in subjects immunized with live IVs in comparison with inactivated formulations. In their study, it was also estimated that the majority of children with ≥ 100 interferon-γ spot-forming cells per 106 peripheral blood mononuclear cells were protected against clinical influenza, suggesting that this level could be a possible target in clinical trials. As discussed by Ambrose et al. [38], in Plotkin’s framework of CoPs [3], the association between the protection induced by live IV and IgA responses measured by means of ELISA constitutes the so-called co-correlate of protection, which is “one of two or more factors that correlate with protection in alternative, additive, or synergistic ways” [3]. Indeed, strain-specific IgA responses are associated with protection in vaccinees, but the level of response may vary by strain and trial, and IV-induced protection may be correlated with other components of the immune response [38].
Universal vaccine candidates have likewise displayed far greater odds of being scrutinized through CMI assays. Universal IVs comprise a large and heterogeneous variety of experimental vaccine formulations with different platforms, targets and mechanisms of action [40,41,42]. As we have already mentioned, the currently accepted CoP assays of HAI and SRH target the viral HA. By contrast, most next-generation universal IVs target some highly conserved proteins that are common across viral (sub) types [40,41,42]. This is why the recognized CoPs and other widely used immunological assays are likely to prove unsuitable for the universal vaccine candidates. On the other hand, CMI will undoubtedly be quantified in future trials on the next-generation IVs, since cross-reactive CD4+ and CD8+ T cells have already been proposed as future CoPs in human challenge and cohort studies [43].
Unlike the other tests analyzed, and independently from the IV formulations used, VN assays were employed increasingly over the 20-year period considered. As described earlier, the proliferating interest in quantifying neutralizing antibodies is probably determined by the fact that, unlike the conventional assays, VN tests measure the functional capability of antibodies and not just their total quantity, and are more efficient in quantifying cross-reactivity/cross-immunogenicity.
Industry-(co)sponsored trials quantified neutralizing and ELISA antibodies and determined CMI to a significantly lesser extent than non-industry-sponsored studies. By contrast, about 85% of industry-(co)sponsored studies determined the HAI response, while 100% of studies that used the SRH assay were industry-(co)sponsored. The most probable explanation is two-fold: (i) both HAI and SRH have a well-recognized threshold as a CoP [9,10,11,12] and (ii) clinical guidelines are available for industry to support the licensure of seasonal IVs [6,7]. Indeed, the US document issued by the CBER [6] cites some criteria to support accelerated approval of new IVs, and all these criteria are based on the HAI assay. Indeed, in the case of children and adults aged <65 years, clinical trials should show that the lower limit of the two-sided 95% CI for the percentage of subjects achieving seroconversion (defined as the proportion of vaccinees with at least a four-fold increase from before to after IV) and seroprotection (defined as the proportion of vaccinees with an HAI titer ≥ 1:40) reaches or exceeds 40% and 70%, respectively. In the case of elderly subjects, these proportions are reduced by 10% (to 30% and 60%, respectively) [6]. The previous European criteria issued by the EMA’s Committee for Medicinal Products for Human Use [7] were similar, but were based on the point estimates rather than the 95% CIs. Moreover, unlike in the US guidelines, the endpoints determined by the SRH assay were recommended only from the European perspective [7]; this is probably why we found that most SRH assays were performed in Europe.
In all our analyses, a later phase of clinical development was generally associated with a lower use of VN, ELISA and CMI assays. Contrary to our expectations, we did not encounter any problem of collinearity between the study phase and sample size; an adequately powered sample size is usually directly related to the study phase. The observed absence of collinearity issues was probably driven by the sample size dichotomization rule adopted. Early phase trials on vaccines usually have safety endpoints as primary outcomes; however, some exploratory immunogenicity endpoints may also be assessed (usually as secondary outcomes). By contrast, pivotal phase III trials are designed to provide robust clinical data in support of licensure [44,45]. Modern phase III immunogenicity trials enroll thousands of individuals, each of whom is tested for the IV-induced immune response at least twice. In these conditions, the HAI assay was most frequently used, not least because this test is both widely recognized as a CoP and relatively cheap [5]. Indeed, the reproducibility and unbiased assessment of an assay should be weighed against its cost-effectiveness [14]. On the other hand, the EMA guidelines [7] state that “It is essential that neutralizing antibody titers are determined in all studies”, “Measurement of … CMI is encouraged” and “Applicants may consider evaluating anti-NA antibodies”. We therefore believe that more sophisticated techniques should also be used in at least a subset of participants in pivotal clinical trials.
Despite its strengths—such as its large sample size and meaningful set of predictors—the current study may have some notable limitations. First of all, the information retrieved came mostly from the registered information on clinical trials and is therefore is highly dependent on the quality of this latter. In this regard, Viergever et al. [46] have shown that the quality of registration at ClinicalTrials.gov is suboptimal, although some slight improvements have been seen over time. We tried to attenuate this bias by consulting the available peer-reviewed publications linked to a given trial; however, this was not always possible. Indeed, in 11.4% of the trials included, we failed to identify the humoral immunity assays used (although we believe that most of these used the HAI assay). This is also why we cannot completely rule out mistakes due to misclassification bias of the study outcome. For instance, records indicating that the immune response was measured according to the CBER criteria were assumed to refer to studies that used the HAI assay, given that the US criteria consider only the HAI assay [6].
Second, although ClinicalTrials.gov is the world’s largest and first-established registry, we acknowledge that a certain number of studies were registered in other supranational (e.g., the European register available at www.clinicaltrialsregister.eu) or country-specific databases, which were not searched systematically. At present, it is not possible to perform a simultaneous search in more databases several databases nor can double-registered trials be directly linked via a single identifier (in order to avoid duplicates). We believe, however, that the sample of registered trials analyzed is globally representative, given the pioneering nature of ClinicalTrials.gov [19]. We also believe that this shortcoming is particularly relevant with regard to the non-industry-sponsored trials; indeed, in our sample approximately 62% of items were industry-(co)sponsored. Vaccine manufacturers are obliged to prospectively register their trials, and the technical documents commonly submitted to the regulatory agencies have to contain a complete list of the studies that support marketing authorization applications [47].
Third, considering the relative paucity of studies that measured CMI, no attempt to further categorize CMI assays was made. It is therefore probable that some meaningful associations were “hidden” by the classification rule adopted.
Finally, we were not able to identify determinants of the SRH and anti-NA assays, owing to the paucity of studies using these tests. Indeed, according to a widely applied “rule of thumb” [48], we needed at least 10 events per independent variable. We tried to address this issue by applying Firth’s penalized logistic regression approach; the output was, however, not consistent (results not shown) [49].

5. Conclusions

In conclusion, the IV-induced immune response may be measured by means of a variety of immunological assays; these are, however, unevenly distributed across the available registered trials. Continuous diversification of the IV market and research into a universal IV will probably produce a gradual shift from the currently preferred HAI test to other more “functional” assays; assays that measure CMI seem particularly promising. Technological innovation can involve high costs and exerts strong financial pressure on health systems. Today’s healthcare systems cannot forgo technological innovation, but must take into account the point of view of the various stakeholders: patients should be guaranteed rapid access to more effective healthcare technologies; research and development efforts should be encouraged when oriented towards the production of high-value products; institutions and regulatory agencies should support innovation by using evidence-based tools for their evaluation, such as health technology assessment (HTA); and health systems should promote technological innovation while ensuring their own sustainability [50]. In this regard, governments around the world are increasingly focusing on the use of public-private partnerships that can combine the strengths of private enterprise, such as innovation, technical knowledge and managerial skills, with the role of public institutions, including social responsibility and public accountability, in order to deliver high-quality health services [51]. Future IV clinical trials will undoubtedly benefit from functional public–private partnerships, especially from the point of view of searching for new CoPs.

Author Contributions

Conceptualization: A.D. and E.M.; methodology: A.D., I.M., D.P.; formal analysis: A.D. and G.E.C.; validation: E.M.; writing: A.D., I.M., D.P. and G.E.C.; supervision: E.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

A.D. is grateful to Maura Cambiaggi for her psychological support during the program, and to Bernard Patrick for his critical review of the paper.

Conflicts of Interest

The present study was conceived and carried out by A.D. during his PhD program at Siena University. No product-specific information is presented in the present paper. The other authors declare no potential conflict of interests regarding this article. The study methods, results and conclusions represent the personal view of the authors.

References

  1. Cassini, A.; Colzani, E.; Pini, A.; Mangen, M.J.; Plass, D.; McDonald, S.A.; Maringhini, G.; van Lier, A.; Haagsma, J.A.; Havelaar, A.H.; et al. Impact of infectious diseases on population health using incidence-based disability-adjusted life years (DALYs): Results from the Burden of Communicable Diseases in Europe study, European Union and European Economic Area countries, 2009 to 2013. Eur. Surveill. 2018, 23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. World Health Organization (WHO). Vaccines against influenza WHO position paper—November 2012. Wkly. Epidemiol. Rec. 2012, 87, 461–476. [Google Scholar]
  3. Plotkin, S.A. Correlates of protection induced by vaccination. Clin. Vaccine Immunol. 2010, 17, 1055–1065. [Google Scholar] [CrossRef] [Green Version]
  4. Domnich, A.; Manini, I.; Calabrò, G.E.; de Waure, C.; Montomoli, E. Mapping host-related correlates of influenza vaccine-induced immune response: An umbrella review of the available systematic reviews and meta-analyses. Vaccines 2019, 7, 215. [Google Scholar] [CrossRef] [Green Version]
  5. Trombetta, C.M.; Remarque, E.J.; Mortier, D.; Montomoli, E. Comparison of hemagglutination inhibition, single radial hemolysis, virus neutralization assays, and ELISA to detect antibody levels against seasonal influenza viruses. Influenza Other Respir. Viruses 2018, 12, 675–686. [Google Scholar] [CrossRef] [PubMed]
  6. US Department of Health and Human Services Food and Drug Administration Center for Biologics Evaluation and Research. Guidance for Industry: Clinical Data Needed to Support the Licensure of Seasonal Inactivated Influenza Vaccines. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/clinical-data-needed-support-licensure-seasonal-inactivated-influenza-vaccines (accessed on 9 May 2019).
  7. European Medicines Agency (EMA); Committee for Medicinal Products for Human Use (CHMP). Guideline on Influenza Vaccines: Non-Clinical and Clinical Module. Available online: https://www.ema.europa.eu/en/documents/scientific-guideline/influenza-vaccines-non-clinical-clinical-module_en.pdf (accessed on 9 May 2020).
  8. Hobson, D.; Curry, R.L.; Beare, A.S.; Ward-Gardner, A. The role of serum haemagglutination-inhibiting antibody in protection against challenge infection with influenza A2 and B viruses. J. Hyg. 1972, 70, 767–777. [Google Scholar] [CrossRef] [Green Version]
  9. de Jong, J.C.; Palache, A.M.; Beyer, W.E.; Rimmelzwaan, G.F.; Boon, A.C.; Osterhaus, A.D. Haemagglutination-inhibiting antibody to influenza virus. Dev. Biol. 2003, 115, 63–73. [Google Scholar]
  10. Coudeville, L.; Bailleux, F.; Riche, B.; Megas, F.; Andre, P.; Ecochard, R. Relationship between haemagglutination-inhibiting antibody titres and clinical protection against influenza: Development and application of a Bayesian random-effects model. BMC Med. Res. Methodol. 2010, 10, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Black, S.; Nicolay, U.; Vesikari, T.; Knuf, M.; Del Giudice, G.; Della Cioppa, G.; Tsai, T.; Clemens, R.; Rappuoli, R. Hemagglutination inhibition antibody titers as a correlate of protection for inactivated influenza vaccines in children. Pediatr. Infect. Dis. J. 2011, 30, 1081–1085. [Google Scholar] [CrossRef] [PubMed]
  12. Delem, A.; Jovanovic, D. Correlation between rate of infection and preexisting titer of serum antibody as determined by single radial hemolysis during and epidemic of influenza A/Victoria/3/75. J. Infect. Dis. 1978, 137, 194–196. [Google Scholar] [CrossRef] [PubMed]
  13. Cheng, L.W.; Huang, S.W.; Huang, L.M.; Chang, L.Y.; Shao, P.L.; Kiang, D.; Wang, J.R. Comparison of neutralizing and hemagglutination-inhibiting antibody responses for evaluating the seasonal influenza vaccine. J. Virol. Methods 2012, 182, 43–49. [Google Scholar] [CrossRef]
  14. Sicca, F.; Martinuzzi, D.; Montomoli, E.; Huckriede, A. Comparison of influenza-specific neutralizing antibody titers determined using different assay readouts and hemagglutination inhibition titers: Good correlation but poor agreement. Vaccine 2020, 38, 2527–2541. [Google Scholar] [CrossRef]
  15. Dunning, A.J.; DiazGranados, C.A.; Voloshen, T.; Hu, B.; Landolfi, V.A.; Talbot, H.K. Correlates of protection against influenza in the elderly: Results from an influenza vaccine efficacy trial. Clin. Vaccine Immunol. 2016, 23, 228–235. [Google Scholar] [CrossRef] [Green Version]
  16. Eichelberger, M.C.; Wan, H. Influenza neuraminidase as a vaccine antigen. Curr. Top. Microbiol. Immunol. 2015, 386, 275–299. [Google Scholar] [CrossRef]
  17. Eichelberger, M.C.; Monto, A.S. Neuraminidase, the forgotten surface antigen, emerges as an influenza vaccine target for broadened protection. Clin. Infect. Dis. 2019, 219 (Suppl. 1), S75–S80. [Google Scholar] [CrossRef] [Green Version]
  18. Gianchecchi, E.; Torelli, A.; Montomoli, E. The use of cell-mediated immunity for the evaluation of influenza vaccines: An upcoming necessity. Hum. Vaccin. Immunother. 2019, 15, 1021–1030. [Google Scholar] [CrossRef]
  19. United States National Library of Medicine. ClinicalTrials.gov. Available online: https://clinicaltrials.gov/ct2/home (accessed on 9 May 2020).
  20. Kang, S.M.; Kim, M.C.; Compans, R.W. Virus-like particles as universal influenza vaccines. Expert Rev. Vaccines 2012, 11, 995–1007. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. R Core Team. R: A Language and Environment for Statistical Computing. Available online: http://www.R-project.org/ (accessed on 9 May 2020).
  22. Rowe, T.; Abernathy, R.A.; Hu-Primmer, J.; Thompson, W.W.; Lu, X.; Lim, W.; Fukuda, K.; Cox, N.J.; Katz, J.M. Detection of antibody to avian influenza A (H5N1) virus in human serum by using a combination of serologic assays. J. Clin. Microbiol. 1999, 37, 937–943. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Stephenson, I.; Heath, A.; Major, D.; Newman, R.W.; Hoschler, K.; Junzi, W.; Katz, J.M.; Weir, J.P.; Zambon, M.C.; Wood, J.M. Reproducibility of serologic assays for influenza virus A (H5N1). Emerg. Infect. Dis. 2009, 15, 1252–1259. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Trombetta, C.M.; Perini, D.; Mather, S.; Temperton, N.; Montomoli, E. Overview of serological techniques for influenza vaccine evaluation: Past, present and future. Vaccines 2014, 2, 707–734. [Google Scholar] [CrossRef] [Green Version]
  25. World Health Organization. Vaccines for Pandemic Influenza. Available online: https://apps.who.int/iris/bitstream/handle/10665/69821/WHO_CDS_CSR_GIP_2004_3_eng.pdf;jsessionid=DD4F77C9249E85AB9796B60F4497FBD6?sequence=1 (accessed on 9 May 2020).
  26. Sui, J.; Hwang, W.C.; Perez, S.; Wei, G.; Aird, D.; Chen, L.M.; Santelli, E.; Stec, B.; Cadwell, G.; Ali, M.; et al. Structural and functional bases for broad-spectrum neutralization of avian and human influenza a viruses. Nat. Struct. Mol. Biol. 2009, 16, 265–273. [Google Scholar] [CrossRef] [PubMed]
  27. Nunes, M.C.; Weinberg, A.; Cutland, C.L.; Jones, S.; Wang, D.; Dighero-Kemp, B.; Levine, M.Z.; Wairagkar, N.; Madhi, S.A. Neutralization and hemagglutination-inhibition antibodies following influenza vaccination of HIV-infected and HIV-uninfected pregnant women. PLoS ONE 2018, 13, e0210124. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Hsu, J.P.; Zhao, X.; Chen, M.I.; Cook, A.R.; Lee, V.; Lim, W.Y.; Tan, L.; Barr, I.G.; Jiang, L.; Tan, C.L.; et al. Rate of decline of antibody titers to pandemic influenza A (H1N1-2009) by hemagglutination inhibition and virus microneutralization assays in a cohort of seroconverting adults in Singapore. BMC Infect. Dis. 2014, 14, 414. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Verschoor, C.P.; Singh, P.; Russell, M.L.; Bowdish, D.M.; Brewer, A.; Cyr, L.; Ward, B.J.; Loeb, M. Microneutralization assay titres correlate with protection against seasonal influenza H1N1 and H3N2 in children. PLoS ONE 2015, 10, e0131531. [Google Scholar] [CrossRef]
  30. Nicolay, U.; Heijnen, E.; Nacci, P.; Patriarca, P.A.; Leav, B. Immunogenicity of aIIV3, MF59-adjuvanted seasonal trivalent influenza vaccine, in older adults ≥65 years of age: Meta-analysis of cumulative clinical experience. Int. J. Infect. Dis. 2019, 85S, S1–S9. [Google Scholar] [CrossRef] [Green Version]
  31. Banzhoff, A.; Nacci, P.; Podda, A. A new MF59-adjuvanted influenza vaccine enhances the immune response in the elderly with chronic diseases: Results from an immunogenicity meta-analysis. Gerontology 2003, 49, 177–184. [Google Scholar] [CrossRef]
  32. Ansaldi, F.; Zancolli, M.; Durando, P.; Montomoli, E.; Sticchi, L.; Del Giudice, G.; Icardi, G. Antibody response against heterogeneous circulating influenza virus strains elicited by MF59- and non-adjuvanted vaccines during seasons with good or partial matching between vaccine strain and clinical isolates. Vaccine 2010, 28, 4123–4129. [Google Scholar] [CrossRef]
  33. Zedda, L.; Forleo-Neto, E.; Vertruyen, A.; Raes, M.; Marchant, A.; Jansen, W.; Clouting, H.; Arora, A.; Beatty, M.E.; Galli, G.; et al. Dissecting the immune response to MF59-adjuvanted and nonadjuvanted seasonal influenza vaccines in children less than three years of age. Pediatr. Infect. Dis. J. 2015, 34, 73–78. [Google Scholar] [CrossRef]
  34. Del Giudice, G.; Rappuoli, R.; Didierlaurent, A.M. Correlates of adjuvanticity: A review on adjuvants in licensed vaccines. Semin. Immunol. 2018, 39, 14–21. [Google Scholar] [CrossRef]
  35. Weinberg, A.; Curtis, D.; Ning, M.F.; Claypool, D.J.; Jalbert, E.; Patterson, J.; Frank, D.N.; Ir, D.; Armon, C. Immune responses to circulating and vaccine viral strains in HIV-infected and uninfected children and youth who received the 2013/2014 quadrivalent live-attenuated influenza vaccine. Front. Immunol. 2016, 7, 142. [Google Scholar] [CrossRef] [Green Version]
  36. Wright, P.F.; Hoen, A.G.; Ilyushina, N.A.; Brown, E.P.; Ackerman, M.E.; Wieland-Alter, W.; Connor, R.I.; Jegaskanda, S.; Rosenberg-Hasson, Y.; Haynes, B.C.; et al. Correlates of immunity to influenza as determined by challenge of children with live, attenuated influenza vaccine. Open Forum Infect. Dis. 2016, 23, ofw108. [Google Scholar] [CrossRef] [Green Version]
  37. Mohn, K.G.; Smith, I.; Sjursen, H.; Cox, R.J. Immune responses after live attenuated influenza vaccination. Hum. Vaccin. Immunother. 2018, 14, 571–578. [Google Scholar] [CrossRef] [PubMed]
  38. Ambrose, C.S.; Wu, X.; Jones, T.; Mallory, R.M. The role of nasal IgA in children vaccinated with live attenuated influenza vaccine. Vaccine 2012, 30, 6794–6801. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Forrest, B.D.; Pride, M.W.; Dunning, A.J.; Capeding, M.R.; Chotpitayasunondh, T.; Tam, J.S.; Rappaport, R.; Eldridge, J.H.; Gruber, W.C. Correlation of cellular immune responses with protection against culture-confirmed influenza virus in young children. Clin. Vaccine Immunol. 2008, 15, 1042–1053. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Pica, N.; Palese, P. Toward a universal influenza virus vaccine: Prospects and challenges. Annu. Rev. Med. 2013, 64, 189–202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Gilbert, S.C. Advances in the development of universal influenza vaccines. Influenza Other Respir. Viruses 2013, 7, 750–758. [Google Scholar] [CrossRef]
  42. Zhang, H.; Wang, L.; Compans, R.W.; Wang, B.Z. Universal influenza vaccines, a dream to be realized soon. Viruses 2014, 6, 1974–1991. [Google Scholar] [CrossRef] [Green Version]
  43. Krammer, F.; Weir, J.P.; Engelhardt, O.; Katz, J.M.; Cox, R.J. Meeting report and review: Immunological assays and correlates of protection for next-generation influenza vaccines. Influenza Other Respir. Viruses 2020, 14, 237–243. [Google Scholar] [CrossRef]
  44. World Health Organization (WHO). Clinical Evaluation of Vaccines. Available online: https://www.who.int/biologicals/vaccines/clinical_evaluation/en/ (accessed on 9 May 2020).
  45. World Health Organization (WHO). Guidelines on Clinical Evaluation of Vaccines: Regulatory Expectations. Available online: https://www.who.int/biologicals/expert_committee/Clinical_changes_IK_final.pdf (accessed on 9 May 2020).
  46. Viergever, R.F.; Karam, G.; Reis, A.; Ghersi, D. The quality of registration of clinical trials: Still a problem. PLoS ONE 2014, 9, e84727. [Google Scholar] [CrossRef] [Green Version]
  47. Jørgensen, L.; Gøtzsche, P.C.; Jefferson, T. Index of the human papillomavirus (HPV) vaccine industry clinical study programmes and non-industry funded studies: A necessary basis to address reporting bias in a systematic review. Syst. Rev. 2018, 7, 8. [Google Scholar] [CrossRef] [Green Version]
  48. Harrell, F.E., Jr.; Lee, K.L.; Mark, D.B. Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat. Med. 1996, 15, 361–387. [Google Scholar] [CrossRef]
  49. Puhr, R.; Heinze, G.; Nold, M.; Lusa, L.; Geroldinger, A. Firth’s logistic regression with rare events: Accurate effect estimates and predictions? Stat. Med. 2017, 36, 2302–2317. [Google Scholar] [CrossRef] [PubMed]
  50. European Commission. Report of the Expert Panel on Effective Ways of Investing in Health (EXPH) on Disruptive Innovation: Considerations for Health and Health Care in Europe. Available online: https://ec.europa.eu/health/expert_panel/sites/expertpanel/files/012_disruptive_innovation_en.pdf (accessed on 9 May 2020).
  51. Roehrich, J.K.; Lewis, M.A.; George, G. Are public-private partnerships a healthy option? A systematic literature review. Soc. Sci. Med. 2014, 113, 110–119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Table
Table 1. Frequency of the immunological assays used in the clinical trials included (N = 1164).
Table 1. Frequency of the immunological assays used in the clinical trials included (N = 1164).
Parameter% (N)95% CI
Humoral response only76.5 (891)74.0–79.0
Cell-mediated response only3.0 (35)2.1–4.2
One assay only61.3 (714)58.5–64.2
Two assays26.8 (312)24.3–29.4
Three assays or more11.9 (138)10.1–13.9
HAI assay80.6 (938)78.2–82.8
HAI assay only47.8 (556)44.9–50.7
VN assays21.7 (253)19.4–24.2
VN assays only1.0 (12)0.5–1.8
ELISA10.1 (117)8.4–11.9
ELISA only0.9 (10)0.4–1.6
SRH assay4.6 (54)3.5–6.0
SRH assay only1.2 (14)0.7–2.0
Anti-NA response1.7 (20)1.1–2.6
Anti-NA response only0 (0)0.0–0.3
Humoral response assay unclear11.4 (133)9.7–13.4
ELISA: enzyme-linked immunosorbent assay; HAI: hemagglutination-inhibition; NA: neuraminidase; SRH: single radial hemolysis; VN: virus neutralization.
Table
Table 2. Multivariable logistic regression models to predict the use of immunological assays measuring neutralizing antibodies.
Table 2. Multivariable logistic regression models to predict the use of immunological assays measuring neutralizing antibodies.
VariableLevelBest-Subset ModelFull Model
aOR (95% CI)PaOR (95% CI)P
VaccineMonovalent a5.68 (3.89–8.30)<0.001 ***3.35 (1.75–6.44)<0.001 ***
Trivalent a––0.70 (0.41–1.22)0.21
Quadrivalent––1.07 (0.57–1.98)0.84
Adjuvanted a1.48 (1.02–2.15)0.038 *1.65 (1.10–2.46)0.015 *
Intradermal a––1.04 (0.45–2.37)0.93
Live/intranasal a––1.43 (0.81–2.54)0.22
Cell-derived/recombinant a2.03 (1.37–3.00)<0.001 ***1.82 (1.18–2.80)0.006 **
Universal candidates a––0.55 (0.19–1.63)0.28
AgeAnyRef–Ref–
Children only3.49 (1.22–9.99)0.020 *2.92 (0.97–8.83)0.058
Adults only3.59 (1.32–9.75)0.012 *2.90 (1.01–8.34)0.048 *
Elderly only5.58 (1.85–16.89)0.002 **4.71 (1.49–14.88)0.008 **
Children and adults1.83 (0.52–6.42)0.351.68 (0.45–6.22)0.44
Adults and elderly1.67 (0.60–4.65)0.331.59 (0.54–4.66)0..40
Study typeObservational––Ref–
Interventional––0.63 (0.26–1.49)0.29
Study phase1––Ref–
2––0.72 (0.45–1.16)0.17
3––0.49 (0.26–0.90)0.022 *
4––0.36 (0.20–0.64)<0.001 ***
Industry sponsoredNoRef–Ref–
Yes0.48 (0.33–0.68)<0.001 ***0.40 (0.26–0.90)<0.001 ***
TimeYear b1.08 (1.04–1.13)<0.001 ***1.07 (1.01–1.12)0.016 *
Sample size<180––Ref–
≥180––1.27 (0.87–1.86)0.21
Study locationMulticontinental––Ref–
Europe––0.67 (0.28–1.58)0.36
US and Canada––0.62 (0.27–1.46)0.27
Asia and Pacific––0.85 (0.36–2.04)0.72
Rest of the world––0.09 (0.02–0.49)0.006 **
Pseudo-R2, %30.035.3
BIC1008.61074.2
a Yes versus No; b One-year increase; *** p < 0.001; ** p < 0.01; * p < 0.05; p < 0.10; aOR: adjusted odds ratio; BIC: Bayesian information criterion.
Table
Table 3. Multivariable logistic regression models to predict the use of enzyme-linked immunosorbent assay (ELISA).
Table 3. Multivariable logistic regression models to predict the use of enzyme-linked immunosorbent assay (ELISA).
VariableLevelBest-Subset ModelFull Model
aOR (95% CI)PaOR (95% CI)P
VaccineMonovalent a––1.04 (0.37–2.96)0.94
Trivalent a––1.62 (0.65–4.04)0.30
Quadrivalent––0.82 (0.34–2.01)0.67
Adjuvanted a0.34 (0.17–0.67)0.002 **0.32 (0.15–0.65)0.002 **
Intradermal a––0.30 (0.06–1.37)0.12
Live/intranasal a8.28 (4.86–14.11)<0.001 ***8.60 (4.75–15.56)<0.001 ***
Cell-derived/recombinant a2.41 (1.37–4.24)0.002 **2.28 (1.19–4.37)0.013 *
Universal candidates a––1.97 (0.57–6.80)0.28
AgeAny––Ref–
Children only––1.40 (0.33–6.02)0.65
Adults only––1.34 (0.34–5.35)0.68
Elderly only––2.62 (0.56–12.29)0.22
Children and adults––1.26 (0.25–6.33)0.78
Adults and elderly––1.06 (0.26–4.35)0.94
Study typeObservational––Ref–
Interventional––0.57 (0.21–1.55)0.27
Study phase1Ref–Ref–
20.36 (0.19–0.66)0.001 **0.37 (0.19–0.71)0.003 **
30.10 (0.04–0.29)<0.001 ***0.12 (0.04–0.36)<0..001 ***
40.32 (0.18–0.59)<0.001 ***0.28 (0.14–0.59)<0.001 ***
Industry sponsoredNoRef–Ref–
Yes0.45 (0.27–0.75)0.002 **0.46 (0.27–0.81)0.007 **
TimeYear b––1.06 (0.99–1.14)0.090
Sample size<180––Ref–
≥180––0.72 (0.41–1.27)0.26
Study locationMulticontinental––Ref–
Europe––1.89 (0.22–16.63)0.57
US and Canada––1.16 (0.13–10.10)0.90
Asia and Pacific––1.02 (0.11–9.36)0.98
Rest of the world––0.89 (0.06–12.55)0.93
Pseudo-R2, %38.342.4
BIC571.3666.9
a Yes versus No; b One-year increase; *** p < 0.001; ** p < 0.01; * p < 0.05; p < 0.10; aOR: adjusted odds ratio; BIC: Bayesian information criterion.
Table
Table 4. Multivariable logistic regression models to predict the use of immunological assays measuring cell-mediated immunity.
Table 4. Multivariable logistic regression models to predict the use of immunological assays measuring cell-mediated immunity.
VariableLevelBest-Subset ModelFull Model
aOR (95% CI)PaOR (95% CI)P
VaccineMonovalent a––1.48 (0.79–2.78)0.22
Trivalent a––1.56 (0.90–2.70)0.11
Quadrivalent––1.76 (0.99–3.14)0.055
Adjuvanted a1.56 (1.09–2.23)0.014 *1.53 (1.03–2.29)0.035 *
Intradermal a––1.15 (0.58–2.27)0.69
Live/intranasal a2.56 (1.65–3.96)<0.001 ***2.66 (1.65–4.29)<0.001 ***
Cell-derived/recombinant a––1.35 (0.86–2.12)0.20
Universal candidates a10.10 (4.17–24.19)<.001 ***10.05 (4.17–24.19)<0.001 ***
AgeAny––Ref–
Children only––0.63 (0.27–1.48)0.29
Adults only––1.16 (0.55–2.47)0.70
Elderly only––0.92 (0.38–2.26)0.86
Children and adults––0.60 (0.22–1.63)0.32
Adults and elderly––0.83 (0.40–1.76)0.63
Study typeObservational––Ref–
Interventional––0.64 (0.35–1.17)0.15
Study phase1Ref–Ref–
20.56 (0.37–0.87)0.009 **0.72 (0.45–1.14)0.16
30.32 (0.18–0.56)<0.001 ***0.47 (0.25–0.90)0.022 *
40.94 (0.62–1.42)0.761.17 (0.70–1.95)0.54
Industry sponsoredNoRef–Ref–
Yes0.32 (0.23–0.45)<0.001 ***0.31 (0.21–0.46)<0.001 ***
TimeYear b––0.99 (0.94–1.03)0.60
Sample size<180––Ref–
≥180––0.62 (0.44–0.88)0.007 **
Study locationMulticontinental––Ref–
Europe––3.95 (0.84–18.54)0.08
US and Canada––2.28 (0.49–10.68)0.30
Asia and Pacific––1.68 (0.35–8.14)0.52
Rest of the world––2.32 (0.41–13.31)0.34
Pseudo-R2, %23.429.5
BIC1144.41224.4
a Yes versus No; b One-year increase; *** p < 0.001; ** p < 0.01; * p < 0.05; p < 0.10; aOR: adjusted odds ratio; BIC: Bayesian information criterion.

Share and Cite

MDPI and ACS Style

Domnich, A.; Manini, I.; Panatto, D.; Calabrò, G.E.; Montomoli, E. Immunogenicity Measures of Influenza Vaccines: A Study of 1164 Registered Clinical Trials. Vaccines 2020, 8, 325. https://doi.org/10.3390/vaccines8020325

AMA Style

Domnich A, Manini I, Panatto D, Calabrò GE, Montomoli E. Immunogenicity Measures of Influenza Vaccines: A Study of 1164 Registered Clinical Trials. Vaccines. 2020; 8(2):325. https://doi.org/10.3390/vaccines8020325

Chicago/Turabian Style

Domnich, Alexander, Ilaria Manini, Donatella Panatto, Giovanna Elisa Calabrò, and Emanuele Montomoli. 2020. "Immunogenicity Measures of Influenza Vaccines: A Study of 1164 Registered Clinical Trials" Vaccines 8, no. 2: 325. https://doi.org/10.3390/vaccines8020325

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop