Next Article in Journal
Intensity and Dynamics of Anti-SARS-CoV-2 Immune Responses after BNT162b2 mRNA Vaccination: Implications for Public Health Vaccination Strategies
Previous Article in Journal
A Multi-Center, Randomised, Double-Blind, Placebo-Controlled Phase III Clinical Trial Evaluating the Impact of BCG Re-Vaccination on the Incidence and Severity of SARS-CoV-2 Infections among Symptomatic Healthcare Professionals during the COVID-19 Pandemic in Poland—First Results
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 10
Issue 2
10.3390/vaccines10020313
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Adverse Events Reporting Quality of Randomized Controlled Trials of COVID-19 Vaccine Using the CONSORT Criteria for Reporting Harms: A Systematic Review

by
Cindra Tri Yuniar
1,
Bhekti Pratiwi
1,
Ardika Fajrul Ihsan
1,
Bambang Tri Laksono
1,
Iffa Risfayanti
1,
Annisa Fathadina
1,
Yeonseon Jeong
2 and
Eunyoung Kim
2,*
1
Department of Pharmacology and Clinical Pharmacy, School of Pharmacy, Institut Teknologi Bandung, Bandung 40132, Indonesia
2
Clinical Data Analysis, Evidence-Based Clinical Research Laboratory, Department of Health Science & Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Korea
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(2), 313; https://doi.org/10.3390/vaccines10020313
Submission received: 29 December 2021 / Revised: 13 February 2022 / Accepted: 15 February 2022 / Published: 17 February 2022
Browse Figures
Versions Notes

Abstract

:
Background: Assessing the quality of evidence from vaccine clinical trials is essential to ensure the safety and efficacy of the vaccine and further enhance public acceptance. This study aims to summarize and critically evaluate the quality of harm reporting on randomized controlled trials for the COVID-19 vaccine and determine the factors associated with reporting quality. Methods: We systematically searched the literature using PRISMA guidelines for randomized controlled trials (RCT) on COVID-19 Vaccine until 30 December 2021. Published articles were searched from electronic databases such as PubMed, Science Direct, Google Scholar, and Bibliovid. Bias analysis was performed using RoB-2 tools. The quality of reporting was assessed by the Consolidated Standards of Reporting Trials (CONSORT) harm extension modified into 21 items. Results: A total of 61 RCT studies (402,014 patients) were analyzed. Over half the studies demonstrated adequate reporting (59.02%), and 21 studies (34.4%) reported a low risk of bias. All studies reported death and serious adverse events (AEs), but only six studies mentioned how to handle the recurrent AEs. Reporting of AEs in subgroup analysis was also poor (25%). Conclusion: The RCTs on the COVID-19 vaccine were less biased with good quality on reporting harm based on the modified CONSORT harm extension. However, study quality must be considered, especially for a balance of information between effectivity and safety.

1. Introduction

On 30 January 2020, the WHO declared the COVID-19 disease outbreak as a public health emergency of international concern [1]. The emerging pandemic triggered researchers to find and develop some strategies to tackle the outbreak. Based on clinical trials, various drugs have been reported to be an effective therapy for COVID-19 infections. On the other hand, rapid diagnosis and an effective COVID-19 vaccine will complement the therapy and control the epidemic aroused by emerging viruses [2]. As announced by the WHO, there are now 284 COVID-19 vaccines under development, of which 104 are in clinical trials [3].
The first COVID-19 vaccination took place on 14 December 2020, in the US [4]. To date, almost half of the world population (47.8%) has received at least one dose COVID-19 vaccine [5]. Vaccine safety and effectiveness remain a public concern throughout the world [6]. Vaccine acceptance in low- and middle-income countries (LMICs) are primarily explained by an interest in personal protection against COVID-19, while concerns about side effects are the most common reason for hesitancy [7].
The European Medical Agency (EMA) reviewed 18 cases of unique thromboembolic events in combination with thrombocytopenia, such as cerebral venous sinus thrombosis (CVST), on 19 April 2021 [8]. In early April, the EMA safety committee confirmed unusual blood clots as very rare side effects of the COVID-19 Vaccine by AstraZeneca [9]. Other cases were reported in the US regarding the CVST event following the Ad26.COV2.S COVID-19 vaccine (Johnson&Johnson, Amersfoort, The Netherlands). There were 12 cases of CVST with thrombocytopenia that represent serious events from 2 March to 21 April 2021 [10]. Other adverse effects after mRNA vaccination BNT162b2 (Pfizer-BioNTech, Mainz, Germany) or mRNA-1273 (Moderna, Cambridge, MA, USA) were evaluated in the United States and Israel [11,12]. These studies reported the events that occurred during 21 days post-vaccination. A study in the US reported the incidence of ischaemic stroke, appendicitis, and acute myocardial infarction [11]. On the other hand, data from Israel’s largest health care organization showed that the vaccination was most strongly associated with an elevated risk of myocarditis, lymphadenopathy, appendicitis, and herpes zoster infection [12]. These events can usually be seen during the clinical trial, but rare cases may occur after launch. These case reports give rise to a negative perception about the COVID-19 vaccine and discourage some countries from implementing the program.
The best source of information about the effects of medical interventions, including vaccines, can be obtained through randomized controlled trials (RCTs). The benefit is usually measured in RCTs, with harms usually included as secondary outcomes. The important role of RCTs in a medical intervention encourage authors to present sufficient and appropriate details regarding both benefit and harms in the report [13].
Transparent and accurate reporting of trial data is equally important in addition to robust trial design, especially reporting of harm data related to interventions 3. In 2004, the Consolidated Standards of Reporting Trials (CONSORT) Group produced an extension to its guidelines for reporting trial results to include the reporting of harms, but these guidelines are poorly implemented in practice [14]. The adverse events (AE) collection and presentation method highlighted inadequacies and inconsistencies in AE reporting described in various published clinical trials [3,14].
Assessing the quality of evidence from vaccine clinical trials is also essential to ensure the safety and efficacy of the vaccine and further enhance public acceptance. Despite the increasing number of clinical trials assessing vaccine strategies for COVID-19, these trials’ harm reporting quality remains questionable. This study aims to summarize and critically evaluate the quality of harm reporting on a randomized controlled trial in the COVID-19 vaccine and define the determinant factors associated with reporting quality.

2. Materials and Methods

2.1. Search Strategy and Selection Criteria

This study used The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline for the study design, search protocol, screening, and reporting. Published articles were searched from electronic databases: PubMed, Science Direct, Google Scholar, and Bibliovid. The search strategy included all terms related to COVID-19, SARS-CoV-2, and COVID-19 Vaccine Trial. Electronic databases were originally searched from inception until 30 December 2021.
Two independent reviewers (CTY, BP) conducted a review of titles, abstracts, and full papers. Ten of the included RCTs were tested for a pilot analysis wherein two authors (CTY and BP) independently analyzed the trials using the checklist of CONSORT harm. If disagreements among the test RCTs existed, two reviewers discussed to obtain consensus and, if needed, a third reviewer (EYK) acted as the arbitrator [13,14]. This pilot test was repeated twice to ensure inter-rater agreement. The Cohen’s kappa metric was used for measuring agreement between the two authors using a previously described methodology [14,15]. The inclusion criteria were randomized controlled trials published articles evaluating the COVID-19 vaccine in English. Studies were excluded if they were (1) non-randomized, observational studies, animal studies, reviews, case reports, or letter, and (2) duplicate publications.

2.2. Risk of Bias Assessment

Two authors independently assessed the risk of bias using the Cochrane risk-of-bias tool for randomized trials second version (RoB-2) for included studies. This tool is a standardized method for assessing potential bias in reports of randomized interventions, consisting of a fixed set domain of bias due to randomization process, deviations from intended interventions, missing outcome data, measurement of the outcomes, and selection of reported results. A proposed judgment about the risk of bias arising from each domain is generated by an algorithm, where judgment can be “low” or “high” risk of bias or can express “some concerns” [3,16].

2.3. Quality of Reporting of Harm Data

Data on harm reporting from all included trials were assessed by two authors using CONSORT Extension of Harms 2004, a 10-item checklist [14]. A single parameter may be misleading and be challenging to define; therefore, we adapted the methodology used by previous studies and modified it into a 21-item checklist [3,13,14,15]. Each item of the 21-item checklist was scored individually and weighted with equal importance in line with CONSORT harm recommendations. If it were adequately reported on the paper, we would put a score of 1. On the contrary, the 0 score carries if it was inadequately reported or not reported at all. Then, the total score was calculated by summation of all individual scores, called Total Harm Reporting Score (THRS). THRS% was then calculated by dividing the number of items met by the number of total items to generate a percentage score. The adherence to CONSORT harm recommendation is concluded from a percentage more than or equal to 70%. Adherence 70% and above was defined as adequate and below 70% as inadequate [17].

2.4. Data Extraction and Analysis

All included studies were extracted onto a summary table with the following information: journal impact factor, number of authors, study design, number of trial subjects, type of intervention (vaccine and control), dosage of vaccine, age, gender, baseline severity, effectiveness indicator, serious and total adverse events. We used descriptive statistics on the characteristics of RCT studies. The overall number and proportion (%) of RCT that met each of the CONSORT for harm checklist items were determined.

2.5. Statistical Analysis

Cohen’s kappa (point estimate) was determined to appraise inter-rater agreement per CONSORT harm item between two-authors analysis. A kappa point estimate between 0.60 and 0.80 was considered indicative of substantial agreement, while a figure above 0.80 was appraised as an almost perfect agreement [15].
A univariate and multivariate linear regression analysis was planned to determine the possible determinants for high THRS. The dependent variable was THRS of CONSORT harm item checklist. The independent variables were journal impact factors (≥50, <50), number of authors (<20, 20–50, >50), number of subjects (sample size), phase of clinical trials (phase 1, 2, 3, 4), type of study (single-center, multi-center), funding status (non-industry, industry), and participant flowcharts (yes, no). Odds ratios (ORs) and confidence intervals (95% CIs) obtained from the analysis are also presented. All tests for statistical significance were two-tailed, with the threshold set at 0.05. All analyses were performed using SPSS software (version 26.0; IBM Corporation, Armonk, NY, USA).

3. Results

3.1. Result of the Search

From the original search strategy and selection process, 469 studies were identified. After screening and implementation of inclusion criteria, 61 randomized controlled trials (RCTs) were eligible and included in this review, with the total number of subjects about 402,014 [18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78]. Data were extracted from these 61 clinical trials (Figure 1).

3.2. Study Characteristics

Forty studies met the criteria for inclusion in this review. A summary of the characteristics of the included studies is provided in Table 1. The most common type of vaccine in these studies was viral vector, with the viral vectors used were adenovirus in 11 studies [17,22,23,26,29,33,34,36,39,40,54] and baculovirus in 2 studies [35,48]. Eighteen studies using vaccines with adjuvants: AlOH3/Algel-IMDG in 21 studies [18,19,20,27,28,29,30,31,35,45,48,51,52,55,56,57,59,64,66,68,70], Matrix-M1 in three studies [21,63,74], AS03/CpG + Alum in one study [25], Af03/AS03 in one study [36], and MF59 in one study [42].
The included studies were conducted in several countries, mostly in China (n = 19), the United States (n = 12), and the United Kingdom (n = 6). Most studies (62.5%) were multicenter studies. One study was conducted in Argentina, Brazil, Chile, Columbia, Mexico, Peru, South Africa, and United States [17], two studies were conducted in the United States, Argentina, Brazil, South Africa, Germany, and Turkey [24], one study was conducted in the United Kingdom, Brazil, and South Africa [34], one study was conducted in Belgium and United States [57], and one study was conducted in Germany and Belgium [47]. Most studies (n = 24) were double-blind studies. Only six studies were triple-blind studies [24,32,38,41,43,46].
Most studies (68.8%) were conducted in phase I, II, or I/II clinical trials. Only eight studies were conducted in phase III clinical trials [17,22,24,33,34,38,46,51]. Two studies were conducted in phase IV clinical trials [75,77]. The number of participants in these studies ranged from 44–44.325 participants. Twenty-three studies had more than 1000 participants. There are six studies with more than 20,000 participants [17,22,24,33,34,38]. The age of participants in the studies was in the range of 3–100 years old. Most studies (n = 16) had participants in the age range 18–60 years old (adults). Three studies had participants only in children and adolescents age [20,30,46] and one study in older age (more than 60 years old) [31].

3.3. Risk of Bias

The risk of bias was analyzed using the RoB 2 tools for 61 trials included in this review. Among them, 12 clinical trials scored as “high-risk” [19,33,34,39,40,46,47,49,53,54,55,77]; 28 trials categorized as trials with ‘some concerns’; while the remaining trials (21 studies) were classified as “low-risk” (Figure 2). Four studies were identified with the most “high-risk” due to unconcealed intervention to the participants and outcome measure affected by the knowledge of investigators [46,47,54,55].
The most significant domain that induced the high-risk judgment was biased in measurement of the outcome (domain 4) [33,34,40,46,47,49,53,54,55]. There were concerns that the clinical trial outcome would be affected by prior knowledge of the outcome assessor. Another conclusion related to the high-risk judgment was the randomization process—as the prime-booster process in vaccination obligated participants to continue receiving the same vaccine type [34,53].
The second most significant domain that induced the ‘some concern’ was bias caused by deviations from the intended intervention (domain 2), in which 27 trials also appeared to have a probability of risk [24,33,37,44,46,47,48,51,53,54,55,58,59,60,62,64,66,67,68,69,70,73,74,75,76,77]. Almost all of the bias on domain 2 is because of disclosure of the intervention, whether to patients and or the carer of the patients. The risk could only cause “some concerns” if there was no information on whether the deviation was caused by the trial context [24,44,46,47,48,51,53,54,55]; or if the deviations were caused by trial context and possibly intervene the outcome but be balanced in each group [46].
Only five trials had “some concern” of missing outcome bias [22,42,48,59,64]. Most of the bias on domain 3 was caused by missing patient data, from patients withdrawing or losing contact and preventing a follow-up.

3.4. Adherence to CONSORT Recommendations

The total harm reporting score (THRS) and percentage of randomized controlled trials fulfilling the CONSORT Extension of Harms are items and inter-agreement (assessed by Cohen’s kappa) was 0.785. The median score for THRS was 15, with a minimum of 7 and a maximum of 20, of a possible total of 21. A total of 36 studies (59.02%) adhered with the CONSORT recommendation for reporting harms, with the two highest studies reporting 20 score of 21 THRS, as shown in Table 2.
The highest percentage is reported of deaths and serious adverse events (AEs). All of the studies reported serious adverse events (100%). The majority of the studies mentioned adverse events in the title or abstract (93%). Almost all studies used the safety term to define the adverse event in the title or abstract. Nearly all studies presented the timing of data collection of AE data (97%) and mentioned adverse events in the introduction part (92%). Most studies explained the method of presenting and/or analyzing AEs, severity, and grading of AEs, provided both numbers of adverse events and patients with adverse events, have a balanced discussion of benefit-harm and study limitation.
Only six studies (10%) provided an approach for the handling of recurrent AEs [29,47,55,58,59,74]. The authors rarely reported subgroup analysis and exploratory analysis for harms (25%), only 15 studies reported the subgroup analysis [17,22,24,32,36,37,40,50,58,60,68,70,71,73,74]. Less than half of the studies reported the plan for monitoring and rules for stopping the trial because of harms (31%), the withdrawal person on each harm (49%), and definition use for AEs analysis set (41%). A total of 85% reported using an active surveillance approach to collect AEs during the study, but only 64% of studies mentioned the person who was attributed to the trial drug. Most of the trials presented AEs separately for each arm (90%).

3.5. Determinant Factors of Reporting Quality

Potential factors attributing to the overall reporting quality were determined using linear regression analysis. In the univariate analysis, the number of authors (≥50) and type of study (multi-center) were associated significantly with the low THRS, with the score OR = −4.237, 95% CI −6.804 to -1.617 (p = 0.02) and OR = −1.462, 95% CI −2.281 to −0.102 (p = 0.036), respectively. In multivariate analysis, the number of authors (≥50) was also significantly associated in determining the low THRS (OR = −4.439, 95% CI −7.40 to −1.47). On the other hand, journal impact factor and funding status had a positive association with THRS, but was not statistically significant. The graph illustrating the exact relation between the number of authors, or funding status, or impact factors, and the CONSORT score shown in Supplementary Figure S2.

4. Discussion

This systematic review evaluated the randomized clinical trial for the COVID-19 Vaccine from inception to December 2021 and aimed to summarize and critically evaluate the quality of harm reporting and define the determinant factors associated with reporting quality. The rapid development of the COVID-19 vaccine triggered the industry and government (or research institute) to conduct a randomized clinical trial, starting from an inactivated vaccine. More than 90% of RCTs involved adult subjects (≥18 years old) due to having a prioritized area for COVID-19 transmission. As there was a high incidence of death in the elderly with COVID-19, the trials prioritized elderly subjects over adults. In the last term of data collection, several studies also started to conduct trials on child participants and vaccine boosters.
A total of 61 studies were included in this study, and more than half of the studies (59.02%) complied with CONSORT extension of harms. During the COVID-19 pandemic, the publisher gave free access to full-text articles to enhance the COVID-19 vaccine development, helping the authors in collecting the best literature available. Identifying studies as a randomized trial in the search database was also helped by titles that explicitly mentioned the content. Regarding the vaccine development in clinical trial phase 1 and/or 2, the published journal usually mentioned the safety assessment on the title or abstract so that the reported safety item is high. This result is in line with a previous review that concluded that a randomized controlled trial prospectively defined the intervention’s adverse effects and specified the detail of monitoring [79].
Deaths, serious AEs, and events leading to discontinuation of intervention should always be reported for the safety assessment in the trial [80]. In line with that, the highest percentage of CONSORT harm items was reported deaths and serious AEs (item 6b). All the studies reported death and serious adverse events; despite having no events (0 cases) in the study, the trials mentioned no serious events or death related to vaccination in the text. The adverse events reported from randomized clinical trials were limited to the number of participants and study setting. Interindividual variability might affect the events on a specific vaccine. Moreover, specific adverse events are not entirely captured despite occurring in trials; thus, adverse event reporting transparency is essential. We summarized the adverse events reported in included studies in Supplementary Material Table S3.
Interindividual variation may be observed in subgroup analysis. Subgroup analysis was defined as reporting any subgroup effect. Among 61 studies, only 15 studies (25%) reported subgroup analysis. This result aligns with a previous study that showed suboptimal reporting of subgroup analysis in high-impact journals. Trials funded by the industry may more commonly report this aspect, but the authors analyzed using inappropriate methods [81]. The lack of subgroup reporting will affect the physician-decision making and also the public acceptance of vaccination program.
The item related to the recurrent events reporting was poor when analyzing all parameters. Events reported in trials are usually defined as cases, and the number of events is counted by how many cases occur on participants. Only six studies clearly mentioned how they measured and counted cases as events and how they handled them—crude incidence rates or exposure-adjusted incidence rates, which were often analyzed on randomized clinical trials. For individual patient’s profiles, these rates do not adequately account the events because the opportunity of multiple events occurs during the trial. Some AEs were also possible to correlate with other AEs or might lead to another AEs in the future [82].
Although the journal impact factor is not associated significantly with compliance, the high THRS of CONSORT harm reporting recommendation was dominantly reported on high impact journals (≥50). Compared with NEJM and JAMA, The Lancet are the only journals that asked authors to provide and follow CONSORT harm extension in the guidelines [79]. Adherence to CONSORT for abstract checklist is also high in The Lancet, compared with NEJM, Annals IM, The BMJ, and JAMA [83]. Indeed, the requirement from journals will enhance the reporting quality of harm on RCTs.
Among all independent parameters, the number of authors was statistically significant with the THRS based on univariate and multivariate analysis. The other parameters (sample size, clinical phase study, participant flowchart, type of study) had a negative association with THRS, except for journal impact factor and funding status. Journal impact factors was not significantly associated with THRS due to many publications for COVID-19 vaccine trials usually published in high impact factors journal (73.8%), despite high-impact journals commonly limiting the number of authors.
Univariate analysis showed that more authors involved in the manuscript would lead to low adherence on RCTs harm reporting. At the same time, studies with many authors (>50) are usually due to it being a multi-center study. Funding from the industry also was positively associated with the high THRS. This result might correlate with the industry standard in COVID-19 vaccine development and ensure the safety aspects in RCTs fulfill the authorization criteria.
To the best of our knowledge, the present study is the first to evaluate the harm reposting quality using CONSORT harm extension on the COVID-19 vaccine trial. We also include an evaluation from various databases and use PRISMA methods. Furthermore, we also determine the factors associated with adequate reporting quality. This review suggests the authors/company who are reporting the RCT should comply with the standardized reporting of trials and harm-related vaccines. Since the adverse event is usually pointed out by the public, good quality of reporting of harm will give clear and complete information about adverse events for specific Vaccine products. We hope our result will enhance public trust in COVID-19 Vaccine RCTs. The RCT studies evaluating the safety and efficacy of COVID-19 Vaccine to special populations such as those with autoimmune disease are rarely included in this study due to a discrepancy in the inclusion and exclusion criteria. In future, more studies including special groups are expected. This study has assessed the quality of harm reporting on COVID-19 vaccines RCTs. In the future, studies on overall reporting quality with efficacy and outcome measures are required to balance information between efficacy and safety.

5. Conclusions

It is concluded that the RCTs on COVID-19 vaccine were less biased in RoB analysis, and more than half of the studies fulfill the CONSORT harm extension. However, the quality of the study needs to be considered, especially the balance of information between effectivity and safety reasons; this will affect the public acceptance and policy on COVID-19 vaccinations.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/vaccines10020313/s1, Table S1: PRISMA 2020 checklist for systematic review, Table S2: Search Terms Used, Table S3. Characteristics of COVID-19 Randomized control trials included in this study, Figure S1: Chart of Trial for Item Fulfilled, Figure S2: Graph for the relationship of RCTs with the number of authors, funding status, and impact factor.

Author Contributions

Conceptualization, C.T.Y. and E.K.; investigation, C.T.Y.; methodology, C.T.Y. and E.K.; study characteristics analysis, A.F.; bias assessment, I.R., A.F.I., B.T.L. and C.T.Y.; CONSORT analysis, C.T.Y. and B.P.; writing—original draft preparation, C.T.Y., I.R., A.F. and E.K.; writing—review and editing, C.T.Y. and E.K.; statistical analysis, validation, Y.J., C.T.Y. and E.K.; supervision, E.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by LPPM ITB on Riset International 2021 scheme, grant number PN-10-46-2021, by the Korean government, South Korea (Ministry of Science and ICT, MICT; NRF-2021R1F1A1062044), and Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Education, South Korea (NRF-2021R1A6A03044296).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on this paper. The data were collected from published data.

Acknowledgments

The authors would like to show their appreciation to Almira Fathadina and Narulita Dianasari for resuming the study characteristics. Statistical analysis was also supported by Alpha Statistics.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Whitworth, J. COVID-19: A Fast Evolving Pandemic. Trans. R. Soc. Trop. Med. Hyg. 2020, 114, 241–248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Zhu, Y.; Li, J.; Pang, Z. Recent Insights for the Emerging COVID-19: Drug Discovery, Therapeutic Options and Vaccine Development. Asian J. Pharm. Sci. 2021, 16, 4–23. [Google Scholar] [CrossRef] [PubMed]
  3. Mazhar, F.; Hadi, M.A.; Kow, C.S.; Marran, A.M.N.; Merchant, H.A.; Hasan, S.S. Use of Hydroxychloroquine and Chloroquine in COVID-19: How Good Is the Quality of Randomized Controlled Trials? Int. J. Infect. Dis. 2020, 101, 107–120. [Google Scholar] [CrossRef]
  4. BBC. COVID-19: First Vaccine given in US as Roll-out Begins. BBC News, 14 December 2020. [Google Scholar]
  5. Ritchie, H.; Mathieu, E.; Rodés-Guirao, L.; Appel, C.; Giattino, C.; Ortiz-Ospina, E.; Hasell, J.; Macdonald, B.; Beltekian, D.; Roser, M. Coronavirus (COVID-19) Vaccinations—Statistics and Research—Our World in Data. Available online: https://ourworldindata.org/covid-vaccinations (accessed on 19 October 2021).
  6. Wagner, A.L.; Gordon, A.; Tallo, V.L.; Simaku, A.; Porter, R.M.; Edwards, L.J.; Duka, E.; Abu-Khader, I.; Gresh, L.; Sciuto, C.; et al. Intent to Obtain Pediatric Influenza Vaccine among Mothers in Four Middle Income Countries. Vaccine 2020, 38, 4325–4335. [Google Scholar] [CrossRef] [PubMed]
  7. Solís Arce, J.S.; Warren, S.S.; Meriggi, N.F.; Scacco, A.; McMurry, N.; Voors, M.; Syunyaev, G.; Malik, A.A.; Aboutajdine, S.; Adeojo, O.; et al. COVID-19 Vaccine Acceptance and Hesitancy in Low- and Middle-Income Countries. Nat. Med. 2021, 27, 1385–1394. [Google Scholar] [CrossRef] [PubMed]
  8. France24. WHO Urges Countries to Continue the Roll-out of AstraZeneca Vaccine. France24, 19 March 2021. [Google Scholar]
  9. European Medical Agency. AstraZeneca’s COVID-19 Vaccine: EMA Finds Possible Link to Very Rare Cases of Unusual Blood Clots with Low Blood Platelets; European Medicines Agency: Amsterdam, The Netherlands, 2021.
  10. See, I.; Su, J.R.; Lale, A.; Woo, E.J.; Guh, A.Y.; Shimabukuro, T.T.; Streiff, M.B.; Rao, A.K.; Wheeler, A.P.; Beavers, S.F.; et al. US Case Reports of Cerebral Venous Sinus Thrombosis with Thrombocytopenia after Ad26.COV2.S Vaccination, March 2 to April 21, 2021. JAMA—J. Am. Med. Assoc. 2021, 325, 2448–2456. [Google Scholar] [CrossRef]
  11. Klein, N.P.; Lewis, N.; Goddard, K.; Fireman, B.; Zerbo, O.; Hanson, K.E.; Donahue, J.G.; Kharbanda, E.O.; Naleway, A.; Nelson, J.C.; et al. Surveillance for Adverse Events after COVID-19 MRNA Vaccination. JAMA—J. Am. Med. Assoc. 2021, 326, 1390–1399. [Google Scholar] [CrossRef]
  12. Barda, N.; Dagan, N.; Ben-Shlomo, Y.; Kepten, E.; Waxman, J.; Ohana, R.; Hernán, M.A.; Lipsitch, M.; Kohane, I.; Netzer, D.; et al. Safety of the BNT162b2 MRNA COVID-19 Vaccine in a Nationwide Setting. N. Engl. J. Med. 2021, 385, 1078–1090. [Google Scholar] [CrossRef]
  13. Shukralla, A.A.; Tudur-Smith, C.; Powell, G.A.; Williamson, P.R.; Marson, A.G. Reporting of Adverse Events in Randomised Controlled Trials of Antiepileptic Drugs Using the CONSORT Criteria for Reporting Harms. Epilepsy Res. 2011, 97, 20–29. [Google Scholar] [CrossRef]
  14. Ioannidis, J.P.A.; Evans, S.J.W.; Gøtzsche, P.C.; O’Neill, R.T.; Altman, D.G.; Schulz, K.; Moher, D. Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement. Ann. Intern. Med. 2004, 141, 781–788. [Google Scholar] [CrossRef]
  15. Cornelius, V.R.; Sauzet, O.; Williams, J.E.; Ayis, S.; Farquhar-Smith, P.; Ross, J.R.; Branford, R.A.; Peacock, J.L. Adverse Event Reporting in Randomised Controlled Trials of Neuropathic Pain: Considerations for Future Practice. Pain 2013, 154, 213–220. [Google Scholar] [CrossRef]
  16. Higgins, J.P.T.; Altman, D.G.; Gøtzsche, P.C.; Jüni, P.; Moher, D.; Oxman, A.D.; Savović, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A.C.; et al. The Cochrane Collaboration’s Tool for Assessing Risk of Bias in Randomised Trials. BMJ 2011, 343, d5928. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Liampas, I.; Chlinos, A.; Siokas, V.; Brotis, A.; Dardiotis, E. Assessment of the Reporting Quality of RCTs for Novel Oral Anticoagulants in Venous Thromboembolic Disease Based on the CONSORT Statement. J. Thromb. Thrombolysis 2019, 48, 542–553. [Google Scholar] [CrossRef] [PubMed]
  18. Sadoff, J.; Gray, G.; Vandebosch, A.; Cárdenas, V.; Shukarev, G.; Grinsztejn, B.; Goepfert, P.A.; Truyers, C.; Fennema, H.; Spiessens, B.; et al. Safety and Efficacy of Single-Dose Ad26.COV2.S Vaccine against COVID-19. N. Engl. J. Med. 2021, 384, 2187–2201. [Google Scholar] [CrossRef] [PubMed]
  19. Che, Y.; Liu, X.; Pu, Y.; Zhou, M.; Zhao, Z.; Jiang, R.; Yin, Z.; Xu, M.; Yin, Q.; Wang, J.; et al. Randomized, Double-Blinded, Placebo-Controlled Phase 2 Trial of an Inactivated Severe Acute Respiratory Syndrome Coronavirus 2 Vaccine in Healthy Adults. Clin. Infect. Dis. 2020, 73, e3949–e3955. [Google Scholar] [CrossRef]
  20. Ella, R.; Reddy, S.; Jogdand, H.; Sarangi, V.; Ganneru, B.; Prasad, S.; Das, D.; Raju, D.; Praturi, U.; Sapkal, G.; et al. Safety and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine, BBV152: Interim Results from a Double-Blind, Randomised, Multicentre, Phase 2 Trial, and 3-Month Follow-up of a Double-Blind, Randomised Phase 1 Trial. Lancet Infect. Dis. 2021, 21, 950–961. [Google Scholar] [CrossRef]
  21. Han, B.; Song, Y.; Li, C.; Yang, W.; Ma, Q.; Jiang, Z.; Li, M.; Lian, X.; Jiao, W.; Wang, L.; et al. Safety, Tolerability, and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine (CoronaVac) in Healthy Children and Adolescents: A Double-Blind, Randomised, Controlled, Phase 1/2 Clinical Trial. Lancet Infect. Dis. 2021, 21, 1645–1653. [Google Scholar] [CrossRef]
  22. Keech, C.; Albert, G.; Cho, I.; Robertson, A.; Reed, P.; Neal, S.; Plested, J.S.; Zhu, M.; Cloney-Clark, S.; Zhou, H.; et al. Phase 1–2 Trial of a SARS-CoV-2 Recombinant Spike Protein Nanoparticle Vaccine. N. Engl. J. Med. 2020, 383, 2320–2332. [Google Scholar] [CrossRef]
  23. Logunov, D.Y.; Dolzhikova, I.V.; Shcheblyakov, D.V.; Tukhvatulin, A.I.; Zubkova, O.V.; Dzharullaeva, A.S.; Kovyrshina, A.V.; Lubenets, N.L.; Grousova, D.M.; Erokhova, A.S.; et al. Safety and Efficacy of an RAd26 and RAd5 Vector-Based Heterologous Prime-Boost COVID-19 Vaccine: An Interim Analysis of a Randomised Controlled Phase 3 Trial in Russia. Lancet 2021, 397, 671–681. [Google Scholar] [CrossRef]
  24. Madhi, S.A.; Baillie, V.; Cutland, C.L.; Voysey, M.; Koen, A.L.; Fairlie, L.; Padayachee, S.D.; Dheda, K.; Barnabas, S.L.; Bhorat, Q.E.; et al. Efficacy of the ChAdOx1 NCoV-19 COVID-19 Vaccine against the B.1.351 Variant. N. Engl. J. Med. 2021, 384, 1885–1898. [Google Scholar] [CrossRef]
  25. Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Moreira, E.D.; Zerbini, C.; et al. Safety and Efficacy of the BNT162b2 MRNA COVID-19 Vaccine. N. Engl. J. Med. 2020, 383, 2603–2615. [Google Scholar] [CrossRef] [PubMed]
  26. Richmond, P.; Hatchuel, L.; Dong, M.; Ma, B.; Hu, B.; Smolenov, I.; Li, P.; Liang, P.; Han, H.H.; Liang, J.; et al. Safety and Immunogenicity of S-Trimer (SCB-2019), a Protein Subunit Vaccine Candidate for COVID-19 in Healthy Adults: A Phase 1, Randomised, Double-Blind, Placebo-Controlled Trial. Lancet 2021, 397, 682–694. [Google Scholar] [CrossRef]
  27. Zhu, F.C.; Guan, X.H.; Li, Y.H.; Huang, J.Y.; Jiang, T.; Hou, L.H.; Li, J.X.; Yang, B.F.; Wang, L.; Wang, W.J.; et al. Immunogenicity and Safety of a Recombinant Adenovirus Type-5-Vectored COVID-19 Vaccine in Healthy Adults Aged 18 Years or Older: A Randomised, Double-Blind, Placebo-Controlled, Phase 2 Trial. Lancet 2020, 396, 479–488. [Google Scholar] [CrossRef]
  28. Zhang, Y.; Zeng, G.; Pan, H.; Li, C.; Hu, Y.; Chu, K.; Han, W.; Chen, Z.; Tang, R.; Yin, W.; et al. Safety, Tolerability, and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine in Healthy Adults Aged 18–59 Years: A Randomised, Double-Blind, Placebo-Controlled, Phase 1/2 Clinical Trial. Lancet Infect. Dis. 2021, 21, 181–192. [Google Scholar] [CrossRef]
  29. Yang, S.; Li, Y.; Dai, L.; Wang, J.; He, P.; Li, C.; Fang, X.; Wang, C.; Zhao, X.; Huang, E.; et al. Safety and Immunogenicity of a Recombinant Tandem-Repeat Dimeric RBD-Based Protein Subunit Vaccine (ZF2001) against COVID-19 in Adults: Two Randomised, Double-Blind, Placebo-Controlled, Phase 1 and 2 Trials. Lancet Infect. Dis. 2021, 21, 1107–1119. [Google Scholar] [CrossRef]
  30. Xia, S.; Zhang, Y.; Wang, Y.; Wang, H.; Yang, Y.; Gao, G.F.; Tan, W.; Wu, G.; Xu, M.; Lou, Z.; et al. Safety and Immunogenicity of an Inactivated COVID-19 Vaccine, BBIBP-CorV, in People Younger than 18 Years: A Randomised, Double-Blind, Controlled, Phase 1/2 Trial. Lancet Infect. Dis. 2021, 22, 196–208. [Google Scholar] [CrossRef]
  31. Xia, S.; Duan, K.; Zhang, Y.; Zhao, D.; Zhang, H.; Xie, Z.; Li, X.; Peng, C.; Zhang, Y.; Zhang, W.; et al. Effect of an Inactivated Vaccine Against SARS-CoV-2 on Safety and Immunogenicity Outcomes: Interim Analysis of 2 Randomized Clinical Trials. JAMA—J. Am. Med. Assoc. 2020, 324, 951–960. [Google Scholar] [CrossRef]
  32. Wu, Z.; Hu, Y.; Xu, M.; Chen, Z.; Yang, W.; Jiang, Z.; Li, M.; Jin, H.; Cui, G.; Chen, P.; et al. Safety, Tolerability, and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine (CoronaVac) in Healthy Adults Aged 60 Years and Older: A Randomised, Double-Blind, Placebo-Controlled, Phase 1/2 Clinical Trial. Lancet Infect. Dis. 2021, 21, 803–812. [Google Scholar] [CrossRef]
  33. Walsh, E.E.; Frenck, R.W.; Falsey, A.R.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Neuzil, K.; Mulligan, M.J.; Bailey, R.; et al. Safety and Immunogenicity of Two RNA-Based COVID-19 Vaccine Candidates. N. Engl. J. Med. 2020, 383, 2439–2450. [Google Scholar] [CrossRef]
  34. Voysey, M.; Costa Clemens, S.A.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Single-Dose Administration and the Influence of the Timing of the Booster Dose on Immunogenicity and Efficacy of ChAdOx1 NCoV-19 (AZD1222) Vaccine: A Pooled Analysis of Four Randomised Trials. Lancet 2021, 397, 881–891. [Google Scholar] [CrossRef]
  35. Voysey, M.; Clemens, S.A.C.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Safety and Efficacy of the ChAdOx1 NCoV-19 Vaccine (AZD1222) against SARS-CoV-2: An Interim Analysis of Four Randomised Controlled Trials in Brazil, South Africa, and the UK. Lancet 2021, 397, 99–111. [Google Scholar] [CrossRef]
  36. Pan, H.X.; Liu, J.K.; Huang, B.Y.; Li, G.F.; Chang, X.Y.; Liu, Y.F.; Wang, W.L.; Chu, K.; Hu, J.L.; Li, J.X.; et al. Immunogenicity and Safety of a Severe Acute Respiratory Syndrome Coronavirus 2 Inactivated Vaccine in Healthy Adults: Randomized, Double-Blind, and Placebo-Controlled Phase 1 and Phase 2 Clinical Trials. Chin. Med. J. 2021, 134, 1289–1298. [Google Scholar] [CrossRef] [PubMed]
  37. Goepfert, P.A.; Fu, B.; Chabanon, A.L.; Bonaparte, M.I.; Davis, M.G.; Essink, B.J.; Frank, I.; Haney, O.; Janosczyk, H.; Keefer, M.C.; et al. Safety and Immunogenicity of SARS-CoV-2 Recombinant Protein Vaccine Formulations in Healthy Adults: Interim Results of a Randomised, Placebo-Controlled, Phase 1–2, Dose-Ranging Study. Lancet Infect. Dis. 2021, 21, 1257–1270. [Google Scholar] [CrossRef]
  38. Li, J.; Hui, A.; Zhang, X.; Yang, Y.; Tang, R.; Ye, H.; Ji, R.; Lin, M.; Zhu, Z.; Türeci, Ö.; et al. Safety and Immunogenicity of the SARS-CoV-2 BNT162b1 MRNA Vaccine in Younger and Older Chinese Adults: A Randomized, Placebo-Controlled, Double-Blind Phase 1 Study. Nat. Med. 2021, 27, 1062–1070. [Google Scholar] [CrossRef]
  39. Baden, L.R.; el Sahly, H.M.; Essink, B.; Kotloff, K.; Frey, S.; Novak, R.; Diemert, D.; Spector, S.A.; Rouphael, N.; Creech, C.B.; et al. Efficacy and Safety of the MRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021, 384, 403–416. [Google Scholar] [CrossRef]
  40. Folegatti, P.M.; Ewer, K.J.; Aley, P.K.; Angus, B.; Becker, S.; Belij-Rammerstorfer, S.; Bellamy, D.; Bibi, S.; Bittaye, M.; Clutterbuck, E.A.; et al. Safety and Immunogenicity of the ChAdOx1 NCoV-19 Vaccine against SARS-CoV-2: A Preliminary Report of a Phase 1/2, Single-Blind, Randomised Controlled Trial. Lancet 2020, 396, 467–478. [Google Scholar] [CrossRef]
  41. Ramasamy, M.N.; Minassian, A.M.; Ewer, K.J.; Flaxman, A.L.; Folegatti, P.M.; Owens, D.R.; Voysey, M.; Aley, P.K.; Angus, B.; Babbage, G.; et al. Safety and Immunogenicity of ChAdOx1 NCoV-19 Vaccine Administered in a Prime-Boost Regimen in Young and Old Adults (COV002): A Single-Blind, Randomised, Controlled, Phase 2/3 Trial. Lancet 2020, 396, 1979–1993. [Google Scholar] [CrossRef]
  42. Mulligan, M.J.; Lyke, K.E.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Neuzil, K.; Raabe, V.; Bailey, R.; Swanson, K.A.; et al. Phase I/II Study of COVID-19 RNA Vaccine BNT162b1 in Adults. Nature 2020, 586, 589–593. [Google Scholar] [CrossRef]
  43. Chappell, K.J.; Mordant, F.L.; Li, Z.; Wijesundara, D.K.; Ellenberg, P.; Lackenby, J.A.; Cheung, S.T.M.; Modhiran, N.; Avumegah, M.S.; Henderson, C.L.; et al. Safety and Immunogenicity of an MF59-Adjuvanted Spike Glycoprotein-Clamp Vaccine for SARS-CoV-2: A Randomised, Double-Blind, Placebo-Controlled, Phase 1 Trial. Lancet Infect. Dis. 2021, 21, 1383–1394. [Google Scholar] [CrossRef]
  44. Chu, L.; McPhee, R.; Huang, W.; Bennett, H.; Pajon, R.; Nestorova, B.; Leav, B. A Preliminary Report of a Randomized Controlled Phase 2 Trial of the Safety and Immunogenicity of MRNA-1273 SARS-CoV-2 Vaccine. Vaccine 2021, 39, 2791–2799. [Google Scholar] [CrossRef]
  45. Sadoff, J.; le Gars, M.; Shukarev, G.; Heerwegh, D.; Truyers, C.; de Groot, A.M.; Stoop, J.; Tete, S.; van Damme, W.; Leroux-Roels, I.; et al. Interim Results of a Phase 1–2a Trial of Ad26.COV2.S COVID-19 Vaccine. N. Engl. J. Med. 2021, 384, 1824–1835. [Google Scholar] [CrossRef] [PubMed]
  46. Ella, R.; Vadrevu, K.M.; Jogdand, H.; Prasad, S.; Reddy, S.; Sarangi, V.; Ganneru, B.; Sapkal, G.; Yadav, P.; Abraham, P.; et al. Safety and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine, BBV152: A Double-Blind, Randomised, Phase 1 Trial. Lancet Infect. Dis. 2021, 21, 637–646. [Google Scholar] [CrossRef]
  47. Frenck, R.W.; Klein, N.P.; Kitchin, N.; Gurtman, A.; Absalon, J.; Lockhart, S.; Perez, J.L.; Walter, E.B.; Senders, S.; Bailey, R.; et al. Safety, Immunogenicity, and Efficacy of the BNT162b2 COVID-19 Vaccine in Adolescents. N. Engl. J. Med. 2021, 385, 239–250. [Google Scholar] [CrossRef] [PubMed]
  48. Kremsner, P.G.; Mann, P.; Kroidl, A.; Leroux-Roels, I.; Schindler, C.; Gabor, J.J.; Schunk, M.; Leroux-Roels, G.; Bosch, J.J.; Fendel, R.; et al. Safety and Immunogenicity of an MRNA-Lipid Nanoparticle Vaccine Candidate against SARS-CoV-2: A Phase 1 Randomized Clinical Trial. Wien. Klin. Wochenschr. 2021, 133, 931–941. [Google Scholar] [CrossRef]
  49. Meng, F.Y.; Gao, F.; Jia, S.Y.; Wu, X.H.; Li, J.X.; Guo, X.L.; Zhang, J.L.; Cui, B.P.; Wu, Z.M.; Wei, M.W.; et al. Safety and Immunogenicity of a Recombinant COVID-19 Vaccine (Sf9 Cells) in Healthy Population Aged 18 Years or Older: Two Single-Center, Randomised, Double-Blind, Placebo-Controlled, Phase 1 and Phase 2 Trials. Signal Transduct. Target. Ther. 2021, 6, 271. [Google Scholar] [CrossRef]
  50. Liu, X.; Shaw, R.H.; Stuart, A.S.V.; Greenland, M.; Aley, P.K.; Andrews, N.J.; Cameron, J.C.; Charlton, S.; Clutterbuck, E.A.; Collins, A.M.; et al. Safety and Immunogenicity of Heterologous versus Homologous Prime-Boost Schedules with an Adenoviral Vectored and MRNA COVID-19 Vaccine (Com-COV): A Single-Blind, Randomised, Non-Inferiority Trial. Lancet 2021, 398, 856–869. [Google Scholar] [CrossRef]
  51. Shu, Y.J.; He, J.F.; Pei, R.J.; He, P.; Huang, Z.H.; Chen, S.M.; Ou, Z.Q.; Deng, J.L.; Zeng, P.Y.; Zhou, J.; et al. Immunogenicity and Safety of a Recombinant Fusion Protein Vaccine (V-01) against Coronavirus Disease 2019 in Healthy Adults: A Randomized, Double-Blind, Placebo-Controlled, Phase II Trial. Chin. Med. J. 2021, 134, 1967–1976. [Google Scholar] [CrossRef]
  52. Tanriover, M.D.; Doğanay, H.L.; Akova, M.; Güner, H.R.; Azap, A.; Akhan, S.; Köse, Ş.; Erdinç, F.Ş.; Akalın, E.H.; Tabak, Ö.F.; et al. Efficacy and Safety of an Inactivated Whole-Virion SARS-CoV-2 Vaccine (CoronaVac): Interim Results of a Double-Blind, Randomised, Placebo-Controlled, Phase 3 Trial in Turkey. Lancet 2021, 398, 213–222. [Google Scholar] [CrossRef]
  53. Pu, J.; Yu, Q.; Yin, Z.; Zhang, Y.; Li, X.; Yin, Q.; Chen, H.; Long, R.; Zhao, Z.; Mou, T.; et al. The Safety and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine in Chinese Adults Aged 18–59 Years: A Phase I Randomized, Double-Blinded, Controlled Trial. Vaccine 2021, 39, 2746–2754. [Google Scholar] [CrossRef]
  54. Borobia, A.M.; Carcas, A.J.; Pérez-Olmeda, M.; Castaño, L.; Bertran, M.J.; García-Pérez, J.; Campins, M.; Portolés, A.; González-Pérez, M.; García Morales, M.T.; et al. Immunogenicity and Reactogenicity of BNT162b2 Booster in ChAdOx1-S-Primed Participants (CombiVacS): A Multicentre, Open-Label, Randomised, Controlled, Phase 2 Trial. Lancet 2021, 398, 121–130. [Google Scholar] [CrossRef]
  55. Wu, S.; Huang, J.; Zhang, Z.; Wu, J.; Zhang, J.; Hu, H.; Zhu, T.; Zhang, J.; Luo, L.; Fan, P.; et al. Safety, Tolerability, and Immunogenicity of an Aerosolised Adenovirus Type-5 Vector-Based COVID-19 Vaccine (Ad5-NCoV) in Adults: Preliminary Report of an Open-Label and Randomised Phase 1 Clinical Trial. Lancet Infect. Dis. 2021, 21, 1654–1664. [Google Scholar] [CrossRef]
  56. Zakarya, K.; Kutumbetov, L.; Orynbayev, M.; Abduraimov, Y.; Sultankulova, K.; Kassenov, M.; Sarsenbayeva, G.; Kulmagambetov, I.; Davlyatshin, T.; Sergeeva, M.; et al. Safety and Immunogenicity of a QazCovid-In® Inactivated Whole-Virion Vaccine against COVID-19 in Healthy Adults: A Single-Centre, Randomised, Single-Blind, Placebo-Controlled Phase 1 and an Open-Label Phase 2 Clinical Trials with a 6 Months Follow-up in Kazakhstan. EClinicalMedicine 2021, 39, 101078. [Google Scholar] [CrossRef] [PubMed]
  57. Fadlyana, E.; Rusmil, K.; Tarigan, R.; Rahmadi, A.R.; Prodjosoewojo, S.; Sofiatin, Y.; Khrisna, C.V.; Sari, R.M.; Setyaningsih, L.; Surachman, F.; et al. A Phase III, Observer-Blind, Randomized, Placebo-Controlled Study of the Efficacy, Safety, and Immunogenicity of SARS-CoV-2 Inactivated Vaccine in Healthy Adults Aged 18–59 Years: An Interim Analysis in Indonesia. Vaccine 2021, 39, 6520–6528. [Google Scholar] [CrossRef] [PubMed]
  58. Falsey, A.R.; Sobieszczyk, M.E.; Hirsch, I.; Sproule, S.; Robb, M.L.; Corey, L.; Neuzil, K.M.; Hahn, W.; Hunt, J.; Mulligan, M.J.; et al. Phase 3 Safety and Efficacy of AZD1222 (ChAdOx1 NCoV-19) COVID-19 Vaccine. N. Engl. J. Med. 2021, 385, 2348–2360. [Google Scholar] [CrossRef]
  59. Hsieh, S.M.; Liu, M.C.; Chen, Y.H.; Lee, W.-S.; Hwang, S.J.; Cheng, S.H.; Ko, W.C.; Hwang, K.P.; Wang, N.C.; Lee, Y.L.; et al. Safety and Immunogenicity of CpG 1018 and Aluminium Hydroxide-Adjuvanted SARS-CoV-2 S-2P Protein Vaccine MVC-COV1901: Interim Results of a Large-Scale, Double-Blind, Randomised, Placebo-Controlled Phase 2 Trial in Taiwan. Lancet Respir. Med. 2021, 9, 1396–1406. [Google Scholar] [CrossRef]
  60. Asano, M.; Okada, H.; Itoh, Y.; Hirata, H.; Ishikawa, K.; Yoshida, E.; Matsui, A.; Kelly, E.J.; Shoemaker, K.; Olsson, U.; et al. Immunogenicity and Safety of AZD1222 (ChAdOx1 NCoV-19) against SARS-CoV-2 in Japan: A Double-Blind, Randomized Controlled Phase 1/2 Trial. Int. J. Infect. Dis. 2022, 114, 165–174. [Google Scholar] [CrossRef]
  61. Ella, R.; Reddy, S.; Blackwelder, W.; Potdar, V.; Yadav, P.; Sarangi, V.; Aileni, V.K.; Kanungo, S.; Rai, S.; Reddy, P.; et al. Efficacy, Safety, and Lot-to-Lot Immunogenicity of an Inactivated SARS-CoV-2 Vaccine (BBV152): Interim Results of a Randomised, Double-Blind, Controlled, Phase 3 Trial. Lancet 2021, 398, 2173–2184. [Google Scholar] [CrossRef]
  62. Haranaka, M.; Baber, J.; Ogama, Y.; Yamaji, M.; Aizawa, M.; Kogawara, O.; Scully, I.; Lagkadinou, E.; Türeci, Ö.; Şahin, U.; et al. A Randomized Study to Evaluate Safety and Immunogenicity of the BNT162b2 COVID-19 Vaccine in Healthy Japanese Adults. Nat. Commun. 2021, 12, 7105. [Google Scholar] [CrossRef]
  63. Munro, A.P.S.; Janani, L.; Cornelius, V.; Aley, P.K.; Babbage, G.; Baxter, D.; Bula, M.; Cathie, K.; Chatterjee, K.; Dodd, K.; et al. Safety and Immunogenicity of Seven COVID-19 Vaccines as a Third Dose (Booster) Following Two Doses of ChAdOx1 NCov-19 or BNT162b2 in the UK (COV-BOOST): A Blinded, Multicentre, Randomised, Controlled, Phase 2 Trial. Lancet 2021, 398, 2258–2276. [Google Scholar] [CrossRef]
  64. Liao, Y.; Li, Y.; Pei, R.; Fang, X.; Zeng, P.; Fan, R.; Ou, Z.; Deng, J.; Zhou, J.; Guan, W.; et al. Safety and Immunogenicity of a Recombinant Interferon-Armed RBD Dimer Vaccine (V-01) for COVID-19 in Healthy Adults: A Randomized, Double-Blind, Placebo-Controlled, Phase I Trial. Emerg. Microbes Infect. 2021, 10, 1589–1597. [Google Scholar] [CrossRef]
  65. Halperin, S.A.; Ye, L.; MacKinnon-Cameron, D.; Smith, B.; Cahn, P.E.; Ruiz-Palacios, G.M.; Ikram, A.; Lanas, F.; Lourdes Guerrero, M.; Muñoz Navarro, S.R.; et al. Final Efficacy Analysis, Interim Safety Analysis, and Immunogenicity of a Single Dose of Recombinant Novel Coronavirus Vaccine (Adenovirus Type 5 Vector) in Adults 18 Years and Older: An International, Multicentre, Randomised, Double-Blinded, Placebo-Controlled Phase 3 Trial. Lancet 2022, 399, 237–248. [Google Scholar] [CrossRef] [PubMed]
  66. Intapiboon, P.; Seepathomnarong, P.; Ongarj, J.; Surasombatpattana, S.; Uppanisakorn, S.; Mahasirimongkol, S.; Sawaengdee, W.; Phumiamorn, S.; Sapsutthipas, S.; Sangsupawanich, P.; et al. Immunogenicity and Safety of an Intradermal BNT162b2 MRNA Vaccine Booster after Two Doses of Inactivated SARS-CoV-2 Vaccine in Healthy Population. Vaccines 2021, 9, 1375. [Google Scholar] [CrossRef] [PubMed]
  67. Kremsner, P.G.; Ahuad Guerrero, R.A.; Arana-Arri, E.; Aroca Martinez, G.J.; Bonten, M.; Chandler, R.; Corral, G.; de Block, E.J.L.; Ecker, L.; Gabor, J.J.; et al. Efficacy and Safety of the CVnCoV SARS-CoV-2 MRNA Vaccine Candidate in Ten Countries in Europe and Latin America (HERALD): A Randomised, Observer-Blinded, Placebo-Controlled, Phase 2b/3 Trial. Lancet Infect. Dis. 2021. [Google Scholar] [CrossRef]
  68. Guo, W.; Duan, K.; Zhang, Y.; Yuan, Z.; Zhang, Y.B.; Wang, Z.; Zhao, D.; Zhang, H.; Xie, Z.; Li, X.; et al. Safety and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine in Healthy Adults Aged 18 Years or Older: A Randomized, Double-Blind, Placebo-Controlled, Phase 1/2 Trial. EClinicalMedicine 2021, 38, 101010. [Google Scholar] [CrossRef]
  69. Kulkarni, P.S.; Padmapriyadarsini, C.; Vekemans, J.; Bavdekar, A.; Gupta, M.; Kulkarni, P.; Garg, B.S.; Gogtay, N.J.; Tambe, M.; Lalwani, S.; et al. A Phase 2/3, Participant-Blind, Observer-Blind, Randomised, Controlled Study to Assess the Safety and Immunogenicity of SII-ChAdOx1 NCoV-19 (COVID-19 Vaccine) in Adults in India. eClinicalMedicine 2021, 42, 101218. [Google Scholar] [CrossRef]
  70. Zeng, G.; Wu, Q.; Pan, H.; Li, M.; Yang, J.; Wang, L.; Wu, Z.; Jiang, D.; Deng, X.; Chu, K.; et al. Immunogenicity and Safety of a Third Dose of CoronaVac, and Immune Persistence of a Two-Dose Schedule, in Healthy Adults: Interim Results from Two Single-Centre, Double-Blind, Randomised, Placebo-Controlled Phase 2 Clinical Trials. Lancet Infect. Dis. 2022. [Google Scholar] [CrossRef]
  71. Ali, K.; Berman, G.; Zhou, H.; Deng, W.; Faughnan, V.; Coronado-Voges, M.; Ding, B.; Dooley, J.; Girard, B.; Hillebrand, W.; et al. Evaluation of MRNA-1273 SARS-CoV-2 Vaccine in Adolescents. N. Engl. J. Med. 2021, 385, 2241–2251. [Google Scholar] [CrossRef]
  72. el Sahly, H.M.; Baden, L.R.; Essink, B.; Doblecki-Lewis, S.; Martin, J.M.; Anderson, E.J.; Campbell, T.B.; Clark, J.; Jackson, L.A.; Fichtenbaum, C.J.; et al. Efficacy of the MRNA-1273 SARS-CoV-2 Vaccine at Completion of Blinded Phase. N. Engl. J. Med. 2021, 385, 1774–1785. [Google Scholar] [CrossRef]
  73. Thomas, S.J.; Moreira, E.D.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Polack, F.P.; Zerbini, C.; et al. Safety and Efficacy of the BNT162b2 MRNA COVID-19 Vaccine through 6 Months. N. Engl. J. Med. 2021, 385, 1761–1773. [Google Scholar] [CrossRef]
  74. Formica, N.; Mallory, R.; Albert, G.; Robinson, M.; Plested, J.S.; Cho, I.; Robertson, A.; Dubovsky, F.; Glenn, G.M.; 2019nCoV-101 Study Group. Different Dose Regimens of a SARS-CoV-2 Recombinant Spike Protein Vaccine (NVXCoV2373) in Younger and Older Adults: A Phase 2 Randomized Placebo-Controlled Trial. PLoS Med. 2021, 18, e1003769. [Google Scholar] [CrossRef]
  75. Feng, Y.; Chen, J.; Yao, T.; Chang, Y.; Li, X.; Xing, R.; Li, H.; Xie, R.; Zhang, X.; Wei, Z.; et al. Safety and Immunogenicity of Inactivated SARS-CoV-2 Vaccine in High-Risk Occupational Population: A Randomized, Parallel, Controlled Clinical Trial. Infect. Dis. Poverty 2021, 10, 138. [Google Scholar] [CrossRef] [PubMed]
  76. Choi, A.; Koch, M.; Wu, K.; Chu, L.; Ma, L.Z.; Hill, A.; Nunna, N.; Huang, W.; Oestreicher, J.; Colpitts, T.; et al. Safety and Immunogenicity of SARS-CoV-2 Variant MRNA Vaccine Boosters in Healthy Adults: An Interim Analysis. Nat. Med. 2021, 27, 2025–2031. [Google Scholar] [CrossRef] [PubMed]
  77. Medeiros-Ribeiro, A.C.; Aikawa, N.E.; Saad, C.G.S.; Yuki, E.F.N.; Pedrosa, T.; Fusco, S.R.G.; Rojo, P.T.; Pereira, R.M.R.; Shinjo, S.K.; Andrade, D.C.O.; et al. Immunogenicity and Safety of the CoronaVac Inactivated Vaccine in Patients with Autoimmune Rheumatic Diseases: A Phase 4 Trial. Nat. Med. 2021, 27, 1744–1751. [Google Scholar] [CrossRef]
  78. Xia, S.; Zhang, Y.; Wang, Y.; Wang, H.; Yang, Y.; Gao, G.F.; Tan, W.; Wu, G.; Xu, M.; Lou, Z.; et al. Safety and Immunogenicity of an Inactivated SARS-CoV-2 Vaccine, BBIBP-CorV: A Randomised, Double-Blind, Placebo-Controlled, Phase 1/2 Trial. Lancet Infect. Dis. 2021, 21, 39–51. [Google Scholar] [CrossRef]
  79. Singh, S.; Loke, Y.K. Drug Safety Assessment in Clinical Trials: Methodological Challenges and Opportunities. Trials 2012, 13, 138. [Google Scholar] [CrossRef] [Green Version]
  80. Phillips, R.; Hazell, L.; Sauzet, O.; Cornelius, V. Analysis and Reporting of Adverse Events in Randomised Controlled Trials: A Review. BMJ Open 2019, 9, e024537. [Google Scholar] [CrossRef] [PubMed]
  81. Gabler, N.B.; Duan, N.; Raneses, E.; Suttner, L.; Ciarametaro, M.; Cooney, E.; Dubois, R.W.; Halpern, S.D.; Kravitz, R.L. No Improvement in the Reporting of Clinical Trial Subgroup Effects in High-Impact General Medical Journals. Trials 2016, 17, 320. [Google Scholar] [CrossRef] [Green Version]
  82. Siddiqui, O. Statistical Methods to Analyze Adverse Events Data of Randomized Clinical Trials. J. Biopharm. Stat. 2009, 19, 889–899. [Google Scholar] [CrossRef]
  83. Hays, M.; Andrews, M.; Wilson, R.; Callender, D.; O’Malley, P.G.; Douglas, K. Reporting Quality of Randomised Controlled Trial Abstracts among High-Impact General Medical Journals: A Review and Analysis. BMJ Open 2016, 6, e011082. [Google Scholar] [CrossRef] [Green Version]
Vaccines 10 00313 g001 550
Figure 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram of the study selection process.
Figure 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram of the study selection process.
Vaccines 10 00313 g001
Vaccines 10 00313 g002 550
Figure 2. Summary of risk of bias analysis using ROB2 tools.
Figure 2. Summary of risk of bias analysis using ROB2 tools.
Vaccines 10 00313 g002
Table
Table 1. Characteristics of Eligible Studies.
Table 1. Characteristics of Eligible Studies.
Study CharacteristicNo. (%)
Total, No.61
     Type of vaccine
     Inactivated vaccine18 (29.5)
     mRNA18 (29.5)
     Protein subunit7 (11.5)
     Viral vector18 (29.5)
No. of subjects
     1–50022 (36.1)
     500–100016 (26.2)
     >100023 (37.3)
Age of participants
     <184 (6.6)
     ≥121 (1.7)
     ≥1856 (96.7)
Type of study
     Multi-center 35 (57.4)
     Single-center 26 (42.6)
     Study design
     Open-label6 (9.8)
     Single-blind15 (24.6)
     Double-blind33 (54.1)
     Triple blind6 (9.8)
     Not stated1 (1.7)
Clinical trial phase
     Phase I11 (18)
     Phase I/II19 (31.1)
     Phase II12 (19.7)
     Phase II/III4 (6.6)
     Phase III9 (14.7)
     Phase I–III4 (6.6)
     Phase IV2 (3.3)
Impact Factor
     <5045 (73.8)
     ≥5016 (26.2)
Number of authors
     <2016 (26.2)
     20–5040 (65.6)
     >505 (8.2)
Funding
     Industry31 (50.8)
     Non-industry30 (49.2)
Participants flowchart
     Yes54 (88.5)
     No7 (11.5)
Table
Table 2. Items fulfilled against the quality of reporting criteria (Consolidated Standards of Reporting Trials (CONSORT) Extension for Harm) (n = 61).
Table 2. Items fulfilled against the quality of reporting criteria (Consolidated Standards of Reporting Trials (CONSORT) Extension for Harm) (n = 61).
Section of PaperCONSORT Harm RecommendationDetailed ItemsCompliance of Trials, n (%)
Title and abstract
1.
If the study collected data on harms and benefits, the title or abstract should state so
1. Adverse events mentioned in title or abstract57 (93)
Introduction
2.
If the trial addresses both harms and benefits, the introduction should state so
2. Information on adverse events mentioned in the introduction 56 (92)
Methods
3.
Include a list of AEs with definitions for each (with attention, when relevant, to grading, expected vs. unexpected events, references to standardized and validated definitions, and description of new definitions
3a. Definitions of AEs mentioned50 (82)
3b. If article mentioned all or selected sample of AE45 (74)
3c. If article mentioned the use of a validated instrument to report adverse event severity25 (41)
4.
Clarify how harms-related information was collected (mode of data collection, timing, attribution methods, intensity of ascertainment, and harms-related monitoring and stopping rules, if pertinent)
4a. Describe the mode of data collection (e.g., diaries, phone interviews, face-to-face interviews)52 (85)
4b. Stated the timing of collection of AE data59 (97)
4c. Description of how AE were attributed to trial drugs39 (64)
4d. Described the plan for monitoring for harms and rules for stopping the trial because of harms19 (31)
5.
Describe plans for presenting and analyzing information on harms (including coding, handling of recurrent events, specification of timing issues, handling of continuous measures, and any statistical analyses)
5a. Described the methods for presenting and/or analyzing adverse events53 (87)
5b. Description of approach for the handling of recurrent AEs6 (10)
Result
6.
Describe for each arm the participant withdrawals that are due to harm and the experience with the allocated treatment
6a. Reported withdrawals because of AE in each arm 30 (49)
6b. Reported deaths and serious AEs61 (100)
7.
Provide denominators for describing harms
7a. Provided denominators for adverse events44 (72)
7b. Provided definitions used for analysis set (intention to treat, per protocol, safety data available, unclear)25 (41)
8.
Present the absolute risk of each adverse event (specifying type, grade, and seriousness per arm), and present appropriate metrics for recurrent events, continuous variables, and scale variables, whenever pertinent
8a. Reported results separately for each treatment arm55 (90)
8b. Severity and grading of AEs56 (92)
8c. Provided both number of adverse events and number of patients with adverse events57 (93)
9.
Describe any subgroup analysis and exploratory analysis for harms
9. Described subgroup analysis and exploratory analysis for harms15 (25)
Discussion
10.
Provide a balanced discussion of benefits and harms with emphasis on study limitations, generalisability and other sources of information on harms
10a. Provided a balanced view that puts benefits and harms into perspective55 (90)
10b. Included limitations of study with respect to harms (e.g., lack of power, short duration of exposure, inconclusive findings, post hoc analysis, generalisability of AE info as dependent on clinical setting)57 (93)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yuniar, C.T.; Pratiwi, B.; Ihsan, A.F.; Laksono, B.T.; Risfayanti, I.; Fathadina, A.; Jeong, Y.; Kim, E. Adverse Events Reporting Quality of Randomized Controlled Trials of COVID-19 Vaccine Using the CONSORT Criteria for Reporting Harms: A Systematic Review. Vaccines 2022, 10, 313. https://doi.org/10.3390/vaccines10020313

AMA Style

Yuniar CT, Pratiwi B, Ihsan AF, Laksono BT, Risfayanti I, Fathadina A, Jeong Y, Kim E. Adverse Events Reporting Quality of Randomized Controlled Trials of COVID-19 Vaccine Using the CONSORT Criteria for Reporting Harms: A Systematic Review. Vaccines. 2022; 10(2):313. https://doi.org/10.3390/vaccines10020313

Chicago/Turabian Style

Yuniar, Cindra Tri, Bhekti Pratiwi, Ardika Fajrul Ihsan, Bambang Tri Laksono, Iffa Risfayanti, Annisa Fathadina, Yeonseon Jeong, and Eunyoung Kim. 2022. "Adverse Events Reporting Quality of Randomized Controlled Trials of COVID-19 Vaccine Using the CONSORT Criteria for Reporting Harms: A Systematic Review" Vaccines 10, no. 2: 313. https://doi.org/10.3390/vaccines10020313

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop