Next Article in Journal
Is Pre-Exposure Prophylaxis a Cost-Effective Intervention to Avert Rabies Deaths among School-Aged Children in India? Comment on Royal et al. A Cost-Effectiveness Analysis of Pre-Exposure Prophylaxis to Avert Rabies Deaths in School-Aged Children in India. Vaccines 2023, 11, 88
Next Article in Special Issue
Follow-Up of Side Effects throughout the Entire Course of Coronavirus Vaccination
Previous Article in Journal
The Course of COVID-19 among Unvaccinated Patients—Data from the National Hospital in Warsaw, Poland
Previous Article in Special Issue
New-Onset Arthritis Following COVID-19 Vaccination: A Systematic Review of Case Reports
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Safety Profile of Homologous and Heterologous Booster COVID-19 Vaccines in Physicians in Quito-Ecuador: A Cross-Sectional Study

by
Nancy Flores-Lastra
1,†,
Josue Rivadeneira-Dueñas
1,2,3,*,†,
Luis Fuenmayor-González
1,4,†,
Glenda Guayasamín-Tipanta
4,
Michelle Jácome-García
1,
Tamara Otzen
2,3 and
Carlos Manterola
2,3
1
Zero Biomedical Research, Quito 170103, Ecuador
2
Doctorado en Ciencias Médicas, Universidad de La Frontera, Temuco 4811230, Chile
3
Núcleo Milenio de Sociomedicina, Santiago 7560908, Chile
4
Facultad de Ciencias Médicas, Universidad Central del Ecuador, Quito 170136, Ecuador
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Vaccines 2023, 11(3), 676; https://doi.org/10.3390/vaccines11030676
Submission received: 24 January 2023 / Revised: 13 March 2023 / Accepted: 13 March 2023 / Published: 16 March 2023
(This article belongs to the Special Issue Adverse Events of COVID-19 Vaccines)

Abstract

:
More than 600 healthcare workers died due to COVID-19 infection until January 2022 in Ecuador. Even though the COVID-19 vaccines are safe, local and systemic reactions were reported among physicians. This study aims to analyze the adverse events of COVID-19 with an emphasis on comparing the homologous and heterologous booster doses in physicians that received three approved vaccines in Ecuador. An electronic survey was performed in Quito, Ecuador, directed at physicians who were vaccinated with the three doses of COVID-19 vaccines. A total of 210 participants were analyzed after administering any dose of the vaccines. At least one AE was identified in 60.0% (126/210) of the sample after the first dose, 52.40% (110/210) after the second dose, and 75.2% (158/210) after the booster dose. The most frequent AEs were localized pain, myalgia, headache, and fever. At least one drug was used in 44.3% of the population after the first dose, 37.1% after the second dose, and 63.8% in the booster dose. Heterologous booster produces more AEs compared with homologous booster (80.1% vs. 53.8%), and 77.3% of participants reported that interfered with daily activities. Similar studies agree that reactogenicity occurs mainly with heterologous vaccination compared to homologous vaccination. This situation affected physicians’ performance in daily activities and led them to use medication for the symptoms. In the future, it is recommended to perform cohort studies, where adverse events that are associated with vaccine boosters in the general population can be analyzed longitudinally, thus improving the level of evidence of the results.

1. Introduction

The COVID-19 pandemic has produced 568,773,510 cases and 6,381,643 deaths worldwide [1]. In Ecuador, 946,487 people were diagnosed with COVID-19 [1]; the most affected province is Pichincha [2], and Quito, the capital of Ecuador, is the city with the highest number of confirmed cases [3].
In a historic context, the first COVID-19 vaccines arrived in Ecuador in January 2021 and were destinated for first responders [4], and four months later, in May 2021, the Nation Vaccination Plan included vulnerable groups such as the elderly, people with disabilities, and people with high occupational risk [5]. By July 2021, the population older than 16 got their vaccination [6], and in September 2021, nine million inhabitants got their full vaccination [7]. The booster dose application started on December 2021 with homologous and primarily heterologous regimens in those that were fully vaccinated 6 months prior [8].
Healthcare workers (HCWs) are defined as paid or unpaid persons engaged in actions whose primary intent is to enhance health [9]. Among the first line HCWs, physicians are one of the groups that are most affected by COVID-19 infections and the one with the highest mortality [10], for instance, more than 600 physicians died due to COVID-19 infection up to January 2022 in Ecuador [11]. For this reason, the World Health Organization (WHO) established that physicians were a priority in the administration of vaccines including the booster dose [12].
A booster dose is the response of the Public Health Systems to the emergence of new SARS-CoV-2 variants [13] and the decay of neutralizing antibodies in people that are fully vaccinated after 3–6 months [14,15]. The National Vaccination Campaign achieved full vaccination of 83.84% of the population and 39.98% got a booster dose [16]. The Ministry of Health (MoH) managed the administration of four COVID-19 vaccines: the mRNA Pfizer/BioNTech-Comirnaty, the non-replicating viral vector Oxford/AstraZeneca-Vaxzevria, and CanSino-Convidencia, and the inactivated virus vaccine Sinovac-CoronaVac.
The 56.39% of the total booster doses were primarily administered with Oxford/AstraZeneca-Vaxzevria, 34.78% with Pfizer/BioNTech-Comirnaty, 2.09% with CanSino-Convidencia, and 6.72% with Sinovac-CoronaVac [16].
Even though the COVID-19 vaccines are safe [17], a few local and systemic reactions were reported after the first and second doses of vaccination [18] and after the application of a heterologous booster dose among HCWs [19]. Regarding the homologous versus heterologous booster, the latter demonstrated a slightly higher rate of adverse events in HCW [20].
In Ecuador, the presence of adverse events associated with booster vaccination has not been studied. Due to the low vaccination rate related mainly to the fear and anxiety generated by the development of severe adverse events [21], it is important to provide local results to evaluate whether heterologous vaccination increases events [20], with the objective of reducing fear in the population and to provide physicians with another tool to stimulate vaccination.
This study aims to analyze the adverse events of COVID-19 with an emphasis on comparing the homologous and heterologous booster doses in physicians that received three approved vaccines in Ecuador.

2. Materials and Methods

This article was written following the STROBE initiative for the reporting of observational studies [22].

2.1. Study Design and Ethical Conditions

The present cross-sectional study was approved by the Independent Ethics Committee SOLCA-NUCLEO QUITO with the number OBS.21.202 and during its development, all the norms of Good Clinical Practice and Helsinki principles [23] were complied to maintain the participant’s safety and assure the quality of data that were obtained.

2.2. Settings, Data Source, and Participants

An open and anonymous electronic survey (27 questions and 6 different screens) was performed in the city of Quito, Ecuador, directed to the medical volunteer participants who were vaccinated with the 3 doses of the following vaccines against COVID-19: Oxford/AstraZeneca-Vaxzevria, Pfizer/BioNTech-Comirnaty, or Sinovac-CoronaVac (greater than 7 days from the third dose). The instrument was published on different online media and social networks using platforms followed by physicians to delimit the sample; obtaining data from February 15 to April 01 of 2022 through the Google formulary application after individual authorization through the acceptance of electronic Informed Consent. To deal with the risk of duplicated responses, the email address was requested and if duplicated files were identified then the oldest one was eliminated.
The validity of the instrument was determined through content validation based on the criteria of three experts (1 family physician, 1 Master in Public Health, and 1 general practitioner), after which the instrument was applied in a pilot study to 25 participants, who approved the understanding and clarity of the content. After this, a Cronbach’s Alpha of 0.89 was obtained for the instrument used, proving its reliability.

2.3. Measurement of Variables

Outcome measures: The results were obtained through the different responses to the questions that were asked during the development of the survey, keeping the development of any adverse event, the use of 1 or more medications, and the affectation of daily activities 7 days after any dose of vaccination against COVID-19 as dependent variables.
The outcome adverse events was evaluated through the closed question “Did you present any subsequent adverse event in the 7 days following the administration of the COVID-19 vaccine?”, in each dose administered (3 doses) dichotomizing the answer in Yes/No; in the case of an affirmative answer, the type of adverse event was requested through the following non-exclusive question “If yes. Which of the following adverse events occurred during the first 7 days post-vaccination?”, awaiting confirmation or denial of the following adverse events: localized pain, localized edema, localized erythema, localized pruritus, thermal elevation, diarrhea, nausea, vomiting, myalgia, arthralgia, headache, and the development of other types of adverse events (obtained from the U.S Food and Drug Administration (FDA) [24]).
The use of medication was requested through the closed question “Was any medication administered for these side effects?”, at each dose obtaining Yes/No answers; in case of an affirmative answer, it was requested to describe which medications were used through the use of the excluding question: Paracetamol, Ibuprofen, Diclofenac, Etoricoxib, and other medications. This qualitative variable was subclassified as the number of drugs that were used during the 7 days following each dose of the COVID-19 vaccine (None, 1 drug, 2 drugs, 3 or more drugs).
The affectation of daily activities during the 7 days after the administration of each dose of the COVID-19 vaccine was classified as an ordinal qualitative variable and assessed through a Likert-type scale with 4 options requested through the following question “Indicate the relationship between your daily activities and the adverse events present on a scale of 1 to 4”, obtaining, as a result, the options: (1) Does not interfere with your daily activities and no treatment is administered, (2) interferes with daily activities and/or required pharmacological treatment, (3) impedes the performance of daily activities and required treatment; and (4) was hospitalized.
Individual measures: The participants were asked for sociodemographic information related to their date of birth (for age calculation), sex (male, female), and place of work; this last variable was classified as public, private, or no work. Dates of vaccination and the name of the vaccine applied were also required for each dose; these variables were classified according to the number of doses (first dose, second dose, third dose) and administered vaccine (Oxford/AstraZeneca-Vaxzevria, Pfizer/BioNTech-Comirnaty, or Sinovac-CoronaVac). The third dose was subclassified concerning the type of vaccine into homologous (defined as administration of the same vaccine in all three doses) and heterologous (placement of a different vaccine in any dose) and is described in Table A1 in the Appendix A.

2.4. Biases

As the study requires retrospective data, the risk of memory bias is latent, and it was managed by placing the download link of the vaccination certificate of the MoH of Ecuador and the request based on mixed questions that counted as options for different adverse events that help to remember the events that occurred.

2.5. Statistical Analysis

To calculate the sample size, the finite universe formula was used with a sampling error of 5%, a confidence interval of 95%, and an expected proportion of 82.1% for a population of 11,730 physicians of Quito, Ecuador, with a loss of 10%, a sample of 250 participants was obtained. A non-probabilistic snowball sampling was used.
In the case of missing data, the mean of each variable was placed to avoid loss of information. The descriptive analysis for qualitative variables was expressed with frequency tables; for qualitative variables, summary measures such as the mean, median, standard deviation, and interquartile range were used and presented according to the type of distribution of each variable. For the bivariate analysis, the association between variables was assessed with a parametric test (chi2 and Student’s t-tests) and nonparametric test (Mann–Whitney U test), and risk measures (odds ratio) with their respective 95% confidence intervals, using the presence or absence of adverse events as the dependent variable. Statistical analysis was performed with the Statistical Package for the Social Sciences version 26 program® (SPSS; IBM Corp., Armonk, NY, USA).

3. Results

A total of 225 participants gave their consent to participate in the study, obtaining a recruitment and completion rate of 100%; 15 research subjects were excluded, 13 for being non-medical professionals, and 2 for receiving another type of vaccine. A total of 210 participants were analyzed with 630 vaccines administered divided into 3 doses (Figure 1). A total of 65.7% (138/210) were women; the participants presented an average age of 32 years (RIQ: 11.25) and for the 630 doses that were administered, 47.3% were Pfizer/BioNTech-Comirnaty, the 39.0% Oxford/AstraZeneca-Vaxzevria, and 13.7% Sinovac-CoronaVac). Table 1 describes the characteristics of the participants; no missing data were identified during the analysis.

3.1. Doses Administered

It has been identified that 62.5% (394/630) of the doses that were administered presented at least one adverse event during the 7 days after the administration of any dose of the vaccine, with a frequency of 60.0% (126/210) after the first dose, 52.40% (110/210) and in the second dose, and 75.2% (158/210) after the third dose, this difference is statistically significant (p-value < 0.001). The most frequent adverse event that was reported was localized pain in 49.5% (312/630) followed by myalgia in 28.3% (178/630), headache in 24.9% (157/630), and thermal elevation with a frequency of 21.6% (136/630). Concerning the use of medications, 48.4% (305/630) of the participants reported having used at least one medication for the management of adverse events, 44.3% (93/210) after the first dose, 37.1% (78/210) after the second dose, and 63.8% (134/210) in the third dose applied. Of the participants who reported at least one adverse event, 44.7% (176/391) reported that their daily activities were affected and/or required pharmacological treatment. The characteristics of each dose are described in Table 2.

3.2. Vaccine Administered

Regarding the vaccine administered, it becomes evident that 74.8% (184/246) of the participants that were given Oxford/AstraZeneca-Vaxzevria presented adverse events, with a mean of 3.4 (SD = 2.0) adverse events. In the group of participants that were administered with Pfizer/BioNTech-Comirnaty, a frequency of 59.1% (176/298) with a mean of 2.4 (SD = 1.6) adverse events were identified, and in the Sinovac-CoronaVac group, 39.5% (34/86) presented at least one adverse event with a mean of 1.8 (SD = 1.2) this difference is statistically significant (p-value < 0.001). Concerning the use of medication, 63.0% (155/246) of the Oxford/AstraZeneca-Vaxzevria group reported using a medication, compared to 42.3% (126/298) of the Pfizer/BioNTech-Comirnaty group, and 27.9% (24/86) of the participants that were vaccinated with Sinovac-CoronaVac, this difference is statistically significant (p-value < 0.001). The characteristics of adverse events, the use of medication, and the relationship with daily activities are described in Table 3. In Appendix A, Table A2 provides descriptive characteristics of adverse events with the doses and the vaccine.

3.3. Group Vaccine

In the group of participants with heterologous reinforcement, it is evident that 80.1% (137/171) presented at least one adverse event, compared to 53.8% (21/39) of the homologous group, this difference is statistically significant (p-value < 0.001); they also report that 70.2% (120/171) report the use of medication for the control of adverse events in the heterologous group compared to 35.9% (14/39) of the homologous group, this difference is statistically significant (p-value < 0.001). The characteristics of adverse events, medication use, and their relationship with daily activities are described in Table 4.

3.4. Factors Related to the Occurrence of Adverse Events

In the bivariate analysis, it was identified that 62.5% (394/630) of the participants developed some adverse event, where being female (OR: 1.76 (1.25–2.46)), receiving the third dose (OR: 2.36 (1.64–3.42)), the Oxford/AstraZeneca vaccine (OR: 2.45 (1.79–3.49)), and a heterologous vaccine (OR: 4.20 (2.02–8.73)) increased the probability of presenting an adverse event. Table 5 describes these results.

4. Discussion

During the first year of the pandemic, scientists worldwide developed safe and effective vaccines to reduce hospitalization and deaths associated with COVID-19. However, due to the limited availability of vaccine doses, vaccination was prioritized for HCWs and was the best strategy to control deaths and diseases in this population [25]. It is essential to describe the characteristics of the local and systemic AEs presented by the HCW and to analyze their relationship with the degree of affectation in the performance of daily activities after full or booster immunization and thus improve vaccination plans in the future.
Our study shows a high prevalence of local and systemic adverse events (62.5%) in medical personnel after 7 days of administration of the approved vaccines in Ecuador, describing a higher frequency after administration of the third dose (75.2%), compared to the first and second doses (60.0% and 52.4%, respectively). Of these adverse events, the great majority did not interfere or slightly interfered with daily activities, showing that they were mild to moderate. Despite this, 48.4% of the participants administered some medication to control the side effects. Regarding the most frequent side effects, localized pain at the injection site (local event), myalgia, and headache (systemic events) were reported. Likewise, it was identified that being a woman, receiving an mRNA vaccine, Oxford/AstraZeneca-Vaxzevria, the third dose of any vaccine, and the heterologous vaccine as a booster increased the risk of presenting adverse events.
Naito et al. [26] conducted a study with HCWs in Japan with a population that received Pfizer/BioNTech-Comirnaty and Moderna vaccines. They reported similar frequencies of adverse reactions during the first eight days after the second and third vaccination. They also found that the incidence of adverse reactions was significantly higher in heterologous vaccination compared to homologous vaccination [26], which is consistent with our results and several others that have been reported [27,28,29].
In a German study performed by Nachtigall et al. [30], in health workers, the most reported local adverse event during the first eight days at any vaccination dose, was pain at the injection site (50.2%), followed by malaise (30.1%). Homologous vaccination produced fewer adverse events (49.4%) than heterologous vaccination (81.4%) [30].
In Thailand, a prospective study was performed in HCWs, where the most common systemic adverse events after the Sinovac-CoronaVac/Oxford/AstraZeneca-Vaxzevria booster dose included myalgia, headache, and fever (37%, 34%, and 34%). The AE prevalence was significantly lower for individuals in the Oxford/AstraZeneca-Vaxzevria group after the CoronaVac booster. The most common symptoms that were observed in this group were headache, myalgia, and fatigue (13%, 11%, and 9%, respectively), and the local reaction was 14%, in comparison with 17% of the other group [31], similar our results showed previously.
Concerning the vaccine type, Oxford/AstraZeneca-Vaxzevria vaccine showed the highest risk of adverse events (OR 2.45, CI 95% 1.73–3.49, p < 0.001) with similar results in several other studies [32,33]. On the other hand, a systematic review and meta-analysis performed by Kouhpayeh and Ansari reported that inactivated vaccines such as Sinovac-CoronaVac have no relationship with systemic adverse events (RR 1.13, CI 95% 0.79–1.61) [34] as in our study where Sinovac-CoronaVac showed the least risk for AE (OR 0.33, 95% CI 0.20–0.53, p < 0.001).
Besides the heterologous regimen during the third dose application, the highest probability of AEs with statistical significance was presented in females. These findings coincide with the results of Alqahtani et al., where female gender was a significant risk factor for developing AEs (OR: 1.69 CI 95% 1.17–2.44) [32]. On the other hand, Granados-Villalpando et al. analyzed AEs in the Mexican population, and even though the female gender was numerically a risk factor, the results were not statistically significant (OR: 1.69 CI 95% 1.17–2.44) [35].
Our study presented some limitations such as the low sample size, which could affect the power of the study. However, in post hoc examination, statistical power obtained 98%, with a low beta error. Moreover, the cohort consisted of physicians, and therefore, in terms of age distribution, most participants were of working age; this may constrain the generalizability of our results, especially for the elder age groups. In addition, the recall bias could also affect the reliability of the responses. Another limitation is the lack of multivariate analysis due to the lack of independence in the independent variables of the sample studied, and it is suggested that future studies take this type of analysis into account in order to reduce bias due to confounding variables. For these reasons, further analysis including larger samples of nurses, paramedics, and laboratory staff should be performed to generalize our results to the healthcare workers group.

5. Conclusions

This study presents the descriptive characteristics of local and systemic adverse events in medical personnel from Quito who were immunized with Oxford/AstraZeneca-Vaxzevria, Pfizer/BioNTech-Comirnaty, and Sinovac-CoronaVac during the National Vaccination Campaign in Ecuador. This study compares the symptoms that were described most frequently by the participants in the different doses and in the group that received homologous and heterologous vaccination. In addition, the relationship between vaccination and daily activities performance was analyzed, with the requirement of pharmacological treatment to alleviate the reported symptoms. People who received the Vaxzevria vaccine had more adverse events (74.8%) compared to those who received Comirnaty (59.1%) and CoronaVac (39.5%). The highest degree of adverse events occurred with heterologous vaccination compared to homologous immunization (80.1% vs. 53.8%), in line with other international results. All the vaccines that were used by medical personnel produced local and systemic adverse events from the first dose to the booster dose during the first seven days, while the booster dose presented a higher prevalence of adverse events. This situation led to the use of medication for the symptoms that presented and affected the performance of physicians’ daily activities during the pandemic.

Author Contributions

Conceptualization, J.R.-D., L.F.-G. and N.F.-L.; methodology, J.R.-D., L.F.-G. and N.F.-L.; software, J.R.-D., L.F.-G. and N.F.-L.; validation, J.R.-D., L.F.-G., M.J.-G. and N.F.-L.; formal analysis, J.R.-D., T.O. and C.M.; investigation, J.R.-D., L.F.-G. and G.G.-T.; resources, J.R.-D., L.F.-G., G.G.-T. and M.J.-G.; data curation, J.R.-D. and M.J.-G.; writing—original draft preparation, J.R.-D., L.F.-G. and N.F.-L.; writing—review and editing, J.R.-D., L.F.-G., T.O., C.M., M.J.-G., G.G.-T. and N.F.-L.; supervision, J.R.-D. and L.F.-G.; project administration, J.R.-D., L.F.-G. and N.F.-L.; funding acquisition, G.G.-T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study was approved by the Independent Ethics Committee SOLCA-NUCLEO QUITO with the number OBS.21.202 and during its development, all the norms of Good Clinical Practice and Helsinki principles were complied to maintain the participant’s safety and assure the quality of data obtained.

Informed Consent Statement

Electronic informed consent was obtained from all subjects that were involved in the study.

Data Availability Statement

The data that are presented in this study are available on request from the corresponding author. The data are not publicly available due to maintaining privacy data of the participants such as e-mail addresses.

Acknowledgments

ANID—MILENIO—NCS2021_013.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1 descriptive characteristics of adverse events in relation to the dose and vaccine.
Table A1. Definition of the homologous and heterologous COVID-19 vaccine regimes.
Table A1. Definition of the homologous and heterologous COVID-19 vaccine regimes.
Type of RegimenFirst DoseSecond DoseBooster Dose
HomologousOxford/AstraZeneca-VaxzevriaOxford/AstraZeneca-VaxzevriaOxford/AstraZeneca-Vaxzevria
Pfizer/BioNTech-Comirnaty Pfizer/BioNTech-Comirnaty Pfizer/BioNTech-Comirnaty
Sinovac-CoronaVac Sinovac-CoronaVac Sinovac-CoronaVac
HeterologousOxford/AstraZeneca-VaxzevriaOxford/AstraZeneca-VaxzevriaPfizer/BioNTech-Comirnaty
Pfizer/BioNTech-Comirnaty Pfizer/BioNTech-Comirnaty Oxford/AstraZeneca-Vaxzevria
Sinovac-CoronaVac Sinovac-CoronaVac Pfizer/BioNTech-Comirnaty
Sinovac-CoronaVac Sinovac-CoronaVac Oxford/AstraZeneca-Vaxzevria
Table A2. Descriptive characteristics of adverse events in relation to the dose and vaccine.
Table A2. Descriptive characteristics of adverse events in relation to the dose and vaccine.
First Dose (n = 210)Second Dose (n = 210)Third Dose (n = 210)
Oxford/AstraZeneca-Vaxzevria n (%)Pfizer/BioNTech-Comirnaty
n (%)
Sinovac-CoronaVac
n (%)
Oxford/AstraZeneca-Vaxzevria n (%)Pfizer/BioNTech-Comirnaty
n (%)
Sinovac-CoronaVac
n (%)
Oxford/AstraZeneca-Vaxzevria n (%)Pfizer/BioNTech-Comirnaty
n (%)
N32 (100.0)135 (100.0)43 (100.0)32 (100.0)135 (100.0)43 (100.0)182 (100.0)28 (100.0)
Adverse Events25 (78.1)84 (62.2)17 (39.5)17 (53.1)76 (56.3)17 (39.5)142 (78.0)16 (57.1)
Pain18 (56.3)74 (54.8)15 (34.9)11 (34.4)64 (47.4)16 (37.2)100 (54.9)14 (50.0)
Edema2 (6.3)7 (5.2)2 (4.7)0 (0.0)3 (2.2)2 (4.7)21 (11.5)3 (10.7)
Erythema2 (6.3)11 (8.1)1 (2.3)0 (0.0)3 (2.2)3 (7.0)14 (7.7)2 (7.1)
Pruritus1 (3.1)9 (6.7)1 (2.3)3 (9.4)6 (4.4)2 (4.7)14 (7.7)3 (10.7)
Thermal elevation9 (28.1)19 (14.1)2 (4.7)1 (3.1)16 (11.9)2 (4.7)81 (44.5)6 (21.4)
Diarrhea2 (6.3)2 (1.5)0 (0.0)0 (0.0)2 (1.5)0 (0.0)12 (6.6)2 (7.1)
Nausea2 (6.3)2 (1.5)0 (0.0)1 (3.1)5 (3.7)0 (0.0)15 (8.2)0 (0.0)
Vomiting1 (3.1)0 (0.0)0 (0.0)0 (0.0)1 (0.7)0 (0.0)2 (1.1)0 (0.0)
Myalgia14 (43.8)29 (21.5)2 (4.7)7 (21.9)26 (19.3)3 (7.0)90 (49.5)7 (25.0)
Arthralgia12 (37.5)17 (12.6)0 (0.0)5 (15.6)11 (8.1)1 (2.3)61 (33.5)4 (14.3)
Headache12 (37.5)24 (17.8)7 (16.3)5 (15.6)22 (16.3)3 (7.0)77 (42.3)7 (25.0)
Other types of adverse events5 (15.6)16 (11.9)0 (0.0)2 (6.3)5 (3.7)0 (0.0)20 (11.0)3 (10.7)

References

  1. WHO. WHO Coronavirus (COVID-19) Dashboard|WHO Coronavirus (COVID-19) Dashboard with Vaccination Data. Available online: https://covid19.who.int/ (accessed on 20 April 2022).
  2. Ministerio de Salud Pública. Situación Epidemiológica Nacional COVID-19, Ecuador. 2022. Available online: https://www.salud.gob.ec/wp-content/uploads/2022/01/10.1.2022-epi.pdf (accessed on 28 July 2022).
  3. COE Provincial de Pichincha. Situación Cantonal por COVID-19. Distrito Metropolitano de Quito. 2021. Available online: https://coe-pichincha.senescyt.gob.ec/situacion-cantones-pichincha/ (accessed on 28 July 2022).
  4. Valeria Heredia. 8 000 Vacunas Contra el Covid-19 Llegaron a Ecuador este 20 de enero. El Comercio. 2021. Available online: https://www.elcomercio.com/tendencias/sociedad/vacunas-covid19-llegaron-ecuador-quito.html (accessed on 2 February 2023).
  5. Ministrio de Salud Pública. Plan Nacional de Vacunación Contra la COVID-19. Plan 9/100. 2021. Available online: https://www.salud.gob.ec/wp-content/uploads/2022/04/Plan-Nacional-de-Vacunacion-plan-9-100.pdf (accessed on 3 February 2023).
  6. Ministerio de Salud Pública. Inicia Fase 2 del Plan de Vacunación 9/100 en Ecuador. 2021. Available online: https://www.salud.gob.ec/inicia-fase-2-del-plan-de-vacunacion-9-100-en-ecuador/ (accessed on 3 February 2023).
  7. PRIMICIAS. Ecuador Alcanza la Meta de Vacunar a Nueve Millones de Personas en 100 Días. 2021. Available online: https://www.primicias.ec/noticias/sociedad/ecuador-nueve-millones-vacunas-covid/ (accessed on 3 February 2023).
  8. Ministerio de Salud Pública. Mañana Inicia Vacunación de Refuerzo a Personas Mayores de 18 años Que Cumplieron Seis Meses de Aplicada la Segunda Dosis—Ministerio de Salud Pública. 2021. Available online: https://www.salud.gob.ec/mspmanana-inicia-vacunacion-de-refuerzo-a-personas-mayores-de-18-anos-que-cumplieron-seis-meses-de-aplicada-la-segunda-dosis/ (accessed on 3 February 2023).
  9. WHO. The World Health Report. 2006: Working Together for Health; World Health Organization: Geneva, Switzerland, 2006.
  10. Bandyopadhyay, S.; Baticulon, R.E.; Kadhum, M.; Alser, M.; Ojuka, D.K.; Badereddin, Y.; Kamath, A.; Parepalli, S.A.; Brown, G.; Iharchane, S.; et al. Infection and mortality of healthcare workers worldwide from COVID-19: A systematic review. BMJ Glob. Health 2020, 5, 3097. [Google Scholar] [CrossRef] [PubMed]
  11. La Federación Médica Reporta Decesos de Profesionales de la Salud por Ómicron. Ecuavisa. 2022. Available online: https://www.ecuavisa.com/noticias/ecuador/la-federacion-medica-reporta-decesos-de-profesionales-de-la-salud-por-omicron-DJ1281757 (accessed on 28 July 2022).
  12. WHO. Access and Allocation: How Will There Be Fair and Equitable Allocation of Limited Supplies? 2021. Available online: https://www.who.int/news-room/feature-stories/detail/access-and-allocation-how-will-there-be-fair-and-equitable-allocation-of-limited-supplies (accessed on 26 July 2022).
  13. Wang, P.; Nair, M.S.; Liu, L.; Iketani, S.; Luo, Y.; Guo, Y.; Wang, M.; Yu, J.; Zhang, B.; Kwong, P.D.; et al. Antibody resistance of SARS-CoV-2 variants B.1.351 and B.1.1.7. Nature 2021, 593, 130–135. [Google Scholar] [CrossRef] [PubMed]
  14. Wall, E.C.; Wu, M.; Harvey, R.; Kelly, G.; Warchal, S.; Sawyer, C.; Daniels, R.; Hobson, P.; Hatipoglu, E.; Ngai, Y.; et al. Neutralising antibody activity against SARS-CoV-2 VOCs B.1.617.2 and B.1.351 by BNT162b2 vaccination. Lancet 2021, 397, 2331–2333. [Google Scholar] [CrossRef] [PubMed]
  15. Khoury, D.S.; Cromer, D.; Reynaldi, A.; Schlub, T.E.; Wheatley, A.K.; Juno, J.A.; Subbarao, K.; Kent, S.J.; Triccas, J.A.; Davenport, M.P. Neutralizing antibody levels are highly predictive of immune protection from symptomatic SARS-CoV-2 infection. Nat. Med. 2021, 27, 1205–1211. [Google Scholar] [CrossRef] [PubMed]
  16. Ministerio de Salud Pública. Vacunómetro COVID-19. 2022. Available online: https://app.powerbi.com/view?r=eyJrIjoiYTkzNTFkMmUtZmUzNi00NDcwLTg0MDEtNjFkNzhhZTg5ZWYyIiwidCI6IjcwNjIyMGRiLTliMjktNGU5MS1hODI1LTI1NmIwNmQyNjlmMyJ9&pageName=ReportSection (accessed on 26 July 2022).
  17. CDC. Selected Adverse Events Reported after COVID-19 Vaccination|CDC. Vaccines. 2022. Available online: https://www.cdc.gov/coronavirus/2019-ncov/vaccines/safety/adverse-events.html (accessed on 21 April 2022).
  18. Nohl, A.; Brune, B.; Weichert, V.; Standl, F.; Stang, A.; Dudda, M. COVID-19: Vaccination Side Effects and Sick Leave in Frontline Healthcare-Workers-A Web-Based Survey in Germany. 2022. Available online: https://www.mdpi.com/2076-393X/10/3/411 (accessed on 21 April 2022).
  19. Kitro, A.; Sirikul, W.; Thongkum, W.; Soponpong, S.; Yasamut, U.; Kiratipaisarl, W.; Kosai, A.; Kasinrerk, W.; Tayapiwatana, C.; Srithanaviboonchai, K. Dynamic of Anti-Spike Receptor Binding Domain (RBD) Levels and Short-Term Adverse Events Following a Heterologous Booster Dose of BNT162b2 after Two Doses of CoronaVac in Thai Health Care Workers. Available online: https://www.sciencedirect.com/science/article/pii/S0264410X22004388?via%3Dihub (accessed on 21 April 2022).
  20. Hillus, D.; Schwarz, T.; Tober-Lau, P.; Vanshylla, K.; Hastor, H.; Thibeault, C.; Jentzsch, S.; Helbig, E.T.; Lippert, L.J.; Tscheak, P.; et al. Safety, reactogenicity, and immunogenicity of homologous and heterologous prime-boost immunisation with ChAdOx1 nCoV-19 and BNT162b2: A prospective cohort study. Lancet Respir. Med. 2021, 9, 1255–1265. [Google Scholar] [CrossRef] [PubMed]
  21. Akbulut, S.; Gokce, A.; Boz, G.; Saritas, H.; Unsal, S.; Ozer, A.; Akbulut, M.S.; Colak, C. Evaluation of Vaccine Hesitancy and Anxiety Levels among Hospital Cleaning Staff and Caregivers during COVID-19 Pandemic. Vaccines 2022, 10, 1426. [Google Scholar] [CrossRef] [PubMed]
  22. von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. J. Clin. Epidemiol. 2008, 61, 344–349. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Helsinki Statement. WMA Declaration of Helsinki—Ethical Principles for Medical Research Involving Human Subjects. 64th WMA General Assembly. Fortaleza, Brazil. 2013. Available online: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/ (accessed on 15 December 2022).
  24. Food and Drug Administration. Toxicity Grading Scale for Healthy Adult and Adolescent Volunteers Enrolled in Preventive Vaccine Clinical Trials|FDA. Center for Biologics Evaluation and Research, Editor. 2007; pp. 1–10. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/toxicity-grading-scale-healthy-adult-and-adolescent-volunteers-enrolled-preventive-vaccine-clinical (accessed on 19 April 2022).
  25. Organización Panamericana de la Salud. Introducción de la Vacuna Contra la COVID-19: Orientaciones Para Determinar los Grupos Prioritarios y Elaborar la Micro-planificación. 2021. Report No.: 1. Available online: https://www.campusvirtualsp.org/es (accessed on 27 December 2022).
  26. Naito, T.; Tsuchida, N.; Kusunoki, S.; Kaneko, Y.; Tobita, M.; Hori, S.; Ito, S. Reactogenicity and immunogenicity of BNT162b2 or mRNA-1273 COVID-19 booster vaccinations after two doses of BNT162b2 among healthcare workers in Japan: A prospective observational study. Expert Rev. Vaccines 2022, 21, 1319–1329. [Google Scholar] [CrossRef] [PubMed]
  27. Chen, P.-Y.; Wu, B.-J.; Su, M.-C.; Lin, Y.-H.; Chiang, S.-C.; Wu, J.-C.; Chen, T.-J.; Chen, Y.-C. Risk Factors and Incidence Rates of Self-Reported Short-Term Adverse Events of COVID-19 Vaccine Booster Dose. Vaccines 2022, 10, 1115. [Google Scholar] [CrossRef] [PubMed]
  28. Warkentin, L.; Zeschick, N.; Kühlein, T.; Steininger, P.; Überla, K.; Kaiser, I.; Gall, C.; Sebastião, M.; Hueber, S. Reactogenicity after Heterologous and homologous COVID-19 Prime-Boost Vaccination Regimens: Descriptive Interim Results of a Comparative Observational Cohort Study. 2021. Available online: https://bmcinfectdis.biomedcentral.com/articles/10.1186/s12879-022-07443-x (accessed on 5 February 2023).
  29. Bonelli, M.; Mrak, D.; Tobudic, S.; Sieghart, D.; Koblischke, M.; Mandl, P.; Kornek, B.; Simader, E.; Radner, H.; Perkmann, T.; et al. Additional heterologous versus homologous booster vaccination in immunosuppressed patients without SARS-CoV-2 antibody seroconversion after primary mRNA vaccination: A randomised controlled trial. Ann. Rheum. Dis. 2022, 81, 687–694. [Google Scholar] [CrossRef] [PubMed]
  30. Nachtigall, I.; Bonsignore, M.; Hohenstein, S.; Bollmann, A.; Günther, R.; Kodde, C.; Englisch, M.; Ahmad-Nejad, P.; Schröder, A.; Glenz, C.; et al. Effect of gender, age and vaccine on reactogenicity and incapacity to work after COVID-19 vaccination: A survey among health care workers. BMC Infect. Dis. 2022, 22, 1–13. [Google Scholar] [CrossRef] [PubMed]
  31. Cohen, G.; Jungsomsri, P.; Sangwongwanich, J.; Tawinprai, K.; Siripongboonsitti, T.; Porntharukchareon, T.; Wittayasak, K.; Thonwirak, N.; Soonklang, K.; Sornsamdang, G.; et al. Immunogenicity and reactogenicity after heterologous prime-boost vaccination with CoronaVac and ChAdox1 nCov-19 (AZD1222) vaccines. Hum. Vaccines Immunother. 2022, 18, 2052525. [Google Scholar] [CrossRef] [PubMed]
  32. Alqahtani, S.; Jokhdar, H.; Al-Tawfiq, J.A.; Al-Otaibi, S.; Assiri, A.; Almudarra, S.; Alabdulkareem, K.; Haji, A. Adverse events following administration of COVID-19 vaccines in Saudi Arabia. Sci. Rep. 2022, 12, 19551. [Google Scholar] [CrossRef] [PubMed]
  33. Montano, D. Frequency and Associations of Adverse Reactions of COVID-19 Vaccines Reported to Pharmacovigilance Systems in the European Union and the United States. Front. Public Health 2022, 9, 2237. [Google Scholar] [CrossRef] [PubMed]
  34. Kouhpayeh, H.; Ansari, H. Adverse events following COVID-19 vaccination: A systematic review and meta-analysis. Int. Immunopharmacol. 2022, 109, 108906. [Google Scholar] [CrossRef] [PubMed]
  35. Villalpando, J.M.G.; Tapia, S.D.J.R.; Flores, G.D.C.B.; Castillo, J.L.B.; Rojop, I.E.J.; Junco, F.I.L.; Hernández, V.O.; Gomez, S.Q.; Quiñones, J.A.R.; Priego, C.G.G. Prevalence and Risk Factors of Adverse Effects and Allergic Reactions after COVID-19 Vaccines in a Mexican Population: An Analytical Cross-Sectional Study. 2022. Available online: https://www.mdpi.com/2076-393X/10/12/2012 (accessed on 5 February 2023).
Figure 1. Summary of participants. IC: Informed consent.
Figure 1. Summary of participants. IC: Informed consent.
Vaccines 11 00676 g001
Table 1. Sociodemographic characteristics and vaccine that was administered to the participants.
Table 1. Sociodemographic characteristics and vaccine that was administered to the participants.
n (%)
General210 (100.0)
SexFemale138 (65.7)
Male72 (34.3)
Age (Years)Under 30 years of age88 (41.9)
30 to 39 years old70 (33.3)
40 to 49 years old25 (11.9)
50 to 59 years old15 (7.1)
Over 60 years old12 (5.7)
VaccineTotal630 (100.0)
Pfizer/BioNTech-Comirnaty298 (47.3)
Oxford/AstraZeneca-Vaxzevria246 (39.0)
Sinovac-CoronaVac86 (13.7)
Table 2. Descriptive characteristics of adverse events, medication, and relationship with daily activities.
Table 2. Descriptive characteristics of adverse events, medication, and relationship with daily activities.
Total
n (%)
First Dose
n (%)
Second Dose n (%)Third Dose
n (%)
p-Value (*)
General630 (100.0)210 (33.3)210 (33.3)210 (33.4)
Adverse Events394 (62.5)126 (60.0)110 (52.4)158 (75.2)<0.001
Pain312 (49.5)107 (51.0)91 (43.3)114 (54.3)0.071
Myalgia178 (28.3)45 (21.4)36 (17.1)97 (46.2)<0.001
Headache157 (24.9)43 (20.5)30 (14.3)84 (40.0)<0.001
Thermal elevation136 (21.6)30 (14.3)19 (9.0)87 (41.4)<0.001
Arthralgia111 (17.6)29 (13.8)17 (8.1)65 (31.0)<0.001
Edema40 (6.3)11 (5.2)5 (2.4)24 (11.4)0.001
Pruritus39 (6.2)11 (5.2)11 (5.2)17 (8.1)0.374
Erythema36 (5.7)14 (6.7)6 (2.9)16 (7.6)0.084
Other types of adverse events100 (15.9)30 (3.6)16 (7.3)54 (25.8)0.008
Use of medication305 (48.4)93 (44.3)78 (37.1)134 (63.8)<0.001
1 drug243 (79.7)84 (90.3)68 (87.2)91 (67.9)-
2 drugs54 (17.7)6 (6.5)8 (10.3)40 (29.9)-
3 or more drugs8 (2.6)3 (3.2)2 (2.6)3 (2.2)-
Daily Activities394 (100.0)126 (100.0)110 (100.0)158 (100.0)-
Do not interfere with your daily activities and no treatment is administered158 (40.1)64 (50.8)56 (50.9)38 (24.1)-
Interferes with daily activities and/or required pharmacological treatment.176 (44.7)55 (43.7)46 (41.8)75 (47.5)-
Impedes the performance of daily activities and required treatment57 (14.5)7 (5.6)8 (7.3)42 (26.6)-
Was hospitalized3 (0.8)0 (0.0)0 (0.0)86 (1.9)-
*: Chi-square test.
Table 3. Descriptive characteristics of adverse events, medication, and relationship to daily activities in relation to the vaccine.
Table 3. Descriptive characteristics of adverse events, medication, and relationship to daily activities in relation to the vaccine.
Oxford/AstraZeneca-Vaxzevria
n (%)
Pfizer/BioNTech-Comirnaty
n (%)
Sinovac-CoronaVac
n (%)
p-Value (*)
General246 (100.0)298 (100.0)86 (100.0)
Adverse Events184 (74.8)176 (59.1)34 (39.5)<0.001
Pain129 (52.4)152 (51.0)31 (36.0)0.025
Myalgia111 (45.1)62 (20.8)5 (5.8)<0.001
Headache94 (38.2)53 (17.8)10 (11.6)<0.001
Thermal elevation91 (37.0)41 (13.8)4 (4.7)<0.001
Arthralgia78 (31.7)32 (10.7)1 (1.2)<0.001
Edema23 (9.30)13 (4.4)4 (4.7)0.047
Pruritus18 (7.3)18 (6.0)3 (3.5)0.443
Erythema16 (6.5)16 (5.4)4 (4.7)0.767
Other types of adverse events62 (22.3)38 (12.7)0 (0.0)0.006
Use of medication155 (63.0)126 (42.3)24 (27.9)<0.001
1 drug111 (71.6)110 (87.3)22 (91.7)-
2 drugs40 (25.8)12 (9.5)2 (8.3)-
3 or more drugs4 (2.6)4 (3.2)0 (0.0)-
Daily Activities184 (100.0)176 (100.0)34 (100.0)-
Do not interfere with your daily activities and no treatment is administered54 (77.0)79 (44.9)25 (73.5)-
Interferes with daily activities and/or required pharmacological treatment.88 (79.0)79 (44.9)9 (26.5)-
Impedes the performance of daily activities and required treatment39 (18.0)18 (10.2)0 (0.0)-
Was hospitalized3 (1.6)0 (0.0)0 (0.0)-
*: chi-square test.
Table 4. Adverse events after vaccination medication, and relationship to daily activities: heterologous vs. homologous.
Table 4. Adverse events after vaccination medication, and relationship to daily activities: heterologous vs. homologous.
Heterologous
n (%)
Homologous
n (%)
p-Value (*)
General171 (100.0)39 (100.0)
Adverse Events137 (80.1)21 (53.8)<0.001
Pain97 (56.7)17 (43.6)0.156
Myalgia89 (52.0)8 (20.5)<0.001
Thermal elevation80 (46.8)7 (17.9)0.001
Headache78 (45.6)6 (15.4)<0.001
Arthralgia61 (35.7)4 (10.3)0.002
Edema23 (13.5)1 (2.6)0.055
Pruritus15 (8.80)2 (5.1)0.745
Erythema14 (8.20)2 (5.1)0.742
Other types of adverse events51 (29.9)3 (7.7)<0.001
Use of medication120 (70.2)14 (35.9)<0.001
1 drug82 (68.3)9 (64.3)-
2 drugs35 (29.2)5 (35.7)-
3 or more drugs3 (2.5)0 (0.0)-
Daily Activities137 (100.0)21 (100.0)-
Do not interfere with your daily activities and no treatment is administered28 (20.4)10 (47.6)-
Interferes with daily activities and/or required pharmacological treatment.68 (49.6)7 (33.3)-
Impedes the performance of daily activities and required treatment38 (27.7)4 (19.0)-
Was hospitalized3 (2.2)0 (0.0)-
*: chi-square test.
Table 5. Factors related to the development of adverse events.
Table 5. Factors related to the development of adverse events.
Total
(n/%)
Adverse Event No
(n/%)
Adverse Event Yes
(n/%)
p Value (*)OR (CI 95%)
Overall630 (100.0)236 (37.5)394 (62.5)--
Sex
Female414 (65.7)136 (57.6)278 (70.6)0.0011.76 (1.25–2.46)
Male (+)216 (34.3)100 (42.4)116 (29.4)
Age
Over or equal 32 years old522 (82.9)193 (81.8)329 (83.5)0.5791.12 (0.73–1.72)
Under to 32 years of age (+)108 (17.1)43 (18.2)65 (16.5)
Doses administered (+)
First Dose Yes210 (33.3)84 (35.6)126 (32.0)0.3530.85 (0.60–1.19)
No (+)420 (66.7)152 (64.4)268 (68.0)
Second DoseYes210 (33.3)100 (42.4)110 (27.9)<0.0010.52 (0.37–0.74)
No (+)420 (66.7)136 (57.6)284 (72.1)
Third DoseYes210 (33.3)52 (22.0)158 (40.1)<0.0012.36 (1.64–3.42)
No (+)420 (66.7)184 (78.0)236 (59.9)
Vaccine
Pfizer/BioNTech-ComirnatyYes298 (47.3)122 (51.7)176 (44.7)0.0870.75 (0.55–1.04)
No (+)332 (52.7)114 (48.3)218 (55.3)
Oxford/AstraZeneca-VaxzevriaYes246 (39.0)62 (26.3)184 (46.7)<0.0012.45 (1.73–3.49)
No (+)384 (61.0)174 (73.7)210 (53.3)
Sinovac-CoronaVacYes86 (13.7)52 (22.0)34 (8.6)<0.0010.33 (0.20–0.53)
No (+)544 (86.3)184 (78.0)360 (91.4)
Group Vaccine
Heterologous171 (81.4)51 (29.8)120 (70.2)<0.0014.20 (2.02–8.73)
Homologous (+)39 (18.6)25 (64.1)14 (35.9)
CI: Confidence interval; OR: Odds Ratio. *: Chi-square test; +: Reference variable; dependent variable: Development of any adverse event; Independent variables: Sex, Age, Number of doses, Vaccine and group Vaccine.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Flores-Lastra, N.; Rivadeneira-Dueñas, J.; Fuenmayor-González, L.; Guayasamín-Tipanta, G.; Jácome-García, M.; Otzen, T.; Manterola, C. Safety Profile of Homologous and Heterologous Booster COVID-19 Vaccines in Physicians in Quito-Ecuador: A Cross-Sectional Study. Vaccines 2023, 11, 676. https://doi.org/10.3390/vaccines11030676

AMA Style

Flores-Lastra N, Rivadeneira-Dueñas J, Fuenmayor-González L, Guayasamín-Tipanta G, Jácome-García M, Otzen T, Manterola C. Safety Profile of Homologous and Heterologous Booster COVID-19 Vaccines in Physicians in Quito-Ecuador: A Cross-Sectional Study. Vaccines. 2023; 11(3):676. https://doi.org/10.3390/vaccines11030676

Chicago/Turabian Style

Flores-Lastra, Nancy, Josue Rivadeneira-Dueñas, Luis Fuenmayor-González, Glenda Guayasamín-Tipanta, Michelle Jácome-García, Tamara Otzen, and Carlos Manterola. 2023. "Safety Profile of Homologous and Heterologous Booster COVID-19 Vaccines in Physicians in Quito-Ecuador: A Cross-Sectional Study" Vaccines 11, no. 3: 676. https://doi.org/10.3390/vaccines11030676

APA Style

Flores-Lastra, N., Rivadeneira-Dueñas, J., Fuenmayor-González, L., Guayasamín-Tipanta, G., Jácome-García, M., Otzen, T., & Manterola, C. (2023). Safety Profile of Homologous and Heterologous Booster COVID-19 Vaccines in Physicians in Quito-Ecuador: A Cross-Sectional Study. Vaccines, 11(3), 676. https://doi.org/10.3390/vaccines11030676

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop