Next Article in Journal
Reactogenicity Correlates Only Weakly with Humoral Immunogenicity after COVID-19 Vaccination with BNT162b2 mRNA (Comirnaty®)
Next Article in Special Issue
Potential Adjuvant Therapeutic Effect of Lactobacillus plantarum Probio-88 Postbiotics against SARS-COV-2
Previous Article in Journal
Functional NK Cell Activation by Ovalbumin Immunization with a Monophosphoryl Lipid A and Poly I:C Combination Adjuvant Promoted Dendritic Cell Maturation
Previous Article in Special Issue
Cost–Benefit Analysis of a Mass Vaccination Strategy to Control Brucellosis in Sheep and Goats in Northern Iraq
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cost-Effectiveness of Three Poliovirus Immunization Schedules in Shanghai, China

1
Shanghai Municipal Center for Disease Control and Prevention, Institute of Immunization, Shanghai 200336, China
2
Ministry of Education Key Laboratory of Public Health Safety, Department of Epidemiology, School of Public Health, Fudan University, Shanghai 200032, China
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(10), 1062; https://doi.org/10.3390/vaccines9101062
Submission received: 24 August 2021 / Revised: 18 September 2021 / Accepted: 19 September 2021 / Published: 23 September 2021

Abstract

:
In Shanghai, China, a polio immunization schedule of four inactivated polio vaccines (IPV) has been implemented since 2020, replacing the schedules of a combination of two IPVs and two bivalent live attenuated oral polio vaccines (bOPV), and four trivalent live attenuated oral polio vaccines (tOPV). This study aimed to assess the cost-effectiveness of these three schedules in infants born in 2016, in preventing vaccine-associated paralytic poliomyelitis (VAPP). We performed a decision tree model and estimated incremental cost-effectiveness ratio (ICER). Compared to the four-tOPV schedule, the two-IPV-two-bOPV schedule averted 1.2 VAPP cases and 16.83 disability-adjusted life years (DALY) annually; while the four-IPV schedule averted 1.35 VAPP cases and 18.96 DALY annually. Consequently, ICERVAPP and ICERDALY were substantially high for two-IPV-two-bOPV (CNY 12.96 million and 0.93 million), and four-IPV (CNY 21.24 million and 1.52 million). Moreover, net monetary benefit of the two-IPV-two-bOPV and four-IPV schedules was highest when the cost of IPV was hypothesized to be less than CNY 23.75 or CNY 9.11, respectively, and willingness-to-pay was hypothesized as CNY 0.6 million in averting one VAPP-induced DALY. IPV-containing schedules are currently cost-ineffective in Shanghai. They may be cost-effective by reducing the prices of IPV, which may accelerate polio eradication in Chinese settings.

1. Introduction

Poliomyelitis is an acute intestinal infection caused by poliovirus (PV), which may result in lifelong disability in children. Large-scale global use of the polio vaccine has dramatically reduced 99% of polio incidence [1,2]. The latest local poliomyelitis case of wild poliovirus (WPV) was notified in 1987 in Shanghai, and the latest indigenous case was reported in 1994 in China [3,4]. In 2000, China was certified as free of polio [2,5]. After containing the imported cases and subsequent epidemic of poliomyelitis in northwestern China in 2011, China was affirmed as having polio-free status in 2012 [2,3]. Currently, high polio vaccination coverage and continual surveillance of acute flaccid paralysis (AFP) cases are maintained in China [2]. However, China remains at risk of WPV due to bordering on polio-endemic countries, namely, Pakistan and Afghanistan [2,6].
The use of live attenuated oral polio vaccine (OPV) in China since 1965 has resulted in a significant decrease in the incidence of poliomyelitis [7]. However, OPV may cause vaccine-associated paralytic poliomyelitis (VAPP) in rare cases, and its clinical symptoms are difficult to distinguish from those caused by WPV [8]. The incidence of VAPP cases in Shanghai was 3.01 cases per million for the first dose of OPV in 1980–1998 [4]. In addition, mutation in the vaccine strain virus of OPV may induce vaccine-derived poliovirus cases (VDPVs), due to long-term circulation in humans or the environment [8]. In 2016, the World Health Organization (WHO) recommended a global switch in immunization strategy from trivalent OPV (tOPV) (containing serotype 1, 2 and 3) to the bivalent version (bOPV) (containing serotype 1 and 3) in the national immunization program, and inclusion of at least one dose of inactivated poliovirus vaccine (IPV) in routine immunization schedules [1]. China subsequently implemented the combined immunization schedule of one IPV and three bOPVs that year [3]. In the same year, Shanghai was the first provincial administrative region to adopt the schedule of two IPVs and two bOPVs in China [9,10]. Furthermore, Shanghai has adopted a four-IPV schedule since October 2020 [11].
However, the economic benefits of IPV-containing immunization schedules remained unclear, which might delay its expanding implementation worldwide. Findings from the health economics evaluation of replacing OPV with IPV varied widely, such as incremental cost-effectiveness ratio (ICER) for preventing one VAPP case ranging between USD 0.74 and 80.0 million and ICER for averting one corresponding disability-adjusted life year (DALY) caused by VAPP ranging between USD 0.009 and 5.6 million [12,13,14,15,16,17,18,19,20]. In addition, IPV inclusion in the immunization schedule remains cost-ineffective, though it differed extensively across the studies [17,18,21,22,23,24,25]. This study is aimed to determine and compare the cost-effectiveness and cost-benefit of averting VAPP by three polio immunization schedules in Shanghai, which would provide convincing evidence to further switch polio immunization strategy in China.

2. Materials and Methods

We simulated the utilization of three polio immunization schedules, including four-tOPV (vaccinated at 2, 3, and 4 months, and 4 years of age), two-IPV-two-bOPV (2, 3, and 4 months, and 4 years of age), and four-IPV (2, 3, 4, and 18 months of age), in a birth cohort of 2016 in Shanghai. The two-IPV-two-bOPV schedule replaced the traditional four-tOPV schedule in May 2016; furthermore, the four-IPV schedule has replaced the two-IPV-two-bOPV schedule since October 2020. Thus, during this study, the four-IPV schedule is the single polio immunization program implemented in Shanghai. A decision tree model was designed to estimate total cost of immunization, averted VAPP cases and DALYs, and then calculate corresponding ICER, for three polio immunization schedules in a cost-effectiveness analysis. Moreover, we hypothesized a willingness to pay (WTP) and determined net monetary benefit (NMB) for three immunization schedules, in a cost-benefit analysis. This study used routinely collected data from literature and the Shanghai Municipal Center for Disease Control and Prevention (SCDC) and involved no personal data, so it is exempted from ethical approval.

2.1. Definitions of AFP and VAPP

AFP cases were those who presented with symptoms of acute flaccid paralysis at less than 15 years of age or with a clinical diagnosis of polio at any age [26]. VAPP cases were described elsewhere [27]. Furthermore, VAPP cases were classified into recipient VAPP and contact VAPP according to OPV immunization history [28]. A recipient VAPP was defined as a case with fever occurring 4–35 days after vaccination, AFP occurring 6–40 days after vaccination, and a definite clinical diagnosis. A contact VAPP was a case having close contact with OPV-immunized persons within 35 days after vaccination and developed AFP 6–60 days after exposure, or with no OPV immunization 40 days prior to onset of paralysis and a definite clinical diagnosis. Both recipient and contact VAPP are confirmed by isolation of vaccine-related poliovirus from feces, pharynx, cerebrospinal fluid, brain, or spinal cord with very limited nucleotide mutations within VP1 sequence, compared to the Sabin strain [26].

2.2. Construction of a Decision Tree Model

A cohort of 218,400 infants born and routinely immunized between 1 January and 31 December 2016, in Shanghai, was used as a birth cohort in this study [29]. A decision tree model was constructed by using TreeAge Pro 2011 (TreeAge Software Inc., Williamstown, MA, USA). In the model, we hypothesized two states, being healthy and diagnosed as VAPP, for the vaccinated children. In addition, the model had the following hypotheses: (1) 100% coverage of polio immunization, (2) no self-paid polio-containing vaccines, (3) no occurrence of VAPP after four-IPV immunization in the study population; and (4) cost of cold-chain services, human resources, and administration (including training on the implementation of new immunization schedules, supervision, and social mobilization) remain identical across three polio immunization schedules (Figure 1).
Subsequently, total annual cost and corresponding sums of life years (LY) were estimated based on the probability of being healthy and VAPP in the context of different polio immunization schedules. Two IPV-containing schedules were compared to the four-tOPV schedule, in terms of additional cost per VAPP case prevented and corresponding ICER. In addition, univariate sensitivity analysis was performed for key variables in the model, using Tornado plot as described elsewhere [30,31,32].

2.3. Measurement of Cost

In this study, the cost was defined as being associated with the implementation of different polio immunization schedules, including procurement of vaccines, storage of vaccines, and compensation for VAPP cases.

2.3.1. Procurement of Vaccines

First, polio vaccine, as an Expanded Programme on Immunization (EPI) vaccine, is purchased by SCDC. In this study, four categories of polio vaccines were involved, which had government procurement prices in 2016 as Chinese Yuan (CNY) 9.7/vial (for 10-dose) for tOPV, CNY 27.2/vial (for 10-dose) for bOPV, CNY 35/vial (for 1-dose) for Sabin IPV (sIPV), and CNY 39/vial (for 1-dose) for wild-type IPV (wIPV).
Second, we included two categories of IPV (sIPV and wIPV) to meet the demands of the IPV-containing immunization schedule in this study, as there were only two vaccine manufacturers in China that could supply IPV in 2016 and their production capacities were limited. SCDC has previously procured sIPV and wIPV at a ratio of 2:1–1:1, the baseline value was determined at 2:1.
Third, tOPV and bOPV are multi-dose vial vaccines, which may induce loss of doses in use. According to the Practical Regulations for Vaccination in Shanghai (2017 edition) [33] and SCDC data [34], the baseline coefficient of loss for OPV was determined to be 1.8 (range, 1.8–2.5), and that of IPV was 1 (range, 1–1.05) in this study.
Therefore, we calculated the cost per OPV dose = procurement price per OPV dose × coefficient of loss. Moreover, cost per IPV dose = procurement price per sIPV dose × procurement ratio of sIPV and wIPV/(procurement ratio of sIPV and wIPV + 1) + procurement price per wIPV dose × 1/(procurement ratio of sIPV and wIPV + 1) × coefficient of loss.

2.3.2. Storage of Vaccines

OPV and IPV have different requirements of storage, which are attributable to the cold-chain equipment, including −20 °C for OPV (low-temperature refrigerator) and 2–8 °C for IPV (ordinary medical refrigerator). We defined that cost of low-temperature refrigerator = procurement price × number of vaccination clinics/years of depreciation. The depreciation rate of cold-chain equipment is 8–10 years, and the procurement price of a low-temperature refrigerator is about CNY 10,000–20,000 (baseline value was CNY 15,000). It was hypothesized that one low-temperature refrigerator is required for each community vaccination clinic (n = 265 in Shanghai Municipality).

2.3.3. Compensation for VAPP Cases

Financial compensation for VAPP by Shanghai Municipal Government and its standards were specified in the Shanghai Compensation Measures for Vaccination Related Adverse Events (trial edition) in 2015 [35]. The amount of compensation would not exceed the maximum standards in each damage level. A total of five recipient VAPP cases due to tOPV vaccination in 2011–2014 were compensated, whereas one contact VAPP did not. Of them, 4 cases had damage levels of Grade II D and 1 case had Grade II B. With the cost of humanitarian compensation excluded, possible compensation for recipient VAPP cases in 2016 was calculated based on the maximum standards of compensation for Grade II D and Grade II B, which were CNY 748,005 and CNY 997,340, respectively. Considering that VAPP cases of Grade II D were predominant (80%), the baseline value of compensation for VAPP was set as CNY 748,005 in this study. Furthermore, a Chinese study in 2014 reported economic burden for VAPP cases with a disabling illness was CNY 1.18 million [21], which was discounted to compensation for VAPP cases in 2016 with a discount rate of 3%.

2.3.4. Total Cost

Total cost was the sum of the above three parts, as cost of cold-chain services, human resources, and administration were hypothesized to be identical across the three polio immunization schedules. A formula was designed as follows:
Total cost of polio immunization = CV × D × A + CM + Bi × A × E,
where, A, number of births; Bi, compensation for one VAPP case by implementing different immunization schedules; CM, maintenance of low-temperature refrigerators; CV, procurement of vaccines; D, administered doses; and E, the incidence of VAPP cases.

2.4. Measurement of Effectiveness

In this study, we presented number of VAPP cases prevented and related DALY averted as effectiveness.

2.4.1. Incidence of VAPP Cases

The incidence of VAPP cases in the context of three polio immunization schedules was estimated based on the combination of local VAPP cases notified in Shanghai and literature review (Appendix A). We have a hypothesis that there would be no VAPP case in the context of the four-IPV immunization schedule.

2.4.2. DALY Caused by VAPP Cases

It has previously been documented that there were 13 DALYs lost per VAPP case in low-income countries, while 14 DALYs in lower-middle, upper-middle, and high-income countries [12,14]. China has been classified as an upper-middle-income country [36], so baseline value was determined to be 14 DALYs per VAPP case (range, 13–14) in the model. In addition, according to the Shanghai Statistical Yearbook 2017 [29], life expectancy of local residents in Shanghai was 83.18 years in 2016.

2.5. Measurement of ICER

ICER is the ratio of incremental cost to incremental effectiveness [37]. In this study, incremental cost was the difference in the cost, and incremental effectiveness was the difference in preventing VAPP and averting DALYs, between IPV-containing schedules and the four-tOPV schedule. Low ICER means low incremental cost of preventing VAPP, using IPV-containing schedules compared to the four-tOPV schedule, which may have larger public health significance in polio immunization strategy.
Moreover, vaccines with an ICER ≤ 3 times of gross domestic product (GDP) are classified as cost-effective, while those with an ICER > 3 times that of GDP are cost-ineffective by the WHO guidelines [38]. The per capita GDP in Shanghai was CNY 116,562 in 2016.

2.6. Determination of WTP

WTP towards averting one VAPP case varied widely across the studies [21,22]. In a retrospective study in 2006, it was approximately USD 890,000 which meant a WTP of USD 64,000 towards averting one DALY caused by VAPP [14]. Considering a 3% discount rate and exchange rate, this was equal to approximately CNY 600,000, which was input into the decision tree model. In addition, we defined that net monetary benefit (NMB) = total benefit – total cost, in which total benefit = effectiveness (sum of LY per year) × bound of ICERLY (that is WTP) and total cost was the total annual cost of different polio immunization schedules. Effect of possible variables on the NMB of the polio immunization schedules was presented in one-way sensitivity analysis net benefits graph, by using TreeAge Pro 2011 (TreeAge Software Inc., Williamstown, MA, USA).

3. Results

3.1. Cost-Effectiveness across Three Polio Immunization Schedules

Parameters as inputs in the decision tree model are presented in Table 1. We estimated the cost of tOPV (CNY 1.75–2.43 per dose), bOPV (CNY 4.90–6.80 per dose), and IPV (CNY 36.33–38.85 per dose). The cost of maintenance for all the low-temperature refrigerators in Shanghai was estimated to be between CNY 265,000 and 662,500 per year for OPV. In addition, compensation cost for VAPP was determined to be CNY 1,250,000 in 2016 with a range of CNY 748,005–1,250,000. Therefore, the total annual cost of polio immunization schedules was calculated to be CNY 2.98 million (four-tOPV), 18.56 million (two-IPV-two-bOPV), and 31.74 million (four-IPV) (Table 2).
Moreover, we estimated the effectiveness. Based on the incidence of VAPP and number of local resident births in 2016 (Table 1), the four-tOPV immunization schedule resulted in 1.35 VAPP cases per year, equivalent to 18.96 DALYs. In contrast, IPV-containing schedules averted corresponding VAPP cases and losses of DALYs, though they had additional costs (Table 2). ICERDALY for the two-IPV-two-bOPV schedule and the four-IPV schedule was CNY 0.93 million and CNY 1.52 million, respectively, suggesting they were cost-ineffective (Table 2, Figure 2).

3.2. Sensitivity Analysis of Cost-Effectiveness

The incidence of VAPP cases with the four-tOPV schedule and the two-IPV-two-bOPV schedule, compensation cost of VAPP cases, and cost of IPV were included in the univariate sensitivity analysis according to the range of values (Table 1) to evaluate the influence of changes in these parameters on ICERLY. The change in the incidence of VAPP cases with four-tOPV had the largest effect on ICERLY, in the context of both the two-IPV-two-bOPV and four-IPV schedules (Figure 3a,b), which was further determined to be a negative association. In addition, ICERLY was associated with cost of IPV (Figure 3a,b) and incidence of VAPP cases with the two-IPV-two-bOPV schedule (Figure 3a), which were both positive associations.

3.3. Cost-Benefit across Three Polio Immunization Schedules

We further determined the effects of WTP towards averting one DALY caused by VAPP on the decision tree model. When IPV cost < CNY 23.75, the two-IPV-two-bOPV schedule had a higher NMB, compared to the four-tOPV schedule; furthermore, when IPV cost < CNY 9.11, the four-IPV schedule had the highest NMB, (Figure 4a). In addition, when the incidence of VAPP cases with the four-tOPV schedule was >8.95 cases per million births, the two-IPV-two-bOPV schedule had a higher NMB, compared to the four-tOPV and the four-IPV schedules (Figure 4b).

4. Discussion

In this study, we found that the two-IPV-two-bOPV and the four-IPV schedules could prevent 1.20–1.35 VAPP cases and avert 16.83–18.96 DALYs per year, compared to the previous four-tOPV schedule in Shanghai, China. Similar studies have been previously reported. In Russia, incidence of VAPP cases was much lower for sequential immunization schedule of OPV and IPV (1 case/4.18 million doses) than that for the OPV schedule (1 case/1.59 million OPV doses) [41]. In the United States, no VAPP occurred for the IPV-containing schedule, compared to the incidence of VAPP being 2.9 cases/1 million OPV doses [42]. However, the two-IPV-two-bOPV and the four-IPV schedules had additional costs. ICER for preventing one VAPP and averting DALY caused by VAPP varied widely [12,13,14,15,16,17,18,19]. In this study, ICERVAPP was between approximately USD 2.01 million and 3.29 million, while ICERDALY was between approximately USD 0.14 million and 0.23 million. In 1996, an American study of children <6 years of age reported an ICERVAPP of USD 3.1 million per VAPP for the two-IPV-two-bOPV schedule and USD 3 million per VAPP for the four-IPV schedule [19]. In contrast, an Australian study in 2001 of children <6 years showed that the ICERVAPP was USD 10 million per VAPP and USD 29 million per VAPP, for these two schedules [18]. In addition, ICERDALY in Columbia was USD 0.071 million per DALY [15]. The disparity in ICERVAPP across countries may be related to the differing cost between IPV and OPV, incidence of VAPP, and compensation cost for VAPP in different countries.
However, the two-IPV-two-bOPV and the four-IPV immunization schedules were cost-ineffective, according to the WHO guidelines [38]. Sensitivity analysis of ICER showed that the incidence of VAPP with the four-tOPV schedule and cost of IPV had a larger impact on ICER (Figure 3). Furthermore, we found that when the cost of IPV decreased to CNY 23.75 or 9.11 per dose or the incidence of VAPP with the four-tOPV schedule exceeded 8.95 cases per million births, IPV-containing schedules had higher benefits, as shown in Figure 4, under a hypothetical WTP of CNY 600,000 in the decision tree. Our findings suggested that lower cost of IPV and higher VAPP incidence may contribute to lower ICER and higher cost-effectiveness. However, ICER varies across countries with different economic status [15,17,18,19,21]. In the upper-middle-income countries, polio immunization schedules save money in addition to preventing disease, which means the expected cost of treatment exceeds the difference in the cost between the schedules. In contrast, in low-income countries, the cost of immunization schedules remains relatively higher and the treatment cost is much lower, which implies a need to pay additional cost to obtain effectiveness [12]. It suggested possible limitations of utilizing ICER in the vaccine evaluation. Fundamental issues for deciding on the introduction of a vaccine may include the disease, the vaccines, and the strength of immunization program and health system [43].
The three polio immunization schedules in this study have both advantages and disadvantages in terms of safety, effectiveness, accessibility, and cost of administration [14,19]. In order to achieve the goal of polio eradication, VAPP and VDPV caused by OPV should be eliminated [44]. IPV provides protection against all three serotypes of poliovirus, which facilitates maintaining polio-free status [45]. Therefore, we could not ignore the possible social and economic impact of VAPP, such as vaccine hesitancy in Nigeria in 2003 [46], though the four-IPV schedule was cost-ineffective in our study. In Shanghai in 2019, in the context of implementing the free two-IPV-two-bOPV schedule, 47% of children’s parents chose the four-IPV schedule at their own expense or an IPV-containing combined vaccine instead (unpublished data), suggesting a high intent to receive IPV. Therefore, it indicated the feasibility of including the four-IPV immunization schedule into local EPI in resource-rich Chinese settings, such as metropolitan areas like Shanghai.
There are some limitations in this study. Cost of cold-chain services, human resources, and administration cost of human resources and administration of VAPP surveillance, treatment, follow-up, and compensation is difficult to accurately estimate. Thus, we hypothesized that they remain identical across the three polio immunization schedules. However, this study has made better estimations based on previous findings. In addition, cost of VAPP cases in this study was estimated only by the amount of compensation. Economic and social burden caused by VAPP was not included.

5. Conclusions

This study found that the two-IPV-two-bOPV and the four-IPV immunization schedules are currently cost-ineffective, which might be attributable to the difference in the cost between IPV and OPV and rare VAPP cases. However, they may be cost-effective by decreasing prices of IPV. Considering the risk of VAPP in the context of the four-tOPV schedule, IPV-containing schedules may be a feasible strategy to accelerate polio eradication efforts in China. In addition, it warrants further evaluation of the long-term effectiveness and benefits of IPV-containing schedules in China.

Author Contributions

Y.L. conceived of this study; J.R., H.M., J.L., J.Y., Z.L., and Q.B. collected data; J.R., H.M., and Y.L. conducted the analysis and drafted the initial manuscript; Y.L., X.S., and Z.H. critically revised the manuscript and interpreted data. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Shanghai Three-year Action Plan (2020–2022) for Public Health (grant no. GWV-10.1-XK16 and GWV-1.1). The funding organization had no role in study design, data analysis, statistical input, review of drafts, writing of the article, identification of papers for inclusion, or any other form of input.

Institutional Review Board Statement

Ethical review and approval were waived for this study, as this study involved the use of existing, routinely-collected data from public health surveillance in the Shanghai Municipal Center for Disease Control and Prevention. No additional personal data were collected independently for this study. Thus, this study is exempt from ethical review which has been approved by the Institutional Review Board of Shanghai Municipal Center for Disease Control and Prevention.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated during the current study are not publicly available due to privacy but are available from the corresponding author Yihan Lu on reasonable request.

Acknowledgments

We thank a lot to the Shanghai Municipal Center for Disease Control and Prevention, for their contribution to childhood immunization program and children’s health and well-being.

Conflicts of Interest

The authors declare that they have no conflict of interest.

Abbreviations

AFPAcute Flaccid Paralysis
bOPVbivalent live attenuated Oral Polio Vaccines
CNYChinese Yuan
DALYDisability-adjusted Life Years
EPIExpanded Programme on Immunization
ICERIncremental Cost-Effectiveness Ratio
IPVInactivated Polio Vaccines
LYLife Year
NMBNet Monetary Benefit
OPVLive Attenuated Oral Polio Vaccines
PVPoliovirus
SCDCShanghai Municipal Center for Disease Control and Prevention
sIPVSabin Strain Inactivated Poliovirus Vaccine
tOPVtrivalent Live Attenuated Oral Polio Vaccines
VAPPVaccine-associated Paralytic Poliomyelitis
VDPVVaccine-derived Poliovirus
WHOWorld Health Organization
wIPVwild-type Inactivated Polio Vaccines
WPVWild Poliovirus
WTPWillingness to Pay

Appendix A

(1) Incidence of VAPP cases
A total of six VAPP cases between 2011 and 2015 following the four-tOPV immunization schedule were reported in Shanghai. The total number of local resident births during this period was 968,200 [47,48,49,50,51]. Thus, incidence of VAPP cases with the four-tOPV schedule was calculated to be 6.2 cases per million births, which was set as the baseline value in the decision tree model. In addition, due to the difference in diagnostic criteria, estimation methods [52], and surveillance system of VAPP cases, the incidence of VAPP cases documented in the literature varied widely among countries, in which surveillance data in developing countries are very limited. In China, the estimated incidence in 2010–2015 was 1.0–2.4 per million births [3]. According to the literature review published by the World Health Organization (WHO), the incidence of VAPP cases was estimated to be 3.8 cases per million births (range 2.9–4.7) in countries using OPV [39]. The highest incidence (43.7 per million births) was reported in Romania in 1970–1984, and the lowest (0.41 per million births) was in Brazil in 1995–2001. Therefore, we set the range (0.41–43.7 per million births) for the incidence of VAPP in the model.
It has been documented that vaccine recipients who take the first dose of OPV and their contacts have 6.6 times higher risk of developing VAPP, compared to those recipients who take subsequent doses and their contacts [40]. In addition, 26–31% of VAPP cases were caused by serotype 2 vaccine strain viruses according to the WHO position paper [1]. Consequently, the baseline value of VAPP incidence using the two-IPV-two-bOPV schedule was determined to be 0.70 per million births. For this schedule, no case of VAPP has been reported in Shanghai since its implementation in 2016 or the United States since 1996 [53]. In Russia, VAPP cases continued to occur for this schedule since 2008, but the incidence has decreased to 1.56 per million births [41]. Therefore, the range was set as 0–1.56 per million births.
Finally, VAPP cases are unlikely to occur after the four-IPV immunization schedule [45], so the incidence of VAPP was set as 0 in the model.

References

  1. WHO. Polio vaccines: WHO position paper—March, 2016. Wkly. Epidemiol. Rec. 2016, 91, 145–168. [Google Scholar]
  2. Yu, W.-Z.; Wen, N.; Zhang, Y.; Wang, H.-B.; Fan, C.-X.; Zhu, S.-L.; Xu, W.-B.; Liang, X.-F.; Luo, H.-M.; Li, L. Poliomyelitis eradication in China: 1953–2012. J. Infect. Dis. 2014, 210, S268–S274. [Google Scholar] [CrossRef]
  3. Wu, W.; Wang, H.; Li, K.; Nuorti, J.P.; Liu, D.; Xu, D.; Ye, J.; Zheng, J.; Fan, C.; Wen, N.; et al. Recipient vaccine-associated paralytic poliomyelitis in China, 2010–2015. Vaccine 2018, 36, 1209–1213. [Google Scholar] [CrossRef]
  4. Wu, Z.M.; Hu, J.Y.; Xu, T.Q.; Li, X.Z.; Zhao, L.L. Epidemiological analysis of the vaccine-associated paralytic poliomyelitis in 1980–1998 in Shanghai. Chin. J. Vaccines Immun. 1999, 6, 6–8. [Google Scholar]
  5. World Health Organization. Poliomyelitis: WHO Response. 22 July 2019. Available online: https://www.who.int/news-room/fact-sheets/detail/poliomyelitis (accessed on 25 June 2021).
  6. Hsu, C.H.; Kader, M.; Mahamud, A.; Bullard, K.; Jorba, J.; Agbor, J.; Safi, M.M.; Jafari, H.S.; Ehrhardt, D. Progress toward poliomyelitis eradication—Pakistan, January 2018–September 2019. MMWR. Morb. Mortal. Wkly. Rep. 2019, 68, 1029–1033. [Google Scholar] [CrossRef] [Green Version]
  7. Pan, J.; Wang, Y.; Cao, L.; Wang, Y.; Zhao, Q.; Tang, S.; Gong, W.; Guo, L.; Liu, Z.; Wen, Z.; et al. Impact of immunization programs on 11 childhood vaccine-preventable diseases in China: 1950–2018. Innovation 2021, 2. [Google Scholar] [CrossRef]
  8. Lopalco, P.L. Wild and vaccine-derived poliovirus circulation, and implications for polio eradication. Epidemiol. Infect. 2016, 145, 413–419. [Google Scholar] [CrossRef]
  9. Huang, Z.Y.; Sun, X.D.; Liu, M.Y.; Li, C.S.; Ren, J.; Hu, J.Y.; Yang, J.P.; Liu, J.C.; Li, Z.; Yang, Y.Y.; et al. Immunogenicity analysis of sequential inoculation of different strains of poliomyelitis vaccines in Shanghai. Chin. J. Prev. Med. 2019, 53, 513–518. [Google Scholar]
  10. Liu, M.Y.; Huang, Z.Y.; Lu, J.; Yang, J.P.; Yang, Y.Y. Polio antibody levels in infants during 2015–2016 in Shanghai before and after polio vaccination strategy adjustment. Shanghai J. Prev. Med. 2020, 32, 627–630. [Google Scholar]
  11. Shanghai Municipal Health Commission. Notice on the Adjustment of the Immunization Program of Polio Vaccine and Measles-Containing Vaccine in the City; Shanghai Municipal Health Commission: Shanghai, China, 2020. Available online: http://wsjkw.sh.gov.cn/jbfk2/20200724/784eaeeaf7ce4ebd8e2528cdd6d35280.html (accessed on 14 May 2021).
  12. Tebbens, R.J.D.; Pallansch, M.A.; Cochi, S.L.; Wassilak, S.G.; Linkins, J.; Sutter, R.W.; Aylward, R.B.; Thompson, K. Economic analysis of the global polio eradication initiative. Vaccine 2010, 29, 334–343. [Google Scholar] [CrossRef] [PubMed]
  13. Khan, M.M. Economics of polio vaccination in the post-eradication era: Should OPV-using countries adopt IPV? Vaccine 2008, 26, 2034–2040. [Google Scholar] [CrossRef] [PubMed]
  14. Thompson, K.M.; Tebbens, R.J.D.; Pallansch, M.A.; Kew, O.M.; Sutter, R.W.; Aylward, R.B.; Watkins, M.; Gary, H.E.; Alexander, J.; Jafari, H.; et al. The risks, costs, and benefits of possible future global policies for managing polioviruses. Am. J. Public Health 2008, 98, 1322–1330. [Google Scholar] [CrossRef] [PubMed]
  15. Alvis, N.; de la Hoz, F.; Narváez, J. Economic impact of introducing the injectable inactivated polio vaccine in Colombia. Rev. Panam. Salud. Publica 2010, 27, 352–359. [Google Scholar] [CrossRef] [Green Version]
  16. Li, R.P. Strategic Analysis and Cost Estimation on OPV Switching to Sabin-IPV at the Stage of the Endgame of Polio Eradication in China; Shandong University: Jinan, China, 2007. [Google Scholar]
  17. Griffiths, U.K.; Botham, L.; Schoub, B.D. The cost-effectiveness of alternative polio immunization policies in South Africa. Vaccine 2006, 24, 5670–5678. [Google Scholar] [CrossRef] [PubMed]
  18. Tucker, A.W.; Isaacs, D.; Burgess, M. Cost-effectiveness analysis of changing from live oral poliovirus vaccine to inactivated poliovirus vaccine in Australia. Aust. N. Zealand J. Public Health 2001, 25, 411–416. [Google Scholar] [CrossRef]
  19. Miller, M.A. Cost-effectiveness of incorporating inactivated poliovirus vaccine into the routine childhood immunization schedule. JAMA 1996, 276, 967. [Google Scholar] [CrossRef]
  20. Tebbens, R.J.D.; Pallansch, M.A.; Cochi, S.L.; Wassilak, S.G.; Thompson, K.M. An economic analysis of poliovirus risk management policy options for 2013–2052. BMC Infect. Dis. 2015, 15, 1–21. [Google Scholar] [CrossRef] [Green Version]
  21. Yang, L.X. Incremental Cost Study of Inactivated Poliovirus Vaccine into National Immunization Program; Chinese Center for Disease Control and Prevention: Beijing, China, 2015.
  22. Thompson, K.M.; Tebbens, R.J.D. Retrospective cost-effectiveness analyses for polio vaccination in the United States. Risk Anal. 2006, 26, 1423–1440. [Google Scholar] [CrossRef]
  23. Sartori, A.M.C.; Vicentine, M.P.; Gryninger, L.C.F.; Soarez, P.; Novaes, H. Polio inactivated vaccine costs into routine childhood immunization in Brazil. Rev. Saude Public 2015, 49, 1–10. [Google Scholar] [CrossRef] [Green Version]
  24. Khan, M.; Sharma, S.; Tripathi, B.; Alvarez, F.P. Budget impact of polio immunization strategy for India: Introduction of one dose of inactivated poliomyelitis vaccine and reductions in supplemental polio immunization. Public Health 2017, 142, 31–38. [Google Scholar] [CrossRef]
  25. Domingues, C.M.A.S.; de Fátima Pereira, S.; Cunha Marreiros, A.C.; Menezes, N.; Flannery, B. Introduction of sequential inactivated polio vaccine-oral polio vaccine schedule for routine infant immunization in Brazil’s National Immunization Program. J. Infect. Dis. 2014, 210 (Suppl. S1), S143–S151. [Google Scholar] [CrossRef] [PubMed]
  26. Nanteza, M.B.; Kisakye, A.; Ota, M.O.; Gumede, N.; Bwogi, J. The expanded program on immunization laboratory team—Uganda Virus Research Institute (EPI LAB—UVRI) Vaccine associated paralytic poliomyelitis cases from children presenting with acute flaccid paralysis in Uganda. J. Med. Virol. 2015, 87, 2163–2167. [Google Scholar] [CrossRef] [PubMed]
  27. Diop, O.M.; Burns, C.C.; Wassilak, S.G.; Kew, O.M. Update on vaccine-derived polioviruses—Worldwide, July 2012–December 2013. MMWR. Morb. Mortal. Wkly. Rep. 2014, 63, 242. [Google Scholar] [PubMed]
  28. WS 294-2016 Poliomyelitis Diagnosis. 2016. Available online: http://www.nhc.gov.cn/wjw/s9491/201606/55fca4a0e4b0458bba1-659fda26c22e6.shtml (accessed on 14 May 2021).
  29. Shanghai Bureau of Statistics National Investigation Corps, Shanghai Bureau of Statistics. 2017 Shanghai Statistical Yearbook; China Statistics Press: Shanghai, China, 2017.
  30. TreeAge. Tornado diagrams. In TreeAge Pro 2017 User’s Manual; TreeAge Software, Inc.: Williamstown, MA, USA, 2017; pp. 256–260. [Google Scholar]
  31. Le, V.; Zhong, L.; Narsipur, N.; Hays, E.; Tran, D.K.; Rosario, K.; Wilson, L. Cost-effectiveness of ribociclib plus endocrine therapy versus placebo plus endocrine therapy in HR-positive, HER2-negative breast cancer. J. Manag. Care Speéc. Pharm. 2021, 27, 327–338. [Google Scholar] [CrossRef]
  32. Arakawa, I.; Momoeda, M.; Osuga, Y.; Ota, I.; Koga, K. Cost-effectiveness of the recommended medical intervention for the treatment of dysmenorrhea and endometriosis in Japan. Cost Eff. Resour. Alloc. 2018, 16, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Practical Regulations for Vaccination in Shanghai (2017 Edition). 2017. Available online: http://wsjkw.sh.gov.cn/mygh-zcwj/20191012/0012-65397.html (accessed on 7 July 2021).
  34. Duan, M.J.; Cao, L.; Cao, L.S. Wastage factor estimation of bivalent polio attenuated live vaccine in China. Chin. J. Vaccines Immun. 2017, 23, 134–137. [Google Scholar]
  35. Shanghai Compensation Measures for Vaccination Related Abnormal Reactions (for Trial Implementation). 2017. Available online: http://wsjkw.sh.gov.cn/mygh-zcwj/20191012/0012-65399.html (accessed on 25 June 2021).
  36. World Bank. Country Income Groups. Available online: http://chartsbin.com/view/2438 (accessed on 25 June 2021).
  37. Mao, Z.H.; Hu, D.W. Medical Economics 2004; China Statistics Press: Beijing, China, 2004. [Google Scholar]
  38. Circulating Vaccine-derived Poliovirus (cVDPV). Available online: https://polioeradication.org/wp-content/uploads/2020/12/20201118_cVDPV2_Global_Update_EN.pdf (accessed on 21 September 2021).
  39. Platt, L.R.; Estívariz, C.F.; Sutter, R.W. Vaccine-associated paralytic poliomyelitis: A review of the epidemiology and estimation of the global burden. J. Infect. Dis. 2014, 210, S380–S389. [Google Scholar] [CrossRef]
  40. Sutter, R.W.; Kew, O.M.; Cochi, S.L. Poliovirus vaccine-live. Vaccines 2008, 631–685. [Google Scholar] [CrossRef]
  41. Ivanova, O.E.; Eremeeva, T.P.; Morozova, N.S.; Shakaryan, A.K.; Korotkova, E.A.; Kozlovskaya, L.I.; Baykova, O.Y.; Krasota, A.Y.; Gmyl, A.P. Vaccine-associated paralytic poliomyelitis in the Russian Federation in 1998–2014. Int. J. Infect. Dis. 2018, 76, 64–69. [Google Scholar] [CrossRef] [Green Version]
  42. Alexander, L.N. Vaccine policy changes and epidemiology of poliomyelitis in the United States. JAMA 2004, 292, 1696–1701. [Google Scholar] [CrossRef] [Green Version]
  43. World Health Organization Department Immunization. Principles and Considerations for Adding a Vaccine to a National Immuniza-tion Programme: From Decision to Implementation and Monitoring; WHO: Geneva, Switzerland, 2014. [Google Scholar]
  44. Huang, Z.; Hu, J.; Sun, X.; Yang, J. Analysis of poliomyelitis eradication and recommendations for immunization strategies. J. Microbes Infect. 2020, 15, 337–344. [Google Scholar]
  45. WHO. Polio vaccines: WHO position paper, March 2016—Recommendations. Vaccine 2017, 35, 1197–1199. [Google Scholar] [CrossRef] [PubMed]
  46. Nasir, U.N.; Bandyopadhyay, A.S.; Montagnani, F.; Akite, J.E.; Mungu, E.B.; Uche, I.; Ismaila, A.M. Polio elimination in Nigeria: A review. Hum. Vaccines Immunother. 2015, 12, 658–663. [Google Scholar] [CrossRef] [Green Version]
  47. Shanghai Bureau of Statistics. Shanghai Statistical Bulletin of National Economic and Social Development, 2011. Statistical Science and Practice; Shanghai Bureau of Statistics: Shanghai, China, 2013; Volume 3, pp. 7–14.
  48. Shanghai Bureau of Statistics. Shanghai Statistical Bulletin of National Economic and Social Development, 2012. Statistical Science and Practice; Shanghai Bureau of Statistics: Shanghai, China, 2013; Volume 3, pp. 16–23.
  49. Shanghai Bureau of Statistics. Shanghai Statistical Bulletin of National Economic and Social Development, 2013. Statistical Science and Practice; Shanghai Bureau of Statistics: Shanghai, China, 2014; Volume 3, pp. 14–24.
  50. Shanghai Bureau of Statistics. Shanghai Statistical Bulletin of National Economic and Social Development, 2014. Statistical Science and Practice; Shanghai Bureau of Statistics: Shanghai, China, 2015; Volume 3, pp. 20–29.
  51. Shanghai Bureau of Statistics. Shanghai Statistical Bulletin of National Economic and Social Development, 2015. Statistical Science and Practice; Shanghai Bureau of Statistics: Shanghai, China, 2016; Volume 3, pp. 19–28.
  52. Zhang, L.F.; Yu, Z.W.; Wen, N.; Luo, H.M. Occurrence and Epidemiological Characteristics of Vaccine-associated Paralytic Poliomyelitis. Chin. J. Vaccines. Immun. 2015, 21, 101–107. [Google Scholar]
  53. Wattigney, W.A.; Mootrey, G.T.; Braun, M.M.; Chen, R.T. Surveillance for poliovirus vaccine adverse events, 1991 to 1998: Impact of a sequential vaccination schedule of inactivated poliovirus vaccine followed by oral poliovirus vaccine. Pediatrics 2001, 107, e83. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. A decision tree model for cost-effectiveness analysis of three polio immunization schedules. The decision tree model had the following hypotheses: (1) 100% coverage of polio immunization in the study population; (2) no self-paid polio-containing vaccines in the study population; (3) no occurrence of VAPP after four-IPV immunization in the study population; (4) cost of cold-chain services, human resources, and administration remain identical across three polio immunization schedules. IPV, inactivated polio vaccine; VAPP, vaccine-associated paralytic poliomyelitis.
Figure 1. A decision tree model for cost-effectiveness analysis of three polio immunization schedules. The decision tree model had the following hypotheses: (1) 100% coverage of polio immunization in the study population; (2) no self-paid polio-containing vaccines in the study population; (3) no occurrence of VAPP after four-IPV immunization in the study population; (4) cost of cold-chain services, human resources, and administration remain identical across three polio immunization schedules. IPV, inactivated polio vaccine; VAPP, vaccine-associated paralytic poliomyelitis.
Vaccines 09 01062 g001
Figure 2. Cost-effectiveness analysis by using a decision tree model. Total cost of three polio immunization schedules in 2016 was used as the cost, and the sum of LY of local resident births in 2016 was used as the effectiveness. The four-tOPV immunization schedule was cost-effective; in contrast, both the two-IPV-two-bOPV schedule and the four-IPV schedule were cost-ineffective. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; IPV, inactivated polio vaccine; LY, life year.
Figure 2. Cost-effectiveness analysis by using a decision tree model. Total cost of three polio immunization schedules in 2016 was used as the cost, and the sum of LY of local resident births in 2016 was used as the effectiveness. The four-tOPV immunization schedule was cost-effective; in contrast, both the two-IPV-two-bOPV schedule and the four-IPV schedule were cost-ineffective. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; IPV, inactivated polio vaccine; LY, life year.
Vaccines 09 01062 g002
Figure 3. Tornado plot of the two-IPV-two-bOPV (a) and the four-IPV (b) immunization schedules, compared to the four-tOPV schedule, using univariate sensitivity analysis. The X-axis represented ICERLY. The incidence of VAPP cases with the four-tOPV schedule, incidence of VAPP cases with the two-IPV-two-bOPV schedule, compensation cost of VAPP cases, and cost of IPV were included in the analysis according to the range of values (Table 1). Positive and negative associations were further determined by the estimation of ICER, which were not presented in the figure. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; ICER, incremental cost-effectiveness ratio; IPV, inactivated polio vaccine; LY, life year; VAPP, vaccine-associated paralytic poliomyelitis.
Figure 3. Tornado plot of the two-IPV-two-bOPV (a) and the four-IPV (b) immunization schedules, compared to the four-tOPV schedule, using univariate sensitivity analysis. The X-axis represented ICERLY. The incidence of VAPP cases with the four-tOPV schedule, incidence of VAPP cases with the two-IPV-two-bOPV schedule, compensation cost of VAPP cases, and cost of IPV were included in the analysis according to the range of values (Table 1). Positive and negative associations were further determined by the estimation of ICER, which were not presented in the figure. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; ICER, incremental cost-effectiveness ratio; IPV, inactivated polio vaccine; LY, life year; VAPP, vaccine-associated paralytic poliomyelitis.
Vaccines 09 01062 g003
Figure 4. One-way sensitivity analysis net benefits graph for three polio immunization schedules. In (a), NMB of IPV-containing schedules was estimated over cost of IPV (X-axis), while that of the four-tOPV schedule was constant. In (b), NMB of the four-tOPV schedule was estimated over the incidence of VAPP cases with the four-tOPV, and those of IPV-containing schedules remained stable. The WTP in the decision tree model was set as CNY 600,000. NMB = total benefit – total cost, in which total benefit = effectiveness (sum of LY per year) × bound of ICERLY (that is WTP) and total cost was the total annual cost of different polio immunization schedules. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; IPV, inactivated polio vaccine; NMB, net monetary benefit; VAPP, vaccine-associated paralytic poliomyelitis.
Figure 4. One-way sensitivity analysis net benefits graph for three polio immunization schedules. In (a), NMB of IPV-containing schedules was estimated over cost of IPV (X-axis), while that of the four-tOPV schedule was constant. In (b), NMB of the four-tOPV schedule was estimated over the incidence of VAPP cases with the four-tOPV, and those of IPV-containing schedules remained stable. The WTP in the decision tree model was set as CNY 600,000. NMB = total benefit – total cost, in which total benefit = effectiveness (sum of LY per year) × bound of ICERLY (that is WTP) and total cost was the total annual cost of different polio immunization schedules. bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; IPV, inactivated polio vaccine; NMB, net monetary benefit; VAPP, vaccine-associated paralytic poliomyelitis.
Vaccines 09 01062 g004
Table 1. Parameters for estimation of cost and effectiveness in the decision tree model.
Table 1. Parameters for estimation of cost and effectiveness in the decision tree model.
ParametersBaseline ValueMinimum ValueMaximum ValueSource of Data
Cost
Government procurement price of vaccines (CNY/vial)
tOPV (for 10-dose)9.709.709.70China Government Procurement Network
bOPV (for 10-dose)27.2027.2027.20China Government Procurement Network
sIPV (for 1-dose)35.0035.0035.00China Government Procurement Network
wIPV (for 1-dose)39.0039.0039.00China Government Procurement Network
Coefficient of loss
10-dose per vial1.801.802.50Practical Regulations for Vaccination in Shanghai (2017 edition) [33]; SCDC
1-dose per vial1.001.001.05Practical Regulations for Vaccination in Shanghai (2017 edition) [33]; SCDC
Procurement ratio of sIPV:wIPV2:11:12:1SCDC
Procurement price of the low-temperature refrigerator (CNY)15,00010,00020,000SCDC
Depreciation of low-temperature refrigerator (years)9810SCDC
Compensation for VAPP cases (CNY, per case)748,005748,0051,250,000SCDC; Shanghai Compensation Measures for Vaccination Related Adverse Events (trial edition) [35]; Yang LS [21]
Effectiveness
Number of local resident births in Shanghai in 2016 (per 10,000)21.8421.8421.84Shanghai Statistical Yearbook 2017 [29]
Incidence of VAPP (per 1 million births)
Four-tOPV schedule6.200.4143.70SCDC; WHO study [39]
Two-IPV-two-bOPV schedule0.700.001.56SCDC; WHO position paper [1]; Sutter et al. [40]; Ivanova et al. [41]
Four-IPV schedule000
DALY caused by VAPP141314Duintjer et al. [12], and Thompson et al. [14]
bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; CNY, Chinese Yuan; DALY, disability-adjusted life year; ICER, incremental cost-effectiveness ratio; IPV, inactivated polio vaccine; SCDC, Shanghai Municipal Center for Disease Control and Prevention; VAPP, vaccine-associated paralytic poliomyelitis.
Table 2. Total cost and effectiveness of three polio immunization schedules.
Table 2. Total cost and effectiveness of three polio immunization schedules.
Four-tOPV ScheduleTwo-IPV-Two-bOPV ScheduleFour-IPV Schedule
Total cost (CNY 10,000 per year)297.981856.423174.08
Cost of vaccines (CNY 10,000 per year)152.531800.903174.08
Maintenance of low-temperature refrigerator (CNY 10,000 per year)44.1744.170
Compensation for VAPP cases (CNY 10,000 per year)101.2911.360
Incremental cost (CNY 10,000 per year)reference1558.442876.10
Number of VAPP cases prevented (per year)reference1.201.35
DALY averted (per year)reference16.8318.96
ICERVAPP (CNY 10,000 per VAPP case)reference1296.262124.02
ICERDALY (CNY 10,000 per DALY)reference92.59151.72
bOPV, bivalent live attenuated oral polio vaccine; tOPV, trivalent live attenuated oral polio vaccine; CNY, Chinese Yuan; DALY, disability-adjusted life year; ICER, incremental cost-effectiveness ratio; IPV, inactivated polio vaccine; VAPP, vaccine-associated paralytic poliomyelitis.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ren, J.; Maimaiti, H.; Sun, X.; Huang, Z.; Liu, J.; Yang, J.; Li, Z.; Bai, Q.; Lu, Y. Cost-Effectiveness of Three Poliovirus Immunization Schedules in Shanghai, China. Vaccines 2021, 9, 1062. https://doi.org/10.3390/vaccines9101062

AMA Style

Ren J, Maimaiti H, Sun X, Huang Z, Liu J, Yang J, Li Z, Bai Q, Lu Y. Cost-Effectiveness of Three Poliovirus Immunization Schedules in Shanghai, China. Vaccines. 2021; 9(10):1062. https://doi.org/10.3390/vaccines9101062

Chicago/Turabian Style

Ren, Jia, Hairenguli Maimaiti, Xiaodong Sun, Zhuoying Huang, Jiechen Liu, Jianping Yang, Zhi Li, Qingrui Bai, and Yihan Lu. 2021. "Cost-Effectiveness of Three Poliovirus Immunization Schedules in Shanghai, China" Vaccines 9, no. 10: 1062. https://doi.org/10.3390/vaccines9101062

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop