Next Article in Journal
Vaccine Hesitancy in College Students
Next Article in Special Issue
Competing Heterogeneities in Vaccine Effectiveness Estimation
Previous Article in Journal
Influenza Vaccination Coverage Rates and Determinants in Greek Children until the Age of Ten (2008–2019), the Rhea Mother–Child Cohort
Previous Article in Special Issue
A Case-Control Study on Factors of HPV Vaccination for Mother and Daughter in China
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 11
Issue 7
10.3390/vaccines11071242
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Understanding Diversity of Policies, Functionalities, and Operationalization of Immunization Information Systems and Their Impact: A Targeted Review of the Literature

by
Elizabeth A. Donckels
1,
Luke Cunniff
2,
Nina Regenold
1,
Kaitlyn Esselman
1,
Erik Muther
1,
Alexandra Bhatti
2,*,† and
Amanda L. Eiden
2,†
1
Real Chemistry Market Access, San Francisco, CA 94108, USA
2
Merck & Co., Inc., Rahway, NJ 07065, USA
*
Author to whom correspondence should be addressed.
†
These authors are joint senior authors.
Vaccines 2023, 11(7), 1242; https://doi.org/10.3390/vaccines11071242
Submission received: 1 June 2023 / Revised: 12 July 2023 / Accepted: 13 July 2023 / Published: 15 July 2023
(This article belongs to the Special Issue Vaccines: 10th Anniversary)
Browse Figures
Review Reports Versions Notes

Abstract

:
The COVID-19 pandemic has focused attention on the use of immunization information systems (IIS) to record and consolidate immunization records from a variety of sources to generate comprehensive patient immunization histories. Operationalization of IIS in the United States is decentralized, and as such, there are over 60 different IIS with wide variations in enabling policies and functionalities. As such, the policies that inform the development and operation of those sub-national IIS exist at the state and sometimes city levels. A targeted literature review was conducted to identify IIS policies and functionalities and assess their impact. The authors identified articles published from 2012 to 2022 that discussed or evaluated IIS policies and functionalities and screened titles, abstracts, and full text for inclusion. When selected for inclusion, authors extracted IIS policy/functionality characteristics and qualitative or quantitative outcomes of their implementation, where applicable. The search terms yielded 86 articles, of which 39 were included in the analysis. The articles were heterogeneous with respect to study design, interventions, outcomes, and effect measures. Out of the 17 IIS policies and functional components identified in the targeted literature review, the most commonly evaluated were provider-based patient reminder/recall, IIS-based centralized reminder/recall, and clinical decision support. Patient reminder/recall had the most published research and was associated with increased vaccination rates and vaccine knowledge. Despite the lack of quantitative evidence, there is a consensus that immunization data interoperability is critical to supporting IIS data quality, access, and exchange. Significant evidence gaps remain about the effectiveness of IIS functionalities and policies. Future research should evaluate the impact of policies and functionalities to guide improved utilization of IIS, increase national interoperability and standardization, and ultimately improve vaccination coverage and population health.

1. Introduction

Immunization information systems (IIS) are confidential databases designed to record and consolidate vaccine doses administered by participating providers within a geographic area, to create comprehensive patient immunization records [1]. There are over 60 IIS in the United States (US) operating at the sub-national level in all fifty states, Washington, D.C., and select cities and territories [2]. As such, the policies that inform the development and operation of those sub-national IIS exist at the state and sometimes city levels.
The COVID-19 pandemic has reinforced the critical importance of robust data systems to ensure the availability of timely, consolidated, and up-to-date patient immunization data to guide public health decisions and support vaccination efforts. The pandemic also exposed that many jurisdictions have capacity constraints to utilize and expand their state IIS to respond to public health emergencies given current policy frameworks [3].
Since IIS are maintained separately by different states or jurisdictions, there is considerable variation between IIS policies (such as mandated reporting) as well as IIS functional components (inclusive of IIS functionalities and technical capabilities, such as reminders/recalls). This variation presents challenges to maintaining complete and high-quality patient data. However, the variability also provides an opportunity to understand the specific impact of different IIS policies and functionalities on vaccination rates, population health efforts, and provider reporting of vaccinations to the IIS.
To understand the available evidence in this area, we conducted a targeted literature review to identify key policy and technical components of IIS. The objectives of our review were to (1) identify the various documented functional and policy components of an IIS and (2) understand the real-world impact of the functional components and policies.

2. Materials and Methods

2.1. Search Strategy and Selection Procedure

We used PubMed to identify literature published between January 2012 and January 2022. All countries and methodologies, including commentaries, were included. Non-English publications were excluded. The search string used was (“vaccin*”[MAJR] OR “Immuniz*”[MAJR]) AND (“information storage and retrieval/methods”[MeSH Major Topic] OR “information systems/standards”[MeSH Major Topic] OR “information systems/trends”[MeSH Terms] OR “Information Systems/organization and administration”[MAJR]).
Reviewers screened abstracts and full texts, with at least two reviewers independently screening each. Due to the small number of articles retrieved, title screening was not applied as part of the review.
Reviewers applied inclusion and exclusion criteria to screen abstracts and full text articles. We included all articles that discussed or evaluated components that could be included in an IIS. This included IIS functional components that were evaluated as electronic health record (EHR) components, such as clinical decision support and patient reminders. Articles were excluded if they discussed strategies to increase vaccination rates unrelated to IIS, reviewed the one-time creation of vaccine databases or registries for a specific initiative, health system, or pilot program, or were specific to vaccine adverse event monitoring. Discrepancies between inclusion and exclusion decisions were resolved through discussion to reach a consensus among researchers.

2.2. Data Extraction

Three researchers independently extracted the following information: article characteristics, including title, authors, data, region, and study design; study population (e.g., pediatric versus adult); IIS policy and/or functional component, such as centralized reminder/recall and bidirectional interoperability; and, where applicable, outcomes or direct impact of IIS policies and functional components, such as vaccination rates and vaccine data quality. Researchers extracted statistical outcomes (e.g., results associated with point estimates and measures of significance) from observational and experimental articles. Only the original results of systematic literature reviews (SLRs) were extracted; any secondary research results referenced in the SLRs had their original sources cited. Extraction conflicts were resolved through review and consensus discussions.

2.3. Data Analysis

Following extraction, researchers used thematic analysis to identify and categorize IIS policies and functional components found throughout the published literature. A frequency analysis was conducted to understand the percent of extracted statistical outcomes that were significant for each identified policy or functionality theme. Non-statistical impacts and outcomes were evaluated qualitatively.

3. Results

3.1. Search Strategy Results

The search string resulted in a total of 86 articles. After an abstract and full text review, 39 articles were included in the final analysis. Figure 1 outlines the search process, application of exclusion criteria, and articles included in the final analysis.

3.2. Article Characteristics

The articles were heterogeneous with respect to study design, interventions, outcomes, and effect measures. The characteristics of the articles included in the review are listed in Table 1. The most frequent study design type was observational without controls (41%), followed by randomized controlled trials (23%). Of all 39 articles, 29 (74%) were from the US; within the US, Colorado had the most published literature compared to other states, represented in six articles (21% of US articles). Eight articles were from other countries, which include: Australia (1), Brazil (1), China (2), Iran (1), Kenya (1), Ghana (1), Nigeria (1), and Zimbabwe (1). Lastly, 25 (64%) of the included articles focused on pediatric populations; nine (23%) articles focused on both adults and children; and only four (10%) articles were limited to adults only.

3.3. Identified IIS Policies and Functional Components

A total of 17 distinct IIS policies and functional components were identified across the 39 articles (Table 2), with many articles discussing multiple policies or functional components (Figure 2). Across the 39 articles, 118 extractions identifying or evaluating IIS policies or functional components were included. Provider-based patient reminder/recall was the most frequently identified functional component with 43 (36.4%) extractions, followed by clinical decision support (n = 14, 11.9%) and IIS-based centralized reminder/recall (n = 13; 11.0%).

3.4. Impact of IIS Policies and Functionalities

Table 3 includes all IIS policies and functional components identified in the literature, including outcomes supported either through statistical evaluation or qualitative evidence. In some cases, outcomes used different terms across articles (e.g., vaccination rate versus immunization rate) to refer to the same concept; we grouped similar concepts together. Some articles used multiple measures to assess one outcome. For example, one article assessed the impact of patient reminder/recall on vaccination rates and assessed both receipt of a Tdap, meningococcal conjugate, or HPV vaccine in a 6-month period post-intervention and receipt of all vaccines (Tdap, meningococcal conjugate, and HPV vaccine) in a 6-month period post-intervention [13]. Additionally, multiple articles examined the same general vaccination outcome but for different vaccines. All outcome measures and definitions used are listed in Table 3. Outcomes with an asterisk (*) indicate the finding is from a randomized control trial (RCT).
Only 45 (38.1%) of all 118 extractions included an evaluation of statistical significance, while 33 (28.0%) extractions cited the impacts of policies and functional components on real-world outcomes but did not statistically evaluate them. In this case, non-statistical impacts were extracted from all sections of the articles, but most commonly the results and conclusions sections. For example, the impacts of clinical decision support were extracted from the evidence synthesis section of Patel et al.’s Economic Review of Immunization Information Systems to Increase Vaccination Rates: A Community Guide Systematic Review [13]. Table 3 includes a complete list of all the evaluated impacts of IIS policies and functional components identified across the articles. For articles with statistical evaluations of the impact of IIS policy or functional component use, we included the proportion of results that showed significant differences in real-world outcomes. We reported non-statistical, evaluated findings, or qualitative support, by article.

4. Discussion

Out of the 17 IIS policies and functional components identified in our targeted literature review, patient reminder/recall was discussed the most in the published research and was associated with increased vaccination rates and vaccine knowledge [34,38]. This IIS functional component may be a key intervention to help increase vaccine uptake across the life course and can also provide opportunities for vaccine education and strengthening vaccination confidence, such as targeted reminder messages with information on the importance of vaccination [39]. However, the different approaches to generating reminder calls may have varied effectiveness. For example, two studies found that centralized reminder/recall interventions coming directly from IIS or Health Departments were more effective in increasing vaccination coverage and cost-effective compared to practice-based reminder/recall interventions—despite both being effective strategies to support vaccine uptake. This could be due to provider burden, capacity, and resources needed to implement practice-based reminders/recalls [19,20]. According to a 2019 Association for Immunization Managers (AIM) survey, only 20 out of the 53 immunization programs surveyed conducted centralized, IIS-based reminder/recall activities [40], providing an opportunity for additional states to explore utilizing this functional component.
Another key functional component with evidence of positive impact that could support vaccination coverage across the life course was clinical decision support. Clinical decision support systems aid providers in administering accurate and timely vaccinations in accordance with Advisory Committee on Immunization Practices (ACIP) recommendations. Four articles demonstrated that implementation of a clinical decision support functional component, such as forecasting and prompting recommended vaccinations for patients, reduced the administration of unnecessary vaccinations and increased vaccination rates [21,22,23,24]. However, according to an assessment conducted by the American Immunization Registry Association (AIRA) in 2021, only 51% of jurisdictional IIS included in the assessment met the twelve criteria necessary for clinical decision support [41].
Despite the lack of studies that lend themselves to statistical analysis in published literature, it is a well-established belief that immunization data interoperability is critical to supporting IIS data quality, information availability and access across provider types and sites of care, and cross-jurisdictional exchange of data [16,42,43]. A complete, accurate, and timely exchange of vaccination data between EHR and IIS supports other IIS functional components, such as reminder/recall and clinical decision support, that aid providers in administering timely and appropriate vaccinations. For instance, data exchange between EHRs and New York City’s IIS was associated with an increase in the percentage of children with up-to-date vaccination status and increased vaccination record completeness [44]. While 54 of 55 evaluated IIS by AIRA in the US can send consolidated patient immunization records to EHRs [45], barriers remain with regard to full national interoperability. In 2019, 51% of EHRs could not receive immunization record data from state IIS, and some required health systems to pay a fee to maintain a connection with the IIS [46]. Additionally, with an increasingly mobile society, interstate data sharing between jurisdictional IIS could be critical to ensuring complete patient data; however, limited data exists in the literature to fully demonstrate the value of cross-justification IIS data exchange.
We identified relatively few articles in our review evaluating the impact of different IIS policies and functional components on the adult population, as most articles focused on pediatric vaccinations and outcomes. The limited amount of research evaluating the outcomes of IIS policies and functional components is surprising, given that many state IIS have been operational since the 1990s [2]. This demonstrates a critical gap in the literature, which may be due, in part, to the difficulty in evaluating the impact of IIS policies and functional components on health outcomes. This demonstrates a critical gap in the literature, which may be due, in part, to the difficulty in evaluating the impact of IIS policies and functional components on health outcomes. National COVID-19 vaccination efforts have accelerated adult immunization capture in the US, with the number of adults with at least one vaccine documented in the IIS increasing from 68% to 89% between 2020 and 2021 [47]. As efforts are underway to increase adult vaccination coverage rates, more work is needed to evaluate the impact of IIS functional components and policies to inform state efforts to improve adult vaccination, including measures that can be implemented to improve adult data completeness in IIS. The number of Americans ages 65 and older is projected to double and become more racially and ethnically diverse between 2018 and 2060 [48]. Having complete patient data for these populations, including demographic data, is critical to ensuring vaccinators can understand patient vaccination needs (especially important for patients with chronic health conditions that are at increased risk for complications from certain vaccine-preventable diseases), as well as understand and address any demographic disparities that may exist within communities.
While the US continues to work toward optimizing the vaccine ecosystem, other countries offer useful insights into promising IIS practices and lessons learned. For instance, Australia has been recognized for its advanced IIS policies [12], which include lifetime patient enrollment, mandatory provider reporting, and patient access to vaccination data [49,50]. Canada also offers useful lessons since their IIS landscape and challenges are comparable to the US, such as multiple sub-national IIS managed by the different territories and provinces and considerable variation across policies and functional components despite national standards. For instance, Canada has faced challenges in the implementation of Panorama, deployed in 2011 and intended to be a national electronic information system to support public health surveillance, including immunization and disease outbreak management [51]. While significant effort was invested in national implementation, Panorama is not used by all provinces and territories, many of which have developed their own platforms with variations in functional components [52,53]. Canada is working to overcome similar challenges to the US to advance sub-national IIS interoperability and data sharing across all regions, such as through the consistent use of standardized codes for vaccine data [54], and may therefore offer useful insights.
Although the CDC maintains IIS functional standards and core data elements [8], they are not federally mandated, and there are challenges in prioritizing the standardization and optimization of state IIS policies and functional components. The lack of centralized requirements and connectivity provides states with flexibility for IIS policy design and management, and downstream, it leads to variation across IIS, posing barriers for cross-jurisdictional exchange of immunization data. For example, variation in state IIS policies for required race and ethnicity data reporting has impeded national efforts to identify and address vaccination disparities [2]. Inconsistent immunization data captured also limits understanding of the full extent of the pandemic’s impact on routine vaccination rates in the US. Recently, the CDC announced the deployment of a Data Use Agreement to jurisdictions in order to facilitate the submission of vaccination data as early as January 2023—aiming to help capture data across all IIS to support informed and timely public health decisions.
Funding from the CDC and other national initiatives are driving momentum to improve IIS infrastructure and broader data modernization, which provides a window of opportunity to implement evidence-based policies and technical improvements. The CDC received funding from the 2021 American Rescue Plan to support state and local-level COVID-19 vaccination efforts, including for health information technology and data system enhancements to facilitate immunization data sharing and vaccination efforts among underserved groups [2]. As funding support continues for state immunization programs to combat the COVID-19 pandemic, further evidence is needed to optimize the use of funds.
There are several limitations to our research. First, our search was restricted to articles in English, and most articles focused on the US as well as the pediatric population. Consequently, an in-depth evaluation between countries or age groups was not able to be performed, so results may not be generalizable to non-US countries or across all age groups pediatric populations. Second, to comprehensively review the limited available literature, we grouped results from articles with different levels of evidence, populations, and study designs and included editorials and opinion pieces, limiting the strength of our conclusions. Third, the majority of study designs used in identified articles did not lend themselves to statistical analysis of IIS impacts, limiting our ability to draw conclusions about the impacts (e.g., on vaccination rates) of many IIS policy and functional components, such as protection of health information and alternative site participation. We relied on article findings and did not independently validate the content within the articles captured in this review [55].

5. Conclusions

Through a targeted review of the literature, patient reminder/recall, centralized reminder/recall, and clinical support had the most published research to suggest their implementation improves real-world outcomes. However, additional research is needed to guide states toward prioritizing and implementing the most impactful IIS policies and functional components. Additional research can further demonstrate the value of robust IIS and support efforts to ensure sustainable IIS funding. There is a need to robustly assess the impact of policies and functional components to guide the development of best practices for IIS, support a more standardized and interoperable national IIS landscape, and ultimately improve vaccination coverage and population health.

Author Contributions

Conceptualization, A.B. and A.L.E.; methodology, L.C., A.B., A.L.E., E.A.D., E.M. and K.E.; writing—original draft preparation, E.A.D.; writing—review and editing, L.C., A.B., A.L.E., E.A.D., E.M., K.E. and N.R.; supervision, A.B. and E.M.; project administration, A.B. All authors have read and agreed to the published version of the manuscript.

Funding

The study was supported by Merck Sharp and Dohme LLC, a subsidiary of Merck and Co., Inc., Rahway, NJ, USA.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

L.C., A.B., and A.L.E. are employees of Merck Sharp and Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA, who may own stock and/or stock options in the Company. The authors declare no other conflicts of interest.

References

  1. Centers for Disease Control and Prevention (CDC). About Immunization Information Systems. 7 June 2019. Available online: https://www.cdc.gov/vaccines/programs/iis/about.html#:~:text=What%20is%20IIS%3F,within%20a%20given%20geopolitical%20area (accessed on 15 May 2022).
  2. Sekar, K. Immunization Information Systems: Overview and Current Issues; Congressional Research Service: Washington, DC, USA, 2022. [Google Scholar]
  3. National Governors Association; Duke Margolis Center for Health Policy; National Academy for State Health Policy. Modernizing Immunization Information Systems: Priorities and Considerations for Governors; National Governors Association: Washington, DC, USA, 2021. [Google Scholar]
  4. CDC. Immunization Information System (IIS) Functional Standards, v4.1. 3 January 2020. Available online: https://www.cdc.gov/vaccines/programs/iis/functional-standards/func-stds-v4-1.html (accessed on 3 May 2022).
  5. American Immunization Registry Association (AIRA). IIS Functional Guide, Vol. 2: CDC Endorsed Data Elements. 25 January 2019. Available online: https://repository.immregistries.org/files/resources/5a83216a1d369/aira_functional_guide_vol2_final.pdf (accessed on 5 April 2022).
  6. Saville, A.W.; Gurfinkel, D.; Beaty, B.L.; Chi, A.E.; Dayton, A.; Hurley, L.; Suresh, K.; Kempe, A. The potential for centralized reminder/recall to increase immunization rates: A national survey of immunization information systems (IIS) managers. Prev. Med. Rep. 2020, 21, 101296. [Google Scholar] [CrossRef]
  7. CDC, Clinical Decision Support for Immunization (CDSi), Centers for Disease Control and Prevention (CDC). 18 February 2022. Available online: https://www.cdc.gov/vaccines/programs/iis/cdsi.html#:~:text=Immunization%20clinical%20decision%20support%20(CDS,recommendations%20to%20the%20healthcare%20provider (accessed on 5 May 2022).
  8. CDC. Core Data Elements for IIS Functional Standards v4.0, Centers for Disease Control and Prevention (CDC). 21 November 2018. Available online: https://www.cdc.gov/vaccines/programs/iis/core-data-elements/iis-func-stds.html (accessed on 15 April 2022).
  9. Martin, D.W.; Lowery, N.E.; Brand, B.; Gold, R.; Horlick, G. Immunization information systems: A decade of progress in law and policy. J. Public Health Manag. Pract. 2015, 21, 296–303. [Google Scholar] [CrossRef] [Green Version]
  10. Informatics Academy. IIS Quick Reference Guide. Public Health Informatics Institute. Available online: https://www.informaticsacademy.org/content/courses/iis/Interoperability/InteroperabilityBasics.pdf (accessed on 20 April 2022).
  11. AIRA. An Environmental Scan on Progress, Challenges, and Opportunities: Expanding Immunization Information Systems for Adults in the United States. July 2020. Available online: https://repository.immregistries.org/files/resources/60395f6d24178/aira_adult_iis_literature_review.pdf (accessed on 10 April 2022).
  12. Groom, H.; Hopkins, D.P.; Pabst, L.J.; Morgan, J.M.; Patel, M.; Calonge, N.; Coyle, R.; Dombkowski, K.; Groom, A.V.; Kurilo, M.B.; et al. Immunization information systems to increase vaccination rates: A community guide systematic review. J. Public Health Manag. Pract. 2015, 21, 227–248. [Google Scholar] [CrossRef] [PubMed]
  13. Suh, C.A.; Saville, A.; Daley, M.F.; Glazner, J.E.; Barrow, J.; Stokley, S.; Dong, F.; Beaty, B.; Dickinson, L.M.; Kempe, A. Effectiveness and net cost of reminder/recall for adolescent immunizations. Pediatrics 2012, 129, e1437–e1445. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. McKinney, Z.J. The merits of MIIC. Minn. Med. 2017, 100, 20–22. [Google Scholar] [PubMed]
  15. Benjamin-Chung, J.; Reingold, A. Measuring the Success of the US COVID-19 Vaccine Campaign—It’s Time to Invest in and Strengthen Immunization Information Systems. Am. J. Public Health 2021, 111, 1078–1080. [Google Scholar] [CrossRef] [PubMed]
  16. Pabst, L.J.; Williams, W. Immunization Information Systems. J. Public Health Manag. Pract. 2015, 21, 225–226. [Google Scholar] [CrossRef] [Green Version]
  17. Szilagyi, P.; Albertin, C.; Gurfinkel, D.; Beaty, B.; Xinkai, Z.; Vangala, S.; Rice, J.; Campbell, J.D.; Whittington, M.D.; Valderrama, R.; et al. Effect of State Immunization Information System Centralized Reminder and Recall on HPV Vaccination Rates. Pediatrics 2020, 145, e20192689. [Google Scholar] [CrossRef]
  18. Hurley, L.P.; Beaty, B.; Lockhart, S.; Gurfinkel, D.; Breslin, K.; Dickinson, M.; Whittington, M.D.; Roth, H.; Kempe, A. RCT of Centralized Vaccine Reminder/Recall for Adults. Am. J. Prev. Med. 2018, 55, 231–239. [Google Scholar] [CrossRef]
  19. Kempe, A.; Saville, A.W.; Dickinson, L.M.; Beaty, B.; Eisert, S.; Gurfinkel, D.; Brewer, S.; Shull, H.; Herrero, D.; Herlihy, R. Collaborative centralized reminder/recall notification to increase immunization rates among young children: A comparative effectiveness trial. JAMA Pediatr. 2015, 169, 365–373. [Google Scholar] [CrossRef] [Green Version]
  20. Kempe, A.; Saville, A.W.; Beaty, B.; Dickinson, L.M.; Gurfinkel, D.; Eisert, S.; Roth, H.; Herrero, D.; Trefren, L.; Herlihy, R. Centralized Reminder/Recall to Increase Immunization Rates in Young Children: How Much Bang for the Buck? Acad. Pediatr. 2017, 17, 330–338. [Google Scholar] [CrossRef]
  21. Dutta, S.; McEvoy, D.S.; Stump, T.; McCabe, J.; Mahendra-Rajah, A.; McMurry, R.; White, B.A.; Rubins, D. Clinical Decision Support Reduces Unnecessary Tetanus Vaccinations in the Emergency Department. Ann. Emerg. Med. 2021, 78, 370–380. [Google Scholar] [CrossRef]
  22. Carlton, C.A.; Potter, R.C.; Vranesich, P.A.; Swanson, R.G. Assessing the ability of an immunization information system to prevent overimmunization of pediatric influenza vaccines. J. Public Health Manag. Pract. 2015, 21, 282–287. [Google Scholar] [CrossRef] [PubMed]
  23. Zhu, V.J.; Grannis, S.J.; Tu, W.; Rosenman, M.B.; Downs, S.M. Evaluation of a clinical decision support algorithm for patient-specific childhood immunization. Artif. Intell. Med. 2012, 56, 51–57. [Google Scholar] [CrossRef] [PubMed]
  24. Swenson, C.J.; Appel, A.; Sheehan, M.; Hammer, A.; Fenner, Z.; Phibbs, S.; Harbrecht, M.; Main, D.S. Using Information Technology to Improve Adult Immunization Delivery in an Integrated Urban Health System. Jt. Comm. J. Qual. Patient Saf. 2012, 38, 15–23. [Google Scholar] [CrossRef]
  25. Patel, M.; Pabst, L.; Chattopadhyay, S.; Hopkins, D.; Groom, H.; Myerburg, S.; Morgan, J.M.; Community Preventive Services Task Force. Economic Review of Immunization Information Systems to Increase Vaccination Rates: A Community Guide Systematic Review. J. Public Health Manag. Pract. 2015, 21, 253–262. [Google Scholar] [CrossRef]
  26. Rogers, J.; Sebastian, S.; Cotton, W.; Pippin, C.; Merandi, J. Reduction of immunization errors through practitioner education and addition of age-specific alerts in the electronic prescribing system. Am. J. Health Pharm. 2016, 73 (Suppl. S3), S74–S79. [Google Scholar] [CrossRef] [PubMed]
  27. Miller, R.M.; Hayney, M.S. Immunization information systems: A decade of progress. J. Am. Pharm. Assoc. 2015, 55, 104–105. [Google Scholar] [CrossRef] [PubMed]
  28. Hills, R.A.; Revere, D.; Altamore, R.; Abernethy, N.F.; Lober, W.B. Timeliness and data element completeness of immunization data in Washington State in 2010: A comparison of data exchange methods. AMIA Annu. Symp. Proc. 2012, 2012, 340–349. [Google Scholar]
  29. CDC. Progress in immunization information systems—United States, 2011. MMWR Morb. Mortal. Wkly. Rep. 2013, 62, 3. [Google Scholar]
  30. Akerele, A.; Obansa, R.; Adegoke, O.J.; Haladu, S.; Adeoye, O.B.; Usifoh, N.; Etamesor, S.; Uba, B.; Waziri, N.E. Determinants of improved data consistency across routine immunization data tools for health facilities in Kano State, Nigeria. Pan Afr. Med. J. 2020, 36, 148. [Google Scholar] [CrossRef]
  31. CDC. Progress in immunization information systems—United States, 2012. MMWR Morb. Mortal. Wkly. Rep. 2013, 62, 1005–1008. [Google Scholar]
  32. Regan, A.K.; Bloomfield, L.; Peters, I.; Effler, P.V. Randomized Controlled Trial of Text Message Reminders for Increasing Influenza Vaccination. Ann. Fam. Med. 2017, 15, 507–514. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Szilagyi, P.G.; Albertin, C.; Humiston, S.G.; Rand, C.M.; Schaffer, S.; Brill, H.; Stankaitis, J.; Yoo, B.-K.; Blumkin, A.; Stokley, S. A Randomized Trial of the Effect of Centralized Reminder/Recall on Immunizations and Preventive Care Visits for Adolescents. Acad. Pediatr. 2013, 13, 204–213. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Bangure, D.; Chirundu, D.; Gombe, N.; Marufu, T.; Mandozana, G.; Tshimanga, M.; Takundwa, L. Effectiveness of short message services reminder on childhood immunization programme in Kadoma, Zimbabwe—A randomized controlled trial, 2013. BMC Public Health 2015, 15, 137. [Google Scholar] [CrossRef] [Green Version]
  35. Frascella, B.; Oradini-Alacreu, A.; Balzarini, F.; Signorelli, C.; Lopalco, P.L.; Odone, A. Effectiveness of email-based reminders to increase vaccine uptake: A systematic review. Vaccine 2019, 38, 433–443. [Google Scholar] [CrossRef]
  36. Murthy, N.; Rodgers, L.; Pabst, L.; Fiebelkorn, A.P.; Ng, T. Progress in Childhood Vaccination Data in Immunization Information Systems—United States, 2013–2016. MMWR Morb. Mortal. Wkly. Rep. 2017, 66, 1178–1181. [Google Scholar] [CrossRef]
  37. Richman, A.R.; Maddy, L.; Torres, E.; Goldberg, E.J. A randomized intervention study to evaluate whether electronic messaging can increase human papillomavirus vaccine completion and knowledge among college students. J. Am. Coll. Health 2016, 64, 269–278. [Google Scholar] [CrossRef] [PubMed]
  38. Sahni, L.C.; Banes, M.R.; Boom, J.A. Understanding the Financial Implications of Immunization Reminder/Recall in a Multipractice Pediatric Group. Acad. Pediatr. 2016, 17, 323–329. [Google Scholar] [CrossRef] [PubMed]
  39. The Community Guide. Vaccination Programs: Client Reminder and Recall Systems. USA.gov; May 2015. Available online: https://www.thecommunityguide.org/findings/vaccination-programs-client-reminder-and-recall-systems (accessed on 19 April 2022).
  40. Association of Immunization Managers (AIM). Annual Survey Snapshot. September 2021. 2019. Available online: https://www.immunizationmanagers.org/content/uploads/2021/09/AIM_Annual_Survey_Infographic_0920.pdf (accessed on 29 March 2022).
  41. AIRA. Clinical Decision Support Validation—Basic Level. 2021. Available online: https://repository.immregistries.org/files/resources/60a5028b5460b/cds_validation_basic_q4_2021.pdf (accessed on 2 March 2022).
  42. Hosseini, M.; Ahmadi, M.; Dixon, B.E. A Service Oriented Architecture Approach to Achieve Interoperability between Immunization Information Systems in Iran. AMIA Annu. Symp. Proc. 2014, 2014, 1797–1805. [Google Scholar] [PubMed]
  43. Greenberger, M. The Imperative of Immunization Interoperability and Information Sharing. Healthcare Information and Management Systems Society (HIMSS). 27 April 2021. Available online: https://www.himss.org/resources/imperative-immunization-interoperability-and-information-sharing (accessed on 20 March 2022).
  44. Stockwell, M.S.; Vawdrey, D.; Ramakrishnan, R. DEVISE: Data Exchange of Vaccine Information between an IIS and HER; Agency for Healthcare Research and Quality (AHRQ): North Bethesda, MD, USA, 2014. [Google Scholar]
  45. AIRA. Transport Validation—Basic Level. 2021. Available online: https://repository.immregistries.org/files/resources/5ae759f692a6c/transport_validation_basic_2nd_half_2021.pdf (accessed on 6 March 2022).
  46. AIRA. Landscape Analysis: IIS Adult Vaccination Data Capture and Data Utilization. May 2021. Available online: https://repository.immregistries.org/files/resources/60958446cdad0/adultlandscape_final.pdf (accessed on 5 April 2022).
  47. CDC. IISAR Data Participation Rates and Maps. Centers for Disease Control and Prevention (CDC). Available online: https://www.cdc.gov/vaccines/programs/iis/annual-report-iisar/rates-maps-table.html (accessed on 22 November 2022).
  48. Mather, M.; Scommegna, P.; Kilduff, L. Fact Sheet: Aging in the United States. Population Reference Bureau. Available online: https://www.prb.org/resources/fact-sheet-aging-in-the-united-states/ (accessed on 17 November 2022).
  49. The Hon Greg Hunt MP. Building a Stronger Australian Immunisation Register. Commonwealth of Australia, Department of Health and Aged Care. 5 February 2021. Available online: https://www.health.gov.au/ministers/the-hon-greg-hunt-mp/media/building-a-stronger-australian-immunisation-register (accessed on 15 February 2022).
  50. Australian National Audit Office. Improving Immunisation Coverage; Commonwealth of Australia: Canberra, Australia, 2021. [Google Scholar]
  51. Bellringer, C. An Audit of the Panorama Public Health System; Office of the Auditor General of British Columbia: Victoria, BC, Canada, 2015. [Google Scholar]
  52. Tumilty, R. Canada Spent $147M on a Public Health Surveillance System That Isn’t Being Used during COVID Pandemic. National Post. 12 September 2020. Available online: https://nationalpost.com/news/politics/canada-spent-147m-on-a-public-health-surveillance-system-that-isnt-being-used-during-covid-pandemic (accessed on 12 August 2022).
  53. Ling, J. Provinces are Working with Outdated Vaccine Tracking Systems, Hindering National Data. The Globe and Mail. 21 February 2021. Available online: https://www.theglobeandmail.com/canada/article-provinces-working-with-outdated-vaccine-tracking-systems/ (accessed on 12 August 2022).
  54. Wilson, S.E.; Quach, S.; MacDonald, S.E.; Naus, M.; Deeks, S.L.; Crowcroft, N.S.; Mahmud, S.M.; Tran, D.; Kwong, J.C.; Tu, K.; et al. Immunization information systems in Canada: Attributes, functionality, strengths and challenges. A Canadian Immunization Research Network study. Can. J. Public Health 2016, 107, e575–e582. [Google Scholar] [CrossRef] [PubMed]
  55. AIRA. IIS Data Quality Practices to Monitor and Evaluate Data at Rest. 11 May 2018. Available online: https://repository.immregistries.org/files/resources/5c002cbde216d/aira_dq_guide_data_at_rest_-_final.pdf (accessed on 10 April 2022).
Vaccines 11 01242 g001 550
Figure 1. Published Literature Search and Screening Process.
Figure 1. Published Literature Search and Screening Process.
Vaccines 11 01242 g001
Vaccines 11 01242 g002 550
Figure 2. Frequency of IIS Policies and Functional Components Identified in Published Articles. * Each of the 39 articles could include multiple outcomes.
Figure 2. Frequency of IIS Policies and Functional Components Identified in Published Articles. * Each of the 39 articles could include multiple outcomes.
Vaccines 11 01242 g002
Table
Table 1. IIS Policy and Functionality Published Article Characteristics (n = 39).
Table 1. IIS Policy and Functionality Published Article Characteristics (n = 39).
Article CharacteristicArticles (n = 39)
Study Design and Level of Evidence
Level 1: Randomized control trial9
Level 2: Non-randomized trial1
Level 3: Observational article with controls5
Level 4: Observational article without controls16
Other: Editorial, review article, etc.8
Geographic Area
Australia1
Brazil1
China2
Iran1
Kenya and Ghana1
Nigeria1
Zimbabwe1
USA29
Colorado (n = 5)
Indiana (n = 1)
Massachusetts (n = 1)
Michigan (n = 1)
Minnesota (n = 1)
New York (n = 1)
Texas (n = 1)
Washington (n = 1)
Multiple states (Colorado and New York) (n = 1)
State not specified (n = 16)
Geographic area not specified2
Adult or Pediatric Population
Pediatric only 25
Adult only4
Pediatric and adult9
Not specified1
Table
Table 2. Identified IIS Policy and Functional Component Themes and Definitions.
Table 2. Identified IIS Policy and Functional Component Themes and Definitions.
IIS Policy/Functional Component ThemeDefinition
Alternative site participationIIS policies and functionalities that support alternative site access and use of IIS data, such as pharmacy, school, and childcare settings [4]
Bidirectional data exchangePolicies and functionalities that enable data systems to exchange data in two directions (e.g., two-way data exchange between a vaccine provider’s EHR and the IIS); this functionality allows providers to submit vaccination data to the IIS and query the IIS for patient records and vaccination forecast [5]
Centralized reminder/recallFunctionality that enables IIS- or Department of Health-based reminders to patients about upcoming scheduled or overdue vaccinations [6]
Clinical decision supportIIS functionality that automatically identifies the appropriate vaccinations for an individual and delivers this information to the vaccination provider (also referred to as evaluation and forecasting) [7]
Cross-jurisdictional data exchangeElectronic data exchange between an IIS and IIS in other jurisdictions consistent with interoperability standards; includes policy authorizing the request and receipt of immunization data from other IIS, the functionality of an IIS to query another IIS for immunization records, and the functionality enabling an IIS to send patient records to IIS in other jurisdictions for individuals located in those jurisdictions [4]
Data elementsPolicy dictating the types of data that must or should be submitted to the IIS to record patient demographics and vaccination events; includes state-level requirements as well as CDC-endorsed data elements [4,8]
Data quality toolsFunctionalities embedded in IIS that ensure that data is complete, accurate, consistent, and timely, including automated processes for identifying, preventing, and resolving fragmented patient records and duplicate vaccination events [4]
Implied consentPolicies where patients are by default included in IIS and must actively opt out of participation; alternatively, policies may stipulate patients cannot opt out of participation, this would be mandated participation though, not implied consent. [9]
InteroperabilityThe functionality of two systems (e.g., IIS and EHR) to exchange data electronically and use the exchanged data, supported by common transport protocols, messaging formats such as Health Level 7 (HL7), and code sets [10]
Mandated reportingPolicy requiring vaccinating providers or sites of care to submit immunization data to the IIS, which can be limited to specific age groups or vaccines [9]
Patient access toolsFunctionality that allows patients to access their immunization record in the IIS (e.g., online patient IIS access portal) [11]
Patient reminder/recallFunctionality enabling provider- or practice-based reminders to patients about upcoming or overdue vaccinations (e.g., phone calls from providers to patients about upcoming vaccinations) [6]
Population health monitoringIIS-based, population-level surveillance of vaccination rates and preventable disease rates or outbreaks, including population vaccination coverage assessments, support for public health emergency responses, and policies and functionalities supporting IIS access for public and population health purposes [4]
Protection of health informationThe functionalities and policies that ensure that patient information is securely stored and shared, including confidentiality policies, IIS-enrolled site and user agreements, account management security policies (e.g., unique IIS log-in credentials), and physical and digital security protections and policies consistent with industry standards [4]
Provider assessment and feedbackFunctionality enabling evaluation of and feedback on provider performance in delivering one or more vaccinations to a patient population [12]
Researcher accessPolicies that allow researchers to request and access IIS data, including access to support vaccine-preventable disease investigation and control [4]
Vaccine ordering/inventory managementFunctionalities that support vaccine ordering for provider sites, provide the status of vaccine orders, or organize and automatically decrement administered doses from vaccine inventory [4]
Table
Table 3. Summary of IIS Policy and Functional Components Findings in Published Literature.
Table 3. Summary of IIS Policy and Functional Components Findings in Published Literature.
IIS Functional Component or PolicyOutcome CategoryAuthor Definition(s)Summary of Findings [* Finding from RCT]
Alternative site participation Data completenessPercentage of state residents between 4 months and 5 years old with immunization data in the IISQualitative support for increase [14]
Bidirectional data exchange and interoperabilityVaccine campaign effectivenessVaccine campaign effectiveness (no definition provided)Qualitative support for increase [15]
Data quality Data quality (no definition provided)Qualitative support for increase [16]
Data completenessData completeness (no definition provided)Qualitative support for increase [16]
Centralized reminder/recallVaccination series initiation ratesInitiation of the HPV 2- or 3-dose vaccine seriesSignificant increase in 1 out of 1 outcome [17] *Qualitative support for no impact [17] *
Vaccination rateDocumentation of receipt of an influenza vaccine in IISSignificant increase in 1 out of 1 outcome [18] *
Percentage of patients with at least 1 documented immunizationSignificant increase in 1 out of 1 outcome [19] *
Up-to-date immunization statusThe percentage of patients who achieved up-to-date immunization statusSignificant increase in 1 out of 1 outcome [19] *
The percentage of children with up-to-date vaccinations 6 months after recallSignificant increase in 1 out of 1 outcome [20] *
Vaccine series completion or initiationCompletion of the HPV 2- or 3-dose vaccine series among adolescents aged 11 to 19 yearsQualitative support for no impact [17] *
Cost of reminders compared to provider-based remindersCost of centralized reminder/recall using the state IIS compared to practice-based reminder/ recallQualitative support for decreased cost [19] *
Cost of centralized reminder/recall using the state IIS compared to provider-based reminder/ recallQualitative support for decreased cost [20] *
Clinical decision supportUnnecessary vaccinations or overvaccinationThe number of potentially unnecessary tetanus vaccine administrations in a baseline phase versus post-interventionSignificant decrease in 1 out of 1 outcomes [21]
Over-immunization with a second influenza vaccine doseQualitative support for decrease [22]
Overvaccination/vaccination duplicationQualitative support for decrease [13]
Immunization accuracyDelivery of accurate childhood vaccinations (aligned with recommended and eligible vaccination timelines)Qualitative support for increase [23]
Vaccination ratesImmunization rates in adults 65 years of age or older and in younger adults with diabetes or chronic obstructive pulmonary diseaseQualitative support for increase [24]
Administrative efficiencyReduced administrative burdens associated with a vaccine delivery systemQualitative support for increase [25]
Immunization errorsVaccination errors/adverse drug events reported through a voluntary systemQualitative support for decrease [26]
Vaccine-preventable outbreaksVaccine-preventable outbreaks (in general)Qualitative support for decrease [27]
Data element requirementsData timelinessThe number of days between immunization administration and submission of data to the IISSignificant decrease in 1 out of 1 outcomes [28]
Timeliness of IIS data exchange using HL7 connectionsQualitative support for increase [28]
Data completenessData element completeness of IIS data exchanged through HL7 connectionsQualitative support for no impact [28]
Completeness of data in IIS fields for vaccine manufacturer and lot numberQualitative support for increase [29]
Vaccination equityReduced gaps in vaccination coverage by race/ethnicityQualitative support for increase [15]
Data quality toolsData consistencyData consistency between routine immunization monthly summary forms and national health management information system summary formsSignificant increase in 1 out of 1 outcomes [30]
Mandated reportingData completenessCompleteness of IIS dataQualitative support for increase [15]
Patient participation in IISAdult participation in IISQualitative support for increase [31]
Patient reminder/recall (provider- or EHR-based reminders)Vaccination rateReceipt of a tetanus-diphtheria-acellular pertussis (Tdap) vaccine, meningococcal conjugate, or the first dose of the human papillomavirus (HPV) vaccine; receipt of all targeted vaccines (Tdap, meningococcal conjugate, and the first dose of the HPV vaccine) Significant increases in 2 out of 2 outcomes [32] *
Receipt of a seasonal influenza vaccine among high-risk patient groups; receipt of a seasonal influenza vaccine among children younger than age fiveSignificant increases in 2 out of 3 outcomes [33] *
Receipt of a meningococcal vaccine (MCV4); receipt of a pertussis vaccine (Tdap); receipt of an HPV-1 vaccine; receipt of an HPV-2 vaccine; receipt of an HPV-3 vaccine; receipt of all vaccinations (Tdap and all 3 HPV vaccines)Significant increases in 7 out of 12 outcomes [34] *
Receipt of scheduled vaccines at 6 weeks, 10 weeks, and 14 weeks Significant increases in 3 out of 3 outcomes [35] *
Vaccine uptake (multiple vaccine types)Qualitative support for increase [36]
Vaccination rates (in general)Qualitative support for increase [37]
Up-to-date immunization statusReceipt of MCV4, Tdap, and all three HPV vaccines among adolescent girlsSignificant increases in 3 out of 4 outcomes [33] *
Vaccine knowledgeKnowledge about the HPV vaccineSignificant increase in 1 out of 1 outcomes [38] *
Vaccination appointment scheduledVaccination appointment scheduledSignificant increase in 1 out of 1 outcomes [39]
Missed vaccination opportunitiesPrimary care visits during which a vaccine (MCV4, Tdap, and HPV vaccines) was due but not administeredSignificant decreases in 4 out of 8 outcomes [34] *
Delay of immunization receiptThose who did not delay receiving scheduled immunizations at 14 weeks; median delay of receipt of scheduled immunizations at 14 weeksSignificant decreases in 2 out of 2 outcomes [35] *
Time to vaccinationThe average number of days between the start of the study period and when seasonal influenza vaccinations occurredSignificant decrease in 1 out of 1 outcomes [33] *
Vaccine completion rateCompletion of the HPV 3-dose seriesQualitative support for no impact [38] *
RevenueRevenue generated by both standard and enhanced reminder/ recall (after subtracting the cost of reminder/ recall activities)Qualitative support for increase [39]
Vaccine-preventable diseasesVaccine-preventable diseases (in general)Qualitative support for decrease [37]
Protection of health informationProvider reportingVaccine provider reporting of immunization data to the IISQualitative support for increase [15]
Provider assessment and feedbackVaccination ratesVaccination rates (in general)Qualitative support for increase [37]
Vaccine-preventable diseasesVaccine-preventable diseases (in general)Qualitative support for decrease [37]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Donckels, E.A.; Cunniff, L.; Regenold, N.; Esselman, K.; Muther, E.; Bhatti, A.; Eiden, A.L. Understanding Diversity of Policies, Functionalities, and Operationalization of Immunization Information Systems and Their Impact: A Targeted Review of the Literature. Vaccines 2023, 11, 1242. https://doi.org/10.3390/vaccines11071242

AMA Style

Donckels EA, Cunniff L, Regenold N, Esselman K, Muther E, Bhatti A, Eiden AL. Understanding Diversity of Policies, Functionalities, and Operationalization of Immunization Information Systems and Their Impact: A Targeted Review of the Literature. Vaccines. 2023; 11(7):1242. https://doi.org/10.3390/vaccines11071242

Chicago/Turabian Style

Donckels, Elizabeth A., Luke Cunniff, Nina Regenold, Kaitlyn Esselman, Erik Muther, Alexandra Bhatti, and Amanda L. Eiden. 2023. "Understanding Diversity of Policies, Functionalities, and Operationalization of Immunization Information Systems and Their Impact: A Targeted Review of the Literature" Vaccines 11, no. 7: 1242. https://doi.org/10.3390/vaccines11071242

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop