1. Introduction
Over the past several decades natural and human disasters have increased substantially, bringing mass devastation to the people and places impacted [
1]. New York City has experienced multiple disasters including extreme weather events (e.g., Hurricane Sandy 2012), infectious disease outbreaks (e.g., Ebola, 2014; Measles, 2019; COVID-19, 2020), and terrorist attacks and attempts (e.g., WTC Truck Bombing 1993; 9/11 WTC Attacks, 2001). Following a disaster, help from local officials and first responders may be delayed for hours or days. Thus, risks for developing health problems from exposure to the elements, food and water shortages, damaged sanitation facilities, and impaired communication lines can lead to excess morbidity [
2]. In the aftermath of Hurricane Sandy, for example, many experienced food and water shortages and were left without power or heat [
3]. Thus, it seemed that a large proportion of those impacted by Sandy did not have an adequate stockpile of supplies or a clear emergency evacuation plan to mitigate the adverse effects of the hurricane [
4].
Given the resulting personal and public hazards following a disaster, it is critical that households and communities are adequately prepared for emergencies to help mitigate these effects. Research has demonstrated that only 40–50% of households in the United States are disaster prepared [
5], such that they have, readily available, an essentials kit, as well as an established disaster plan [
2]. There is thus a pressing need for effective public health interventions to increase household preparedness by addressing key barriers for and motivators to increase preparedness.
While various interventions—ranging from brochures and leaflets to digital tools and expert-led sessions—have aimed to improve preparedness, most studies have focused on general populations and have not directly assessed individuals with prior disaster exposure. Notably, enrollees in the World Trade Center Health Registry (WTCHR), despite their direct experience with 9/11 and other disasters, report significantly lower preparedness levels than the national average—only 18.8% compared to 25% [
6]. This paradox suggests a unique psychosocial profile within this group, possibly influenced by “optimistic bias,” where prior survival diminishes perceived vulnerability to future events [
7].
Mixed degrees of success have been found among studies which employed pamphlets and leaflets in their intervention methodology. For instance, Barik and colleagues compared the use of pamphlets to posters and found that pamphlets were particularly effective for adult populations, as opposed to child/adolescent and elderly populations [
8]. Similarly, Beaujean and colleagues compared leaflets and movies for increasing subject’s knowledge of Lyme disease in the Netherlands, demonstrating that both methods were more effective than a control group in increasing knowledge [
9].
Recent research has employed more complex and resource-intensive interventions. For example James and colleagues (2020) integrated mental health and emergency preparedness training through expert-led discussions, which resulted in increased preparedness and reduced symptoms of mental health disorders, such as anxiety and PTSD [
10]. Noor used a health belief-based intervention to improve knowledge and skills in emergency preparedness, showing significant gains compared to a control group [
11]. Similarly, Adiyaman and colleagues found that earthquake preparedness training significantly improved psychological resilience and preparedness among mothers of children with physical disabilities [
12].
These studies illustrate the diversity in approaches to improving preparedness and highlight the potential of more intensive interventions. However, no study has compared the use of pamphlets to other delivery modalities in a disaster-exposed population such as the World Trade Center Health Registry. Given the linguistic diversity of New York City, it was also critical to include Spanish-speaking individuals to ensure equitable access to emergency preparedness information; language-appropriate outreach is essential in a city where nearly one in four residents speaks Spanish at home, particularly in high-stakes disaster contexts where timely understanding can save lives. As such, given the gaps and lack of evidence on how best to improve preparedness in this population, we conducted a randomized controlled trial to compare the effectiveness of two practical interventions: a mailed brochure and a phone-based preparedness discussion. These particular approaches were utilized for their accessibility, scalability, and real-world applicability in large-population public health settings. The purpose of the study was to determine whether one approach was superior to the other in improving knowledge of emergency preparedness. This research seeks to inform future public health strategies for improving emergency readiness among disaster-exposed populations.
2. Methods
2.1. Study Design
Since initially we did not know which method was best for increasing awareness and knowledge of emergency preparedness, we wanted to compare two practical approaches to determine this. The best way to accomplish this methodologically was to compare the two emergency preparedness approaches using groups that demonstrated shared characteristics, which in our study, is having been exposed to the 9/11 Disaster. By ensuring a similar shared characteristic, we were able to then assess how the design approach employed may improve knowledge of emergency preparedness. The best method for achieving such a comparison is the randomized controlled trial (RCT), in which subjects are randomly assigned to treatment groups, ensuring the two groups are statistically the same. Therefore, a two-arm parallel group randomized controlled trial was designed to compare the effectiveness of a phone-based household emergency preparedness intervention with a mailed informational brochure on household emergency preparedness amongst a sample of World Trade Center Health Registry enrollees residing within New York City. This RCT was registered with
www.clinicaltrials.gov; Identifier: NCT06737510.
2.2. Participants
The World Trade Center Health Registry comprises a longitudinal panel cohort of 71,423 enrollees who were exposed to the World Trade Center attacks in New York City on 11 September 2001. The Registry’s methods have been further described in prior publications [
13]. The WTCHR protocol was approved by the Centers for Disease Control and Prevention (CDC) and NYC Department of Health and Mental Hygiene (DOHMH) institutional review boards (IRB # 02-058) [
13]. All enrollees consented to be in the Registry. The protocol for the present study was approved by the DOHMH IRB on 21 November 2018. Enrollee informed consent for the present study was obtained during the initial outreach phone calls which were conducted between 2003 and 2004. All enrollees in the present study consented to participate. The subjects for this study were randomly selected from the Registry’s Wave 4 survey, subject to the following constraints: English and Spanish-speaking Registry enrollees who were older than 18 years on 9/11, resided in New York City, completed the Registry’s Wave 4 survey, and who were not 9/11 rescue/recovery workers for the New York Police Department (NYPD) or Fire Department of New York City (FDNY). Results from the present study were expected to apply to the entire Registry population. This trial is registered with clinicaltrials.gov (# NCT06737510).
2.3. Intervention
A brochure intervention to enhance household emergency preparedness was developed to include the following topics: (1) a brief statement regarding why emergency preparedness is important; (2) how to make a household disaster plan (or family communication and evacuation plan); (3) how to assemble an “emergency supply kit” of stockpiled supplies; (4) instructions on how to pack a “go bag” and what it should contain; and (5) an emergency reference card for all household members, with essential information (name, meeting place nearby or outside of neighborhood, contact numbers, evacuation location, doctors’ names and numbers). The brochure, entitled “Ready New York: Preparing for Emergencies,” was a pocket guide, available from NYC Emergency Management in several languages (
https://www.nyc.gov/assets/em/downloads/pdf/rny_pocket_english.pdf, accessed on 12 January 2025). In addition to the information mentioned above, it included several resources: disaster contact numbers for emergency and non-emergency calls: 911 or 311, NYC Emergency Management, as well as a website for additional information on preparedness: NYC.gov/hazards, with information specific to New York City hurricane evacuation zones, and how to receive free emergency notifications.
The informational brochure intervention followed the format and topics above and was mailed to participants in the appropriate languages during the intervention period. The phone-based intervention consisted of a 15–20 min talk session completed over the phone following the format and topics noted for the brochure group. The phone intervention mentioned and offered the link to the NYC.gov/hazards website. Features of the two interventions are summarized in
Table 1.
2.4. Procedures
This study consisted of a baseline survey, then the application two months later of one of two possible interventions designed to increase emergency preparedness over time, followed by a follow-up survey two months after that. The purpose of this study was to compare the effectiveness of the two interventions, among a sample of English- and Spanish-speaking Registry enrollees who resided in NYC and completed the Registry Wave survey (W4) in 2015–2016. Baseline information was collected from all participants over the phone and used a modified CASPER preparedness template, a reliable and valid epidemiological survey designed to gather individual household information about a community to respond to needs and make informed policy and programmatic decisions [
14]. The baseline survey was designed to assess three domains: (1) basic household information; (2) household emergency and evacuation plans; and (3) household communication methods. The follow-up survey, also conducted by phone, was administered after the intervention to evaluate changes in enrollees’ level of emergency preparedness.
Between February 2019 and March 2020, eligible enrollees were identified and contacted in batches of 100 enrollees. Introductory (“Lead”) letters were mailed to a total of 2000 enrollees who completed the Wave 4 survey, including 400 Spanish- speaking enrollees, and excluding any enrollee who reported being a rescue and recovery worker affiliated with FDNY or NYPD due to their increased emergency response training. Approximately two weeks after the initial mailing, Registry staff members conducted the initial outreach phone call, whereby verbal consent to participate was obtained, and the baseline data was subsequently collected.
2.5. Randomization
Lead letters were sent out to participants in batches of 100. Enrollees who consented were alternately assigned to the brochure or phone call groups to ensure balance between the two intervention groups. Neither the researchers nor participants were blinded to intervention assignment.
A total of 1800 enrollees were assessed for eligibility and 1787 received a recruitment telephone call. Of those receiving a call, 1082 enrollees could not be contacted; 705 enrollees consented to participate in the study (
Figure 1). Due to a programming error in the assignment of enrollees to interventions, the brochure and phone call groups developed a temporary imbalance. This was corrected by assigning 68 consecutively consented enrollees to the brochure group.
2.6. Outcomes
The primary outcome was emergency preparedness, assessed using a 10-item version of the CDC’s Community Assessment for Public Health Emergency Response (CASPER) questionnaire [
14]. Each question measured a binary (yes/no) indicator of specific preparedness behaviors or resources. The questions covered two main domains: (1) communication planning (e.g., having a family meeting place, copies of documents, and an emergency communication plan), and (2) preparedness supplies (e.g., emergency food, water, medication, and go-bag items). The total score, ranging from 0 to 10, represented the number of preparedness actions reported. A higher score indicated greater household preparedness. Respondents were considered well-prepared if they scored 9 or 10 out of 10.
2.6.1. Baseline Preparedness
Baseline emergency preparedness was captured from February 2019 to March 2020, using an adapted version of the CASPER instrument [
14]. A total of ten questions were asked, rated on a dichotomous scale. Sample items include: Does your household have any of the following emergency plans? Emergency Communication plan such as a list of numbers and designated out of town contact. Designated meeting place immediately outside your home or close by in your neighborhood. Copies of important documents in a safe location (waterproof container). Each response was assigned a value of one for a “yes” and zero for a “no”. The total emergency preparedness score was the sum of the ten responses, ranging from 0 (not prepared) to 10 (completely prepared). Respondents were considered prepared in this study if they scored a 9 or10. These questions included addressing whether participants had disaster supplies and emergency communication plans. Other components of the primary outcome included the total score over the five communication questions, the total score over the five emergency kit questions, and each of the ten individual CASPER items. The ten questions of the CASPER instrument are listed in the
Appendix A.
2.6.2. Follow-Up Preparedness Variables
The CASPER instrument was also used to measure emergency preparedness in the post-intervention follow-up evaluation, two months after the intervention and four months after the baseline survey.
2.7. Wave Data Variables
The Registry conducted surveys (called “waves”) of its enrollees every four to five years. The initial survey (Wave 1) took place from 2003 to 2004, with subsequent surveys taking place during 2006–7 (Wave 2), 2011–12 (Wave 3), and 2015–16 (Wave 4). Wave 1 fielded questions about basic demographics, exposure to the disaster, and pre-9/11 and post-9/11 chronic disease. Wave 2 contained further detailed questions relating to enrollees’ 9/11 exposure, and Waves 2–4 asked about the subsequent development of chronic physical and mental disease.
2.7.1. SocioDemographics Variables
Demographic characteristics included were age at the Wave 1 survey, sex collected at Wave 1, race/ethnicity from the Wave 1 survey, education from the Wave 1 survey, income at Wave 3 or Wave 4, and recruitment source (List: Enrollee located from list of lower Manhattan building inhabitants; Self: Enrollee responded to media campaign).
2.7.2. 9/11 Exposure
Participant exposure at 9/11 was measured using a derived variable comprising eleven items developed from the Wave 1 and wave 2 surveys. Sample items included the number of horrific events witnessed on 9/11, dust cloud exposure intensity, and general measure of number of 9/11 exposures (e.g., being in the north or south WTC Tower or other fully collapsed building on 9/11; moving out of home for at least 24 h between 9/11 and 9/18). This measure has been used and validated in several published studies [
13,
15,
16]. For the present study the 9/11 exposure was collapsed to four categories: low (0–1), medium (2), high (3), and very high (4–11).
2.7.3. Exposure to Hurricane Sandy
Disaster exposure during Hurricane Sandy was measured using seven categories captured using dichotomous (Yes/No) responses. Enrollees could select all the options that applied. These categories included: exposure to sewage, debris, dirty or contaminated flood water, visible mold, exhaust fumes from generators, diesel fuel or heating oil leaks or spills, or no exposure. This measure has been validated in other published works [
6]. This Sandy exposure was collapsed into a dichotomous variable.
2.8. Analytic Strategy
To evaluate baseline emergency preparedness for the two interventions, means and frequency statistics were calculated for the baseline sample to evaluate the association of sociodemographic variables from the Wave 1, 2, 3, and 4 surveys with the intervention (brochure vs. phone call). A χ2 test was employed for categorical variables, where a p-value > 0.05 meant there was no association between a particular sociodemographic variable and the intervention. A t-test was employed to compare the association of continuous variables with the intervention. We also calculated frequencies for the emergency preparedness items by the intervention.
The goal of the main analysis was to determine if there was a statistically and substantially significant advantage of one intervention over the other in improving knowledge of emergency preparedness. Since there were repeated measures per enrollee (e.g., the baseline and post-intervention preparedness evaluations), we tested our main hypothesis, stated above, using Generalized Estimating Equations (GEE) following the intention-to-treat (ITT) principle. We ran GEE regressions separately for the total CASPER preparedness score, the total score for preparing an emergency kit, the total score for preparing communication plans, and each of the ten individual items. GEE regressions on the three total CASPER scale sums used a negative binomial distribution with a log ink, while GEE regression on individual CASPER items used a Poisson distribution with a log link (the latter because the prevalence of many items was greater than 10 percent) and robust standard error estimates. Multiple comparison corrections were applied to GEE regressions for individual CASPER items. Since some enrollees were missing the primary outcomes at the post-intervention assessment, we employed Multiple Imputation under the Missing at Random (MAR) assumption to fill in the missing outcome data for the ITT analysis, using the SAS-compatible program IVEware version 0.3 (University of Michigan, Ann Arbor, MI, United States). The Per-Protocol (PP) approach was also employed. It included only those enrollees who followed the protocol. Since no enrollees switched treatment arms during the trial, the Per Protocol approach was equivalent to a “complete cases” analysis. Since this study overlapped with the start of the COVID pandemic, we performed as a sensitivity analysis of the Per-Protocol analysis separately for enrollees who completed the post-assessment before vs. after March 2020.
4. Discussion
We compared the effects of a brochure mailed to one group of enrollees of the World Trade Center Health Registry with a phone call to another group, to determine if one method was more effective at increasing knowledge of emergency preparedness. We assessed changes using the total CASPER score, its communication and kit subscales, and the ten individual CASPER items.
We found that emergency preparedness increased over time from baseline to post-intervention, with overall preparedness rising by 17%. Some individual items improved by as much as 70%. However, we observed no statistically significant difference between the two intervention groups over time; brochures and phone calls were, on average, equally effective at improving preparedness.
The effect size achieved here, while statistically significant, was modest. The average preparedness score rose from approximately 5.5 to 6.5 out of 10—well below the threshold of 9 or 10 typically associated with being “well-prepared” in the event of a real emergency. This raises questions about the practical significance of the findings, suggesting that while the interventions were helpful, they may not have translated into comprehensive readiness.
Several factors may explain these modest gains. Psychological readiness—including prior trauma exposure and perceived threat—could have influenced participants’ motivation or ability to act. Educational background and health literacy may also have played a role, particularly for those who found the materials difficult to interpret or implement. Moreover, the interventions were delivered only once, limiting their potential to drive sustained behavior change.
The interventions employed here were low-intensity, and the absence of a no-intervention control group further limits interpretation. Nonetheless, our results align with earlier studies showing modest gains from minimal interventions [
9,
17] but contrast with findings from more intensive strategies. For example, an RCT with Latinos in Los Angeles found substantially greater improvements in preparedness among those participating in facilitated small group discussions (“pláticas”) compared to those receiving mailed materials [
18]. Similarly, other studies employing face-to-face education or group-based training reported preparedness gains of 30–44% over controls [
10,
12].
Importantly, while the average effect here was similar across groups, future research should explore whether specific populations—such as older adults or those with limited literacy—might benefit more from phone-based or interactive formats. These individuals may face barriers in engaging with written materials and could benefit from more accessible, personalized communication. In a diverse urban setting like New York City, tailoring interventions to reach these subgroups could improve equity and overall effectiveness.
These findings highlight the limits of low-touch interventions and point to the need for more intensive, sustained, or community-embedded strategies. Future programs might incorporate multiple contact points, peer or community leader engagement, or culturally tailored content. Embedding preparedness messaging within trusted service systems—such as healthcare or social services—could also support longer-term behavior change.
This study had several limitations. First, randomization was briefly disrupted, causing a temporary imbalance between groups. This was corrected quickly, and baseline analysis confirmed balance on key covariates but this departure from strict randomization could have had residual effects on the analysis in that the two intervention groups may not have been strictly comparable on variables not included in the baseline analysis. Second, no information was collected on whether brochure recipients received or read the materials, limiting insight into engagement This means that we cannot know the “dose” of the brochure intervention and if it was equivalent to that for the phone call (i.e., outcome equivalence). Third, there was no true control group receiving no intervention; future studies should include such a group for clearer effect attribution. Fourth, although the study was conducted partly during the COVID-19 pandemic, analyses showed no significant differences between participants enrolled before and during the pandemic. Nonetheless, pandemic-related stressors may have influenced responses and priorities. Fifth, this study was limited to English- and Spanish-speaking subjects in an urban environment. While it is likely that this study’s protocol could be applied to speakers of other languages in an urban setting, this protocol would be more difficult to apply in dispersed rural areas.
Academically, this study contributes to emergency preparedness research by providing one of the few direct comparisons of two low-intensity intervention modalities in a disaster-exposed population, using validated CASPER metrics. The focus on World Trade Center Health Registry enrollees adds insight into preparedness behavior among individuals with shared trauma histories. The study also provides a replicable evaluation framework for future work in this area.
Practically, our findings suggest that while low-cost, scalable interventions like brochures and phone calls can lead to modest improvements, they may be insufficient for achieving real-world readiness. Public health agencies should consider combining such strategies with higher-impact approaches, particularly when targeting vulnerable or hard-to-reach populations. Even small gains, however, are meaningful when deployed at scale—especially in post-disaster contexts. This study underscores the importance of reaching populations with simple preparedness messaging, while also calling attention to the need for more targeted, equity-informed approaches to risk communication.