Skip to Content
You are currently on the new version of our website. Access the old version .
  • Article
  • Open Access

26 September 2017

22 Pages

Are mHealth Interventions to Improve Child Restraint System Installation of Value? A Mixed Methods Study of Parents

,
,
,
,
,
and
1
The Children’s Hospital of Philadelphia, Philadelphia, PA 19104, USA
2
National Clinician Scholars, University of Pennsylvania, Philadelphia, PA 19104, USA
3
Creative Art Therapies and Counseling, Drexel University, Philadelphia, PA 19104, USA
4
Safekids Worldwide, Washington, DC 20037, USA

Abstract

Childhood death from vehicle crashes and the delivery of information about proper child restraint systems (CRS) use continues to be a critical public health issue. Safe Seat, a sequential, mixed-methods study identified gaps in parental knowledge about and perceived challenges in the use of appropriate CRS and insights into the preferences of various technological approaches to deliver CRS education. Focus groups (eight groups with 21 participants) and a quantitative national survey (N = 1251) using MTurk were conducted. Although there were differences in the age, racial/ethnic background, and educational level between the focus group participants and the national sample, there was a great deal of consistency in the need for more timely and personalized information about CRS. The majority of parents did not utilize car seat check professionals although they expressed interest in and lack of knowledge about how to access these resources. Although there was some interest in an app that would be personalized and able to push just-in-time content (e.g., new guidelines, location and times of car seat checks), content that has sporadic relevance (e.g., initial installation) seemed more appropriate for a website. Stakeholder input is critical to guide the development and delivery of acceptable and useful child safety education.

1. Introduction

Injuries to passengers in motor vehicle crashes remain a leading cause of death for children. The correct use of appropriate child restraint systems (CRS) in the rear seat reduces this injury risk [1], yet families continue to transport children in ways that do not optimize their protection despite extensive public awareness and educational campaigns and laws. The delivery of information about proper CRS use remains a critical public health issue. The topic of child passenger safety (CPS) is relevant to most parents, with information needs changing across time and context [2,3]. Appropriate motor vehicle restraint is a safety practice that changes with the child’s age [4], and misuse by parents remains high across all age groups [5,6,7]. While the Haddon Matrix tells us that the reasons for this misuse is likely multi-factorial [8], a well-cited body of literature has supported a significant knowledge and technical skill deficit by parents as a potential cause [9]. Research has shown that although parents and caregivers report having correctly installed a CRS, objective observations and assessments often indicate incorrect CRS installation [10,11].
As mobile technology becomes ubiquitous [12], the opportunity exists to deliver families broad-based yet adaptive and timely child passenger safety information to help address this gap in CRS practice. The use of evidence-based, theoretically grounded content delivered in convenient technical form is necessary but not sufficient to ensure success. Best practices in health communication, behavior theory and adaptive technology design should be applied to ensure that the messages and technology are relevant and positively impact caregiver behavior. Central to this approach is parent/caregiver engagement about the issue of protecting children in motor vehicles, the value of technology for prevention and the types of specific technological approaches and tools that are most useful.
Health communication studies have clearly demonstrated parental preference for tailored over generic messages [13]. This is in accordance with the elaboration likelihood model [10], which demonstrates that people are more likely to actively process and engage with personally relevant information [14,15,16]. Tailored communication provides information unique to prescribed characteristics of the parent, child or family. A 2016 qualitative study by Peng et al. found users wanting designs that were interactive, social and individualized [17]. This is in line with a movement toward applications that are not only tailored toward the users’ needs at a single time point, but also across time as the users’ needs change. Increasingly popular, these adaptive models match the user’s spatial and temporal needs with targeted content, eliminating the static nature of previous designs in mobile health applications [18,19,20]. This design allows content to be intervention-determined and context-triggered rather than user-determined and triggered [21,22,23]. While these tailored applications hold vast potential for promoting health behavior change [23], limited research has explored how adaptive mobile health applications can be used to reach parents, particularly related to injury prevention.
Therefore, the Safe Seat study aimed to match technological solutions to meeting the CPS needs of families/caregivers. Through the application of a sequential, mixed-methods approach, the study (reviewed by CHOP IRB and considered exempt) identified gaps in parental knowledge about and perceived challenges in the use of appropriate child restraints in motor vehicles while also gathering perceived value and preferences in technology for delivering CRS education. Using focus groups, data from a national sample of caregivers and adaptive technology development approaches, these findings provide guidance to program planners and researchers who are developing emerging and technology-based educational interventions to address childhood injury prevention. As a result, our study, “Safe Seat”, is a model to discuss parents’ perceptions of adaptive mobile health applications. This exploratory sequential mixed methods pilot [24] was designed to both provide direct insight on the development of an adaptive, native mobile health application for parents related to CPS and to inform development of future adaptive applications around other health topics.

2. Materials and Methods

2.1. Focus Groups

2.1.1. Aim

A series of focus groups were conducted with parents and caregivers of young children to assess perspectives on and use of existing tools to guide car seat installation, as well as to explore the acceptability of using a mobile app to guide car seat installation.

2.1.2. Eligibility and Recruitment

Parents/caregivers were recruited from five outpatient pediatric primary care practices connected to a large children’s hospital in the greater Philadelphia area. Primary care practices were chosen based on geographic location to ensure variability in participant race/ethnicity, community setting and socioeconomic status. A list of 400 potentially eligible participants was generated for each of the participating practices for review by study personnel. Criteria for inclusion in the initial sample pool included: parent/guardian has a child that is a patient at the participating practice, the child is between ages 0 and 5 (inclusive). Participant eligibility was determined according to the age of the child (child must be between ages 1 and 2, or 4 and 5, inclusive), child race, child medical insurance type (private or Medicaid), parent report of transporting a child in a car seat at least 2 times per week, parent report of installing any type of car seat at least 5 times in the last 6 months, and parent ability to travel to the local pediatric practice. Eligible parents/caregivers were invited to participate by mail and telephone. Parents and caregivers who contacted or were contacted by study staff and screened to be eligible were enrolled and scheduled for a focus group until an initial enrollment goal of at least 40 participants was achieved. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of FWA0000459.

2.1.3. Study Procedures

Upon arrival on the day of the focus group, participants completed a brief demographic questionnaire, which also gathered their child passenger restraint use patterns, as well as personal mobile device usage. Following the group session participants received a prepaid $20 gift card for their participation. Each of the eight focus groups were one hour in duration.

2.1.4. Approach

The focus group interviewers were developed by the research team (Linda Fleisher, Katherine Halkyard, Flaura Winston, and Marisol Morris), based on literature review and extensive research conducted at CHOP. The focus groups were led by the lead author who has training and extensive experience in focus group facilitation. The participants were recruited through each primary care practice and were not familiar with the research team. The focus groups were conducted at each of the participating clinics and therefore convenient for participants. A phenomenological research approach was employed for the conduct of the focus groups to explore participants’ experiences, perceptions, and concerns about CRS and their opinions on using technology to assist in car seat installation. Phenomenological research practices focus on the study of an identified phenomenon or experience from a group of individuals’ perspectives. Consumer knowledge and experiences installing car seats and utilizing digital and mobile educational resources for car seat installation, the phenomenon at hand, was explored with emphasis on parent/caregivers’ subjective experiences and personal interpretation of car-seat installation as well as their current and projected use of car seat installation resources, especially online and mobile resources.
Focus group recordings were transcribed and analyzed using inductive thematic analysis [25] to identify patterns across the dataset. Three reviewers conducted initial coding and then coding conferences were held to discuss and resolve discrepancies. In the first phase of analysis, apparent themes were identified from an initial review of the data. Focus group recordings were then transcribed and read in entirety by members of the research team, who identified initial codes. The transcripts were then imported to NVivo qualitative software (QSR International Pty Ltd., Melbourne, Australia) where data was further coded and themes and subthemes emergent across the dataset were identified and refined. Data were once again read in their entirety, along with accompanied memos, to ensure the themes identified were congruent with dataset and portrayed participants’ experience of the phenomenon. Lastly, themes were defined, categorized, and named.

2.2. National Survey

2.2.1. Aim

Based on focus group data analysis, an online survey was developed to be administered to a national audience of parents and caregivers of young children using car seats. The aim of this survey was to obtain a broader, quantitative perspective on parents’ barriers and facilitators to installing a CRS correctly, resources utilized to guide CRS installation, and perspectives on using a mobile app to guide CRS installation.

2.2.2. Eligibility and Recruitment

Survey eligibility criteria included: participant is at least age 18 and older, English-speaking, parent/guardian/routine caretaker of child between 0 and 8 years old, and cares for at least one child that uses a car seat. Participants were compensated $1.00 for completing the survey.

2.2.3. Approach

Survey topics were selected to expand on qualitative themes gathered from the focus group data, such as caregivers’ role in the installation process, parents’ assessment of perceived risks and benefits of installing a car seat correctly, parents’ attitudes about current resources available to help install a car seat, and parents’ values regarding content and features that could be included in a mobile app to guide CRS installation. Survey items addressing these topics were adapted from other validated CPS measures in the literature [26,27,28,29]. To establish content validity of the instrument, a panel of CPS and mobile app design experts from the Center for Injury Research and Prevention at Children’s Hospital of Philadelphia, Safe Kids Worldwide, and Drexel University Applied Informatics Groups (N = 5) reviewed and offered suggestions for revision.
The final survey was constructed for online administration using QualtricsTM (a commercial survey software) (Qualtrics, Seattle, WA, USA; Provo, UT, USA) and was administered online through Amazon.com’s crowdsourcing labor site, Mechanical Turk (MTurk) (www.mturk.com). MTurk is a service to “crowdsource” labor intensive, yet simple tasks that can be performed on a computer. Literature review of studies using MTurk as a recruitment tool showed that MTurk users are generally younger adults (18 to 30 years old) who are single or have small families, mostly female, and of lower income compared to traditional study samples [30]. A preliminary review of the literature indicates that the majority of studies using MTurk are related to product marketing [31] and that this study is among the first to utilize Mechanical Turk to recruit parents of young children.
A preliminary version of the survey was launched on Mechanical Turk to obtain initial population sample distribution, as well as to obtain feedback on survey readability and flow from MTurk users. The survey was revised based on initial results and comments. A final 52-item survey was developed to assess parents’ utilization of and general experiences with installing a child’s car seat, as well as perspectives on using a mobile app as a resource to obtain information about CRS installation and CRS safety. Descriptive statistics were run for all survey responses.

3. Results

3.1. Focus Groups

3.1.1. Sample Demographics

Fifty-seven parents or caregivers were initially enrolled and scheduled via telephone, with 21 parents or caregivers attending and participating in the eight in-person focus groups (37% participation rate). Groups had two to five participants each. The majority of participants were young parents or legal guardians (62% between 18 to 34 years old), female (86%), and African American (48%), with at least some college education (62%) (Table 1).
Table 1. Focus group participant demographic characteristics.
The focus group survey indicated that most parents/guardians reported having only one child using a car seat at that time (66.6%), specific car seat brand and model (71.4%). Frequency of car seat installation in the last six months varied greatly, with most parents reporting that they installed their car seat 2–4 times (33.3%) or more than 11 times (28.6%). Focus group discussions later clarified that the frequency of car seat installation was highly dependent on both the type of seat being used (i.e., infant seats have semi-permanent bases that remain in the vehicle) and how often the car seat must be moved from one vehicle to another.
All participants owned a mobile phone (100%), with the majority owning a smartphone (90.5%). Similarly, most also owned a mobile tablet device (n = 16), with the majority using their mobile phones (85.7%) or a tablet (9.5%) to connect to the Internet most often. Mobile device ownership did not appear to vary by recruitment site.

3.1.2. Qualitative Themes

Key themes emerged about car seat installation and the value of technology (specifically, mobile phone apps versus Web). The complexity of car seat installation and the recognition of the role of parents/caregivers in this process were raised in the focus groups. These themes included the actors (first-time parents, skilled parents, expert parent, good enough parent or secondary caretakers), the child development timeline (prenatal, newborn, and infancy (rear facing); transition; and toddler (forward facing)), child car seat installation continuum (preparation, execution, evaluation and resolution), installation facilitators (community agents and resources, and technological resources), and installation barriers (lack of information, adjusting car seat). See Table A1 in Appendix A for a comprehensive table of these findings. In addition, the focus group discussion focused on the use of technology to assist in this process, and key themes included proponents of app use (easy accessibility, predictability), deterrents of app use (lack of technology savvy, occasional use, perceptions of value of web-based), and app content preferences (facts about car seat installation, vehicle compatibility, video tutorials). Participants discussed some of the resources available for installation, such as the manufacturers’ website and videos/tutorials online. One parent stated, “I did look at the ones that came from the manufacturer and then I looked at what regular people posted on YouTube”. Parents described the challenges with understanding the directions in the car seat manuals. In terms of using an app to facilitate care seat installation, there were varying viewpoints. Some indicated that an app would be good since “you are outside with your phone, not your computer” and there might be other caretakers, such as grandparents, that might need to install the seat. However, some caretakers do not use apps and would not download an app for something that they would only use occasionally. The focus group findings confirmed that car seat installation is a complex set of behaviors and requires considerable knowledge and skill. Moreover, although technology can facilitate increased knowledge and skill, there are differing views of what types of technology (app or web) would be most suitable.
In addition to the general discussion, participants were asked a series of questions regarding opinions and preferences of using a mobile app to guide the car seat installation process. These questions focused on audience, ideal timing, value of using an app, features and deployment. Table 2 summarizes the findings from these discussions.
Table 2. Caregiver preferences for features/content in mobile app.
Participants were divided among proponents and opponents of using an app to guide car seat installation. Further discussion delineated the various advantages and disadvantages to using an app for this purpose. For example, proponents of app use thought an app would be easy to use, accessible and provide visual assistance. One participant said:
“When somebody else is going to need to install a car seat, for whatever reason… if it were my in-laws watching my children for some reason, or if you were my best friend or something I would direct them to something like that.”
Other participants suggested that an app would be helpful in real time:
“…You’re outside, so I have my phone with me. I wouldn’t have my computer outside with me. It would just be right there and I could check it and would be good to go…”
Another others pointed out that they like apps and know what to expect.
However, other points of view were shared as well. Some participants stated that they did not use apps:
“I actually don’t use apps. I have a smartphone but I don't use apps …”
One of the key findings from these focus group discussions is that an app might not be ideal since car seat installation is very sporadic. As one participant stated:
“If you have an app on your cell phone… it’s something you do regularly but generally you don't install car seats regularly. You could search on the computer and look for some stuff and figure it out and then you are done.”
Another participant concurred:
“I think that like in the beginning it would be used but then how often would it actually be used because once you know how to install a car seat you know? Whether you're going from one car to another to another I mean it’s all the same and so that… I think it would be good for first timers you are learning how to use your car seat but after that how much would it really be used. Would the app cover all different types of car seat instillation cause that would be important, too?”
There was some agreement that a website might be better, but if the app had more features and more content, an app might also have appeal. These features include: FAQs or tips about car seat installation, as well as car seat safety rules, laws, and guidelines; car seat-vehicle compatibility; tutorial of installing various seats in various types of cars, as well how to adjust straps and position child in seat; and access to online forums or parent created car seat reviews.

3.2. National Survey

Surveys were collected from a total of 2217 participants. Of this total, 750 participants were excluded who did not meet the survey eligibility criteria (parent of a child 0–8 years, greater than 18 years of age and English speaking). An additional subset of eligible participants was excluded from the final data set if they did not complete the full survey (n = 145), or did not meet attention check review (n = 71). Attention check review compared the responses to two ranking questions, with systematic responses to both ranking questions triggering further review of other rank order responses. Surveys with systematic responses (e.g., “123456789”, “213456789”, and “123456798”) to all rank questions were eliminated from analysis. Final analysis included 1251 participants.
Sample Demographic Characteristics (Table 1). A majority of participants was female (55.9%), with gender distribution for this sample more balanced than much of the Mechanical Turk literature [32,33]. The majority of participants were young parents or legal guardians (with 58.2% between 23 and 34 years old), Caucasian (81.3%) and with at least some college education (84.8%). There was a largely equal representation of participants from across the four U.S. regions (Northeast, South, Midwest, and West Coast), with about one quarter of participants representing each of these areas.

3.2.1. Key Findings

Parent responses to child seat use questions are summarized in Table A2 in Appendix A. The majority of participants saw themselves (70.2%) or the child’s co-parent (18.6%) as the primary installer of the car seat with over one-third of respondents re-installing a seat at least once per week. While a significant minority of participants reported challenges with installing a car seat (36.2% agree/strongly agree that “it is a hassle”), the majority reported that they always have their child ride in a seat, both in their own vehicle (95.8%) and in other vehicles (91.4%).
The majority of participants used the manual that came with the car seat to learn how to initially it (54.6%), with experienced family members being the next most common source of information (18.8%). Many participants reported not having someone else check to see if the car seat was installed correctly, such as a certified car seat technician or trained safety professional. Only 30.4% of participants reported always having someone check their car seat installation.
While most participants felt physically capable of proper car seat installation, barriers to installation appeared to be highly situational. Participants were asked to rank several circumstances in which it is most difficult to install a car seat; the highest ranked scenarios were when there is little space in the car, when there are many passengers in the car, if the child resists getting in the car seat, or when the individual is in a hurry. Even in these situations, the majority of parents/caretakers use the car seat for their child, with 91.6% of respondents indicating that they are always able to get their child buckled in the car seat even if he/she resists.

3.2.2. Current Car Seat Installation Resources

Parent responses to current resources are summarized in Table A3 in Appendix A. While most participants indicated that it is easy to find information about car seat installation (82.2%), opinions varied on the satisfaction level of the information available (only 60.7% very satisfied). When asked how they look for information about car seats, the majority of participants reported using the Internet (73.5%) and most said that while on the Internet they use a search engine, such as Google, or use YouTube to look at videos. Manufacturer and non-profit websites such as SafeKids.org were the next most visited online resources.

3.2.3. Using a Mobile App for Car Seat Installation

Parent digital use and perceptions are summarized in Table A4 in Appendix A. Similar to the focus group responses, almost all survey respondents owned a cell phone (96.7%), and, of those, most owned smartphones (90.5%). While 63.6% use their computers to access the Internet most of the time, 27.7% use their mobile phone, representing a shift from the focus group participants, who said they use their mobile phone most of the time to access the Internet.
While 62.1% of respondents stated they had looked for health information online in the past, and 80.1% had downloaded an app onto their phone in the past, only 67.9% stated they would download an app about their child’s health and safety, and only 36.2% said they would definitely use an app specifically about car seats. Most participants agreed that a mobile app about car seats would be more convenient (55.8%) than the car seat manual, while 48.1% felt it would be simpler. However, while almost half said an app would be useful (46.9%), many also said an app would not be useful after the first few uses (48.8%). Over half of participants also said they would prefer to use a website rather than an app to get information about car seats (54%).
Finally, participants were asked to indicate the types of features and content they would prefer to have in a hypothetical mobile app about car seats (Table 3). They were asked to rank information and features based on value and preference. In addition, they were asked to select and/or describe additional features and content they would prefer to have. Facts about the type of seat needed for the child, how to troubleshoot car seat installation, laws and policies about car seats, and how to buy the best car seat were top ranked information to include in the app, while FAQs and tips from experts were additional content that participants valued.
Table 3. Ranking of topics by national survey participants.

3.3. Triangulation of Sequential Qualitative and Quantitative Finding

Several emergent themes from the focus group data were used to inform the design of the national survey, including how parents used available resources for seat installation, ease with and frequency of seat installation and lack of follow-up on whether seats were installed correctly. The focus groups provided important insights about the perceived value of various technological approaches to support parents in car seat installation. Although there was a need for more information and support and mobile/web-based tools were of interest, it was not a consensus view. Quantitative MTurk national survey data allowed for these themes to be explored in further depth with attitudes, beliefs and practices in this larger population echoing those in the smaller qualitative population. Although there were differences in the age, racial/ethnic background, and educational level between the focus group participants and the national sample, there was a great deal of consistency in the need for more timely and personalized information about CRS. Largely, participants in both groups felt comfortable installing child safety seats for their children but turned to the user manual for initial information. Participants saw this information as single use and would often not return to the manual or other data sources even when installing the CRS in a new way or in a new vehicle. The majority of parents in both samples did not utilize professionals to check seat installation although they expressed interest in and lack of knowledge about how to access these resources. The use of apps vs. web-based resources raised important considerations regarding what type of information was needed to be in real-time as well as features, such as finding a car seat technician that would be enabled using mobile technology.

4. Limitations

There are a number of limitations to this study. Although the focus groups were conducted in both urban and suburban pediatric practices, they do not represent a national sample, and generalizability of these findings are limited. The national survey, conducted through MTurk, provided a broader representation of parents and caregivers. However, this was a convenience sample of parents and caregivers who have subscribed to participate in MTurk sponsored studies.

5. Discussion

The sequential mixed methods design of this study allowed for both qualitative exploration of these important issues to parents, as well as a deeper exploration of these themes in a larger population. While this study initially intended to inform the design of a mobile health educational tool for CRS use and installation, as a way to address the multi-factorial issue of child safety seat mis-use, qualitative and quantitative data revealed a different need. Parents raised concerns about a mobile application for this purpose alone, and would prefer to use a website to find information about CRS. Participants noted that information needed only once or twice for discrete periods of time, like car seat installation, was not best suited for a mobile app. Instead, mobile apps are better suited for more broad topics that may be accessed more frequently, such as to manage or look for information about their child’s health and safety. Parents noted that apps require significant and necessary space and data on their devices. For apps to be valuable, they must meet a repeated, unique need for the user related to the outcome of interest and derived from individual assessment. In our Safe Seat study, participants stated an app would be used infrequently. Although there was some interest in an app that would be personalized and able to push content (e.g., new guidelines, location and times of car seat checks), they saw content that has sporadic relevance (e.g., initial installation) as more relevant for a website, which could be accessed when needed.
Results from this study were also summarized into a schematic diagram based on the phases of car seat installation, actors involved in the installation process, and changes in installation barriers/facilitators, as described in the focus group results. Features and content were mapped to this diagram based on their value rankings from the survey responses. The schematic diagram was used to produce a preliminary web app workflow design which was used to obtain feedback from target end-users and experts in the CRS safety field. As a result of these findings, it was decided that the final product of this formative research would not be a stand-alone mobile app, but rather a website, which could be easily accessed on either a mobile device or a computer.
Following the conclusion of the Safe Seat study, Safe Kids Worldwide (www.safekids.org) developed a web-based app to assist parents who were overwhelmed by multiple decisions and choices when selecting a car seat for a child. The Ultimate Car Seat Guide (www.ultimatecarseatguide.com) from Safe Kids Worldwide (SKW), which is currently available and being widely disseminated, walks a parent through the four basic steps of buying, installing, fitting a harness and moving from one seat type to the next. Consumers have the option to create a personalized guided tour with more detailed information using their child’s weight and age. The Ultimate Car Seat Guide web app is designed to be used on a phone, tablet or computer. It is offered in English and in Spanish, and can be updated or amended relatively easily. The information offered in the Ultimate Car Seat Guide is informed by our deep experience working with families one-on-one for more than 20 years. Annually, SKW inspects approximately 120,000 car seats and in the past 20 years has inspected more than 2 million seats. SKW collects data on each seat inspected using certified child passenger safety technicians with a standardized checklist form that is later scanned and analyzed. SKW has more than 275 grass roots coalitions that work in the Buckle Up program. Overall, Safe Kids has solid data demonstrating parental misuse of car seats, errors in car seat selection and premature transitioning from one seat type to the next. While it would be ideal for every family to attend a car seat check with a certified child passenger safety technician, it is simply not possible. This online guide is created to make evidence-based, life-saving knowledge available to more families.
The Ultimate Car Seat Guide web app is now available in English and Spanish and the language in the Guide was recently evaluated by a plain reading specialist. It has been amended so both English and Spanish information is available to the person with low reading ability. SKW also plans to evaluate the impact of the Ultimate Car Seat Guide on caregiver knowledge. Questions addressing self-reported knowledge gain and demographics to allow a “scope of reach” assessment will be built into the Guide as a pop-up survey at the end of each section on the four basic steps. From September 2016 to end of July 2017, the site has received 76,690 visits with 53% from a mobile device, 40% from a desktop and 7% from a tablet device.
Central to the findings of the Safe Seat study was the use of our step-wise mixed methods approach, employing survey data gathered from Amazon.com’s crowdsourcing labor site Mechanical Turk (MTurk). While previous literature has shown MTurk’s implicit sample bias compared to other national or population based samples [34,35]. While our sample had greater females (55.9%), higher education (99.9% high school completion) and less diversity (80.1% Caucasian) than the latest census data, median income ($50,000) and parent age were in accordance with expected values. While these biases must be taken into account when interpreting the data, data on MTurk outcomes must be considered as well. Several studies have found the validity and reliability of these data to be equivalent, if not superior, to traditional methods [36,37,38]. Improved survey completion rates and validity of responses have been tied to factors such as compensation rate and survey length, which were taken into account in the design of this study.
While the findings from the study as they apply to child passenger safety must be taken into account in the design of future CPS interventions, it is important to note how the central themes from this work have broad applicability. First and foremost, the Safe Seat Study integrated stakeholder (parents, caregivers and injury prevention experts) perspectives throughout the process from the initial focus groups to the schematic technology diagram. Without this iterative process, our initial assumptions about the need for an app to improve car seat installation might have led to the development of an expensive tool that would not have been well utilized by parents and caregivers Formative research with stakeholder involvement is foundational to delivering effective and acceptable child safety educational interventions and facilitating a more sustainable and broader dissemination. Furthermore, within the public health community, we must look across specific content areas toward the broader themes emerging within literature on technology-based interventions. Both qualitative and quantitative data sources in the Safe Seat study addressed the fit of certain types of messages, such as those with a sporadic, recurrent need like child passenger restraint, with certain technology-based platforms. Consistent with previous studies, this serves as a call to action to pair formative research with strong evidence-based design pairing messaging type with technology platform. Stakeholder input is foundational to delivering effective and acceptable child safety educational interventions and facilitating a more sustainable and broader dissemination.

6. Conclusions

In today’s increasingly digital age, a broad spectrum of platforms exists for digital health interventions, each of which is best suited to address different health topics. For example, a web app can be locally installed like a native app with the data pushed to the user, but it acts like a URL that the user can take with them. Examples include email clients, news readers, and task oriented applications. In this sense, a web app would also not store large amounts of data on the users’ device, an issue that was brought up for using apps in the survey responses but would be able to still use the innovative features of a smartphone, such as video playback, GPS, camera, and movement sensors. These types of platforms can be more adaptive addressing just-in-time issues, such as the changing ages of children, new guidelines, and car seat check locations.
Furthermore, this research opens paths to explore how novel health communications methods can facilitate behavior change among diverse populations. Mobile technologies may better address gaps in language, literacy and cultural disparities since they are more interactive than print and can be easily adapted to different languages. This formative approach to technology-based intervention development can also be applied to other topics in child safety, such as vaccines, nutrition, and driving safety.

Acknowledgments

The authors would like to acknowledge the National Science Foundation (NSF) Center for Child Injury Prevention Studies at the Children’s Hospital of Philadelphia (CHOP) for sponsoring this study and its Industry Advisory Board (IAB) members for their support, valuable input and advice. The views presented are those of the authors and not necessarily the views of CHOP, the NSF, or the IAB members. We also acknowledge the contribution of NotSoldSeparately (NSS) in the development of wireframes for user input.

Author Contributions

Linda Fleisher conceived and designed the study and led the manuscript development; Katherine Halkyard coordinated and performed the study and contributed to the manuscript; Emily Sykes assisted with study coordination and contributed to the manuscript; Marisol S. Norris analyzed the focus group data; Danielle Erkoboni assisted in analysis and manuscript preparation; Flaura Winston served as senior advisor and contributed to the manuscript development; and Lorrie Walker provided guidance to the concept of the study and contributed to the manuscript development.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

Appendix A

Table A1. Focus group themes and quotations.
Table A2. Parents’ use of child restraints.
Table A3. Parents’ car seat installation resources.
Table A4. Parents’ use and preferences around digital media and devices.

References

  1. Durbin, D. Technical report—Child passenger safety. Am. Acad. Pediatr. 2017, 127, 1050–1066. [Google Scholar]
  2. Burstein, D.; Zonfrillo, M.R.; Baird, J.; Mello, M.J. Child passenger safety technician consultation in the pediatric primary care setting. Clin. Pediatr. 2017. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Bachman, S.L.; Salzman, G.A.; Burke, R.V.; Arbogast, H.; Ruiz, P.; Upperman, J.S. Observed child restraint misuse in a large, urban community: Results from three years of inspection events. J. Saf. Res. 2016, 56, 17–22. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Centers for Disease Control. Available online: http://www.cdc.gov/motorvehiclesafety/child_passenger_safety/cps-factsheet.html (accessed on 24 April 2017).
  5. Decina, L.E.; Kathleen, Y.K. Child safety seat misuse patterns in four states. Accid. Anal. Prev. 1997, 29, 125–132. [Google Scholar] [CrossRef] [Scilit]
  6. Eby, D.W.; Lidia, P.K. A statewide analysis of child safety seat use and misuse in Michigan. Accid. Anal. Prev. 1999, 31, 555–566. [Google Scholar] [CrossRef] [Scilit]
  7. Skjerven-Martinsen, M.; Naess, P.A.; Hansen, T.B.; Staff, T.; Stray-Pedersen, A. Observational study of child restraining practice on Norwegian high-speed roads: Restraint misuse poses a major threat to child passenger safety. Accid. Anal. Prev. 2013, 59, 479–486. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  8. William, H., Jr. Advances in the epidemiology of injuries as a basis for public policy. Public Health Rep. 1980, 95, 411. [Google Scholar]
  9. Bilston, L.E.; Wei, D.; Julie, B. Factors predicting incorrect use of restraints by children travelling in cars: A cluster randomised observational study. Inj. Prev. 2010. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  10. Macy, M.L.; Cunningham, R.M.; Resnicow, K.; Freed, G.L. Disparities in age-appropriate child passenger restraint use among children aged 1 to 12 years. Pediatric 2014, 133, 262–271. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  11. Hoffman, B.D.; Gallardo, A.R.; Carlson, K.F. Unsafe from the start: Serious misuse of car safety seats at newborn discharge. J. Pediatr. 2016, 171, 48–54. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Decina, L.E.; Lococo, K.H. Observed latch use and misuse characteristics of child restraint systems in seven states. J. Saf. Res. 2007, 38, 273–281. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Pew Research Center: Internet and Technology. Available online: http://www.pewInternet.org/fact-sheet/mobile/ (accessed on 12 July 2017).
  14. Kreuter, M.W.; Wray, R.J. Tailored and targeted health communication: Strategies for enhancing information relevance. Am. J. Health Behav. 2003, 27, S227–S232. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Petty, R.E.; Cacioppo, J.T. The elaboration likelihood model of persuasion. In Advances in Experimental Social Psychology; Olson, J.M., Zanna, M.P., Eds.; Academic Press: New York, NY, USA, 1986; pp. 123–205. [Google Scholar]
  16. Cacioppo, J.T.; Harkins, S.G.; Petty, R.E. The nature of attitudes and cognitive responses and their relationships to behavior. In Cognitive Responses in Persuasion, 1st ed.; Petty, R.E., Ostrom, T.M., Eds.; Psychology Press: New York, NY, USA, 1982; pp. 31–53. [Google Scholar]
  17. McGuire, W.J. Theoretical Foundations of Campaigns. In Public Communications Campaigns; Rice, R.E., Atkins, C.K., Eds.; SAGE: Beverley Hills, CA, USA, 1991; pp. 41–70. [Google Scholar]
  18. Petty, R.E.; Cacioppo, J.T. Attitudes and Persuasion: Classic and Contemporary Approaches; Westview Press: Boulder, CO, USA, 1981. [Google Scholar]
  19. Peng, W.; Kanthawala, S.; Yuan, S.; Hussain, S.A. A qualitative study of user perceptions of mobile health Apps. BMC Public Health 2016, 16, 1158. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. Spruijt-Metz, D.; Wen, C.K.; O’Reily, G.; Li, M.; Lee, S.; Emken, B.A.; Mitra, U.; Annavaram, M.; Raqusa, G.; Narayanan, S. Innovations in the use of interactive technology to support weight management. Curr. Obes. Rep. 2015, 4, 510–519. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  21. Spruijt-Metz, D.; Nilsen, W. Dynamic models of behavior for just-in-time adaptive interventions. IEEE Pervasive Comput. 2014, 13, 13–17. [Google Scholar] [CrossRef] [Scilit]
  22. Riley, W.T.; Rivera, D.E.; Atienza, A.A.; Nilsen, W.; Allison, S.M.; Mermelstein, R. Health behavior models in the age of mobile interventions: Are our theories up to the task? Transl. Behav. Med. 2011, 1, 53–71. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Naughton, F. Delivering “just-in-time” smoking cessation support via Mobile phones: Current knowledge and future directions. Nicotine Tob. Res. 2017, 19, 379–383. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. Creswell, J.W.; Klassen, A.C.; Clark, V.L.; Smith, K.C. Best Practices for Mixed Methods Research in the Health Sciences; National Institutes of Health: Bethesda, MD, USA, 2011; pp. 2094–2103. [Google Scholar]
  25. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef] [Scilit]
  26. Uherick, L.; Gorelick, M.H.; Biechler, R.; Brixey, S.N.; Melzer-Lange, M. Validation of two child passenger safety questionnaires. Inj. Prev. 2010, 16, 343–347. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. Macy, M.L.; Clark, S.J.; Freed, G.L.; Butchart, A.T.; Singer, D.C.; Sasson, C.; Meurer, W.; Davis, M. Carpooling and booster seats: A national survey of parents. Pediatric 2012, 129, 290–298. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. Simpson, E.M.; Moll, E.K.; Kassam-Adams, N.; Miller, G.J.; Winston, F.K. Barriers to booster seat use and strategies to increase their use. Pediatric 2002, 110, 729–736. [Google Scholar] [CrossRef] [Scilit]
  29. Chew, L.D.; Griffin, J.M.; Partin, M.R.; Noorbaloochi, S.; Grill, J.P.; Snyder, A.; Van Ryn, M. Validation of screening questions for limited health literacy in a large VA outpatient population. J. Gen. Intern. Med. 2008, 23, 561–566. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Paolacci, G.; Chandler, J.; Ipeirotis, G.P. Running experiments on Amazon mechanical Turk. Judgm. Decis. Mak. 2010, 5, 411–419. [Google Scholar]
  31. Kittur, A.; Chi, E.H.; Suh, B. Crowdsourcing user studies with mechanical Turk. In Proceedings of the 2008 Conference on Human Factors in Computing Systems, (CHI 2008), Florence, Italy, 5–10 April 2008. [Google Scholar]
  32. Casler, K.; Bickel, L.; Hackett, E. Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Comput. Hum. Behav. 2013, 29, 2156–2160. [Google Scholar] [CrossRef] [Scilit]
  33. Ross, J.; Irani, L.; Silberman, M.S.; Zaldivar, A.; Tomlinson, B. Who are the crowdworkers? Shifting Demographics in Mechanical Turk. In Proceedings of the 2010 Conference on Human Factors in Computing Systems, (CHI 2010), Atlanta, GA, USA, 5–10 April 2010. [Google Scholar]
  34. Huff, C.; Tingley, D. “Who are these people?” Evaluating the demographic characteristics and political preferences of MTurk survey respondents. Res. Polit. 2015. [Google Scholar] [CrossRef] [Scilit]
  35. Buhrmester, M.; Kwang, T.; Gosling, S. Amazons mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspect. Psychol. Sci. 2011. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  36. Berinsky, A.J.; Huber, G.A.; Lenz, G.S. Evaluating online labor markets for experimental research: Amazon.com mechanical. Turk. Polit. Anal. 2012, 20, 351–368. [Google Scholar] [CrossRef] [Scilit]
  37. Shapiro, D.N.; Chandler, J.; Mueller, P.A. Using mechanical Turk to study clinical populations. Clin. Psychol. Sci. 2013, 1, 213–220. [Google Scholar] [CrossRef] [Scilit]
  38. Hauser, D.J.; Schwarz, N. Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behav. Res. Meth. 2015, 48, 400–407. [Google Scholar] [CrossRef] [Scilit] [PubMed]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.