Next Article in Journal
Personalized Technological Support for Informal Caregivers of Older People with Dementia: A Co-Design Approach Involving Potential End Users and Healthcare Professionals in Three Focus Groups in Italy
Next Article in Special Issue
Social and Preventive Factors That Explain Oral Health among Pregnant Women in the Canton of Cuenca, Ecuador
Previous Article in Journal
Cluster Donation: How Future Healthcare Professionals Bound Certain Types of Tissues and Biomedical Research and How It Affects Their Willingness to Donate
Previous Article in Special Issue
Factors Associated with the Prevalence of Postpartum Anxiety Disorder and Depression in Syrian Migrant Women Living in Turkey: A Cross-Sectional Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Effects of Mobile-Application-Based Parenting Support Program for Premature Infants’ Mothers

College of Nursing, Eulji University, Uijeongbu 11759, Republic of Korea
*
Authors to whom correspondence should be addressed.
Healthcare 2023, 11(19), 2639; https://doi.org/10.3390/healthcare11192639
Submission received: 8 August 2023 / Revised: 23 September 2023 / Accepted: 24 September 2023 / Published: 27 September 2023
(This article belongs to the Special Issue Maternal and Child Health and Healthcare)

Abstract

:
Background: Premature infants are separated from their parents after birth and are admitted to the neonatal intensive care unit. Separation of babies from mothers causes various problems. Therefore, as the number of premature infants increases every year, educational programs to continuously support baby care are needed. Methods: In this study, a nonequivalent control group non-synchronized design was employed. The subjects of the study were 52 mothers of premature infants (16 in the app-based program group, 18 in the electronic document group, and 18 in the control group) using a portal site for parents from February to April 2023. The app-based program and electronic document group followed a parenting support program for two weeks. Results: There were significant differences in maternal confidence between the app-based, electronic document, and control groups (F = 7.354, p = 0.002). Conclusions: Providing necessary information and emotional support through professional counseling centers’ app-based programs for premature infants’ mothers, and providing interaction through member community bulletin boards, are proposed to form an effective educational program.

1. Introduction

In 2021, a total of 23,800 premature infants born in South Korea at less than 37 weeks of gestation represented 9.2% of all the births, 0.7% up from the previous year [1]. In 2022, the World Health Organization noted that approximately 15 million infants are now born prematurely each year, which means that at least 1 out of 10 births is premature [2]. For this reason, premature infants’ parents, medical staff, and relevant experts and institutions highlight that it should be a priority to improve the existing education and support for premature infants’ parents [3].
Most premature infants are institutionalized in neonatal intensive care units (NICUs) to receive special treatment from medical staff right after birth according to their gestational age, weight, and condition [4]. It has been reported that many parents suffer from stress during their infant’s stay in the NICU [5,6,7]. In particular, mothers can suffer from mental distress after giving birth to a premature infant [8] and experience negative emotions such as stress, anxiety, anger, and depression due to their infant’s gestational age, weight, long-term hospitalization right after birth, and so on [9].
Separation of parents from infants who are hospitalized can adversely affect both of them [10]. Unable to lead in decision-making on their newborn’s treatment, they can feel they have lost control and have difficulty in forming a parental identity [11,12]. Such a situation can prevent them from performing maternal roles effectively; therefore, intervention aimed at positive changes in maternal identity is required [13]. In addition, the COVID-19 pandemic caused most of the NICUs to place restrictions on visits in order to protect the infants from the risk of infection all around the world [14,15]. This situation increased parents’ anxiety and mental distress; furthermore, long-term separation from their newborn not only made it difficult for many parents to become attached but also hampered the infant’s growth and development [16].
Premature infants are developmentally behind and are at a relatively higher risk of being exposed to potential harm, compared with term infants, in terms of growth and development due to diverse complications, including some possibly caused by the course of treatment [17].
Most premature infants’ parents attach great importance to any information that the NICU medical staff provides regarding their infant. However, they may not always receive desirable information. Often, premature infants’ parents attempt to obtain additional information through other types of medical services, written teaching materials, or Internet searches [18]. More recently, they have begun to use social media, search engines, and mobile applications to obtain information about their newborn’s health; in particular, young parents tend to prefer using mobile applications [19,20,21]. Due to the worldwide COVID-19 pandemic having normalized noncontact education, the development of a smartphone-based education application may be an effective way of providing information to premature infants’ parents [22].
In the USA and Europe, educational mobile applications are already being actively developed for parents of premature infants. Research involving a systematic literature review of mobile app assessment in parents of premature infants staying in NICUs examined 27 applications retrieved from the Google and Apple app stores [23]. Other international and domestic studies include a study confirming the effects of a constant nutrition control intervention based on a mobile healthcare application on the growth and development of premature infants [24], a study on the development of a smartphone education app for premature infants’ parents [25,26], and a study on an intervention program for premature infants’ parents [27,28,29]. South Korea currently lacks app-based education programs for premature infants’ mothers when compared with other countries. Most of the existing intervention programs provide a one-session program, not long-term education provided over all stages of care. Furthermore, the majority of existing app-based education programs focus either on premature infants’ health problems or on their growth and development, while very few of them involve emotional support for their mothers.
Considering that the birthrate of premature infants increases on an annual basis, the issue of their mothers’ emotional distress is timely to resolve. Accordingly, this study aimed to develop and implement a parenting support app-based education program that permits premature infants’ mothers to participate actively in care from the early stage of childrearing, provides them with emotional support, and provides professional information about infants, and assess its usefulness.

Hypotheses

The research hypotheses on the effects of a parenting support app-based education program for premature infants’ mothers were as follows:
(1)
There will be differences in the maternal identity of mothers between the app-based program group, electronic document group, and control group.
(2)
There will be differences in maternal postpartum attachment between mothers in the app-based program group, electronic document group, and control group.
(3)
There will be differences in maternal confidence between mothers in the app-based program group, electronic document group, and control group.

2. Materials and Methods

2.1. Research Design

This study used a nonequivalent control group non-synchronized design to develop and apply a parenting support app-based education program for premature infants’ mothers and confirm differences in its effectiveness through comparison with a parenting support PDF-based education group and a control group.

2.2. Subjects

The sample size was estimated using a G*Power 3.1.9.7 program. The sample size for the F-test was 51 persons, with the significance level of α = 0.05, testability (1–β) of 0.8, and effect size of 0.45 [30]. A total of 52 respondents were finally chosen: 16 in the app-based education program group, 18 in the electronic document group, and 18 in the control group. To prevent the experiment being compromised by communication between groups, data analysis was not synchronized between the control group and the experimental groups, as shown in Figure 1.
The subjects were recruited by posting a notice advertising for participants on the bulletin boards of two portal sites for parents (Mom’s Holic Baby and Beautiful Preterm Babies).
The inclusion criteria for subjects were as follows:
  • Mothers of premature infants who were born less than a month before at 31–37 weeks of gestational age and who weighed 1.5–2.5 kg at birth;
  • Mothers of premature infants who were staying in the NICU or being given care at home;
  • Mothers capable of using a smartphone and with Wi-Fi or the necessary data;
  • Mothers who understood the purpose of this study and agreed to participate.
  • The exclusion criteria for subjects are as follows:
  • Premature infants with congenital malformations or severe complications;
  • Mothers requiring treatment for postpartum complications and having their daily life restricted.

2.3. Instruments

2.3.1. Maternal Identity

A semantic differential scale, developed by Osgood and colleagues [31] and improved by Walker [32], was used to measure the accessible area of mothers’ maternal identity. This instrument was translated and revised by Kim and Tak [33] to apply in this study. It is a 7-point scale with 11 items, scoring between 11 and 77, with a higher score meaning more positive maternal identity. For reliability, Cronbach’s α was estimated at 0.89 in Kim and Tak [33]. For reliability of internal consistency in this study, Cronbach’s α was 0.92.

2.3.2. MPAS: Maternal Postpartum Attachment Scale

Kim and Tak produced the Korean version of the maternal postpartum attachment scale (MPAS-K) [34], originally developed by Condon and Corkindale (MPAS) [35], by testing it for validity and reliability in mothers of infants and toddlers less than 36 months of age who had stayed in NICUs. It is a Likert scale scoring 2–5 for each of 14 items in total. To give identical weight to each item, recoding is recommended with 1;5 for a 2-point scale, 1;3;5 for a 3-point scale, and 1;2.3;3.6;5 for a 4-point scale. The higher the score, the more positive the maternal attachment. For reliability, Cronbach’s α was 0.80 for all items in Kim and Tak [33]. For reliability of internal consistency in this study, Cronbach’s α was 0.81.

2.3.3. Maternal Confidence

The maternal confidence questionnaire was developed by Parker and Zahr [36] to measure parenting confidence, which is the ability of mothers to use their parenting skills to perceive an infant’s needs. It was then translated by Choi and Shin [37]. This instrument is composed of a total of 14 items: 12 positive ones and 2 negative ones. It is a 5-point scale, scoring from 1 totally disagree to 5 totally agree, with total score of 14–70; the higher the score, the more positive the parenting confidence. Cronbach’s α was estimated at 0.92 in Choi and Shin [37]. For reliability of internal consistency in this study, Cronbach’s α was 0.87.

2.3.4. Educational Satisfaction

The experimental group was given interventional education and had their satisfaction measured using the instrument developed by the researcher. This instrument is composed of a total of 7 items concerning the understanding of the app-based education program and electronic documents, motivation, clarity of data, technical stability of the given program, and achievement after completing an intervention. It is a 5-point scale, with a higher score meaning more positive educational satisfaction. For reliability of internal consistency in this study, Cronbach’s α was 0.60.

2.4. Data Collection

This study obtained approval from the Institutional Review Board of Eulji University (EU22-87) in Uijeongbu, Gyeonggi Province. The data were collected from 1 February to 30 April 2023. A notice was posted advertising for this study on portal sites for parents (Mom’s Holic Baby and Beautiful Preterm Babies), and a total of 52 persons were recruited: 16 in experimental group I (app-based education program group), 18 in experimental group II (electronic document group), and 18 in the control group. The subjects who were willing to participate in the study and who met the criteria were asked to read the written consent and decide on agreement.

2.5. Development of Parenting Support Education Program for Premature Infants’ Mothers

The intervention method in this study, or the parenting support app-based education program for premature infants’ mothers, was developed by using the ADDIE model, that is, through the stages of analysis, design, development, implementation, and evaluation, along with an app professional’s advice.

2.5.1. App-Based Education Program

At the analysis stage, a literature review was performed to analyze the existing education programs, websites, and applications for premature infants’ parents. Keywords were used to search the Apple App Store and Google Play from 27 January 27 to 25 February 2023. A total of 9 keywords—premature infant, preterm infant, premature infant’s parent, premature infant’s mother, neonatal ICU, neonatal intensive care unit, premature infant caring, prematurely born baby, and NICU—brought up 4 app results, with the exception of those irrelevant to this study. Since South Korea has only a few apps for premature infants’ mothers, the keyword “newborn” was added to extend the search. Finally, 20 apps associated with the theme of the study were selected. Of these apps, 7 apps (35%) provided information about growth and development, 10 (50%) were related to breastfeeding and feeding, 7 (35%) provided health information, 2 (10%) operated membership communities, 1 (5%) provided information about physical development, and 8 (40%) provided a growth curve.
At the design stage, the structure of the app program was determined. There were five large categories within the theme: the first category is related to baby growth, with such details as life in hospital, breastfeeding, formula-feeding, defecation, kangaroo care, coping tips for an emergency, and programs for supporting premature infants; the second category is related to baby development, with such details as development milestones, intervention information, and growth curve graphs; the third category is related to record-keeping concerning breastfeeding, formula-feeding, defecation, a parenting diary, and so on; the fourth category is related to emotional support given to mothers, which involves a ‘professional counseling center’ aimed at two-way communication for the researcher to give technical knowledge and information when asked a question about baby care, in addition to a membership community; the fifth category is to give a log-in function and personalized communications.
At the development stage, the operating system was developed in a hybrid form so that it could be usable both in Android and in iOS. The screen for the parenting support app-based program for premature infants’ mothers is as shown in Figure 2.
After its development, the parenting support app for premature infants’ mothers was tested for content validity by experts. It was tested by a total of 6 experts: 2 professors in pediatric nursing, 3 nurses with at least ten-year careers working in NICUs, and 1 professor in pediatrics. As a result of content validation of 17 items, the CVI index was estimated at the average level of 0.94, which met the reference level of 0.80 or higher [38].
At the implementation stage, participants received an explanation about how to use the app and received membership with their ID and password. They were asked to use the app at least three times a week, and the researcher checked their log-in status through the administrator’s page from time to time.
At the assessment stage, the experts and the subjects were asked to give opinions in terms of app composition assessment, and the app was finally developed following its revision and supplementation.

2.5.2. PDF Teaching Materials

The teaching materials in the form of electronic documents for the other experimental parenting support education program for premature infants’ mothers have identical contents to the app program, which was converted to the electronic document (PDF) format by using Adobe Acrobat Reader. Parts of the app program such as the operable professional counseling centers, communities, parenting diary, and recording (amount of feeding, defecation, growth curve graph) were excluded.

2.5.3. Experimental Treatment

To prevent the experiment being compromised by communication between groups, data were first collected from the control group. The pretest involving a survey of the general characteristics of premature infants and their mothers, whereby maternal identity, maternal postpartum attachment, and parenting confidence were investigated in the control group. A posttest was performed two weeks after the pretest. After data collection from the control group, a pretest was performed in experimental group 2 (electronic document group). Immediately after the pretest, experimental group 2 (electronic document group) was given the PDF teaching materials and, two weeks later, underwent the posttest.
After data collection from experimental group 2 (electronic document group), a pretest was performed in experimental group 1 (app-based education program group). Immediately after the pretest, the app-based education program was provided and, two weeks later, a posttest was performed. Overall, the data collection procedure was as follows (Figure 3).

2.6. Data Analysis

The collected data were analyzed using the IBM SPSS Statistics 27.0 program. The respondents’ general characteristics were presented in frequency, percentage, and the mean and standard deviation. The chi-square test, t-test, and one-way ANOVA were used to test the general characteristics for homogeneity among the three groups. One-way ANOVA was performed for homogeneity in the dependent variables among the three groups. One-way ANOVA was then used to compare the dependent variables among the mothers in the three groups in an attempt to confirm the effectiveness of the app-based education program. Those variables the pretest found to be inhomogeneous were treated as covariates and analyzed with ANCOVA. The Scheffe test were used in the posttest. A t-test was applied to analyze the differences in educational satisfaction between the two experimental groups.

2.7. Ethical Considerations

This study was approved by the Institutional Review Board of Eulji University (EU22-87) in Uijeongbu, Gyeonggi Province. The subjects were given an explanation about the purpose and contents of the study and their confidentiality. We ensured their willingness to participate, and the study was conducted with voluntary consent. They were informed that they could withdraw at their will any time, that their participation would be kept confidential, and that their responses would never be used for anything other than the purposes of this study. They were also told that their personal information collected for the study would be regarded as confidential, and the collected data would be discarded three years after being kept with an identification code. After the end of the experiment, the control group and the electronic document group were also given information about the app-based education program, to use if they wanted.

3. Results

3.1. Pretest for Homogeneity in Participants

3.1.1. Homogeneity Test for General Characteristics of Premature Infants’ Mothers

A total of 52 respondents were chosen: 16 in the app-based education program group, 18 in the electronic document group, and 18 in the control group. For the general characteristics, the results were as show in Table 1. In terms of their homogeneity among the three groups, no significant inter-group difference was found in age, education level, monthly income or childbirth experience.

3.1.2. Homogeneity Test for General Characteristics of Premature Infants

The results of the homogeneity test for the general characteristics of premature infants were as shown in Table 2. The gestational age, duration of stay in hospital, gender, delivery type, experience of oxygen therapy, experience of treatment with a ventilator, birth height, weight, and head circumference were homogeneous, with no significant difference among the three groups.

3.1.3. Pretest for Homogeneity in Dependent Variables of Premature Infants’ Mothers

For maternal identity, the pretest found that premature infants’ mothers scored 58.88 ± 5.18 in the app-based education program group, 51.39 ± 13.40 in the electronic document group, and 61.67 ± 7.14 in the control group. For maternal postpartum attachment, the pretest found that they scored 59.84 ± 4.09 in the app-based education program group, 56.39 ± 9.36 in the electronic document group, and 61.48 ± 3.41 in the control group. For parenting confidence, the pretest found that they scored 53.81 ± 8.78 in the app-based education program group, 50.33 ± 8.15 in the electronic document group, and 53.06 ± 6.49 in the control group.
As for homogeneity in the dependent variables of the premature infants’ mothers, the pretest found no statistically significant difference in maternal postpartum attachment or parenting confidence, though there was one in maternal identity (F = 5.735, p = 0.006) among the three groups (Table 3).

3.2. Hypothesis Testing

3.2.1. Hypothesis 1

“Maternal identity will differ among the app education program, electronic document, and control groups”.
The pretest found significant differences in maternal identity: 58.88 ± 5.18 in the app-based education program group, 51.39 ± 13.40 in the electronic document group, and 61.67 ± 7.14 in the control group (F = 5.735, p = 0.006). With maternal identity as a covariate in the pretest, the posttest found no significant difference in maternal identity: 62.56 ± 6.00 in the app-based education program group, 55.61 ± 14.56 in the electronic document group, and 61.00 ± 6.33 in the control group (F = 1.550, p = 0.223).
There was no significant inter-group variation in maternal identity: 3.69 ± 4.09 in the app-based education program group, 4.22 ± 8.13 in the electronic document group, and −0.67 ± 6.84 in the control group (F = 2.884, p = 0.065). Therefore, Hypothesis 1 “maternal identity will differ among the app education program, electronic document, and control groups” was rejected.
The results of the comparison of maternal identity among the three groups before and after the intervention using the app-based parenting support education program for premature infants’ mothers were as follows (Table 4, Figure 4).

3.2.2. Hypothesis 2

“Maternal postpartum attachment will differ among the app education program, electronic document, and control groups”.
The pretest found no significant difference in maternal postpartum attachment: 59.84 ± 4.09 in the app-based education program group, 56.39 ± 9.36 in the electronic document group, and 61.48 ± 3.41 in the control group (F = 3.056, p = 0.056). The posttest found no significant difference in maternal postpartum attachment: 63.93 ± 3.57 in the app-based education program group, 60.28 ± 6.89 in the electronic document group, and 61.69 ± 4.58 in the control group (F = 2.064, p = 0.138).
The posttest found that maternal postpartum attachment differed significantly among the three groups: 4.09 ± 3.72 in the app-based education program group, 3.88 ± 5.02 in the electronic document group, and 0.22 ± 3.69 in the control group (F = 4.716, p = 0.013). The posttest found that the app education program and electronic document groups scored higher for the differences in postpartum maternal attachment than the control group. Therefore, Hypothesis 2 “postpartum maternal attachment will differ among the app-based program, electronic document, and control groups” was partially supported.
The results of the comparison of maternal postpartum attachment among the three groups before and after the intervention using the app-based parenting support education program for premature infants’ mothers were as follows (Table 5, Figure 5).

3.2.3. Hypothesis 3

“Maternal confidence will differ among the app education program, electronic document, and control groups”.
The pretest found no significant difference in parenting confidence: 53.81 ± 8.78 in the app-based education program group, 50.33 ± 8.15 in the electronic document group, and 53.06 ± 6.49 in the control group (F = 0.949, p = 0.394). The pretest found significant differences in parenting confidence: 58.56 ± 5.72 in the app-based education program group, 51.72 ± 6.53 in the electronic document group, and 51.94 ± 5.19 in the control group (F = 7.354, p = 0.002). The posttest found that the app education program scored higher for parenting confidence than the electronic document and control groups.
The posttest found that parenting confidence differed significantly among the three groups: 4.75 ± 4.06 in the app-based education program group, 1.39 ± 3.58 in the electronic document group, and −1.11 ± 6.31 in the control group (F = 6.254, p = 0.004). The posttest found that the app education program scored higher for the differences in parenting confidence than the control group. Therefore, Hypothesis 3 “parenting confidence will differ among the app-based program, electronic document, and control groups” was supported.
The results of the comparison of parenting confidence among the three groups before and after the intervention using the app-based parenting support education program for premature infants’ mothers were as follows (Table 6, Figure 6).

3.2.4. Hypothesis 4

“Satisfaction with education will differ among the app education program and the electronic document groups”.
For satisfaction with education, the participants scored 32.54 ± 1.81 in the app-based education program group and 31.06 ± 1.86 in the electronic document group. There were significant inter-group differences in satisfaction with education (t = 2.222, p = 0.034). Therefore, Hypothesis 4 was supported.
The results of the comparison of satisfaction with education among the two groups before and after the intervention using the app-based parenting support education program for premature infants’ mothers were as follows (Table 7).

4. Discussion

4.1. Development of App-Based Parenting Support Program

This study utilized a nonequivalent control group non-synchronized design to develop an app-based program for mothers of premature infants. The program is based on Mercer’s (1981) maternal role attainment model [39], and the study aimed to determine its effects on these mothers.
Education using a smartphone app, which is characterized by accessibility and convenience, can be used without temporal or spatial restrictions and its users can be given an immediate chance to partake in education at any time. As the worldwide COVID-19 pandemic and many other types of infectious disease have activated noncontact education, development of an app-based education program can be applicable to premature infants’ parents as an effective way of providing them with information.
Because the parenting roles are important for premature infants at each stage of their growth and development from post-birth institutionalization in the NICU through to infanthood and early childhood, it is necessary to develop a sustainable and systematic program that meets each development stage [40]. So, the teaching contents were formed to cover the stay in hospital and also the early period of parenting at home. Specifically, the app contains general teaching contents regarding medical devices applied to premature infants during their stay in the NICU, their growth and development, kangaroo care, and the programs for supporting premature infants; an area to record feeding, defecation frequency, and growth status (height, weight, head circumference); a parenting diary-keeping zone for emotional support; and a professional counseling center enabling two-way communication with the researcher.
The existing research confirming the effectiveness of systematic education in premature infants’ mothers [37,41] has demonstrated that the better understanding the mothers had of premature infants’ physical and physiological characteristics and development, the less parenting stress they experienced and the higher levels of parenting confidence and maternal attachment they showed. In a different way from the discharge education program that informs on basic parenting skills, this study aimed to support an understanding of premature infants and help parents to participate in their care from the moment of staying in the NICU. Based on the findings of the literature review that parents of premature infants in NICUs might experience emotional distress, which involves symptoms of post-traumatic stress disorder and postpartum depression [7,42,43], and that emotional support reduced their stress and raised their parenting confidence and maternal attachment [37], the mothers were asked to keep a parenting diary so that they could feel comfortable and become confident in and satisfied with their performance of their maternal role.
An online parenting community is a principal variable that allows users with many different types of interests in pregnancy, childbirth, and education to engage in communication [44]. A parenting-centered communicative means can reduce parenting stress and assist with emotional support [45]. However, most of the existing studies employed no communication [23,25]. So, a professional counseling center that enables two-way communication with the researcher was established to allow for sharing information and opinions in addition to counseling for emotional support. A membership community was also created for inter-user two-way communication. This helped premature infants’ mothers share their daily life, be given systematic information about their babies, and participate actively in baby care from the early stage of parenting through to childrearing.
While the existing education programs for premature infants’ mothers were limited to one-time programs, which involved face-to-face interviews, telephone interview and handouts, this study enabled them to use information efficiently without temporal or partial restrictions and store data with ease, as smartphone education has recently seen an uptick. Hospitals and communities are expected to provide diverse education programs, and with a smartphone distribution rate of 96% in South Korea now, as well as various advantages of an app-based education program, its use seems beneficial in premature infant care.

4.2. Effects of App-Based Parenting Support Program

After the educational intervention, both the app-based education program and electronic document groups had higher levels of maternal identity, maternal postpartum attachment, and parenting confidence than the control group. This is consistent with the finding that a web-based education program, which was developed for and applied to premature infants’ mothers, was effective in increasing maternal identity, maternal attachment, and parenting confidence and in reducing postpartum depression and anxiety [41]. It is also consistent with the findings of the study that developed the NICU2HOME app for parents of premature infants leaving hospital, which improved parenting confidence and self-efficacy after the intervention [46]. These results may be since the app-based education program can be used freely any time without temporal or spatial restrictions, instead of the existing one-time education, from the post-birth stay in hospital through to the entire course of parenting at home. It can be used to record the daily routines of the baby (feeding, defecation, height, weight, head circumference) and keep a parenting diary, as well as receive technical knowledge and counseling regarding parenting, which supports mothers to assume their maternal role.
The finding that premature infants’ mothers using the app-based education program saw their parenting confidence significantly increase, when compared with the other two groups, indicates that applying the education program from the early stage of parenting can help improve their parenting confidence, even taking the short period of the two-week study intervention into account.
In telephone interviews after undertaking the education program, both the app-based education program and electronic document group members answered that using visual materials, including images and videos, improved their understanding of education and raised their interest in learning, more so than using texts. The app-based education program group positively evaluated the technicality of information and accessibility and convenience of the app-based program. In particular, they answered that in terms of information, the contents related to premature infant support programs and preparations in kangaroo care were useful. Previously, research on the experience among parents of low-birth-weight infants of using social networks [47], and a study that induced premature infants’ parents to participate in the development of a digital education program [48], obtained similar results.
The electronic document group saw a significant increase in maternal identity and maternal postpartum attachment, when compared with the control group. To put these results and the findings of the literature review together, in future work, it is necessary to identify education media desired by users and their education needs and then, based on the findings, apply an intervention program. It may also be effective in terms of education giving teaching materials in an electronic form if there are recipients who can hardly use a smartphone.
This study has confirmed that an app-based education program is more likely to ensure premature infants’ mothers efficiently receive full education than the existing types of face-to-face or written education. Because premature infants’ mothers require more knowledge and skills in parenting than those of term infants, it is vital to give long-term, regular education, instead of a one-time education program. In particular, mothers’ recovery from premature childbirth or their infants’ ill-health can affect their participation in education and make it difficult for them to attend regular face-to-face education; therefore, smartphone use of an app-based education program can be highly suitable for premature infants’ mothers.
A few limitations of the present study must be noted. First, this study design failed to randomize the sample to prevent the experiment being compromised by communication between groups, and the subjects themselves perceived their participation in the experiment. Due to the possibility of these issues affecting the results, in future work, it is necessary to consider how to control for these factors and thereby improve the quality of the study. Second, this study had restrictions in its sampling because premature infants with congenital malformations or severe complications and their mothers were excluded. Further research needs to develop interventions for mothers of high-risk neonates, as well. Third, the difficulty in sampling due to the subjects’ characteristics made it impossible to meet the estimated sample size. To overcome this problem, further research needs to extend the subjects included when testing the program for its effectiveness.

5. Conclusions

These results have demonstrated that the parenting support education program for premature infants’ mothers was effective in improving maternal identity, maternal postpartum attachment, and parenting confidence.
As South Korea has an all-time low birthrate but premature infants are increasing each year, applying a parenting support education program for premature infants’ mothers is important, both to support them to assume their maternal role and so that premature infants grow healthier. Premature infants’ childrearing should no longer be a concern restricted to their parents and medical staff, but instead an area of general social concern that requires for improvements to the existing education and support.
Smartphone use of an app-based education program is a useful educational means readily available to users, whereby they can learn and interact with experts any time, without temporal or spatial restrictions. Since it can also give mothers access to diverse technical information from the infants’ stay in hospital after birth through to care at home, the program is expected to be of great help to mothers in terms of infant care.
On the basis of these results, the following suggestions can be made: Because there are only a few app-based education programs for premature infants’ mothers, it is necessary to conduct studies of this kind repeatedly with the aim of such programs being validated. Further research also needs to be conducted to determine the efficiency of app-based education programs through a prolonged intervention with the objective of confirming the effects on premature infants’ growth and development. Linked to that point, it is necessary to develop a research tool for assessing premature infants’ growth and development after applying an app-based education program. Finally, taking the strengths of the app-based education program into account, it is also advisable to investigate how such a program can be applied in association with communities and other relevant institutions beyond primary medical institutions such as hospitals.

Author Contributions

Conceptualization, H.J.J., H.J.K. and H.Y.A.; methodology, H.J.J., H.J.K. and H.Y.A.; software, H.J.J. and H.J.K.; validation, H.Y.A.; formal analysis, H.J.J.; investigation, H.J.J. and H.J.K.; resources, H.J.K. and H.Y.A.; data curation, H.J.J. and H.J.K.; writing—original draft preparation, H.J.J. and H.Y.A.; writing—review and editing, H.Y.A.; supervision, H.Y.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Eulji University, grant number 2022.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Eulji University in Daejeon (protocol code EUIRB2022-090, 1 February 2023).

Informed Consent Statement

Informed consent was obtained from all the subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Korean Statistical Information Service. Birth Statistics in 2021. Available online: https://kosis.kr/search/search.do?query=%EC%B6%9C%EC%83%9D (accessed on 27 March 2023).
  2. WHO. Preterm Birth. Available online: https://www.who.int/en/news-room/fact-sheets/detail/preterm-birth (accessed on 27 March 2023).
  3. Crowe, S.; Regan, S. Description of a Process and Workshop to Set Research Priorities in Hip and Knee Replacement for Osteoarthritis. Available online: https://www.jla.nihr.ac.uk/priority-setting-partnerships/hip-and-knee-replacement-for-osteoarthritis/downloads/Final-Workshop-Report.pdf (accessed on 17 March 2023).
  4. Harrison, W.; Goodman, D. Epidemiologic trends in neonatal intensive care, 2007–2012. JAMA Pediatr. 2015, 169, 855–862. [Google Scholar] [CrossRef]
  5. Baia, I.; Amorim, M.; Silva, S.; Kelly-Irving, M.; de Freitas, C.; Alves, E. Parenting very preterm infants and stress in neonatal intensive care units. Early Hum. Dev. 2016, 101, 3–9. [Google Scholar] [CrossRef] [PubMed]
  6. Alkozei, A.; McMahon, E.; Lahav, A. Stress levels and depressive symptoms in NICU mothers in the early postpartum period. J. Matern. Fetal Neonatal Med. 2014, 27, 1738–1743. [Google Scholar] [CrossRef]
  7. Koliouli, F.; Gaudron, C.Z.; Raynaud, J.P. Stress, coping, and post-traumatic stress disorder of French fathers of premature infants. Newborn Infant Nurs. Rev. 2016, 16, 110–114. [Google Scholar] [CrossRef]
  8. Davis, L.; Edwards, H.; Mohay, H.; Wollin, J. The impact of very premature birth on the psychological health of mothers. Early Hum. Dev. 2003, 73, 61–70. [Google Scholar] [CrossRef]
  9. Trumello, C.; Candelori, C.; Cofini, M.; Cimino, S.; Cerniglia, L.; Paciello, M.; Babore, A. Mothers’ depression, anxiety, and mental representations after preterm birth: A study during the infant’s hospitalization in a neonatal intensive care unit. Front. Public Health 2018, 6, 359. [Google Scholar] [CrossRef] [PubMed]
  10. Gooding, J.S.; Cooper, L.G.; Blaine, A.I.; Franck, L.S.; Howse, J.L.; Berns, S.D. Family support and family-centered care in the neonatal intensive care unit: Origins, advances, impact. Semin. Perinatol. 2011, 35, 20–28. [Google Scholar] [CrossRef] [PubMed]
  11. Al, M.; Dua’a, F.; Chan, C.M.; Piaw, C.Y.; Al Kawafha, M.M. Systematic review of qualitative studies exploring parental experiences in the Neonatal Intensive Care Unit. J. Clin. Nurs. 2016, 25, 2745–2756. [Google Scholar] [CrossRef]
  12. Gondwe, K.W.; Brandon, D.; Yang, Q.; Malcom, W.F.; Small, M.J.; Holditch-Davis, D. Emotional distress in mothers of early-preterm infants, late-preterm infants, and full-term infants in Malawi. Nurs. Outlook 2020, 68, 94–103. [Google Scholar] [CrossRef]
  13. Na, H.; Moon, S.H. Maternal-fetal attachment and maternal identity according to type of stress coping strategies on immigration pregnancy women. Korean J. Women Health Nurs. 2015, 21, 232–240. [Google Scholar] [CrossRef]
  14. Murray, P.D.; Swanson, J.R. Visitation restrictions: Is it right and how do we support families in the NICU during COVID-19? J. Perinatol. 2020, 40, 1576–1581. [Google Scholar] [CrossRef] [PubMed]
  15. Montes, M.T.; Herranz-Rubia, N.; Ferrero, A.; Flórez, A.; Quiroga, A.; Gómez, A.; Jiménez, T. Neonatal nursing in the COVID-19 pandemic: Can we improve the future? J. Neonatal Nurs. 2020, 26, 247–251. [Google Scholar] [CrossRef]
  16. Bembich, S.; Tripani, A.; Mastromarino, S.; Di Risio, G.; Castelpietra, E.; Risso, F.M. Parents experiencing NICU visit restrictions due to COVID-19 pandemic. Acta Paediatr. 2021, 110, 940. [Google Scholar] [CrossRef]
  17. Schonhaut, L.; Armijo, I.; Pérez, M. Gestational age and developmental risk in moderately and late preterm and early term infants. Pediatrics 2015, 135, e835–e841. [Google Scholar] [CrossRef]
  18. De Rouck, S.; Leys, M. Information needs of parents of children admitted to a neonatal intensive care unit: A review of the literature (1990–2008). Patient Educ. Couns. 2009, 76, 159–173. [Google Scholar] [CrossRef]
  19. Logsdon, M.C.; Mittelberg, M.; Myers, J. Use of social media and internet to obtain health information by rural adolescent mothers. Appl. Nurs. Res. 2015, 28, 55–56. [Google Scholar] [CrossRef] [PubMed]
  20. Orr, T.; Campbell-Yeo, M.; Benoit, B.; Hewitt, B.; Stinson, J.; McGrath, P.; Thibeau, S. Smartphone and internet preferences of parents. Adv. Neonatal Care 2017, 17, 131–138. [Google Scholar] [CrossRef] [PubMed]
  21. Sundstrom, B. Mothers “google it up”: Extending communication channel behavior in diffusion of innovations theory. Health Commun. 2016, 31, 91–101. [Google Scholar] [CrossRef]
  22. Du, L.; Gu, Y.B.; Cui, M.Q.; Li, W.X.; Wang, J.; Zhu, L.P.; Xu, B. Investigation on demands for antenatal care services among 2002 pregnant women during the epidemic of COVID-19 in Shanghai. Zhonghua Fu Chan Ke Za Zhi 2020, 160–165. [Google Scholar] [CrossRef]
  23. Richardson, B.; Dol, J.; Rutledge, K.; Monaghan, J.; Orovec, A.; Howie, K.; Campbell-Yeo, M. Evaluation of mobile apps targeted to parents of infants in the neonatal intensive care unit: Systematic app review. JMIR Mhealth Uhealth 2019, 7, e11620. [Google Scholar] [CrossRef]
  24. Zhang, Q.; Huo, Z. Effect of continuous nutrition management intervention on nutritional status and development of premature infants based on mobile medical app. Comput. Math. Methods Med. 2022, 2022, 8586355. [Google Scholar] [CrossRef] [PubMed]
  25. Rau, N.M.; Hasan, K.; Ahamed, S.I.; Asan, O.; Flynn, K.E.; Basir, M.A. Designing a tablet-based prematurity education app for parents hospitalized for preterm birth. Int. J. Med. Inform. 2020, 141, 104200. [Google Scholar] [CrossRef] [PubMed]
  26. Nourani, A.; Ayatollahi, H.; Mirnia, K. A smart phone application for the mothers of premature infants. Innov. Res. Biomed. Eng. 2019, 40, 263–269. [Google Scholar] [CrossRef]
  27. Ji, E.S.; Shim, K.K. Effects of a community-based follow-up program for parents with premature infants on parenting stress, parenting efficacy, and coping. Child Health Nurs. Res. 2020, 26, 366. [Google Scholar] [CrossRef]
  28. Lee, J.Y.; No, S.H. Effects of breastfeeding interventions program on breastfeeding for premature babies: A systematic review and meta-analysis. Korean Parent-Child Health J. 2018, 21, 50–60. [Google Scholar]
  29. Garfield, C.F.; Lee, Y.S.; Kim, H.N.; Rutsohn, J.; Kahn, J.Y.; Mustanski, B.; Mohr, D.C. Supporting parents of premature infants transitioning from the NICU to home: A pilot randomized control trial of a smartphone application. Int. Interv. 2016, 4, 131–137. [Google Scholar] [CrossRef]
  30. Faul, F.; Erdfelder, E.; Lang, A.G.; Buchner, A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 2007, 39, 175–191. [Google Scholar] [CrossRef]
  31. Osgood, C.E.; Suci, G.J.; Tannenbaum, P.H. The Measurement of Meaning; University of Illinois: Urbana, IL, USA, 1957. [Google Scholar]
  32. Walker, L.O.; Montgomery, E. Maternal identity and role attainment: Long-term relations to children’s development. Nurs. Res. 1994, 43, 105–110. [Google Scholar] [CrossRef]
  33. Kim, A.R.; Tak, Y.R. Maternal role development in neonatal intensive care unit graduate mothers of premature infant. Korea J. Women Health Nurs. 2015, 21, 308–320. [Google Scholar] [CrossRef]
  34. Kim, A.R.; Tak, Y.R. Validation of the Korean version of the maternal postpartum attachment development scale for mothers of children who were in a neonatal intensive care unit. Child Health Nurs. Res. 2018, 39, 129–143. [Google Scholar] [CrossRef]
  35. Condon, J.T.; Corkindale, C.J. The assessment of parent-to-infant attachment: Development of a self-report questionnaire instrument. J. Reprod. Infant Psychol. 1998, 16, 57–76. [Google Scholar] [CrossRef]
  36. Parker, S.; Zahr, L. The Maternal Confidence Questionnaire; Boston City Hospital: Boston, MA, USA, 1985; Volume 5. [Google Scholar]
  37. Choi, H.S.; Shin, Y.H. Effects on maternal attachment, parenting stress, and maternal confidence of systematic information for mothers of premature infants. Child Health Nurs. Res. 2013, 19, 207–215. [Google Scholar] [CrossRef]
  38. Lynn, M.R. Determination and quantification of content validity. Nurs. Res. 1986, 35, 382–386. [Google Scholar] [CrossRef] [PubMed]
  39. Mercer, R.T. A theoretical framework for studying factors that impact on the maternal role. Nurs. Res. 1981, 30, 73–77. [Google Scholar] [CrossRef] [PubMed]
  40. Park, S.J.; Kim, S.J.; Kang, K.A.; Park, S.J.; Kim, S.J.; Kang, K.A. Integrative review of nursing intervention studies on mother-infant interactions. Child Health Nurs. Res. 2014, 20, 75–86. [Google Scholar] [CrossRef]
  41. Seo, Y.S. Development and Effectiveness of a Web-Based Education Program for Mothers with Premature Infants. Ph.D. Dissertation, Graduate School Eulji University, Daejeon, Republic of Korea, 2018. [Google Scholar]
  42. Shanmugam, V. Stress and coping strategies among mothers’ of neonates, admitted in neonatal intensive care unit. Asian J. Nurs. Educ. Res. 2015, 5, 363–365. [Google Scholar] [CrossRef]
  43. Cho, Y.Y.; Park, Y.H.; Jang, J.S.; Lee, J.E. Effects of a maternal care program on self-efficacy and postpartum depression in mothers with preterm babies. J. Korean Acad. Soc. Home Health Care Nurs. 2015, 22, 187–195. [Google Scholar]
  44. Lee, Y.H.; Park, C. The influence of participation in online child care community on satisfaction and intention of continuous use: Focusing on the mediation path of the perceived benefits of housewives and working mothers. Acad. Cust. Satisf. Manag. 2019, 21, 21–35. [Google Scholar] [CrossRef]
  45. Kim, H.J.; Park, K.O. Needs for the spatial composition and services of child care community centers through mothers’ experiences of child care communities. J. Korean Hous. Assoc. 2019, 30, 39–52. [Google Scholar] [CrossRef]
  46. Garfield, C.F.; Kerrigan, E.; Christie, R.; Jackson, K.L.; Lee, Y.S. A mobile health intervention to support parenting self-efficacy in the neonatal intensive care unit from admission to home. J. Pediatr. 2022, 244, 92–100. [Google Scholar] [CrossRef]
  47. Gabbert, T.I.; Metze, B.; Bührer, C.; Garten, L. Use of social networking sites by parents of very low birth weight infants: Experiences and the potential of a dedicated site. Eur. J. Pediatr. 2013, 172, 1671–1677. [Google Scholar] [CrossRef] [PubMed]
  48. Lebel, V.; Héon, M.; Juneau, A.J.; Collette, K.; Feeley, N. The development of a digital educational program with parents of preterm infants and neonatal nurses to meet parents educational needs. J. Neonatal Nurs. 2021, 27, 52–57. [Google Scholar] [CrossRef]
Figure 1. Process flow diagram.
Figure 1. Process flow diagram.
Healthcare 11 02639 g001
Figure 2. App screen development diagram.
Figure 2. App screen development diagram.
Healthcare 11 02639 g002
Figure 3. Data collection procedure flow diagram.
Figure 3. Data collection procedure flow diagram.
Healthcare 11 02639 g003
Figure 4. Comparison of changes in maternal identity among three groups.
Figure 4. Comparison of changes in maternal identity among three groups.
Healthcare 11 02639 g004
Figure 5. Comparison of changes in maternal postpartum attachment scale among three group.
Figure 5. Comparison of changes in maternal postpartum attachment scale among three group.
Healthcare 11 02639 g005
Figure 6. Comparison of changes in maternal confidence among three groups.
Figure 6. Comparison of changes in maternal confidence among three groups.
Healthcare 11 02639 g006
Table 1. Homogeneity test of general characteristics of premature infants’ mothers.
Table 1. Homogeneity test of general characteristics of premature infants’ mothers.
VariablesCategoriesExp. Ⅰ (N = 16)Exp. Ⅱ (N = 18)Cont. (N = 18)χ2 or Fp
N (%) or M ± SDN (%) or M ± SDN (%) or M ± SD
Age (years)25~300 (0.0%)1 (5.6%)2 (11.1%)9.4370.051
31~358 (50.0%)12 (66.7%)15 (83.3%)
36~408 (50.0%)5 (27.8%)1 (5.6%)
Education≤High School0 (0.0%)0 (0.0%)1 (5.6%)1.9260.382
College16 (100.0%)18 (100.0%)17 (94.4%)
Monthly income250~3991 (6.3%)5 (27.8%)2 (11.1%)0.9140.407
400~5497 (43.8%)4 (22.2%)4 (22.2%)
≥5508 (50.0%)9 (50.0%)12 (66.7%)
587.50 ± 183.98542.22 ± 207.02644.44 ± 203.560.6190.543
Number of children110 (62.5%)11 (61.1%)15 (83.3%)2.5780.276
≥26 (37.5%)7 (38.9%)3 (16.7%)
Exp. = Experimental Group; Cont. = Control Group.
Table 2. Homogeneity test of general characteristics of premature infants.
Table 2. Homogeneity test of general characteristics of premature infants.
VariablesCategoriesExp. Ⅰ (N = 16)Exp. Ⅱ (N = 18)Cont. (N = 18)χ2 or Fp
N (%) or M ± SDN (%) or M ± SDN (%) or M ± SD
Gestational age (day) 244.06 ± 8.87240.44 ± 13.78233.78 ± 13.723.0120.058
Period of hospitalization (day) 15.94 ± 8.8712.89 ± 6.0215.94 ± 6.801.0410.361
GenderBoy7 (43.8%)6 (33.3%)5 (27.8%)0.9750.614
Girl9 (56.3%)12 (66.7%)13 (72.2%)
Delivery typeVaginal4 (25.0%)9 (50.0%)9 (50.0%)2.8360.242
Cesarean12 (75.0%)9 (50.0%)9 (50.0%)
Oxygen therapyYes12 (75.0%)9 (50.0%)8 (44.4%)3.5780.167
No4 (25.0%)9 (50.0%)10 (55.6%)
Ventilator therapyYes7 (43.8%)8 (44.4%)7 (38.9%)0.1340.935
No9 (56.3%)10 (55.6%)11 (61.1%)
Weight (gm) 2266.88 ± 339.902041.67 ± 362.352143.27 ± 249.900.0320.969
Height (cm) 44.06 ± 1.9745.16 ± 2.6644.94 ± 2.962.1030.133
Head circumference (cm) 31.51 ± 0.9730.34 ± 1.9330.64 ± 1.043.1550.051
Exp. = Experimental Group; Cont. = Control Group.
Table 3. Homogeneity test of dependent variable among three groups.
Table 3. Homogeneity test of dependent variable among three groups.
CategoryExp. Ⅰ (N = 16)Exp. Ⅱ (N = 18)Cont. (N = 18)Fp
M ± SDM ± SDM ± SD
Maternal identity58.88 ± 5.1851.39 ± 13.4061.67 ± 7.145.7350.006
Maternal postpartum attachment59.84 ± 4.0956.39 ± 9.3661.48 ± 3.413.0560.056
Maternal confidence53.81 ± 8.7850.33 ± 8.1553.06 ± 6.490.9490.394
Exp. = Experimental Group; Cont. = Control Group.
Table 4. Comparison of changes in maternal identity among three groups.
Table 4. Comparison of changes in maternal identity among three groups.
VariablesCategoriesExp. Ⅰ (N = 16)Exp. Ⅱ (N = 18)Cont. (N = 18)FpF(p) *
M ± SDM ± SDM ± SD
Maternal identityPre58.88 ± 5.1851.39 ± 13.4061.67 ± 7.145.7350.0061.550(0.223)
Post62.56 ± 6.0055.61 ± 14.5761.00 ± 6.332.3460.106
Difference3.69 ± 4.094.22 ± 8.13−0.67 ± 6.842.8840.065
Exp. = Experimental Group; Cont. = Control Group. * ANCOVA (covariate values: pre-maternal identity = 57.25.
Table 5. Comparison of changes in maternal postpartum attachment scale among three groups.
Table 5. Comparison of changes in maternal postpartum attachment scale among three groups.
VariableCategoriesExp. Ⅰ (N = 16) aExp. Ⅱ (N = 18) bCont. (N = 18) cFp
Scheffe
M ± SDM ± SDM ± SD
Maternal postpartum
attachment scale
Pre59.84 ± 4.0956.39 ± 9.3661.48 ± 3.413.0560.056
Post63.93 ± 3.5760.28 ± 6.8961.69 ± 4.582.0640.138
Difference4.09 ± 3.723.88 ± 5.020.22 ± 3.694.7160.013a, b > c
Exp. = Experimental Group; Cont. = Control Group. a = Experimental Group I; b = Experimental Group II; c = Control Group.
Table 6. Comparison of changes in maternal confidence among three groups.
Table 6. Comparison of changes in maternal confidence among three groups.
VariableCategoriesExp. Ⅰ (N = 16) aExp. Ⅱ (N = 18) bCont. (N = 18) cFp
Scheffe
M ± SDM ± SDM ± SD
Maternal confidencePre53.81 ± 8.7850.33 ± 8.1553.06 ± 6.490.9490.394
Post58.56 ± 5.7251.72 ± 6.5351.94 ± 5.197.3540.002a > b, c
Difference4.75 ± 4.061.39 ± 3.58−1.11 ± 6.316.2540.004a > c
Exp. = Experimental Group; Cont. = Control Group. a = Experimental Group I; b = Experimental Group II; c = Control Group.
Table 7. Comparison of satisfaction between app program and learning with PDF group.
Table 7. Comparison of satisfaction between app program and learning with PDF group.
VariableApp program (N = 16)PDF learning (N = 18)tp
M ± SDM ± SD
Satisfaction32.54 ± 1.8131.06 ± 1.862.2220.034
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ahn, H.Y.; Ko, H.J.; Jo, H.J. Development and Effects of Mobile-Application-Based Parenting Support Program for Premature Infants’ Mothers. Healthcare 2023, 11, 2639. https://doi.org/10.3390/healthcare11192639

AMA Style

Ahn HY, Ko HJ, Jo HJ. Development and Effects of Mobile-Application-Based Parenting Support Program for Premature Infants’ Mothers. Healthcare. 2023; 11(19):2639. https://doi.org/10.3390/healthcare11192639

Chicago/Turabian Style

Ahn, Hye Young, Hyun Jeong Ko, and Hee Jee Jo. 2023. "Development and Effects of Mobile-Application-Based Parenting Support Program for Premature Infants’ Mothers" Healthcare 11, no. 19: 2639. https://doi.org/10.3390/healthcare11192639

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop