Next Article in Journal
The Evolution of Telepractice Use during the COVID-19 Pandemic: Perspectives of Pediatric Speech-Language Pathologists
Previous Article in Journal
How Does Air Pollution Influence Housing Prices in the Bay Area?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Short Form of the Child/Youth Health Care Questionnaire on Satisfaction, Utilization, and Needs in Children and Adolescents with a Chronic Condition (CHC-SUN-SF/YHC-SUN-SF)

1
Department Health & Prevention, University of Greifswald, 17489 Greifswald, Germany
2
Department of Child and Adolescent Medicine, University of Luebeck, 23538 Luebeck, Germany
3
Medical Psychology Unit, Hannover Medical School, 30625 Hannover, Germany
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(22), 12196; https://doi.org/10.3390/ijerph182212196
Submission received: 27 September 2021 / Revised: 9 November 2021 / Accepted: 10 November 2021 / Published: 20 November 2021
(This article belongs to the Section Global Health)

Abstract

:
We decided to develop a short-form of the CHC-SUN/YHC-SUN, a questionnaire aiming at assessing health care satisfaction of children and adolescents with chronic health conditions. Data analysis was based on samples from three different studies. Item selection involved statistical analysis and expert consensus. For independent validation purposes, we calculated descriptive statistics on single-item and composite-scale levels and applied classic test theory, confirmatory factor analyses, and correlation analysis to investigate the psychometric properties of the final short-form by different types of reliability and validity. Internal consistency (Cronbach’s Alpha) reached values of a = 0.89 (self-report) and a = 0.92 (parents report), split-half reliability values reached 0.85 (self-report) and 0.91 (parents report). Confirmatory factor analysis indicated no sufficient fit for the single factor solution, whereas the solution with three factors and one higher order factor indicated the best overall fit amongst three competing models. Validity of the short-form measure can be assumed, e.g., as indicated by its association with a single-item measure on general health care satisfaction. The short-form measures of the CHC-SUN for parents (CHC-SUN-SF) and the YHC-SUN self-report version for adolescents (YHC-SUN-SF) feature excellent psychometric performances, provide economical assessments, and are easy-to-administer questionnaires. They should be used whenever brief measures are needed for economic reasons.

1. Introduction

Throughout their development, children and adolescents with chronic conditions face continuous challenges with respect to the impact of their conditions on various domains of their daily life. Therefore, developmental science and pediatric care has been paying increased attention to the well-being of this particular vulnerable group of patients. Resulting from this, research suggests that the well-being of these patients could be positively influenced in the early phases of medical treatment, which in turn leads to improved adaptation, increased participation, and thus a more fulfilling life and a higher quality of life [1]. Therefore, identifying special needs of children and adolescents with chronic health conditions is of great importance, as the health status and well-being of young patients has an impact on both childhood and adolescent development [2] as well as the quality of life of the entire family [3,4]. Developing reliable and valid instruments for the assessment of patient-reported outcomes or experiences such as quality of life could make a significant contribution to any activity directed to improving their well-being [5,6]. Incorporating such patient-reported outcome or experience measures in pediatric care would finally support those under treatment and their families—but also their respective health care professionals [6]. It would enable them to gather more information about the treatment of chronic conditions, the effects of different therapies on care processes, as well as their outcomes as seen from the patient’s point of view [7].
Beside health-related quality of life and disease-specific quality of life, another patient-reported outcome that is receiving increasing attention is satisfaction with health care. However, in pediatric care, in contrast to adult medicine, there has been a lack of research on this outcome and its use in clinical practice [7]. This could be because assessing patient-reported outcomes in children and adolescents is much more complex than in adults, since the specific characteristics of this population (e.g., cognitive development) as well as of the pediatric setting (e.g., non-specialized care) make it necessary to account for these factors in constructing appropriate measures [6]. Therefore, previous studies frequently used proxy-reported assessments from adults such as parents or teachers. However, despite these challenges and obstacles when applying self-report measures in the assessment of children and adolescents, it is strongly demanded to take care of the patient’s perspective as provided by patient-reported outcome measures. In addition, there is a need for short and easy-to-administer instruments measuring satisfaction with health care, especially for the assessment of children and adolescents [6]. Finally, when assessing satisfaction with health care, the multi-dimensionality of the construct has received little attention in pediatric research yet and should be taken into consideration whenever possible as well. In sum, these issues lead to shortcomings in the implementation of patient-reported outcome measures in pediatric clinical care and pediatric health services studies, setting the scene for instrument development for this domain within this context.
To account for those challenges, the “Child Health Care–Satisfaction, Utilization, Needs” (CHC-SUN) [8] questionnaire was developed, assessing special health care needs and satisfaction with health care services in children and adolescents with chronic conditions. Initially, the measure exclusively was tested and made available as a parents report from the perspective of parents/relatives. In addition to the initial parents report version of the instrument, it was adapted and validated as a self-report version for adolescents as well and was named “Youth Health Care–Satisfaction, Utilization, Needs” (YHC-SUN) [9]. Due to the length of the original measures [8,9], we decided to develop a short-form, aiming at reproducing the core components of the second “satisfaction” module as closely as possible. Thus, the aim of the current paper is to document the development of these short-form versions and provide evidence for the psychometric quality of the short-form measures of the CHC-SUN for parents and the YHC-SUN self-report for adolescents (CHC-/YHC-SUN-SF) as indicated by different types of reliability and validity.

2. Materials and Methods

2.1. Measures Applied

Health care satisfaction, utilization, and needs: Both versions (self-report, parents report) of the original long-form measure of CHC-/YHC-SUN were applied. This measure consists of 40 items in total, assigned to two different core modules. The first module includes 14 items and refers to the use of and the demand for health care services (“provision of services”), with special emphasis on the assessment of unmet special health care needs. The second module relates to “satisfaction with care” and covers the subjective perception and evaluation of the quality of the provision of health care services. This module consists of 6 different scales with 25 items and an additional single-item measure assessing satisfaction with health care in general. As opposed to this single-item measure, the six scales relate to specific domains of health care, namely, “diagnosis/information”, “doctor’s behavior”, “child-centered care”, “coordination”, “hospital environment”, and “school” (cf. Figure 1). Internal consistencies of the subscales range between α = 0.80 and 0.95 for the CHC-SUN and between α = 0.75 and 0.93 for the YHC-SUN. Items were selected based on content-related expert rating as well as psychometric criteria. Validity was demonstrated with respect to construct, content, and discriminant validity [8,9].
Health-related quality of life: Health-related quality of life was assessed using an index of the Short Form Health Survey with 8 Items, the SF-8 index [10,11]. The items included in this measure are not directly derived from the Short Form Health Survey with 36 items, the SF-36 Health Survey [12,13]. Each of the 8 items is considered to represent the main content of one of the eight subscales from the SF-36; thus, every item serves as an indicator for one factor of the original scales. Scoring procedures recommend the computation of scores for two summary scales (physical/mental), both also included in the SF-36 and SF-12 Health Survey Measures. Internal consistencies of the summary scales reach α = 0.78 and α = 0.87.
General quality of Life: An index derived from the World Health Organization Quality Of Life (WHOQOL) measures was developed and validated within the European Health Information System (EUROHIS) project and is referred to as “EUROHIS-QOL” [14,15] or “WHOQOL-8” [16]. It serves as a generic measurement, assessing subjective global quality of life in the general population. Although it aims to assess one dimension with respect to psychometric properties, it conceptually represents items derived from different domains of quality of life represented within the WHOQOL measures. The WHOQOL-8 reveals sufficient psychometric properties, e.g., with respect to internal consistency of the scale (α = 0.86; Power, 2003).

2.2. Outline of the General Analytic Strategy

Based on expert consensus, it was decided to construct both versions (self-report, parents report) of the short-form as close as possible to the original CHC-SUN and YHC-SUN [8,9] in terms of psychometric criteria especially related to short-form development, such as conceptual representation, statistical association, psychometric comparability, and economy/efficiency [17]. Furthermore, the resulting item pools should display sufficient psychometric properties as stand-alone fixed-length short-form measures. Item selection was performed not only using psychometric indicators, but also by combining a rationale and a statistical approach to instrument construction. To validate the extracted item pool for use as a short-form measure, we conducted the following analytical steps:
Analyzing descriptive statistics: Items and composite scale were evaluated regarding missing data rate and basic descriptive indicators, such as mean and standard deviation, skewness, floor and ceiling effects. Additionally, psychometric performance on item level was investigated by calculating item internal reliability (corrected item–total correlation).
Testing reliability: Internal consistency and homogeneity of the measures were identified by Cronbach’s alpha coefficient. Split-half reliability was computed as well. Concordance between self-report and parents report assessments was investigated using intraclass correlation coefficients (ICC).
Exploring validity: Factorial validity was investigated by applying confirmatory factor analysis (CFA) with maximum likelihood parameter estimation, comparing three a priori defined competitive models, delineated from the measurement model of the original version. We selected the model with the best fit statistics, assuming the standardized root-mean-squared residual (SRMR) close to 0.08 or below, the root-mean-square error (RMSEA) close to 0.06 or below, and the comparative fit index (CFI) close to 0.90 or higher as meaningful cut-off criteria according to the literature [18,19,20].
Hypotheses tested: Other validity estimations were performed by calculating Pearson correlation coefficients for investigating the hypothesized association between composite CHC-/YHC-SUN-SF scores and indicators of generic satisfaction with health care (convergent validity), assumed to be highly associated with the short-form score, as well as general and health-related quality of life (divergent validity), both assumed to be just low or moderately associated with satisfaction with care.

2.3. Statistical Software

Confirmatory factor analysis was processed by M-PLUS software version 7 [21]. Further standard statistics were computed using the IBM SPSS version 22.

2.4. Data Samples

According to the steps in short-form development recommended in the literature [22,23], data analyses for item selection and instrument validation were performed based on independent samples. (i) For item selection purposes, samples from the multicenter DISABKIDS [24] and TRANSITION [25] projects served as data bases (“extraction samples”), the DISABKIDS study sample for the parents report version and the TRANSITION study sample for the self-report version. (ii) For instrument validation purposes, the sample of the multicenter MODUS project [26] was used (“validation sample”), as in this MODUS study sample, for the first time, both short-form measures (CHC-/YHC-SUN-SF) were simultaneously applied to all study participants and their parents.
Samples were recruited by various collaborating centers within the different projects. Whereas the TRANSITION project and the MODUS project were conducted as multicenter studies by national consortia within Germany, the international DISABKIDS project included seven European countries (Austria, France, Germany, Greece, The Netherlands, Sweden, and United Kingdom). Thus, for the purpose of the present study, regarding the DISABKIDS study sample, we just selected a subsample with young patients from Germany and Austria for data analyses to match this sample with the other two samples regarding language. Consequently, all included patients and relatives were German speakers, and therefore all measures applied were provided in German language. Moreover, all samples included in item selection and validation analysis were restricted to adolescents and young adults 14 years old or older.

3. Results

3.1. Item Selection

For the development of CHC-/YHC-SUN-SF measures, we decided, by expert consensus, to restrict item selection to three of the six original scales (“diagnosis/information”, “child-centered care”, “doctor’s behavior”). These scales proved most relevant to the construct as indicated by psychometric analyses, conceptual level, and expert consensus (cf. Figure 1). The scales correlate substantially with one another, all of them assessing satisfaction with care at the very heart of health service provision. This is obvious, given that the content of the items directly relates to the interaction between doctor and patient. As opposed to this, the other three scales (“coordination”, “environment”, “school”) do not immediately reflect the provision of health care services but represent more “contextual” domains of health care delivery, e.g., the coordination of services or the facilities of the hospital environment.
In addition to the restriction of scales, we decided to include at least two items of each scale, with an equal number of items from each scale. In principle, this would enable us to estimate approximate values for the three core domains of satisfaction with health care. Moreover, as compared to other options, this alternative was assumed to provide the best efficiency defined by the optimal ratio of economy gained to information retained, to rationally justify this short-form development [23]. Thus, 18 items were deleted, i.e., 75% of the original item pool (cf. Figure 1). After considering these preconditions for this short-form development, we empirically conducted item selection by means of psychometric analysis. Methodologically, these analyses cover the inspection of the item correlation matrix and the computation of reliability estimators. Regarding the psychometric properties, the item pool should have reached a high consistency (>0.80) to ensure a minimum of required homogeneity [27]. On item level, corrected item-total correlations should have reached a value > 0.40. Different solutions for item selection matching these psychometric properties were provided. All items included were rated by three members from the developer’s team of the original measure, with regards to their relevance, independently. Finally, we decided for the item solution with most items that were frequently judged as “indispensable”. Data analyses were based on both “extraction samples”, including the data set of the “DISABKIDS” project field study (n = 1.152) for the parents report version and the data set of the “TRANSITION” project pilot study (n = 372) for the self-report version of the original CHC-/YHC-SUN. Thus, we developed both short-forms for these versions of the CHC-/YHC-SUN-SF simultaneously. After inspection of the initial analysis based on the data from both “extraction samples”, it turned out that even a minimal selection of two items per scale, and thus of six items in total, would provide very good psychometric properties for the short-forms under construction.

3.2. Validation Analysis

3.2.1. Sample Characteristics

For validation purposes, our “validation sample” (n = 484) served as a database for the final psychometric analysis. Overall, 355 participants filled out the CHC-/YHC-SUN-SF on their own (self-report) as well as through their parents (parents report). Moreover, 114 participants just answered the SF, and for 15 cases, only the parents report was available. The mean age was 18 years (SD = 1.54, range = 14–24), 52% of the participants were female. At the time of the survey, the majority of the participants (71.7%) went to school, 14.7% were in occupational education, 4.1% studied, 2.7% were employed, 0.8% were unemployed, and 6% provided no information or their current activity was coded under miscellaneous. The sample included patients with a diversity of chronic conditions, with diabetes (19%), hyperactivity (14%), inflammatory bowel disease (14%), asthma (11%), and atopic dermatitis (8%) being the most frequent ones.

3.2.2. Descriptive Analysis

We inspected the data set applying box plots for outliers, but no extreme values were apparent. The Kolmogorov–Smirnov test indicated a significant deviation from a normal distribution for both self-report and parents report (all p < 0.001). Descriptive item characteristics of the self- and parents report versions of the CHC-/YHC-SUN are provided in Table 1a,b.

3.2.3. Factor Structure

For confirmatory factor analysis, we applied maximum-likelihood parameter estimation. The results (cf. Table 2a,b) indicated a lack of fit for the single factor solution (self-report: CFI = 0.91; RMSEA = 0.18; SRMR = 0.07/parents report: CFI = 0.84; RMSEA = 0.30; SRMR = 0.09), whereas the solution with three different factors with a higher-order factor indicated the best fit for both self-report (CFI = 0.99; RMSEA = 0.06: SRMR = 0.02) and parents report (CFI = 0.99; RMSEA = 0.09: SRMR = 0.02).

3.2.4. Reliability

Internal consistency values (Cronbach’s Alpha) reached 0.89 (self-report) and 0.92 (parents report), and split-half reliability values reached 0.85 (self-report) and 0.91 (parents report), with sufficient internal consistencies of both test-halves for each report (self-report: 0.79; parents report: 0.82–0.85; cf. Table 3).

3.2.5. Concordance

With respect to concordance, the intraclass-correlation coefficients between self-report and parents report scores for overall scale and sub-scales varied between 0.53 and 0.67 (cf. Table 4).

3.2.6. Validity

Validity of the CHC-/YHC-SUN-SF measures can be assumed, e.g., as indicated by the associations with a single item on general health care satisfaction (self-report: 56; parents report: 0.75). As expected (cf. Table 5), moderate to small associations could be observed for self-reported health care satisfaction with self-reported general quality of life (EUROHIS-QOL: 0.35) and health-related quality of life (SF-8: 0.25/0.29).

4. Discussion

We aimed to investigate the psychometric properties of a newly developed short-form of the CHC-/YHC-SUN measure (CHC-/YHC-SUN-SF), assessing satisfaction with health care in children and adolescents with chronic conditions. We analyzed reliability, factorial validity, as well as convergent and divergent validity for both versions (self-report, parents report) of the measure.
With respect to the factorial structure of the CHC-/YHC-SUN-SF with one global factor (satisfaction with health care) and three sub-ordinated factors, our analysis confirmed the model for both versions independently (self-report, parents report). All fit indices reached values in a very good range, except for the RMSEA of the parents report version. Moreover, as compared to alternative measurement models, the model with this factor structure fitted best to the data. Given the loadings on the higher order factor, analyses supported the assumption that the computation of both a global score as well as three subscale scores of health care satisfaction is meaningful. Despite their shortness, these subscales are psychometrically justified in principle. However, the total score should be used as the standard indicator to document CHC-/YHC-SUN-SF study results.
Reliabilities in terms of internal consistencies for the overall scale with six items (and its test-halves with three items each) as well as for the three sub-scales with two items each reached high values for both versions. Scores for both versions showed a moderate association, which is in line with the literature on self-/parents agreement for patient-reported outcome measures in health care research. Empirical findings reported by Riley (2004) point to the fact that in pediatric care, adolescents as well as their parents are able to give accurate assessments according to their individual perspectives.
Convergent validity of the CHC-/YHC-SUN-SF measures can be assumed, as indicated by associations with a single-item measure on general health care satisfaction, indicating both, shared variance reflecting sufficient overlap in assessing the same underlying construct (satisfaction) as well as sufficient specificity accounting for different approaches to satisfaction assessment (domain-related vs. generic).
Divergent validation of the CHC-/YHC-SUN-SF measures revealed that the relationships between satisfaction with health care and quality of life were widely confirmed for both instruments. Whereas correlation coefficients between satisfaction with care and general quality of life (EUROHIS-8) ranged between 0.26 and 0.35, correlation coefficients with health-related quality of life (SF-8) proved to be even lower (r = 0.17–0.29).
Despite these sound psychometric properties of the measure, several limitations of the validation study must be taken into consideration: Our study covered only a limited age range, given that participants in this sample were adolescents and young people 14 years old or older only, but the questionnaire targeted both adolescents and children. Another issue is a potential bias, because response behavior regarding satisfaction with health care among patients who are willing to participate may be different from those that do not prefer to do so. Moreover, as for any short-form development, content validity decreased by significantly reducing the number of items. Additionally, we were unable to examine the instrument’s ability to detect change over time and test-retest reliability and did not test for known-groups validity as well as for invariance by sex, age, or other attributes. Finally, the analysis was restricted to data that were collected in German language only and therefore may reflect some characteristics specific to a German context, which limits the impact of our study. Previous research has shown differences in pediatric health care provision between different European countries, e.g., for adolescents with disorders/differences of sex development [28]. Due to these limitations, further studies with improved study designs and methods are needed to provide evidence that the newly developed short-forms could be applied to other populations and age groups as well.
Future research options in the field of pediatric health services research fostered by this short instrument cover a wide range of topics. First, the measure provides opportunities to study the association between adolescents’ self-assessment and parents’ assessment regarding satisfaction with health care of the young patients. Moreover, considering the multidimensionality of the measure, it fosters comparisons between objective indicators of health care services and subjective satisfaction with health care, as almost demonstrated [28]. Finally, both short-form versions should be validated in other languages, especially for those versions almost available for the original CHC-/YHC-SUN measures. Therefore, we envisage the further validation of the CHC-/YHC-SUN-SF in an international study investigating cross-cultural comparability in terms of measurement invariance across different languages and countries. This would enable researchers to compare satisfaction with heath care between different countries. Variations across countries might then in part reflect different organization and financing of health care for youth with chronic conditions.

5. Conclusions

In summary, both versions of the CHC-/YHC-SUN-SF have many strengths that demonstrate the relevance of this successful validation. Beside its psychometric quality, the measure is economical and easy to administer. These are essentially important features for use in pediatric routine care. In addition, despite its brevity, it does not just provide a generic assessment of satisfaction with heath care only, but also delivers information about satisfaction with several core aspects of health services provision specifically and is applicable across a wide range of conditions. Taken this together, the CHC-/YHC-SUN-SF has huge potential in both pediatric health services research and pediatric clinical care.

Author Contributions

Conceptualization, H.M. (Holger Muehlan); methodology, H.M. (Holger Muehlan) and H.M. (Henriette Markwart); software, H.M. (Holger Muehlan) and H.M. (Henriette Markwart); validation, H.M. (Holger Muehlan) and H.M. (Henriette Markwart); formal analysis, H.M. (Holger Muehlan) and H.M. (Henriette Markwart); investigation, I.M., G.E., U.T. and S.S.; resources, I.M., G.E., U.T. and S.S.; data curation, H.M. (Holger Muehlan) and H.M. (Henriette Markwart); writing—original draft preparation, H.M. (Holger Muehlan); writing—review and editing, H.M. (Holger Muehlan); visualization, H.M. (Holger Muehlan); supervision, S.S.; project administration, I.M., G.E., U.T. and S.S.; funding acquisition, I.M., G.E., U.T. and S.S. All authors have read and agreed to the published version of the manuscript.

Funding

(i) The “DISABKIDS” project was funded by the EUROPEAN COMMISSION, QLG5-CT-2000-00716 within the Fifth Framework Program “Quality of Life and Management of Living Resources”. (ii) The “TRANSITION” study was funded by the FEDERAL MINISTRY OF EDUCATION AND RESEARCH, BMBF, Grant No. 01 6x1005. (iii) The “MODUS” study was funded by the GERMAN MINISTRY OF HEALTH, BMG, Grant No. IA5-2512FSB121//314-123006/21.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki. (i) Ethical approval for the “DISABKIDS” study was obtained from local ethics committee for all centers. (ii) For the “TRANSITION” study, the Institutional Review Board at the University Medical Center of Greifswald obtained ethical approval. (iii) The ethical approvals for the “MODUS” study were given by the local ethics committees of the University of Luebeck (No. 11-248) and the ethics committee of the Hannover Medical School (No. 1699-2013).

Informed Consent Statement

Informed consent was obtained from all subjects (parental consent) involved in the study.

Data Availability Statement

Due to data protection issues, the data cannot be shared.

Acknowledgments

We acknowledge support by the BMBF (German Ministry of Education and Research) for the article processing charge (APC) provided as a “Post-Grant-Fund” of the “TRANSITION” project (Grant No. 01 6x1005) to support open access publications. The TRANSITION project group was comprised of two research groups located at the Department of Health and Prevention, Institute of Psychology, University of Greifswald, Germany (Schmidt/Herrmann-Garitz) and at the Department of Pediatrics, Medical University of Luebeck, Germany (Thyen/Bomba). The DISABKIDS group was comprised of a coordination group at the Department of Medical Psychology, University Hospital of Hamburg, Germany (Bullinger/Schmidt/Petersen) and several collaborating investigators from seven European countries (only German and Austrian centers are mentioned here since our data analyses was restricted to study samples from those centers): Department of Physical Medicine and Rehabilitation, University of Vienna, Austria (Quittan/Schuhfried/Hachemian); Department of Pediatrics, Medical University of Luebeck, Germany (Thyen/Müller-Godeffroy). We acknowledge the members of the ModuS-T working group and their institutions (listed in alphabetical order of the city names): Berlin (Findorff/Galler/Horn/Lehmann/Müller/Müther/ Staab/Wagner), Bielefeld (Bresser/Hagemeister), Bonn (Haffner), Bremen (Claßen/Faiß/Kauffmann), Celle (Brunckhorst/Riedel), Dresden (Vogelberg/Wanske), Eisenach (Kretzschmar), Essen (Gaebel/ Goll), Freiburg (Hönig/Hufnagel), Hagen (Kreller-Laugwitz/Wolff), Hamburg (Lenhartz/Stollhoff), Hannover (Das/Dingemann/Ernst/Gebert/Lange/Meyer), Kiel (Franke), Köln (Brengmann/Weber), Lübeck (Bomba/Menrath/Thyen), München (Benz/Bohata/Schalm), Münster (Kuwertz-Bröking/ Schüer), Osnabrück (Bockstiegel/Büsing/Rodeck/Szczepanski), Paderborn (Wolf), Sendenhorst (Ganser/Hardt/Stapel), Stuttgart (Jechalke), Sylt (Scheewe/Stachelscheid/Stachow), Tübingen (Moritz), Wangen (Jaeschke/Spindler), Viersen (Umpfenbach), Würzburg (Brosi/Götz).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Verhoof, E.J.A.; Maurice-Stam, H.; Heymans, H.S.A.; Evers, A.W.M.; Grootenhuis, M.A. Psychosocial well-being in young adults with chronic illness since childhood: The role of illness cognitions. Child Adolesc. Psychiatry Ment. Health 2014, 8, 1–10. [Google Scholar] [CrossRef] [Green Version]
  2. Power, C.; Manor, O. A prospective study of limiting longstanding illness in early adulthood. Int. J. Epidemiol. 2000, 29, 131–139. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Eiser, C.; Berrenberg, J.L. Assessing the impact of chronic disease on the relationship between parents and their adolescents. J. Psychosom. Res. 1995, 39, 109–114. [Google Scholar] [CrossRef]
  4. Wallander, J.L.; Varni, J.W. Effects of pediatric chronic physical disorders on child and family adjustment. J. Child Psychol. Psychiatry 1998, 39, 29–46. [Google Scholar] [CrossRef]
  5. Riley, A.W. Evidence that school-age children can self-report on their health. Ambul. Pediatr. 2004, 4, 371–376. [Google Scholar] [CrossRef]
  6. Seid, M.; Varni, J.W.; Kurtin, P.S. Measuring quality of care for vulnerable children: Challenges and conceptualization of a pediatric outcome measure of quality. Am. J. Med. Qual. 2000, 15, 182–187. [Google Scholar] [CrossRef]
  7. Perrin, J.M. Children with special health care needs and changing policy. Acad. Pediatr. 2011, 11, 103–104. [Google Scholar] [CrossRef]
  8. Schmidt, S.; Thyen, U.; Chaplin, J.; Mueller-Godeffroy, E.; The European DISABKIDS Group. Cross-cultural Development of a Child Health Care Questionnaire on Satisfaction, Utilization, and Needs. Ambul. Pediatr. 2007, 7, 374–382. [Google Scholar] [CrossRef] [PubMed]
  9. Schmidt, S.; Thyen, U.; Herrmann-Garitz, C.; Bomba, F.; Muehlan, H. The Youth Health Care measure – satisfaction, utilization, and needs (YHC-SUN)–development of a self-report version of the Child Health Care (CHC-SUN) proxy-measure. BMC Health Serv. Res. 2016, 16, 189. [Google Scholar] [CrossRef] [Green Version]
  10. Ellert, U.; Lampert, T.; Ravens-Sieberer, U. Messung der gesundheitsbezogenen Lebensqualität mit dem SF-8–eine Normstichprobe für Deutschland [Measuring health-related quality of life with the SF-8–Normal sample of the German population]. Bundesgesundheitsblatt Gesundh. Gesundh. 2005, 48, 1330–1337. [Google Scholar] [CrossRef]
  11. Ware, J.E.; Kosinski, M.; Dewey, J.E.; Gandek, B. How to Score and Interpret Single-Item Health Status Measures: A Manual for Users of the SF-8 Health Survey; QualityMetric: Richmond, VA, USA, 1999. [Google Scholar]
  12. Morfeld, M.; Bullinger, M.; Kirchberger, I. SF-36 Fragebogen zum Gesundheitszustand, 2. Aufl. [SF-36 Health Survey Concerning Health Status], 2nd ed.; Hogrefe: Goettingen, Germany, 2011. [Google Scholar]
  13. Ware, J.E.; Kosinski, M.; Keller, S. SF-36 Physical and Mental Summary Scales: A User’s Manual; The Health Institute, New England Medical Center: Boston, MA, USA, 1994. [Google Scholar]
  14. Power, M.J. Development of a common instrument for quality of life. In EUROHIS: Developing Common Instruments for Health Surveys; Nosikov, A., Gudex, C., Eds.; IOS Press: Amsterdam, The Netherlands, 2003. [Google Scholar]
  15. Schmidt, S.; Muehlan, H.; Power, M. The EUROHIS-QOL 8 item index. Psychometric results of a cross-cultural study. Eur. J. Public Health 2006, 16, 420–428. [Google Scholar] [CrossRef]
  16. Pires, A.C.; Fleck, M.P.; Power, M.; da Rocha, N.S. Psychometric properties of the EUROHIS-QOL 8-item index (WHOQOL-8) in a Brazilian sample. Braz. J. Psychiatry 2018, 40, 249–255. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Muehlan, H.; Power, M.; Bullinger, M.; Schmidt, S. Short-forms of subjective quality of life assessments from cross-cultural studies for use in surveys with different populations. Clin. Psychol. Psychother. 2008, 15, 142–153. [Google Scholar] [CrossRef] [PubMed]
  18. Bentler, P.M.; Bonett, D.G. Significance tests and goodness-of-fit in the analysis of covariance structures. Psychol. Bull. 1980, 88, 588–606. [Google Scholar] [CrossRef]
  19. Hu, L.T.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Modeling 1999, 6, 1–55. [Google Scholar] [CrossRef]
  20. Schreiber, J.B.; Nora, A.; Stage, F.K.; Barlow, E.A.; King, J. Reporting structural equation modeling and confirmatory factor analysis results: A review. J. Educ. Res. 2006, 99, 323–338. [Google Scholar] [CrossRef]
  21. Múthen, L.K.; Múthen, B. Mplus. Software Version 7; Múthen & Múthen: Los Angeles, CA, USA, 2012. [Google Scholar]
  22. Goetz, C.; Coste, J.; Lemetayer, F.; Rat, A.C.; Montel, S.; Recchia, S.; Guillemin, F. Item reduction based on rigorous methodological guidelines is necessary to maintain validity when shortening composite measurement scales. J. Clin. Epidemiol. 2013, 66, 710–718. [Google Scholar] [CrossRef] [PubMed]
  23. Smith, G.T.; McCarthy, D.M.; Anderson, K.G. On the sins of short-form development. Psychol. Assess. 2000, 12, 102–111. [Google Scholar] [CrossRef]
  24. Simeoni, M.C.; Schmidt, S.; Muehlan, H.; Debensason, D.; Bullinger, M.; The European DISABKIDS Group. Field testing of a European quality of life instrument for children and adolescents with chronic conditions: The 37-item DISABKIDS Chronic Generic Module. Qual. Life Res. 2007, 16, 881–893. [Google Scholar] [CrossRef]
  25. Schmidt, S.; Markwart, H.; Bomba, F.; Muehlan, H.; Findeisen, A.; Kohl, M.; Menrath, I.; Thyen, U. Differential effect of a patient-education transition intervention in adolescents with IBD vs. diabetes. Eur. J. Pediatr. 2018, 177, 497–505. [Google Scholar] [CrossRef]
  26. Menrath, I.; Ernst, G.; Szczepanski, R.; Lange, K.; Bomba, F.; Stab, D.; Muehlan, H.; Thyen, U. Effectiveness of a generic transition-oriented patient education program in a multicenter, prospective and controlled study. J. Transit. Med. 2019, 1, 20180001. [Google Scholar] [CrossRef] [Green Version]
  27. Cortina, J.M. What is coefficient alpha? An examination of theory and applications. J. Appl. Psychol. 1993, 78, 98. [Google Scholar] [CrossRef]
  28. Thyen, U.; Ittermann, T.; Flessa, S.; Muehlan, H.; Birnbaum, W.; Rapp, M.; Marshall, L.; Szarras-Capnik, M.; Bouvattier, C.; Kreukels, B.P.C.; et al. Quality of health care in adolescents and adults with disorders/ differences of sex development (DSD) in six European countries (dsd-LIFE). BMC Health Serv. Res. 2018, 18, 527. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Overview of versions and content of different CHC-/YHC-SUN instruments for the assessment of special health care needs, health care utilization, and satisfaction with health care in children and adolescents with chronic health conditions.
Figure 1. Overview of versions and content of different CHC-/YHC-SUN instruments for the assessment of special health care needs, health care utilization, and satisfaction with health care in children and adolescents with chronic health conditions.
Ijerph 18 12196 g001
Table 1. (a) Descriptive item characteristics for the self-report of the CHC-/YHC-SUN-SF (n = 469). (b) Descriptive item characteristics for the parents report of the CHC-/YHC-SUN-SF (n = 370).
Table 1. (a) Descriptive item characteristics for the self-report of the CHC-/YHC-SUN-SF (n = 469). (b) Descriptive item characteristics for the parents report of the CHC-/YHC-SUN-SF (n = 370).
(a)
ItemDomainmsdSkewnessCurtosis
1.Diagnosis/Information3.471.01−0.25−0.44
2.Diagnosis/Information3.661.01−0.36−0.50
3.Child-Centered Care3.831.00−0.57−0.25
4.Child-Centered Care4.050.99−0.910.32
5.Doctor’s Behavior4.000.96−0.840.27
6.Doctor’s Behavior3.891.07−0.77−0.11
7.(Generic Single-Item-Measure)3.681.00−0.34−0.52
(b)
ItemDomainmsdSkewnessCurtosis
1.Diagnosis/Information3.411.06−0.44−0.41
2.Diagnosis/Information3.591.07−0.62−0.16
3.Child-Centered Care3.940.92−0.680.03
4.Child-Centered Care4.060.92−0.890.43
5.Doctor’s Behavior3.900.89−0.570.14
6.Doctor’s Behavior3.930.93−0.730.22
7.(Generic Single-Item-Measure)3.800.88−0.37−0.30
Table 2. (a) Selected Indices for Fit Statistics and standardized regression weights for items of Confirmatory Factor Analysis of the self-report version of the CHC-/YHC-SUN-SF (n = 469). (b) Selected Indices for Fit Statistics and standardized regression weights for items of Confirmatory Factor Analysis of the parents report version of the CHC-/YHC-SUN-SF (n = 370).
Table 2. (a) Selected Indices for Fit Statistics and standardized regression weights for items of Confirmatory Factor Analysis of the self-report version of the CHC-/YHC-SUN-SF (n = 469). (b) Selected Indices for Fit Statistics and standardized regression weights for items of Confirmatory Factor Analysis of the parents report version of the CHC-/YHC-SUN-SF (n = 370).
(a)
Fit StatisticsModel 1Model 2Model 3
  • Chi-Square
111.3467.57014.48
  • df
976
  • p (Chi-Square) *
0.0050.0050.129
  • CFI
0.910.940.99
  • RMSEA
0.180.160.06
  • RMSEA (CI-90%)
(0.15–0.21)(0.13–0.19)(0.02–0.11)
  • P
0.0000.0000.246
  • SRMR
0.070.120.02
  • β item 1
0.67 (factor 1)0.92 (factor 1)0.86 (factor 1)
  • β item 2
0.65 (factor 1)0.85 (factor 1)0.81 (factor 1)
  • β item 3
0.81 (factor 1)0.87 (factor 2)0.82 (factor 2)
  • β item 4
0.85 (factor 1)0.91 (factor 2)0.88 (factor 2)
  • β item 5
0.80 (factor 1)0.88 (factor 3)0.80 (factor 3)
  • β item 6
0.80 (factor 1)0.86 (factor 3)0.82 (factor 3)
(b)
Fit StatisticsModel 1Model 2Model 3
  • Chi-Square
286.6155.7723.42
  • df
976
  • p (Chi-Square) *
0.0000.0000.001
  • CFI
0.840.970.99
  • RMSEA
0.300.140.09
  • RMSEA (CI-90%)
(0.27–0.33)(0.11–0.18)(0.06–0.13)
  • P
0.0000.0000.000
  • SRMR
0.090.090.02
  • β item 1
0.68 (factor 1)0.92 (factor 1)0.91 (factor 1)
  • β item 2
0.66 (factor 1)0.95 (factor 1)0.88 (factor 1)
  • β item 3
0.91 (factor 1)0.95 (factor 2)0.93 (factor 2)
  • β item 4
0.90 (factor 1)0.91 (factor 2)0.93 (factor 2)
  • β item 5
0.87 (factor 1)0.95 (factor 3)0.91 (factor 3)
  • β item 6
0.84 (factor 1)0.90 (factor 3)0.86 (factor 3)
Notes. Sample sizes vary depending on missing data. p *: corrected p-values applying Bollen–Stine bootstrap method. CFI: Comparative Fit Index; RMSEA: Root-Mean-Square Error of Approximation; SRMR: Standardized Root-Mean Residual. β: Standardized regression weight.
Table 3. Internal consistencies for the overall scale and subscales of the self-report and parents report versions of the CHC-/YHC-SUN-SF (n = 469).
Table 3. Internal consistencies for the overall scale and subscales of the self-report and parents report versions of the CHC-/YHC-SUN-SF (n = 469).
CHC-/YHC-SUN-SF ScoreNumber of ItemsSelf-ReportParents-Report
Cronbach’s AlphaCronbach’s Alpha
  • Total
60.890.92
  • Diagnosis/Information
20.820.90
  • Child-Centered Care
20.840.93
  • Doctor’s Behavior
20.790.88
Table 4. Intraclass-correlation coefficients between self-report and parents report scores for overall scale and sub-scales of the CHC-/YHC-SUN-SF (n = 355).
Table 4. Intraclass-correlation coefficients between self-report and parents report scores for overall scale and sub-scales of the CHC-/YHC-SUN-SF (n = 355).
CHC-/YHC-SUN-SF ScoreICCCI-95%
  • Total
0.670.60–0.73
  • Diagnosis/Information
0.530.43–0.62
  • Child-Centered Care
0.640.56–0.71
  • Doctor’s Behavior
0.560.46–0.64
Table 5. Correlation coefficients between overall scale and sub-scale scores of the self-report version of the CHC-/YHC-SUN-SF (n = 469) and generic satisfaction with health care (single CHC-/YHC-SUN single-item measure) as well as several quality of life indicators (SF-8, EUROHIS-QOL; n = 469).
Table 5. Correlation coefficients between overall scale and sub-scale scores of the self-report version of the CHC-/YHC-SUN-SF (n = 469) and generic satisfaction with health care (single CHC-/YHC-SUN single-item measure) as well as several quality of life indicators (SF-8, EUROHIS-QOL; n = 469).
TotalDiagnosis/InformationChild-Centered CareDoctor’s Behavior
Divergent validityM (SD)rrrr
  • SF-8 Somatic Sum Score
50.42 (6.37)0.29 **0.28 **0.25 **0.22 **
  • SF-8 Mental Sum Score
49.52 (6.31)0.25 **0.29 **0.20 **0.17 **
  • EUROHIS-QOL Total Score
4.07 (0.52)0.35 **0.35 **0.31 **0.26 **
Notes. ** p < 0.01; r = Pearson-correlation coefficient.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Muehlan, H.; Markwart, H.; Menrath, I.; Ernst, G.; Thyen, U.; Schmidt, S. A Short Form of the Child/Youth Health Care Questionnaire on Satisfaction, Utilization, and Needs in Children and Adolescents with a Chronic Condition (CHC-SUN-SF/YHC-SUN-SF). Int. J. Environ. Res. Public Health 2021, 18, 12196. https://doi.org/10.3390/ijerph182212196

AMA Style

Muehlan H, Markwart H, Menrath I, Ernst G, Thyen U, Schmidt S. A Short Form of the Child/Youth Health Care Questionnaire on Satisfaction, Utilization, and Needs in Children and Adolescents with a Chronic Condition (CHC-SUN-SF/YHC-SUN-SF). International Journal of Environmental Research and Public Health. 2021; 18(22):12196. https://doi.org/10.3390/ijerph182212196

Chicago/Turabian Style

Muehlan, Holger, Henriette Markwart, Ingo Menrath, Gundula Ernst, Ute Thyen, and Silke Schmidt. 2021. "A Short Form of the Child/Youth Health Care Questionnaire on Satisfaction, Utilization, and Needs in Children and Adolescents with a Chronic Condition (CHC-SUN-SF/YHC-SUN-SF)" International Journal of Environmental Research and Public Health 18, no. 22: 12196. https://doi.org/10.3390/ijerph182212196

APA Style

Muehlan, H., Markwart, H., Menrath, I., Ernst, G., Thyen, U., & Schmidt, S. (2021). A Short Form of the Child/Youth Health Care Questionnaire on Satisfaction, Utilization, and Needs in Children and Adolescents with a Chronic Condition (CHC-SUN-SF/YHC-SUN-SF). International Journal of Environmental Research and Public Health, 18(22), 12196. https://doi.org/10.3390/ijerph182212196

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop