Structural Validity of an ICF-Based Measure of Activity and Participation for Children in Taiwan’s Disability Eligibility Determination System
Abstract
:1. Introduction
2. Materials and Methods
2.1. Design
2.2. Participants
2.3. Procedures
2.4. Measures
2.5. Data Reduction and Statistical Method
3. Results
3.1. Characteristics of the Samples
3.2. Exploratory Factor Analyses and Internal Consistency
3.3. Confirmatory Factor Analyses
4. Discussion
5. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
Abbreviations
DEDS | Disability Eligibility Determination System |
FUNDES | Functioning Disability Evaluation Scale |
CASP | Child and Adolescent Scale of Participation |
HCLA | home and community living activities |
References
- World Health Organization. International Classification of Functioning, Disability, and Health (ICF); World Health Organization: Geneva, Switzerland, 2001. [Google Scholar]
- World Health Organization. International Classification of Functioning, Disability and Health: Children & Youth Version (ICF-CY); World Health Organization: Geneva, Switzerland, 2007. [Google Scholar]
- Chiu, W.T.; Yen, C.F.; Teng, S.W.; Liao, H.F.; Chang, K.H.; Chi, W.C.; Wang, Y.H.; Liou, T.H. Implementing disability evaluation and welfare services based on the framework of the International Classification of Functioning, Disability and Health: Experiences in Taiwan. BMC Health Serv. Res. 2013, 13, 416. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Liao, H.F.; Yen, C.F.; Hwang, A.W.; Liou, T.H.; Chang, B.S.; Wu, T.F.; Lu, S.J.; Chi, W.C.; Chang, K.H. Introduction to the application of the Functioning Scale of the Disability Evaluation System. Formos. J. Med. 2013, 17, 317–331. [Google Scholar] [CrossRef]
- Liao, H.F.; Yen, C.F.; Liou, T.H.; Chi, W.C. The development and application of the Functioning Disability Evaluation Scale. In Community Development Quarterly; Social and Family Affairs Administration, Ministry of Health and Welfare: Taipei, Taiwan, 2015; Volume 105, pp. 77–98. [Google Scholar]
- Teng, S.W.; Yen, C.F.; Liao, H.F.; Chang, K.H.; Chi, W.C.; Wang, Y.H.; Liou, T.H. Evolution of system for disability assessment based on the International Classification of Functioning, Disability, and Health: A Taiwanese study. J. Formos. Med. Assoc. 2013, 112, 691–698. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Üstün, T.B.; Chatterji, S.; Kostanjsek, N.; Rehm, J.; Kennedy, C.; Epping-Jordan, J.; Saxena, S.; von Korff, M.; Pull, C. Developing the World Health Organization Disability Assessment Schedule 2.0. Bull. World Health Organ. 2010, 88, 815–823. [Google Scholar] [CrossRef]
- Bedell, G. Further validation of the Child and Adolescent Scale of Participation (CASP). Dev. Neurorehabil. 2009, 12, 342–351. [Google Scholar] [CrossRef]
- Bedell, G.M. Developing a follow-up survey focused on participation of children and youth with acquired brain injuries after discharge from inpatient rehabilitation. NeuroRehabilitation 2004, 19, 191–205. [Google Scholar] [CrossRef] [Green Version]
- Bedell, G.M.; Dumas, H.M. Social participation of children and youth with acquired brain injuries discharged from inpatient rehabilitation: A follow-up study. Brain Inj. 2004, 18, 65–82. [Google Scholar] [CrossRef]
- Hwang, A.W.; Liou, T.H.; Bedell, G.M.; Kang, L.J.; Chen, W.C.; Yen, C.F.; Chang, K.H.; Liao, H.F. Psychometric properties of the child and adolescent scale of participation—Traditional Chinese version. Int. J. Rehabil. Res. 2013, 36, 211–220. [Google Scholar] [CrossRef]
- Hwang, A.W.; Yen, C.F.; Liou, T.H.; Bedell, G.; Granlund, M.; Teng, S.W.; Chang, K.H.; Chi, W.C.; Liao, H.F. Development and validation of the ICF-CY-Based Functioning Scale of the Disability Evaluation System—Child Version in Taiwan. J. Formos. Med. Assoc. 2015, 114, 1170–1180. [Google Scholar] [CrossRef] [Green Version]
- Liao, H.F.; Hwang, A.W.; Kang, L.J.; Liao, Y.T.; Granlund, M.; Simeonsson, R.J. Development of the FUNDES-Child and its implications for the education of Taiwanese children. In An Emerging Approach for Education and Care: Implementing a World-Wide Classification of Functioning and Disability; Castro, S., Palikara, O., Eds.; Routledge: London, UK, 2018; pp. 85–111. [Google Scholar]
- Hwang, A.W.; Yen, C.F.; Liou, T.H.; Simeonsson, R.J.; Chi, W.C.; Lollar, D.J.; Liao, H.F.; Kang, L.J.; Wu, T.F.; Teng, S.W.; et al. Participation of Children with Disabilities in Taiwan: The Gap between Independence and Frequency. PLoS ONE 2015, 10, e0126693. [Google Scholar] [CrossRef] [Green Version]
- Bedell, G. The Child and Family Follow-Up Survey (CFFS)-Administration and Scoring Guidelines. 2011. Unpublished Manual. Available online: http://sites.tufts.edu/garybedell/measurement-tools/ (accessed on 24 August 2020).
- Chen, W.C.; Bedell, G.M.; Yen, C.F.; Liou, T.H.; Kang, L.J.; Liao, H.F.; Hwang, A.W. Psychometric properties of the Chinese version of the child and adolescent factors inventory (CAFI-C). Res. Dev. Disabil. 2017, 68, 111–121. [Google Scholar] [CrossRef] [PubMed]
- Chiu, T.Y.; Yen, C.F.; Escorpizo, R.; Chi, W.C.; Liou, T.H.; Liao, H.F.; Chou, C.H.; Fang, W.H. What is the gap in activity and participation between people with disability and the general population in Taiwan? Int. J. Equity Health 2017, 16, 136. [Google Scholar] [CrossRef] [PubMed]
- Kang, L.J.; Yen, C.F.; Bedell, G.; Simeonsson, R.J.; Liou, T.H.; Chi, W.C.; Liu, S.W.; Liao, H.F.; Hwang, A.W. The Chinese version of the Child and Adolescent Scale of Environment (CASE-C): Validity and reliability for children with disabilities in Taiwan. Res. Dev. Disabil. 2015, 38, 64–74. [Google Scholar] [CrossRef] [PubMed]
- Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Qual. Life Res. 2010, 19, 539–549. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chi, W.C.; Chang, K.H.; Escorpizo, R.; Yen, C.F.; Liao, H.F.; Chang, F.H.; Chiou, H.Y.; Teng, S.W.; Chiu, W.T.; Liou, T.H. Measuring disability and its predicting factors in a large database in Taiwan using the World Health Organization Disability Assessment Schedule 2.0. Int. J. Environ. Res. Public Health 2014, 11, 12148–12161. [Google Scholar] [CrossRef] [PubMed]
- Ministry of Health and Welfare. Regulations for the Classification, Categories, Grades of Disability and Standards in Disability Evaluation System; Ministry of Health and Welfare: Taipei, Taiwan, 2014. [Google Scholar]
- Costello, A.B.; Osborne, J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10. [Google Scholar] [CrossRef]
- Sharma, S. Applied Multivariate Techniques; John Wiley and Sons, Inc.: New York, NY, USA, 1996; pp. 90–143. [Google Scholar]
- Prinsen, C.A.C.; Vohra, S.; Rose, M.R.; Boers, M.; Tugwell, P.; Clarke, M.; Williamson, P.R.; Terwee, C.B. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”—A practical guideline. Trials 2016, 17, 449. [Google Scholar] [CrossRef] [Green Version]
- Byrne, B.M. Structural Equation Modeling with LISREL, PRELIS, and SIMPLIS: Basic Concepts, Applications, and Programming; Psychology Press: Stanford, CA, USA, 2013. [Google Scholar]
- Beauducel, A.; Wittmann, W.W. Simulation Study on Fit Indexes in CFA Based on Data with Slightly Distorted Simple Structure. Struct. Equ. Modeling A Multidiscip. J. 2005, 12, 41–75. [Google Scholar] [CrossRef]
- Marsh, H.W.; Hocevar, D. Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. Psychol. Bull. 1985, 97, 562–582. [Google Scholar] [CrossRef]
- Dijkers, M.P. Issues in the conceptualization and measurement of participation: An overview. Arch. Phys. Med. Rehabil. 2010, 91, S5–S16. [Google Scholar] [CrossRef]
- McDougall, J.; Bedell, G.; Wright, V. The youth report version of the Child and Adolescent Scale of Participation (CASP): Assessment of psychometric properties and comparison with parent report. Child Care Health Dev. 2013, 39, 512–522. [Google Scholar] [CrossRef] [PubMed]
- Golos, A.; Bedell, G. Psychometric properties of the Child and Adolescent Scale of Participation (CASP) across a 3-year period for children and youth with traumatic brain injury. NeuroRehabilitation 2016, 38, 311–319. [Google Scholar] [CrossRef] [PubMed]
- De Bock, F.; Bosle, C.; Graef, C.; Oepen, J.; Philippi, H.; Urschitz, M.S. Measuring social participation in children with chronic health conditions: Validation and reference values of the child and adolescent scale of participation (CASP) in the German context. BMC Pediatr. 2019, 19, 125. [Google Scholar] [CrossRef] [PubMed]
- De Kloet, A.J.; Berger, M.A.; Bedell, G.M.; Catsman-Berrevoets, C.E.; van Markus-Doornbosch, F.; Vlieland, T.P.V. Psychometric evaluation of the Dutch language version of the Child and Family Follow-up Survey. Dev. Neurorehabil. 2015, 18, 357–364. [Google Scholar] [CrossRef] [PubMed]
- Bedell, G.; Coster, W. Measuring participation of school-aged children with traumatic brain injuries: Considerations and approaches. J. Head Trauma. Rehabil. 2008, 23, 220–229. [Google Scholar] [CrossRef]
- Liao, Y.T.; Hwang, A.W.; Liao, H.F.; Kang, L.J. Do we hear the child’s voice? Supporting participation engagement in goal-setting for elementary school students with special needs: A case report. FJPT 2017, 42, 228–233. [Google Scholar] [CrossRef]
- Liao, Y.T.; Hwang, A.W.; Liao, H.F.; Granlund, M.; Kang, L.J. Understanding the participation in home, school, and community activities reported by children with disabilities and their parents: A pilot study. Int. J. Environ. Res. Public Health 2019, 16, 2217. [Google Scholar] [CrossRef] [Green Version]
- Liao, H.F.; Wu, P.F. Early childhood inclusion in Taiwan. Infants Young Child 2017, 30, 320–327. [Google Scholar] [CrossRef]
- Hwang, A.W.; Lin, P.J.; Kang, L.J.; Chen, L.J.; Chen, H.J.; Liao, H.F. To envision professional development —The planning of school-based physical therapy in Taiwan. FJPT 2017, 42, 195–210. [Google Scholar] [CrossRef]
- Imms, C.; Granlund, M.; Wilson, P.H.; Steenbergen, B.; Rosenbaum, P.L.; Gordon, A.M. Participation, both a means and an end: A conceptual analysis of processes and outcomes in childhood disability. Dev. Med. Child Neurol. 2017, 59, 16–25. [Google Scholar] [CrossRef] [Green Version]
FUNDES-Child Versions | The Date of Design Completion and Start Training Program | Subscales and Dimensions or Illustrates |
---|---|---|
Has been developing | 2010–2011
|
|
FUNDES-Child 5.0 * | 2011/09 |
|
FUNDES-Child 6.0 | 2012/07-12 | Developing the manuals. The adult and children’s training programs and versions are combined in the same manual. |
FUNDES-Child 7.0 | 2014/06-12-2017 | To separate adult and children’s manual and add evidence of the reliability and validity of FUNDES 7.0 (adult and child versions) into the manual. Due to the need for cultural adaptation and the practical demands of nationwide application, revisions to FUNDES-Child have been ongoing based on feedback from field testers and experts as well as results after 2017. |
Characteristics | All Participants n (%) | Sample 1 for EFA 2 | Sample 2 for CFA 2 | ||
---|---|---|---|---|---|
n = 13,835 | n = 4111 | n = 4823 | |||
Gender | |||||
Male | 9101 (65.8) | 2705 (65.8) | 3184 (66.0) | ||
Female | 4734 (34.2) | 1406 (34.2) | 1639 (34.0) | ||
Age (years) | |||||
6–9 | 4733 (34.2) | 1444 (35.1) | 1644 (34.1) | ||
10–13 | 4636 (33.5) | 1357 (33.0) | 1604 (33.3) | ||
14–17 | 4466 (32.3) | 1310 (31.9) | 1575 (32.6) | ||
Mean age | 11.4 ± 3.5 | 11.3 ± 3.5 | 11.4 ± 3.5 | ||
Number of impairments identified 1 | |||||
Single type of disability | 12,644 (91.4) | 3751 (91.2) | 4411 (91.4) | ||
Types of disability based on b/s Chapter | |||||
Chapter 1 | 11,083 (87.7) | 3288 (87.7) | 3848 (87.2) | ||
Chapter 2 | 438 (3.5) | 136 (3.6) | 169 (3.8) | ||
Chapter 3 | 107 (0.8) | 32 (0.9) | 36 (0.8) | ||
Chapter 4 | 210 (1.7) | 64 (1.7) | 70 (1.6) | ||
Chapter 5 | 14 (0.1) | 7 (0.2) | 3 (0.1) | ||
Chapter 6 | 30 (0.2) | 11 (0.3) | 12 (0.3) | ||
Chapter 7 | 584 (4.6) | 161 (4.3) | 206 (4.7) | ||
Chapter 8 | 13 (0.1) | 3 (0.1) | 7 (0.2) | ||
Others (chromosome or gene et al.) | 165 (1.3) | 49 (1.3) | 60 (1.3) | ||
Two types of disabilities | 1033 (7.5) | 311 (7.6) | 360 (7.5) | ||
More than three types of disabilities | 158 (1.1) | 49 (1.2) | 52 (1.1) | ||
Disability severity level | |||||
Mild | 8241 (59.6) | 2464 (59.9) | 2889 (60.0) | ||
Moderate | 3949 (28.5) | 1171 (28.5) | 1367 (28.3) | ||
Severe | 1104 (8.0) | 325 (7.9) | 393 (8.1) | ||
Profound | 541 (3.9) | 153 (3.7) | 174 (3.6) | ||
Living situation | |||||
Independent living in community | 8042 (58.1) | 2455 (59.8) | 2743 (56.9) | ||
Assisted living in community | 5616 (40.6) | 1609 (39.1) | 2016 (41.8) | ||
Not living in community | 177 (1.3) | 47 (1.1) | 64 (1.3) |
Item No. and Name | Factor 1,2 | ||||
---|---|---|---|---|---|
1 | 2 | 3 | 4 | ||
3. Home: Family chores, responsibilities, and decisions | 0.821 | −0.077 | 0.012 | 0.047 | |
16. HCLA: Household activities | 0.810 | −0.005 | −0.070 | 0.061 | |
18. HCLA: Managing daily schedule | 0.403 | 0.322 | 0.105 | −0.092 | |
17. HCLA: Shopping and managing money | 0.356 | 0.279 | −0.071 | 0.127 | |
13. School: Moving around | −0.180 | 0.639 | 0.278 | 0.022 | |
9. Community: Moving around | −0.104 | 0.617 | −0.207 | 0.462 | |
5. Home: Moving around | 0.030 | 0.552 | 0.138 | −0.041 | |
19. HCLA: Using transportation to get around | 0.181 | 0.480 | −0.063 | 0.025 | |
4. Home: meals with family | 0.370 | 0.447 | 0.116 | −0.169 | |
15. School: Communicating with other children and adults | −0.057 | −0.018 | 0.715 | 0.201 | |
11. School: Educational activities with classmates | −0.048 | 0.115 | 0.701 | −0.095 | |
12. School: Social, play, and recreational activities with classmates | −0.063 | 0.047 | 0.633 | 0.143 | |
14. School: Using educational materials and equipment | −0.007 | 0.367 | 0.479 | −0.136 | |
6. Home: Communicating with other children and adults | 0.176 | −0.009 | 0.470 | 0.173 | |
1. Home: Social, play, or leisure activities with family members | 0.182 | −0.039 | 0.431 | 0.136 | |
7. Community: Social, play, or leisure activities with friends | −0.024 | −0.028 | 0.028 | 0.874 | |
10. Community: Communicating with other children and adults | 0.013 | 0.063 | 0.096 | 0.696 | |
8. Community: Structured events and activities | 0.111 | 0.156 | −0.069 | 0.579 | |
2. Home: Social, play, or leisure activities with friends | 0.064 | −0.162 | 0.265 | 0.533 | |
Variance explained | (total = 51.3%) | 11.9% | 12.8% | 14.2% | 12.4% |
Factors inter-correlation coefficients | Factor 1 | 0.55 | 0.54 | 0.46 | |
Factor 2 | 0.59 | 0.45 | |||
Factor 3 | 0.56 |
Item No. and Name | Factor 1,2 | ||
---|---|---|---|
1 | 2 | ||
16. HCLA: Household activities | 0.821 | −0.027 | |
4. Home: Self-care activities | 0.812 | −0.048 | |
3. Home: Family chores, responsibilities, and decisions | 0.704 | 0.074 | |
5. Home: Moving around | 0.670 | −0.035 | |
18. HCLA: Managing daily schedule | 0.647 | 0.064 | |
13. School: Moving around | 0.625 | 0.105 | |
19. HCLA: Using transportation to get around | 0.610 | 0.018 | |
17. HCLA: Shopping and managing money | 0.602 | 0.118 | |
9. Community: Moving around | 0.471 | 0.243 | |
14. School: Using educational materials and equipment | 0.425 | 0.300 | |
7. Community: Social, play, or leisure activities with friends | −0.125 | 0.911 | |
10. Community: Communicating with other children and adults | −0.004 | 0.821 | |
2. Home: Social, play, or leisure activities with friends | −0.078 | 0.791 | |
15. School: Communicating with other children and adults | 0.054 | 0.759 | |
12. School: Social, play, and recreational activities with classmates | 0.140 | 0.648 | |
6. Home: Communicating with other children and adults | 0.124 | 0.648 | |
8. Community: Structured events and activities | 0.154 | 0.611 | |
11. School: Educational activities with classmates | 0.186 | 0.539 | |
1. Home: Social, play, or leisure activities with family members | 0.230 | 0.517 | |
Variance explained | (total = 53.6%) | 26.6% | 27.0% |
Factors inter-correlation coefficients | Factor 1 | 0.75 |
CFA Model | BSχ2 | df | GFI | NFI | CFI | TLI | RMSEA |
---|---|---|---|---|---|---|---|
Frequency dimension | |||||||
F-1. First-order 4-factor model | 175.2 | 149 | 0.996 | 0.996 | 0.999 | 0.996 | 0.006 |
F-2. Second-order 4-factor model | 183.6 | 158 | 0.996 | 0.996 | 0.999 | 0.997 | 0.006 |
Independence dimension | |||||||
I-1. First-order 2-factor model | 190.6 | 151 | 0.997 | 0.997 | 0.999 | 0.994 | 0.007 |
I-2. Second-order 2-factor model | 191.0 | 152 | 0.997 | 0.997 | 0.999 | 0.994 | 0.007 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Hwang, A.-W.; Yen, C.-F.; Liao, H.-F.; Chi, W.-C.; Liou, T.-H.; Chang, B.-S.; Wu, T.-F.; Kang, L.-J.; Lu, S.-J.; Simeonsson, R.J.; et al. Structural Validity of an ICF-Based Measure of Activity and Participation for Children in Taiwan’s Disability Eligibility Determination System. Int. J. Environ. Res. Public Health 2020, 17, 6134. https://doi.org/10.3390/ijerph17176134
Hwang A-W, Yen C-F, Liao H-F, Chi W-C, Liou T-H, Chang B-S, Wu T-F, Kang L-J, Lu S-J, Simeonsson RJ, et al. Structural Validity of an ICF-Based Measure of Activity and Participation for Children in Taiwan’s Disability Eligibility Determination System. International Journal of Environmental Research and Public Health. 2020; 17(17):6134. https://doi.org/10.3390/ijerph17176134
Chicago/Turabian StyleHwang, Ai-Wen, Chia-Feng Yen, Hua-Fang Liao, Wen-Chou Chi, Tsan-Hon Liou, Ben-Sheng Chang, Ting-Fang Wu, Lin-Ju Kang, Shu-Jen Lu, Rune J. Simeonsson, and et al. 2020. "Structural Validity of an ICF-Based Measure of Activity and Participation for Children in Taiwan’s Disability Eligibility Determination System" International Journal of Environmental Research and Public Health 17, no. 17: 6134. https://doi.org/10.3390/ijerph17176134
APA StyleHwang, A.-W., Yen, C.-F., Liao, H.-F., Chi, W.-C., Liou, T.-H., Chang, B.-S., Wu, T.-F., Kang, L.-J., Lu, S.-J., Simeonsson, R. J., Wang, T.-H., & Bedell, G. (2020). Structural Validity of an ICF-Based Measure of Activity and Participation for Children in Taiwan’s Disability Eligibility Determination System. International Journal of Environmental Research and Public Health, 17(17), 6134. https://doi.org/10.3390/ijerph17176134