Spanish Cultural Adaptation and Inter-Rater Reliability of the Revised Knox Preschool Play Scale
Abstract
1. Introduction
2. Materials and Methods
2.1. Participants
2.2. Measures
2.3. Procedure
2.3.1. Direct Translation
2.3.2. Back Translation
2.3.3. Cognitive Interviewing
2.3.4. Linguist Expert Revision
2.3.5. Inter-Rater Reliability
3. Results
3.1. Direct and Back Translation
3.2. Cognitive Interviews
3.3. Expert Linguist Review
3.4. Inter-Rater Reliability
4. Discussion
Limitations and Future Research
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- American Occupational Therapy Association. Occupational therapy practice framework: Domain and process. Am. J. Occup. Ther. 2020, 74 (Suppl. S2), 7412410010p1–7412410010p87. [Google Scholar] [CrossRef] [PubMed]
- Parham, L.D.; Fazio, L. Play in Occupational Therapy for Children, 2nd ed.; Mosby: St. Louis, MO, USA, 2008. [Google Scholar]
- Hobson, J.A.; Hobson, R.P.; Malik, S.; Bargiota, K.; Caló, S. The Relation between Social Engagement and Pretend Play in Autism. Br. J. Occup. Ther. 2013, 31, 114–127. [Google Scholar] [CrossRef] [PubMed]
- Jones, S.S. The Development of Imitation in Infancy. Philos. Trans. R. Soc. 2009, 364, 2325–2335. [Google Scholar] [CrossRef][Green Version]
- Bundy, A.C. Leisure: Delineation of the Problem. Am. J. Occup. Ther. 1993, 217–222. [Google Scholar] [CrossRef][Green Version]
- Kaugars, A.S. Assessment of pretend play. In Play in Clinical Practice: Evidence-Based Approaches; Russ, S.W., Niec, L.N., Eds.; Guilford Press: New York, NY, USA, 2011; pp. 51–82. [Google Scholar]
- Kuhaneck, H.M.; Britner, P.A. A Preliminary Investigation of the Relationship between Sensory Processing and Social Play in Autism Spectrum Disorder. OTJR Occup. Particip. Health 2013, 33, 159–167. [Google Scholar] [CrossRef] [PubMed]
- Couch, K.J.; Deitz, J.C.; Kanny, E.M. The Role of Play in Pediatric Occupational Therapy. Am. J. Occup. Ther. 1998, 52, 111–117. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Miller Kuhaneck, H.; Tanta, K.J.; Coombs, A.K.; Pannone, H. Survey of pediatric occupational therapists’ use of play. J. Occup. Ther. Sch. Early. Interv. 2013, 6, 213–227. [Google Scholar] [CrossRef]
- Lynch, H.; Prellwitz, M.; Schulze, A.H.M. The state of play in children’s occupational therapy: A comparison between Ireland, Sweden and Switzerland. Br. J. Occup. Ther. 2018, 81, 42–50. [Google Scholar] [CrossRef][Green Version]
- Moore, A.; Lynch, H. Play and play occupation: A survey of paediatric occupational therapy practice in Ireland. Ir. J. Occup. Ther. 2018, 46, 59–72. [Google Scholar] [CrossRef][Green Version]
- Bledsoe, N.; Shepherd, J. A study of reliability and validity of a Preschool Play Scale. Am. J. Occup. Ther. 1992, 36, 783–788. [Google Scholar] [CrossRef][Green Version]
- Knox, S. Development and current use of the Knox Preschool Play Scale. In Play in Occupational Therapy for Children; Parham, L.D., Fazio, L.S., Eds.; Mosby: St. Louis, MO, USA, 1997; pp. 35–51. [Google Scholar]
- International Test Commission. ITC Guidelines for Translating and Adapting Tests. 2005. Available online: https://www.intestcom.org/files/guideline_test_adaptation.pdf (accessed on 18 December 2019).
- Ramada-Rodilla, J.M.; Serra-Pujadas, C.; Delclos-Clanchet, G.L. Cross-cultural adaptation and health questionnaires validation: Revision and methodological recommendations. Salud. Publ. Mex. 2013, 55, 57–66. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Knox, S. Development and current use of the Knox Preschool Play Scale. In Play in Occupational Therapy for Children, 2nd ed.; Parham, L.D., Fazio, L.S., Eds.; Mosby: St. Louis, MO, USA, 2008; pp. 55–70. [Google Scholar]
- Jankovich, M.; Mullen, J.; Rinear, E.; Tanta, K.; Deitz, J. Revised Knox Preschool Play Scale: Interrater agreement and construct validity. Am. J. Occup. Ther 2008, 62, 221–227. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Román-Oyola, R.; Reynolds, S.E. Validating the response process of the Spanish version of the Short Sensory Profile: A pilot study using cognitive interviews. J. Occup. Ther. Sch. Early Interv. 2010, 3, 197–206. [Google Scholar] [CrossRef]
- Gándara-Gafo, B.; Santos-del Riego, S.; Viana-Moldes, I.; Muñiz, J. Cultural adaptation of the Adolescent/Adult Sensory Profile for Spain. Am. J. Occup. Ther. 2019, 73, 7306205070p1–7306205070p9. [Google Scholar] [CrossRef] [PubMed]
- Muñiz, J.; Elosua, P.; Hambleton, R.K. Directrices para la traducción y adaptación de los tests: Segunda edición. Psicothema 2013, 25, 151–157. [Google Scholar]
- Gjersing, L.; Caplehorn, J.R.; Clausen, T. Cross-cultural adaptation of research instruments: Language, setting, time and statistical considerations. BMC Med. Res. Methodol. 2010, 10, 13. [Google Scholar] [CrossRef][Green Version]
- Willis, G.B. Cognitive Interviewing: A Tool for Improving Questionnaire Design, 1st ed.; Sage Publications: Thousand Oaks, CA, USA, 2004. [Google Scholar]
- Beatty, P.C.; Willis, G.B. Research synthesis: The practice of cognitive interviewing. Public Opin. Q. 2007, 71, 287–311. [Google Scholar] [CrossRef][Green Version]
- Bujang, M.A.; Baharum, N. Guidelines of the minimum sample size requirements for Kappa agreement test. Epidemiol. Biostat. Public Health 2017, 14, e12267-1. [Google Scholar] [CrossRef]
- Hallgren, K.A. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutor Quant Methods Psychol. 2012, 8, 23–34. [Google Scholar] [CrossRef][Green Version]
- Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef][Green Version]
- Paul, S. Culture and its influence on occupational therapy evaluation. Can. J. Occup. Ther. 2016, 62, 154–161. [Google Scholar] [CrossRef]
- Harachi, T.W.; Choi, Y.; Abbott, R.D.; Catalano, R.F.; Bliesner, S.L. Examining equivalence of concepts and measures in diverse samples. Prev. Sci. 2006, 7, 359–368. [Google Scholar] [CrossRef][Green Version]
- Pacciulio, A.M.; Pfeifer, L.I.; Santos, J.L. Preliminary reliability and repeatability of the Brazilian version of the Revised Knox Preschool Play Scale. Occup. Ther. Int. 2010, 17, 74–80. [Google Scholar] [CrossRef] [PubMed]
- Sposito, A.M.P.; Santos, J.L.F.; Pfeifer, L.I. Validation of the Revised Knox Preschool Play Scale for the Brazilian Population. Occup. Ther. Int. 2019, 2, 6397425. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Romero-Ayuso, D.; Ruiz-Salcedo, M.; Barrios-Fernández, S.; Triviño-Juárez, J.M.; Maciver, D.; Richmond, J.; Muñoz, M.A. Play in Children with Neurodevelopmental Disorders: Psychometric Properties of a Parent Report Measure ‘My Child’s Play’. Children 2021, 8, 25. [Google Scholar] [CrossRef] [PubMed]
- Montes-Montes, R.; Delgado-Lobete, L.; Pereira, J.; Pousada, T. Cross-cultural adaptation and preliminary validation of the European Spanish version of the Developmental Coordination Disorder Questionnaire (DCDQ–ES). Am. J. Occup. Ther. 2020, 74, 7404205060p1–7404205060p10. [Google Scholar] [CrossRef]
Original Test Item | Spanish Translation | Modifications | Final Translation |
---|---|---|---|
Beginning integration of entire body in activities. Concentrates on complex movements, jumps off floor, stands on one foot briefly, throws ball in stance without falling. | Comienza a interactuar con todo el cuerpo en actividades, se concentra en movimientos complejos, salta, se para en un pie brevemente, lanza una pelota sin caerse. | Replace “se pone en un pie” to “se pone a la pata coja” | Comienza a interactuar con todo el cuerpo en actividades, se concentra en movimientos complejos, salta, se pone a la pata coja, lanza una pelota sin caerse. |
Runs around obstacles, turns corners, climbs nursery apparatus, walks up and down stairs (alternating feet), catches ball by trapping it, stands on tiptoe. | Corre alrededor de los obstáculos, gira en las esquinas; trepa estructuras de juego; sube y baja escaleras (alternando pies); agarra y atrapa las pelotas; se pone sobre las puntas de los pies. | Replace “se pone en las puntas de los pies” to “se pone de puntillas” | Corre alrededor de obstáculos, gira en las esquinas; trepa estructuras de juego; sube y baja escaleras (alternando pies); agarra y atrapa las pelotas; se pone de puntillas. |
Quiet play 5 to 10 min; play with single object 5 min. | Juego tranquilo por 5 a 10 min, juego con un objeto por 5 min. | Replace “por” to “durante”. Add “se observa” at the beginning of the item | Se observa juego tranquilo durante 5 a 10 min; juego con un objeto durante 5 min. |
Imitation of observed facial expressions and physical movement (i.e., smiling, pat-a-cake), imitates vocalizations. | Imitación de expresiones faciales que observa y de movimientos (p. ej., sonrisas, acariciar un pastel), imita vocalizaciones. | Replace “acariciar un pastel” to “palmas palmitas” | Expresiones faciales y de movimientos que observa (p. ej., sonrisas, palmas palmitas); imita vocalizaciones. |
Original Test Item | Translation | Rationale | Final Translation |
---|---|---|---|
Runs, squats, climbs on and off chairs, walks up and down stairs (step to gait), kicks ball, rides kiddy car. | Corre; se pone en cuclillas; trepa y se baja de las sillas; sube y baja escaleras sin alternancia; patea pelotas; conduce un coche con las piernas. | There were no comprehension difficulties. Even so, five participants suggest changing “patea pelotas” to “da patadas a una pelota” | Corre; se pone en cuclillas; trepa y se baja de las sillas; sube y baja escaleras sin alternancia; da patadas a una pelota; conduce un coche con las piernas. |
15 s for detailed object, 30 s for visual and auditory toy. | 15 segundos para los objetos con detalle; 30 segundos para juguetes visual o auditivo. | Three participants suggest completing the items by including “se mantiene atento” to improve its comprehensibility | Se mantiene atento 15 segundos para los objetos con detalle; 30 segundos para juguetes visual o auditivo. |
Attends to sounds and voices, babbles, uses razzing sounds. | Presta atención a los sonidos y voces, balbucea, hace sonidos con la lengua entre labios. | Four participants suggest changing the expresión “hace sonido con la lengua entre los labios”, to “hace pedorretas” | Presta atención a los sonidos y voces; balbucea; hace pedorretas. |
Combination of solitary and onlooker, beginning interaction with peers. | Combinación de juego solitario y espectador, comienza la interacción con niños compañeros. | Six participants suggest changing the term “niños compañeros” to “iguales” | Combinación de juego solitario y espectador; comienza la interacción con sus iguales. |
More complex games with a variety of adults (hide and seek, chasing), commands others to carry out actions. | Juegos más complejos con distintos adultos (a esconderse; persecuciones); ordena a otros que realicen acciones. | Three participants suggest the need to modify the expressions “a esconderse” to “jugar al escondite”, and “persecuciones” to “jugar al pillapilla” | Juegos más complejos con distintos adultos (p. ej., jugar al escondite; jugar al pillapilla); ordena a otros que realicen acciones. |
Space Management | Material Management | Pretense/ Symbolism | Participation | ||||
---|---|---|---|---|---|---|---|
Item | κ | Item | κ | Item | κ | Item | κ |
Gross motor | 0.96 *** | Manipulation | 0.86 *** | Imitation | 0.82 *** | Type | 0.89 *** |
Construction | 0.93 *** | Cooperation | 0.94 *** | ||||
Interest | 0.94 *** | Purpose | 0.92 *** | Dramatization | 0.87 *** | Humor | 0.87 *** |
Attention | 0.91 *** | Language | 0.82 *** |
Item | κ |
---|---|
Space Management | 0.93 *** |
Material Management | 0.91 *** |
Pretense/Symbolism | 0.81 *** |
Participation | 0.89 *** |
Total Score | 0.90 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Serrada-Tejeda, S.; Pérez-de-Heredia-Torres, M.; Knox, S.H.; Sánchez-Herrera-Baeza, P.; Martínez-Piédrola, R.M.; Obeso-Benítez, P.; Santos-del-Riego, S. Spanish Cultural Adaptation and Inter-Rater Reliability of the Revised Knox Preschool Play Scale. Children 2023, 10, 965. https://doi.org/10.3390/children10060965
Serrada-Tejeda S, Pérez-de-Heredia-Torres M, Knox SH, Sánchez-Herrera-Baeza P, Martínez-Piédrola RM, Obeso-Benítez P, Santos-del-Riego S. Spanish Cultural Adaptation and Inter-Rater Reliability of the Revised Knox Preschool Play Scale. Children. 2023; 10(6):965. https://doi.org/10.3390/children10060965
Chicago/Turabian StyleSerrada-Tejeda, Sergio, Marta Pérez-de-Heredia-Torres, Susan H. Knox, Patricia Sánchez-Herrera-Baeza, Rosa M. Martínez-Piédrola, Paula Obeso-Benítez, and Sergio Santos-del-Riego. 2023. "Spanish Cultural Adaptation and Inter-Rater Reliability of the Revised Knox Preschool Play Scale" Children 10, no. 6: 965. https://doi.org/10.3390/children10060965
APA StyleSerrada-Tejeda, S., Pérez-de-Heredia-Torres, M., Knox, S. H., Sánchez-Herrera-Baeza, P., Martínez-Piédrola, R. M., Obeso-Benítez, P., & Santos-del-Riego, S. (2023). Spanish Cultural Adaptation and Inter-Rater Reliability of the Revised Knox Preschool Play Scale. Children, 10(6), 965. https://doi.org/10.3390/children10060965