Next Article in Journal
Technology-Enabled Senior Living: A Preliminary Report on Stakeholder Perspectives
Previous Article in Journal
The Commitment to Excellence: Understanding Nurses’ Perspectives on Continuous Professional Development
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability, Knowledge Translation, and Implementability of the Spanish Version of the Hammersmith Infant Neurological Examination

by
Álvaro Hidalgo-Robles
1,
Javier Merino-Andrés
2,3,*,
Ángel Luis Rodríguez-Fernández
4,
Mónica Gutiérrez-Ortega
5,
Irene León-Estrada
1 and
Maribel Ródenas-Martínez
6
1
Facultad de Educación, Universidad Internacional de La Rioja, 26006 Logroño, Spain
2
Faculty of Physiotherapy and Nursing, Universidad de Castilla-La Mancha, 45004 Toledo, Spain
3
Physiotherapy Research Group of Toledo (GIFTO), Universidad de Castilla-La Mancha, 45004 Toledo, Spain
4
Facultad de Medicina, Universidad CEU San Pablo, 28668 Alcorcón, Spain
5
Facultad de Educación y Trabajo Social, Universidad de Valladolid, 47011 Valladolid, Spain
6
Asociación APSA, 03005 Alicante, Spain
*
Author to whom correspondence should be addressed.
Healthcare 2024, 12(3), 380; https://doi.org/10.3390/healthcare12030380
Submission received: 5 December 2023 / Revised: 17 January 2024 / Accepted: 20 January 2024 / Published: 1 February 2024
(This article belongs to the Section Perinatal and Neonatal Medicine)

Abstract

:
Purpose. This study aimed to: (a) translate and cross-culturally adapt the Hammersmith Infant Neurological Examination (HINE) into Spanish; (b) evaluate its intra- and inter-examiner reliability; (c) support a knowledge translation and tool implementation program in early intervention; and (d) evaluate its reliability and implementation for professionals one year after receiving training. Materials and methods. The translation followed the World Health Organization’s recommendations. Reliability was assessed in 25 infants aged between 3 and 15 months with identifiable risks of cerebral palsy (CP). The implementation was also evaluated by analyzing the reliability of professionals without previous experience of the tool by using a pre-survey and a follow-up survey one year after training. The survey covered aspects related to the use of early detection tools of CP and the use of HINE, including attitudes, opinions, and perceptions. Results. An excellent intra- and inter-examiner agreement was obtained for the total score of the HINE intra-class correlation coefficient (ICC = 0.98 in both indices). One year after training, the professionals also showed excellent reliability values (ICC = 0.99), as well as an increase in sensitization and skills in evidence-based practices for the early detection of “high risk” of CP. Conclusions. The Spanish version of HINE is a reliable measure for the neurological evaluation of “high risk” of CP and can be administered after standardized training and without costs to acquire the evaluation. This allows its accessible and widespread implementation in the clinical context.

1. Introduction

Cerebral palsy (CP) is one of the most common movement and posture disorders, with a prevalence of 1.6/1000 live births, although with a significant decreasing trend for pre- and peri-natal CP in Europe and Australia [1]. Despite the lack of epidemiological registers in Spain [2], it is estimated that there are significant differences between Spanish regions attributed to a disparity in diagnostic practices, especially at an early age [3]. This may lead to a delayed follow-up of the “high-risk population for CP” and late referral to early intervention services [4,5].
Compared with the option of conservative follow-up, the scientific literature has shown that CP or “high risk for CP” can be diagnosed accurately and early—often under 6 months of age—using clinical reasoning and a combination of standardized measures [4,6]. Within these measures, neurological evaluation plays an essential role in the follow-up programs for the high-risk population, supporting the diagnosis and defining the prognosis, monitoring the longitudinal history of the condition, and documenting the effects of the interventions [7].
The Hammersmith Infant Neurological Examination (HINE) is a simple, quantifiable, easy-to-use, and widely studied neurological evaluation used in typically developing and high-risk children between 2 and 24 months of age [8]. It was developed in 1999 by Haataja et al. and is composed of three sections: neurological evaluation, motor development, and behavior. The total HINE score is based solely on the first section, which includes 26 items and examines neurological function (cranial nerve function, posture, movements, tone and reflexes, and reactions). Together with Prechtl’s General Movement Assessment and neuroimaging, it is recommended by international clinical practice guidelines, attaining a positive predictive value of 90% [4,9]. With the existence of an optimal score range [10] and the possibility of a quantitative assessment of neurological findings and developmental monitoring, HINE can be used for clinical and research purposes.
The development of brief training workshops that include theoretical, research, and practical aspects of HINE has proven effective for the subsequent implementation of the tool in the United States [7]. Cross-cultural adaptations and studies of the psychometric properties of HINE in Indian and Turkish populations provide excellent intra- and inter-examiner correlation coefficients and contribute to knowledge translation [11,12]. Similarly, studies investigating intra-examiner reliability in the United States [13] and inter-examiner reliability in Italy [14] and Norway [15] consistently support the applicability of HINE across diverse cultural contexts. In the absence of more data about the psychometric properties that allow comparative studies of international scope —also for those professionals who have participated in a standardized HINE training program—the cross-cultural adaptation of HINE to the Spanish population is essential. Following the World Health Organization’s recommendations on the development and use of standardized health indicators [16], the objectives of this study include: (a) obtaining a cross-cultural translation and adaptation of HINE; (b) assessing HINE’s intra- and inter-examiner reliability in professionals experienced with the tool; (c) supporting knowledge translation processes through the implementation of training programs and the adaptation of different materials; and (d) evaluating the use of early detection tools of CP, including HINE and its inter-examination reliability, and attitudes, opinions, and perceptions of professionals one year after receiving training.

2. Materials and Methods

2.1. Description of HINE

HINE comprises 37 items divided into 3 sections: neurological evaluation, motor development, and behavior [10]. The 1st section of HINE examines neurological functions and includes 26 items. The 2nd section assesses motor development through 8 items. The 3rd section assesses behavior and includes 3 items. In the neurological assessment section only, each item is scored individually—from 0 to 3—according to descriptions and illustrative diagrams. The total score is the sum of all individual scores and can range from 0 to 78. The second and third sections are not part of the total score but provide important additional information regarding progress of development. Similarly, if asymmetries appear in the child, this must be recorded when presenting the items, with a score of 1 if they exist and 0 if not.
The application time of HINE varies between 5 and 15 min [8,17]. The examination is carried out through the intervention of the evaluator, who follows the instructions for each item as requested in the score sheet. This allows obtaining the responses concerning the child to determine the score and the asymmetries according to the child’s degree of response.
The cross-cultural adaptation of HINE consists of three phases: (i) translation and cross-cultural adaptation into Spanish from Spain; (ii) adaptation of a training program, guidelines of recommendations, and adapted materials; (iii) intra- and inter-examiner reliability analysis; (iv) analysis of intra- and inter-examiner reliability of professionals one year after training.

2.2. Cross-Cultural Translation and Adaptation

The HINE score sheet was translated into Spanish from the original language—English—and back-translated following the recommendations of the World Health Organization and publications and expert opinions for the translation, adaptation, and interpretation of protocols [16,18,19].

2.3. Participants

This study targets children at risk of developing CP, identified as a population with identifiable risk at birth or with identifiable risk in the child aged between 3 and 15 months and residing in Spain. Participants were recruited from early intervention services in the provinces of Valencia, Alicante, and Toledo (Spain). In line with the existing scientific literature, the inclusion criteria encompassed identifiable risk characteristics at birth: prematurity, neonatal encephalopathies, history of neurological risk factors, e.g., newborns with congenital disabilities, intrauterine growth retardation, and/or being admitted to neonatal intensive care units. Similarly, other identifiable factors in the child, such as identifying concerns in the family, the inability to sit at 9 months, or manual asymmetry, were considered [4].
Systemic diseases, orthopedic deformities, or medications that could affect alertness during the evaluation process were considered exclusion criteria. This study was approved by the Research Ethics Committee of the Universitat Internacional de Catalunya (FIS-2019-01).

2.4. Evaluation of Intra- and Inter-Examiner Reliability

The assessment of intra- and inter-examiner reliability involved two steps: (i) a preliminary and preparatory study; (ii) intra- and inter-examiner reliability analysis.
The preliminary study involved 25 participants aged between 3 and 12 months. Three physiotherapists with experience and training in pediatrics (AH-R, JM-A, and MR-M) administered HINE to the same patients after completing a 4 h training led by two HINE instructors who had published articles on the tool. The initial in-person HINE assessment was conducted by one physiotherapist (AH-R), and subsequent evaluations were based on the review of the video recording of the initial assessment. The preliminary results provided excellent intra-examiner reliability (intra-class correlation coefficient, ICC = 0.97) and good inter-examiner reliability (ICC = 0.67) for the total score. Following this phase, meetings were conducted with the evaluators to consolidate the application of common criteria during the evaluation and to develop recommendation guidelines based on the detailed analysis of the results obtained.
For the intra- and inter-examiner analysis, the assessment of 25 different participants was performed in person by one of the evaluators (MR-M) and video-recorded to allow the subsequent evaluations following the methodology used in the preliminary study and consistent with previous studies of the tool’s psychometric properties [11,12]. The video recordings were sent without any additional information to the two remaining evaluators (AH-R and JM-A), who analyzed them independently and without any communication between them to determine inter-examiner reliability. Through video analysis, a second evaluation was carried out by the first evaluator to perform a test–retest in a period of not less than 15 days, thus eliminating recall bias. In this way, we could evaluate the degree of reliability of HINE at the level of reproducibility and repeatability, estimating the intra-examiner reliability.

2.5. Training Program and Development of the Recommendation Guidelines for Evaluation with HINE in Spanish

In order to adapt an impactful training program based on successful international experiences and to evaluate its impact on the professional practice of Spanish clinicians, we trained professionals in the use and application of HINE items, structured by adapting the modules developed by Maitre et al. [7] (Table 1). To this program, we developed a document with recommendations for assessment with HINE in Spanish, following different materials published in studies on the tool and general recommendations by experts.
To ensure the reliability of the HINE training program, an additional study was conducted to evaluate the inter-examination reliability in two early intervention services in Valencia (Spain) one year after receiving HINE training. Additionally, pre- and post-training surveys were conducted in December 2020 and December 2021, respectively, with 18 questions related to the use of early detection tools of CP and the use of HINE, as well as attitudes, opinions, and perceptions. In April 2022, three consecutive workshops focused on evaluation with HINE were conducted. Three physiotherapists—team leaders for administering HINE in their clinical routines—independently scored the neurological evaluation of 11 children aged between 3 and 12 months. The fourth examiner was a professional with experience with the tool (AH-R).

2.6. Statistical Analysis

The required number of individuals was calculated, considering the formulas for calculating the sample size in concordance studies (Zou) [20]. A significance level of 5%, a power of 80%, an expected correlation coefficient of 0.90, and a minimum coefficient of 0.75 were set, for which studies of cross-cultural adaptation and validation of HINE in Indian and Turkish populations were taken into account [11,12]. In addition, a 10% possible loss was considered between valuations. Thus, a sample size of 25 individuals was obtained.
Statistical analysis was performed with statistical package SPSS v.24 for Windows. Descriptive analysis included means and standard deviations for quantitative variables that followed a normal distribution and a median (Q1–Q3) for those that did not have a normal distribution. Normality was assessed using the Kolmogorov–Smirnov test with the correction of Lilliefors. Reliability analysis was calculated using two approaches. Weighted kappa (κ) analysis was used to determine inter-examiner reliability for the categorical items with 7 response options: 0, 0.5, 1, 1.5, 2, 2.5, and 3. Weighted κ reflects the level of agreement between raters by assigning greater importance to large differences between ratings than to small differences [21]. The linear weighting method was used for calculation. According to Landis and Koch, the strength of agreement of κ is considered slight between 0.00 and 0.20, fair between 0.21 and 0.40, moderate between 0.41 and 0.60, substantial between 0.61 and 0.80, and almost perfect between 0.81 and 1.00 [22].
The ICC (2,1) was obtained using the two-way mixed-effects and absolute agreement model. In all cases, ICC indices were obtained for the total score and asymmetries of the neurological evaluation of HINE and for the different scores that made up the subsections of the neurological evaluation. The confidence interval employed was 95%, therefore values of p < 0.05 were considered significant. As reliability criteria, those established by Shrout et al. [23] were used, which state the following: if ICC > 0.80, reliability is considered excellent; if 0.60 < ICC ≤ 0.80, reliability is considered good; if 0.40 < ICC ≤ 0.60, reliability is considered moderate; and if ICC ≤ 0.40, reliability is considered weak or poor.

3. Results

3.1. Cross-Cultural Translation and Adaptation

After the back-translation process and based on the recommendations of one of the original authors of HINE (LH), four possible comprehension errors were established concerning items of auditory response, hands, quality of movements, and lateral suspension. We proceeded to clarify the back-translated concepts that could lead to comprehension errors (Table 2) to ensure a conceptually equivalent wording in Spanish to the original English version of HINE (Section S1).

3.2. Participants

Caregivers of 25 participants between the ages of 3 and 15 months (8.8 months on average) were invited to participate in the intra- and inter-examiner reliability study. Table 3 summarizes the characteristics of the study group.

3.3. Evaluation of Intra- and Inter-Examiner Reliability

The results denoted an excellent intra-examiner agreement (MR-M): 0.98 for the total HINE score, and in a range between 0.90 and 0.98 for the subsections (Table 4). Regarding inter-examiner reliability, excellent values were again found for total scores (ICC MR-R, AH-R, JM-A = 0.98). For the subsections, all but three of the ICCs were greater than 0.80, obtaining good reliability for cranial nerve function (ICC AH-R, JM-A = 0.79) and movements (ICC MR-R, JM-A = 0.79) and moderate for asymmetries (range 0.45–0.58).
For individual items, the weighted κ values of inter-examiner agreement between in-person assessment (MR-M) and the video recording (AH-R) ranged from 0.17 to 0.92, with 85% of the items demonstrating at least moderate agreement (κ > 0.41). Substantial agreement (κ = 0.61–0.80) was observed for 10 out of 26 items—including arms, quantity of movements, scarf sign, passive shoulder elevation, pronation/supination, pull to sit, ventral suspension, arm protection, lateral tilting, and forward parachute—while agreement on auditory response and quality of movements were almost perfect (κ > 0.81). Moderate agreement was found for 10 out of 26 items, and fair agreement (κ = 0.21–0.40) for 3 out of 26. The only exception, with slight agreement, was vertical suspension (κ = 0.17) (Table 5). When considering optimal results (scores 2 and 3) together, they constituted 88% (MR-R) and 80% (AH-R) of the results for vertical suspension, revealing that disagreement in that item was found for scores 2 and 3.

3.4. Evaluation of Implementation and Inter-Examiner Reliability One Year after the Training Program

Eleven Spanish professionals with multiple specialties—three physiotherapists, three speech therapists, three psychologists, and two occupational therapists—received training in HINE and completed a pre-survey and a survey one year after the training program. They were at the time performing their care work in child development and early intervention services; 54% had less than 5 years of experience in early intervention, 36% between 5 and 15 years, and 9% between 16 and 20 years.
In the block of questions concerning the use of early detection tools in CP, there was a shift in positive responses (“Yes” and “Yes, but it could be improved”) to the question “Does your workplace have any protocol, procedure or standardized reference guidelines for the referral of children at high risk of CP?” The percentage increased from 27% before training to 63% post-training (Figure 1).
In this way, the familiarity with the early detection tools contemplated in the international guidelines also increased. Familiarization with HINE increased by 82%, and with Prechtl’s General Movement Assessment by 91%. For the Alberta Infant Motor Scale and the Bayley Scales of Infant and Toddler Development, familiarization also increased by 9% each, and with the Peabody Developmental Motor Scales-2 by 18%. However, there was no increase in familiarity with the Test of Infant Motor Performance—9% of the participants.
In the block on the use of HINE, the professionals reported recording “sometimes” or “almost always” a higher percentage of HINE or HINE items isolated during their clinical practice, increasing after training for all subsections (Figure 2).
Some questions referred to attitudes and opinions towards HINE, rating the degree of agreement from 1 (strongly disagree) to 5 (strongly agree). The question “I believe that the HINE is a useful tool to help children and their families” was rated before training at 3 (36%), 4 (36%), and 5 (27%), and after training at 2 (9%) and 5 (91%). Additionally, questions were asked about the opinions of HINE in relation to the families (Figure 3). In this regard, if “medical services/other specialists want to know the results of the HINE and its meaning” the 2 (27%), 3 (64%), and 5 (9%) evolved to 1 (9%), 2 (27%), 3 (9%), 4 (27%), and 5 (27%).
Regarding the perception of HINE, the professionals increased their confidence in processes related to the use of HINE for referral to other services or specialists, transmission of results to families and medical services, and successful implementation of the tool in practice (Figure 4).
The inter-examiner reliability of the Spanish version of HINE one year after the training program showed excellent values for the total score (ICC = 0.99), as well as for cranial nerves, posture, tone and reflexes, and reactions (ICCs between 0.86 and 0.98). The movements and the recording of asymmetries showed good reliability (ICC = 0.79 and 0.62, respectively) (Table 6).

4. Discussion

This study focuses on the effective implementation of HINE in Spain through its translation and cross-cultural adaptation and the adaptation of a training program, a guideline of recommendations, and adapted materials. Likewise, it includes the study of intra- and inter-examiner reliability of its administration in children at identifiable risk of CP at birth or in the child aged between 3 and 15 months.
The results of the study suggest that the Spanish version of HINE is reliable for application in the Spanish population, with excellent levels of intra-examiner (ICC = 0.98) and inter-examiner reliability (ICC = 0.98). These results contribute to the growing body of research on the psychometric properties of HINE across diverse international contexts. In the original study by Haataja et al. [10], excellent inter-examiner reliability was reported, with an ICC “close to 1” in 25 participants without neurological risk aged 12 and 18 months. Similarly, studies investigating the psychometric properties of HINE in Indian [11], Turkish [12], Italian [14], and Norwegian [15] populations reported comparable inter-examiner reliability values for the total score (ICC = 0.98, 0.97, 0.93, and 0.95, respectively). The excellent intra-examiner reliability observed by Tedla et al. and Adigüzel et al. (ICC = 0.99 and 1.00, respectively) [11,12] is also consistent with the results obtained in this Spanish version for an equivalent population group. A study in the US, focusing on infants born very preterm and using a different method —without video recording analysis but with 26.8 ± 5.16 days between in-person assessments for HINE—resulted in an ICC of 0.79 [13].
In relation to the different subsections, to our knowledge, this is the first study that collects the reliability results for the registration of asymmetries, based on recent recommendations regarding the importance of their registration in the context of evaluation with HINE for the early detection of unilateral CP [24,25]. The good intra-examiner reliability presented by the asymmetries in the Spanish version (ICC = 0.96) contrasts with the moderate values of inter-examiner reliability (ICC = 0.58), which could suggest the need to incorporate descriptors that establish unified criteria for the score of asymmetries in each item of the tool, also highlighting those identified in the literature with a higher correlation with unilateral CP. This would increase the reliability of HINE by reporting asymmetric signs for resistance to passive movement, muscle rigidity, manual reach, or spontaneous kicking, among others [26].
Regarding the rest of the subsections studied in the Indian, Turkish, and Norwegian populations, the excellent inter-examiner reliability for all values (ICC from 0.90 to 1.00, 0.84 to 0.99, and 0.78 to 0.97, respectively) was also obtained in the Spanish version (ICC from 0.87 to 0.94). In this way, a formal training in HINE together with the score sheet—which contains instructions for obtaining the requested answers in each item, illustrative diagrams, and brief descriptions for determining the score according to the degree of response—seems sufficient for its effective implementation in follow-up programs of newborns at risk of CP with professionals trained in HINE and experienced in the management and evaluation of neurodevelopmental disorders. In the absence of a user manual, a guideline of recommendations available in several languages can help improve these training processes.
The evaluation was conducted through video recording by two of the evaluators, following the methodology from other studies on psychometric properties [11,12]. Experiences of the telematic follow-up of children at “high risk” during the COVID-19 pandemic seemed to open a door to the incorporation of HINE within the evaluation processes in telemedicine [27]. This approach could enhance monitoring, facilitate recorded reviews, and potentially prevent delayed diagnosis and referral. Additionally, in the context of implementation and training, video methods enable late review, ensure consistency and reliability, and, if needed, allow revision by other skilled assessors [28].
The inter-examiner reliability for the single items between in-person and video-recorded assessments—not previously reported for HINE—revealed that 85% of the items demonstrated at least moderate agreement. Possible limitations for the evaluation of certain items of tone and/or reflexes and reactions, due to their subjective impact [29] and the lack of hands-on management of children, do not seem to influence the examiner’s perception. This is illustrated by the intra- and inter-examiner reliability obtained for both subsections.
Interestingly, 11 out of 12 (92%) of the HINE items shown to be more predictive for CP [30] had at least moderate agreement in this study. Seven of them showed substantial agreement (quantity of movements, scarf sign, pronation/supination, ventral suspension, arm protection, lateral tilting, and forward parachute), and quality of movements demonstrated “almost perfect” κ strength of agreement. This suggests promise for a short screening version of HINE that could be video-recorded. Similarly, exploring an adapted version of the tool allowing family participation in requesting items could follow examples set by Prechtl’s General Movement Assessment [31], the Alberta Infant Motor Scale [32], or the Gross Motor Function Measure [33].
HINE has additional advantages compared with other neurological evaluations. It requires a shorter administration time—it can be completed in 5 to 15 min [8,17]—than the Amiel–Tison Neurologic Assessment [34] or the Touwen Infant Neurological Examination [35], which are more extensive and present some items that are difficult to obtain in a routine clinical environment. It is also described as a neurological evaluation that can be administered even by students or professionals with limited experience [7,8,36,37,38]. This would differentiate it from other neurological evaluations that require examiners with extensive experience, lengthy certification processes, significant costs to acquire the evaluation, and/or considerable time for its administration. These benefits seem to be directed specifically to the main barriers identified by professionals, such as Spanish physiotherapists, concerning the use of early detection tools for CP [39].
This study has investigated the impact of standardized training, through the modules proposed by Maitre et al. [7], in professionals with one year of experience with the tool. Excellent reliability values were obtained for the Spanish version, in addition to increasing the incorporation of the HINE items in clinical practice—in accordance with Maitre et al. [7]—but also the sensitization of professionals regarding the need for the existence and improvement of referral protocols for children at high risk of CP. One year after the training, the professionals’ perception about what “families want” seemed much more aligned with the reality expressed by them in qualitative studies [40]. As a result, awareness was raised about the transmission of the name, description, and purpose of HINE, as well as the results obtained and their significance. In addition, the importance of parental involvement in the course of the evaluation was strengthened, even their participation in the administration of items. In parallel, the professionals’ confidence in carrying out these processes increased substantially.
Scientific evidence supports HINE’s ability to predict CP [4] and distinguish between unilateral and bilateral CP, as well as the prognosis of the motor function [41]. This aspect needs further exploration for the Spanish version, representing a limitation of this feasibility project. The roles of various healthcare professions —including neonatologists, developmental pediatricians, and/or neurologists [42]—as crucial figures in the neurological examination, should also be investigated. Additionally, based on the available evidence, the use of the Spanish version of HINE should be promoted together with Prechtl’s General Movement Assessment and other motor assessment tools (such as the Infant Motor Profile test and the Alberta Infant Motor Scale) for the description of the population at “high risk” of development of CP [6] and the follow-up population with identifiable risk at birth or in the child, in Spain [43]. The Spanish from Spain version of the HINE proforma could likewise serve for further cross-cultural adaptations to other Spanish-speaking countries in Latin America.

5. Conclusions

The results of the intra- and inter-examiner reliability study of the Spanish version of HINE indicate that it may be a reliable measure for the neurological evaluation of children at risk of CP between 3 and 15 months of age. It can be administered after a standardized training of 4 h, evaluated through video recording without costs to acquire the evaluation. This would allow its accessible and generalized implementation in the clinical context. Future studies and implementation procedures are needed to improve the assessment of asymmetries within HINE as an important component in supporting the processes of early detection of unilateral CP.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare12030380/s1, Section S1: HINE proforma in Spanish.

Author Contributions

Conceptualization, Á.H.-R., J.M.-A. and M.R.-M.; methodology, Á.H.-R., J.M.-A., Á.L.R.-F. and M.R.-M.; software, Á.H.-R. and Á.L.R.-F.; formal analysis, Á.H.-R. and Á.L.R.-F.; investigation, Á.H.-R., J.M.-A. and M.R.-M.; data curation, Á.H.-R. and Á.L.R.-F.; writing—original draft preparation, Á.H.-R.; writing—review and editing, Á.H.-R., J.M.-A., M.G.-O., I.L.-E. and M.R.-M.; supervision, M.G.-O. and I.L.-E. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the International University of La Rioja. IDDT Project (Grant No. Biennium 2023/2025, B0036).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Research Ethics Committee of the Universitat Internacional de Catalunya (FIS-2019-01).

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

Data are contained within the article or Supplementary Materials.

Acknowledgments

The authors of this study would like to express their gratitude to Leena Haataja, Andrea Guzzetta, Olena Chorna, Roslyn Livingstone, and Ginny Paleg for their support in various steps of this study. Likewise, sincere thanks are extended to the participants involved in the translation and back-translation processes: Joaquín Fagoaga Mata, Lourdes Macías Merlo, Ascensión Martín Díez, Óscar Rodríguez López, and Joan Ramon Nieto Fabregat.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. McIntyre, S.; Goldsmith, S.; Webb, A.; Ehlinger, V.; Hollung, S.J.; McConnell, K.; Arnaud, C.; Smithers-Sheedy, H.; Oskoui, M.; Khandaker, G.; et al. Global prevalence of cerebral palsy: A systematic analysis. Dev. Med. Child Neurol. 2022, 64, 1494–1506. [Google Scholar] [CrossRef] [PubMed]
  2. Gómez-Conesa, A.; Suarez-Serrano, C. Parálisis cerebral infantil. Panorama de su prevalencia en España. Fisioterapia 2017, 39, 185–186. [Google Scholar] [CrossRef]
  3. Cancho Candela, R.; Fernández Alonso, J.E.; Lanza Fernández, E.; Lozano Domínguez, M.A.; Andrés De Llano, J.M.; Folgado Toranzo, I. Estimación de la prevalencia de parálisis cerebral en la comunidad de Castilla y León mediante el registro de minusvalías. An. Pediatr. 2006, 65, 97–100. [Google Scholar] [CrossRef]
  4. Novak, I.; Morgan, C.; Adde, L.; Blackman, J.; Boyd, R.N.; Brunstrom-Hernandez, J.; Cioni, G.; Damiano, D.; Darrah, J.; Eliasson, A.-C.; et al. Early, Accurate Diagnosis and Early Intervention in Cerebral Palsy. JAMA Pediatr. 2017, 171, 897–907. [Google Scholar] [CrossRef] [PubMed]
  5. Monica, T.; Catherine, M.; Iona, N. New Screening Tool for Term-Born Infants Enables Update to the Clinical Practice Guideline for Early Diagnosis of Cerebral Palsy. JAMA Pediatr. 2023, 177, 115–117. [Google Scholar] [CrossRef] [PubMed]
  6. Maitre, N.L.; Byrne, R.; Duncan, A.; Dusing, S.; Gaebler-Spira, D.; Rosenbaum, P.; CP EDI Consensus Group. High-risk for cerebral palsy” designation: A clinical consensus statement. J. Pediatr. Rehabil. Med. 2022, 15, 165–174. [Google Scholar] [CrossRef] [PubMed]
  7. Maitre, N.L.; Chorna, O.; Romeo, D.M.; Guzzetta, A. Implementation of the Hammersmith Infant Neurological Exam in a High-Risk Infant Follow-Up Program. Pediatr. Neurology 2016, 65, 31–38. [Google Scholar] [CrossRef]
  8. Romeo, D.M.; Ricci, D.; Brogna, C.; Mercuri, E. Use of the Hammersmith Infant Neurological Examination in infants with cerebral palsy: A critical review of the literature. Dev. Med. Child Neurol. 2015, 58, 240–245. [Google Scholar] [CrossRef]
  9. Morgan, C.; Romeo, D.M.; Chorna, O.; Novak, I.; Galea, C.; Del Secco, S.; Guzzetta, A. The Pooled Diagnostic Accuracy of Neuroimaging, General Movements, and Neurological Examination for Diagnosing Cerebral Palsy Early in High-Risk Infants: A Case Control Study. J. Clin. Med. 2019, 8, 1879. [Google Scholar] [CrossRef]
  10. Haataja, L.; Mercuri, E.; Regev, R.; Cowan, F.; Rutherford, M.; Dubowitz, V.; Dubowitz, L. Optimality score for the neurologic examination of the infant at 12 and 18 months of age. J. Pediatr. 1999, 135 Pt 1, 153–161. [Google Scholar] [CrossRef]
  11. Tedla, J.S.; Bajaj, A.; Joshua, A.; Kamath, G. Psychometric Properties of Hammersmith Infant Neurological Examination in 12 Months Old High-Risk Infants: A Cross Sectional Study. Indian J. Physiother. Occup. Ther. Int. J. 2014, 8, 169–177. [Google Scholar] [CrossRef]
  12. Adıgüzel, H.; Sarıkabadayı, Y.Ü.; Apaydın, U.; Kırmacı, Z.İ.K.; Gücüyener, K.; Karadeniz, P.G.; Elbasan, B. Turkish Validity and Reliability of the Hammersmith Infant Neurological Examination (HINE) with High-Risk Infant Group: A Preliminary Study. Turk. Arch. Pediatr. 2022, 57, 151–159. [Google Scholar] [CrossRef] [PubMed]
  13. Harpster, K.; Merhar, S.; Priyanka Illapani, V.S.; Peyton, C.; Kline-Fath, B.; Parikh, N.A. Associations Between Early Structural Magnetic Resonance Imaging, Hammersmith Infant Neurological Examination, and General Movements Assessment in Infants Born Very Preterm. J. Pediatr. 2021, 232, 80–86.e2. [Google Scholar] [CrossRef] [PubMed]
  14. Romeo, D.M.; Apicella, M.; Velli, C.; Brogna, C.; Ricci, D.; Pede, E.; Sini, F.; Coratti, G.; Gallini, F.; Cota, F.; et al. Hammersmith Infant Neurological Examination in low-risk infants born very preterm: A longitudinal prospective study. Dev. Med. Child Neurol. 2022, 64, 863–870. [Google Scholar] [CrossRef] [PubMed]
  15. Ljungblad, U.W.; Paulsen, H.; Tangeraas, T.; Evensen, K.A.I. Reference Material for Hammersmith Infant Neurologic Examination Scores Based on Healthy, Term Infants Age 3–7 Months. J. Pediatr. 2022, 244, 79–85.e12. [Google Scholar] [CrossRef] [PubMed]
  16. Patrick, D.L.; Pennifer, E. Health Status and Health Policy: Quality of Life in Health Care Evaluation and Resource Allocation; Oxford University Press: Oxford, UK, 1993; 478p. [Google Scholar]
  17. Dubowitz, L.; Ricciw, D.; Mercuri, E. The Dubowitz neurological examination of the full-term newborn. Ment. Retard. Dev. Disabil. Res. Rev. 2005, 11, 52–60. [Google Scholar] [CrossRef] [PubMed]
  18. Tsang, S.; Royse, C.F.; Terkawi, A.S. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J. Anaesth. 2017, 11 (Suppl. 1), S80–S89. [Google Scholar] [CrossRef] [PubMed]
  19. Beaton, D.E.; Bombardier, C.; Guillemin, F.; Ferraz, M.B. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 2000, 25, 3186–3191. [Google Scholar] [CrossRef]
  20. Zou, G.Y. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Stat. Med. 2012, 31, 3972–3981. [Google Scholar] [CrossRef]
  21. Sim, J.; Wright, C.C. The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size Requirements. Phys. Ther. 2005, 85, 257–268. [Google Scholar] [CrossRef]
  22. Landis, J.R.; Koch, G.G. The Measurement of Observer Agreement for Categorical Data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed]
  23. Shrout, P.E.; Fleiss, J.L. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 1979, 86, 420–428. [Google Scholar] [CrossRef] [PubMed]
  24. Hay, K.; Nelin, M.; Carey, H.; Chorna, O.; Moore-Clingenpeel, M.M.; Maitre, N. Hammersmith Infant Neurological Examination Asymmetry Score Distinguishes Hemiplegic Cerebral Palsy From Typical Development. Pediatr. Neurol. 2018, 87, 70–74. [Google Scholar] [CrossRef] [PubMed]
  25. Pietruszewski, L.; Nelin, M.A.; Batterson, N.O.; Less, J.; Moore-Clingenpeel, M.M.; Lewandowski, D.; Levengood, K.; Maitre, N.L. Hammersmith Infant Neurological Examination Clinical Use to Recommend Therapist Assessment of Functional Hand Asymmetries. Pediatr. Phys. Ther. 2021, 33, 200–206. [Google Scholar] [CrossRef] [PubMed]
  26. Heathcock, J.C.; Lobo, M.; Galloway, J.C. Movement training advances the emergence of reaching in infants born at less than 33 weeks of gestational age: A randomized clinical trial. Phys. Ther. 2008, 88, 310–322. [Google Scholar] [CrossRef] [PubMed]
  27. Maitre, N.L.; Benninger, K.L.; Neel, M.L.; Haase, J.A.; Pietruszewski, L.; Levengood, K.; Adderley, K.M.; Batterson, N.O.; Hague, K.M.; Lightfoot, M.M.-B.; et al. Standardized Neurodevelopmental Surveillance of High-risk Infants Using Telehealth: Implementation Study during COVID-19. Pediatr. Qual. Saf. 2021, 6, e439. [Google Scholar] [CrossRef]
  28. Coxon, M.L.; Hoyt, C.R.; Smith, A.E.; Hadders-Algra, M. Going Beyond Conventional Assessment of Developmental Motor Disorders: Exploring Video Methods for Early Identification Among Children 0 to 3 Years. Adv. Rehabilitation Sci. Pract. 2023, 12. [Google Scholar] [CrossRef]
  29. Dey, P.; Dogra, D.P.; Roy, P.P.; Bhaskar, H. Autonomous vision-guided approach for the analysis and grading of vertical suspension tests during Hammersmith Infant Neurological Examination (HINE). In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 863–866. Available online: http://www.ncbi.nlm.nih.gov/pubmed/28268460 (accessed on 29 June 2019).
  30. Pizzardi, A.; Romeo, D.M.M.; Cioni, M.; Romeo, M.G.; Guzzetta, A. Infant Neurological Examination from 3 to 12 Months: Predictive Value of the Single Items. Neuropediatrics 2008, 39, 344–346. [Google Scholar] [CrossRef]
  31. Kwong, A.K.L.; Eeles, A.L.; Olsen, J.E.; Cheong, J.L.Y.; Doyle, L.W.; Spittle, A.J. The Baby Moves smartphone app for General Movements Assessment: Engagement amongst extremely preterm and term-born infants in a state-wide geographical study. J. Paediatr. Child Health 2018, 55, 548–554. [Google Scholar] [CrossRef]
  32. Boonzaaijer, M.; Van Dam, E.; Van Haastert, I.C.; Nuysink, J. Concurrent validity between live and home video observations using the Alberta infant motor scale. Pediatr. Phys. Ther. 2017, 29, 146–151. [Google Scholar] [CrossRef]
  33. Chagas, P.S.C.; Rosenbaum, P.; Wright, F.V.; Pritchard, L.; Wright, M.; Toledo, A.M.; Camargos, A.C.R.; Longo, E.; Leite, H.R. Development of the Gross Motor Function Family Report (GMF-FR) for Children with Cerebral Palsy. Physiother. Can. 2022, 75, 83–91. [Google Scholar] [CrossRef]
  34. Amiel-Tison, C.; Grenier, A. Neurological Assessment during the First Years of Life; Oxford University Press: New York, NY, USA, 1986. [Google Scholar]
  35. Touwen, B.C.L. Examination of the Child with Minor Neurological Dysfunction. In Clinics in Developmental Medicine; Spastics International Medical Publications: London, UK, 1979. [Google Scholar]
  36. Dubowitz, L.; Dubowitz, V.; Mercuri, E. The Neurological Assessment of the Preterm and Full-term Newborn Infant, 2nd ed.; Heinemann, Ed.; Clinics in Developmental Medicine: London, UK, 1999. [Google Scholar]
  37. McGready, R.; Simpson, J.; Panyavudhikrai, S.; Loo, S.; Mercuri, E.; Haataja, L.; Kolatat, T.; Nosten, F.; Dubowitz, L. Neonatal neurological testing in resource-poor settings. Ann. Trop. Paediatr. 2000, 20, 323–336. [Google Scholar] [CrossRef]
  38. Lata, K.; Jindal, P.; Verma, A.; Dochania, K.; Batra, R. Comparison between trained specialist and medical student in performing neurological assessment of high-risk infant by Hammersmith infant neurological examination (HINE). J. Fam. Med. Prim. Care 2020, 9, 6297–6298. [Google Scholar] [CrossRef]
  39. Merino-Andrés, J.; Hidalgo-Robles, Á.; Pérez-Nombela, S.; Williams, S.A.; Paleg, G.; Fernández-Rego, F.J. Tool Use for Early Detection of Cerebral Palsy: A Survey of Spanish Pediatric Physical Therapists. Pediatr. Phys. Ther. 2022, 34, 202–210. [Google Scholar] [CrossRef] [PubMed]
  40. Byrne, R.; Duncan, A.; Pickar, T.; Burkhardt, S.; Boyd, R.N.; Neel, M.L.; Maitre, N.L. Comparing parent and provider priorities in discussions of early detection and intervention for infants with and at risk of cerebral palsy. Child Care Health Dev. 2019, 45, 799–807. [Google Scholar] [CrossRef] [PubMed]
  41. Romeo, D.M.M.; Cioni, M.; Scoto, M.; Mazzone, L.; Palermo, F.; Romeo, M.G. Neuromotor development in infants with cerebral palsy investigated by the Hammersmith Infant Neurological Examination during the first year of age. Eur. J. Paediatr. Neurol. 2008, 12, 24–31. [Google Scholar] [CrossRef] [PubMed]
  42. Maitre, N.L.; Burton, V.J.; Duncan, A.F.; Iyer, S.; Ostrander, B.; Winter, S.; Ayala, L.; Burkhardt, S.; Gerner, G.; Getachew, R.; et al. Network Implementation of Guideline for Early Detection Decreases Age at Cerebral Palsy Diagnosis. Pediatrics 2020, 145, e20192126. [Google Scholar] [CrossRef] [PubMed]
  43. McNamara, L.M.; Scott, K.M.; Boyd, R.N.; Webb, A.E.; Taifalos, C.J.; Novak, I.E. Effectiveness of early diagnosis of cerebral palsy guideline implementation: A systematic review. Minerva Pediatr. 2023. [Google Scholar] [CrossRef]
Figure 1. Responses (n = 11) to the question “Does your workplace have any standardized protocols, procedures, or reference guidelines for the referral of children at high risk of CP?”
Figure 1. Responses (n = 11) to the question “Does your workplace have any standardized protocols, procedures, or reference guidelines for the referral of children at high risk of CP?”
Healthcare 12 00380 g001
Figure 2. Responses (n = 11) to the question “In your clinical practice, how much of the HINE (or isolated HINE items) do you usually record?”
Figure 2. Responses (n = 11) to the question “In your clinical practice, how much of the HINE (or isolated HINE items) do you usually record?”
Healthcare 12 00380 g002
Figure 3. Responses (n = 11) to the questions “Families want…” Degree of agreement from 1 (strongly disagree) to 5 (strongly agree).
Figure 3. Responses (n = 11) to the questions “Families want…” Degree of agreement from 1 (strongly disagree) to 5 (strongly agree).
Healthcare 12 00380 g003
Figure 4. Responses (n = 11) to the questions “I trust that…” Degree of agreement from 1 (strongly disagree) to 5 (strongly agree).
Figure 4. Responses (n = 11) to the questions “I trust that…” Degree of agreement from 1 (strongly disagree) to 5 (strongly agree).
Healthcare 12 00380 g004
Table 1. HINE training modules. Adapted from Maitre et al. [6].
Table 1. HINE training modules. Adapted from Maitre et al. [6].
Training ElementsDuration
Reading the scientific literature supporting the use of HINE30 min
Review of the administration and scoring of individual HINE items45 min
HINE demonstrations with video recordings and face-to-face assessments (different ages and health statuses)15 min per patient
Review of video recordings and discussion of HINE administration and scoring20 min per patient
Table 2. Clarification of back-translated concepts with possible misunderstandings.
Table 2. Clarification of back-translated concepts with possible misunderstandings.
ItemSubsectionPossible Comprehension Errors
Auditory responseCranial nervesThe Spanish translation should clarify the concept of “dubious reaction” to the stimulus.
HandsPostureIn the Spanish translation, there should be the concept of “fisting”.
QualityMovementsIn the Spanish translation, there should be a word conceptually equivalent to “spasmodic”.
Lateral suspensionReflexes and reactionsThe Spanish translation should make it clear that the movement is “towards” the horizontal, not in the full horizontal position.
Table 3. Characteristics of the participants.
Table 3. Characteristics of the participants.
CharacteristicTotal Study Population (n = 25)
Gestational age mean (SD) (minimum, maximum), wks30.3 (4.5) (24.4–41.0)
Birth weight mean (SD) (minimum, maximum), g1512.6 (741.1) (720–3450)
Head circumference, mean (SD) (minimum, maximum), cm27.8 (4.1) (21.5–35)
Apgar 1′ mean (SD) (minimum, maximum); Apgar 1′ mean (SD) (minimum, maximum)6.5 (1.9) (2–9); 8.1 (1.6) (4–10)
Multiple birth, n (%)8 (32)
Preterm birth (<37 wks gestation), n (%)23 (92)
HIE, n (%)1 (4)
BPD, n (%)2 (8)
Major brain pathologies in neuroimaging a, n (%)3 (12)
Age at HINE assessment mean (SD) (minimum, maximum), mo8.8 (3.0) (3.5–15.0)
3 to 5 mo, n (%)4 (16)
6 to 8 mo, n (%)9 (36)
9 to 15 mo, n (%)12 (48)
a Neuroimaging (ultrasound, magnetic resonance imaging) was performed routinely in the neonatal intensive care unit; BPD—bronchopulmonary dysplasia; HIE—hypoxic-ischemic encephalopathy.
Table 4. Intra- and inter-examiner reliability of the Spanish version of HINE.
Table 4. Intra- and inter-examiner reliability of the Spanish version of HINE.
Intra-Examiner ReliabilityCranial NervesPostureMovementsToneReflexes and ReactionsAsymmetriesTotal Score
MR-M0.9040.9550.9800.9180.9720.9590.981
<0.001<0.001<0.001<0.001<0.001<0.001<0.001
Inter-Examiner Reliability
MR-R, AH-R0.8170.8180.9900.8680.9140.5070.968
<0.001<0.001<0.001<0.001<0.0010.003<0.001
MR-R, JM-A0.8540.8680.7940.9700.8880.4510.975
<0.001<0.001<0.001<0.001<0.0010.050<0.001
AH-R, JM-A0.7860.8320.8160.8680.8670.4890.976
<0.001<0.001<0.001<0.001<0.0010.037<0.001
MR-R, AH-R, JM-A0.8700.8870.9030.9360.9240.5830.982
<0.001<0.001<0.001<0.001<0.0010.001<0.001
The higher values indicate the ICCs; the lower values are the corresponding p-values.
Table 5. Inter-examiner reliability of single HINE items.
Table 5. Inter-examiner reliability of single HINE items.
Inter-Examiner Reliability
MR-R, AH-R
Cranial nerve functionFacial appearanceEye movementsVisual responseAuditory responseSucking/swallowing
0.3590.4680.4900.9170.370
0.0220.0010.004<0.0010.006
PostureHeadTrunkArmsHandsLegsFeet
0.4190.5960.6480.2590.5450.527
0.006<0.0010.0010.080<0.001<0.001
MovementsQuantityQuality
0.6840.855
<0.001<0.001
ToneScarf signPassive shoulder elevationPronation/supinationHip adductorsPopliteal angleAnkle dorsiflexionPull to sitVentral suspension
0.6580.6480.6480.4680.5520.4160.7790.795
<0.0010.0010.0010.0060.0010.007<0.001<0.001
Reflexes and reactionsArm protectionVertical suspensionLateral tiltingForward parachuteTendon reflexes
0.6270.1720.6630.6310.479
<0.0010.380<0.001<0.0010.001
The higher values indicate the weighted κ; the lower values are the corresponding p-values.
Table 6. Inter-examiner reliability of the Spanish version of HINE one year after the training program.
Table 6. Inter-examiner reliability of the Spanish version of HINE one year after the training program.
Inter-Examiner ReliabilityCranial NervesPostureMovementsToneReflexes and ReactionsAsymmetriesTotal Score
AH-R, IA-G, CB-M, AMF-T0.9450.9730.7900.8560.9800.6180.988
Total score<0.001<0.001<0.001<0.001<0.0010.026<0.001
The higher values indicate the ICCs; the lower values are the corresponding p-values.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hidalgo-Robles, Á.; Merino-Andrés, J.; Rodríguez-Fernández, Á.L.; Gutiérrez-Ortega, M.; León-Estrada, I.; Ródenas-Martínez, M. Reliability, Knowledge Translation, and Implementability of the Spanish Version of the Hammersmith Infant Neurological Examination. Healthcare 2024, 12, 380. https://doi.org/10.3390/healthcare12030380

AMA Style

Hidalgo-Robles Á, Merino-Andrés J, Rodríguez-Fernández ÁL, Gutiérrez-Ortega M, León-Estrada I, Ródenas-Martínez M. Reliability, Knowledge Translation, and Implementability of the Spanish Version of the Hammersmith Infant Neurological Examination. Healthcare. 2024; 12(3):380. https://doi.org/10.3390/healthcare12030380

Chicago/Turabian Style

Hidalgo-Robles, Álvaro, Javier Merino-Andrés, Ángel Luis Rodríguez-Fernández, Mónica Gutiérrez-Ortega, Irene León-Estrada, and Maribel Ródenas-Martínez. 2024. "Reliability, Knowledge Translation, and Implementability of the Spanish Version of the Hammersmith Infant Neurological Examination" Healthcare 12, no. 3: 380. https://doi.org/10.3390/healthcare12030380

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop