1. Introduction
Impaired mobility is the leading cause of reduced functionality, restricted participation levels and decreased activity levels in children and youth with severe movement disabilities, resulting in, among others, social isolation, anxiety and depression [
1,
2,
3]. Introducing powered mobility wheelchairs to children with severe motor limitations has shown to improve their psychosocial and cognitive skills while increasing independence, self–exploration and intuition without any negative impact on their motor development [
4]. Therefore, mobility training is of major importance starting at a young age [
5].
In the child-population, cerebral palsy is the most common neuromotor disability, with a prevalence of 1.7 per 1000 livebirths [
6] and is categorized into three groups: Spastic, dyskinetic and ataxic [
7]. Dyskinetic cerebral palsy (DCP) is the second largest and most limiting CP group [
8]. DCP is characterized by two complex movement disorders: Dystonia (i.e., involuntary movements, distorted voluntary movements and abnormal postures due to sustained muscle contractions) and choreoathetosis (i.e., chorea defined as rapid, involuntary, often fragmented movements and athetosis defined as slower and constantly changing movements) [
8]. In DCP, dystonia and choreoathetosis are also present as overflow movements, defined as unintentional contractions of muscles different from the ones used during a goal–directed movement [
9]. More than 70% of the DCP population presents with the highest levels of severity in gross motor functioning and fine manual abilities [
10]. As a result, children with DCP are unable to use powered mobility wheelchairs with a conventional joystick, hence leaving them heavily dependent on caregivers’ assistance [
4,
8,
11].
Alternate steering methods such as switches or head arrays for powered mobility are proposed in literature as a way to achieve independence for children with severe gross and manual limitations [
12]. In this respect, in DCP, the basal movements of the head and the feet are better controlled than the movements of the arms [
8]. Therefore, clinical practice widely supports the use of a head/foot steering system as the best option to promote independent powered mobility for children with DCP, where the head movements are used to steer the wheelchair to the right and left and the feet are used to drive the wheelchair forward and backward. In general, there is little evidence supporting the best methods to train children to use a powered wheelchair and a lack of comprehensive training results in longer, time–consuming and unstructured motor learning and skill acquisition processes [
4,
13].
Thus, evidence–based knowledge into the different stages of powered mobility, from learning towards self–exploration remains scarce in DCP and mobility training so far is based only on clinical expertise. To increase insights into the potential use and learning process of powered mobility wheelchairs for children with DCP, the process of learning to use it, operation of the system, the impact of movement disorders and environmental factors need to be further explored. These insights would contribute to a better understanding of the mobility limitations in this population, and assist in tailoring of better powered mobility training programs to shorten learning curves.
Whereas the characterizing dystonia and choreoathetosis movement disorders seem to be the biggest limiting concepts of powered mobility in DCP [
8], it is important to be able to assess the presence and severity of these movement disorders during powered mobility tasks. That is, it is stipulated that an increase in severity causes higher distortion of voluntary movements and higher presence of involuntary/overflow movements, which might result in longer and more difficult powered mobility skills training. Thereby, increased insights in the severity of dystonia and choreoathetosis during powered mobility may generate knowledge to develop more straightforward mobility training guidelines and assist powered mobility training by shortening learning curves.
To date, presence and severity of dystonia and choreoathetosis are measured using the Dyskinesia Impairment Scale (DIS) [
9,
14,
15,
16], a video–based tool which measures the movement disorders during requested but voluntary activities and rest postures. The DIS measures requested but voluntary activities in a controlled environment and may, therefore, not provide information about the occurrence of the movement disorders in a more real–life context, such as steering a powered wheelchair using a head/foot steering system. This implies that there is a necessity for a reliable and valid assessment tool that will generate insights on the presence and severity of movement disorders during daily–life activities. The DIS has shown high reliability and validity in measuring dystonia and choreoathetosis in DCP [
14,
15]. Thereby, an adapted protocol of the DIS which will reliably measure the movement disorders during powered mobility could be the solution to fill in the gap in the current existing assessment tools.
Therefore, this study aimed to (1) develop an adapted standardized protocol of the DIS which will measure presence and severity of dystonia and choreoathetosis during powered mobility tasks in individuals with DCP, and (2) to assess the reliability and validity of this protocol. Serving that purpose, the new scale will be named the Dyskinesia Impairment Mobility Scale (DIMS).
3. Results
3.1. Interrater Reliability of the DIMS
The ICCs and 95% CIs of the total scale, subscale and region scores are shown in
Table 2.
Moderately high to good interrater reliability was obtained for the total score of the DIMS with ICC 0.87 (95% CI 0.35–0.99; p = 0.011), for the total DIMS-D with ICC 0.68 (95% CI 0.00–0.98; p = 0.098) and for the total DIMS-CA with ICC 0.79 (95% CI 0.07–0.98; p = 0.000). Similar interrater reliability was found for the total score of the DIMS duration factor and amplitude factor with ICC 0.62 and 0.87 respectively.
For the DIMS-D subscale, interrater reliability of the duration factor, amplitude factor and the summation of both factors were low to good, with ICCs 0.22, 0.85 and 0.68 respectively. For the DIMS-D subscale of the neck region, good interrater reliability was found for the total score with ICC 0.83 while for the DIMS-D subscale of the arm regions, ICCs ranged between 0.04 and 0.73.
For the DIMS-CA subscale, interrater reliability of the duration factor, amplitude factor and summation of both factors were good with ICCs 0.83, 0.73 and 0.79 respectively. The interrater reliability of the total DIMS-CA for the neck was excellent with ICC 0.96. Good to excellent interrater reliability was found for the total DIMS-CA subscale of the arm regions with ICCs ranging between 0.79 and 0.96.
3.2. Test-Retest Reliability of the DIMS
The ICCs and 95% CIs of the total scale, subscale and region scores are shown in
Table 3.
Moderate to excellent test–retest reliability was found for the total score of the DIMS, DIMS-D and DIMS-CA with ICCs 0.80 (95% CI 0.00–0.98; p = 0.079), 0.93 (95% CI 0.42–0.99; p = 0.000) and 0.51 (95% CI 0.00–0.95; p = 0.283). Good test–retest reliability was found for the total DIMS duration factor and amplitude factor with ICCs 0.76 and 0.84 respectively.
For the DIMS-D subscale, excellent test-retest reliability was found for the duration factor, amplitude factor and summation of both, having ICCs of 0.90, 0.94, and 0.93 respectively. For the DIMS-D subscale of the neck region, excellent test–retest reliability was found for the total score with ICC 0.92 while for the DIMS-D subscale of the arm regions, ICCs ranged between 0.69 and 0.96.
For the DIMS-CA subscale, the ICCs for the total duration factor, amplitude factor and summation of both were 0.38, 0.61 and 0.51 respectively. The ICC of the total DIMS-CA subscale for the neck region was 0.96 whereas for the arm regions, ICCs ranged between 0.00* and 0.83. SPSS reported negative ICC scores, most likely related to the relatively small between-subject variation compared to within-subject variation, however as negative ICCs are not theoretically possible [
22], (the ICC score was changed to 0.00*) [
23]. For this reason, an additional analysis was performed excluding the DIMS-CA arm LP scores. DIMS-CA subscale ICC scores varied from moderately high to good when excluding left proximal arm scores (see
Appendix C,
Table A3).
3.3. Internal Consistency
Cronbach’s alphas for the total DIMS, DIMS-D subscale and DIMS-CA subscale were α = 0.81, α = 0.80 and α = 0.69 respectively. For the total DIMS-D subscale, α = 0.80 was obtained for both duration factor and amplitude factor. For the total DIMS-CA subscale, α = 0.71 was found for the duration factor and α = 0.66 for the amplitude factor.
3.4. Concurrent Validity
For the concurrent validity of the neck region, DIMS-D subscale showed moderate correlation (rs = 0.41 95% CI,0.00–0.95, p = 0.003) while DIMS-CA subscale showed weak correlation (rs = 0.33 95% CI 0.00–0.94, p = 0.018) with the DIS scores of the second requested voluntary activity (i.e., neck rotation). No correlation was found with the first DIS requested voluntary activity (i.e., neck lateroflexion) or with DIS neck rest postures.
For the arm RP region, DIMS-D subscale showed strong correlations (rs = 0.63 95% CI 0.00–0.97, p = 0.000) and DIMS-CA showed moderate correlations (rs = 0.46 (95% CI 0.00–0.95, p = 0.001) with arm RP rest postures of the DIS. No correlations were found with the DIS overflow movements.
For the arm RD region, DIMS-D subscale showed a strong correlation (rs = 0.63 95% CI 0.00–0.97, p = 0.000) with DIS rest postures and no correlation with DIS overflow movements. The DIMS-CA subscale showed weak correlation (rs = 0.29 95% CI 0.00–0.93, p = 0.049) with DIS overflow movements and no correlation with DIS rest postures.
For the arm LP region, both the DIMS-D and the DIMS-CA subscale showed moderate correlations of rs = 0.45 (95% CI 0.00–0.95, p = 0.001) and rs=0.41 (95% CI 0.00–0.95, p = 0.003) only with DIS rest postures.
For the arm LD region, both the DIMS-D (rs = 0.29 95% CI 0.00–0.93, p = 0.057) and the DIMS-CA (rs = 0.37 95% CI 0.00–0.94, p = 0.011) subscale showed weak correlations only with the DIS rest postures.
4. Discussion
This study aimed to develop the DIMS, a new tool to measure presence and severity of both dystonia and choreoathetosis during powered mobility tasks in DCP. The DIMS is an adapted standardized protocol of the DIS which is a reliable and valid tool to measure presence and severity of dystonia and choreoathetosis during requested but voluntary activities and rest postures. The outcomes of this study indicate that DIMS is a reliable and valid measurement tool to determine presence and severity of dystonia and choreoathetosis during powered mobility. A moderately high to good interrater reliability was found for the total score of the DIMS, the DIMS-D and the DIMS-CA with correlation coefficients of 0.87, 0.68 and 0.79 respectively. Good interrater reliability was found for the total DIMS duration factor and amplitude factor with coefficients of 0.83 and 0.73. In addition, internal consistency scores were moderately high to good. Finally, concurrent validity showed during mobility tasks significant correlations with rest postures in the arm region, and with voluntarily, requested activity in the neck region.
Interrater reliability scores are good, in particular for DIMS total and DIMS-CA. The reliability of DIMS total is in line with both the interrater reliability of junior and senior physiotherapists [
15], implying that the DIMS can be reliably used in the future by all clinicians, regardless of their work experience. Interrater reliability scores of DIMS-D duration are relatively lower as is in line with previous literature [
14,
15]. Visual inspection of the raw data showed a much lower variability in the scores of the duration factor than the scores of the amplitude factor. In addition, low DIMS-D duration scores primarily occur in proximal arm regions, while scores in neck and distal arm regions are still moderate to moderately high. This might be because the visibility of the proximal arms is slightly lower due to the sitting position of the participants while driving the wheelchair in comparison to the distal arm region and neck region. Similarly, this may explain why scoring the duration of dystonia for the proximal arms is more difficult than scoring its amplitude, which is clinically easier to see and evaluate [
14]. Interestingly, for the proximal arm regions, an excellent interrater reliability was found for the duration factor of the DIMS-CA. This is likely due to the hyperkinetic nature of choreoathetosis, which is easier to observe than the hypertonic nature of dystonia [
8]. The summation of both factors revealed a good interrater reliability for the DIS-D region scores, implying a reliable measure of dystonia for both voluntary and overflow movements during powered mobility. In this respect, higher scores for the duration factor as opposed to the amplitude factor were obtained for the DIMS-CA subscale, which is in line with previous research [
14,
15]. The good to excellent interrater reliability of the DIMS-CA duration and amplitude factors shows that presence and severity of choreoathetosis can be reliably measured during powered mobility.
The current study of the DIMS is the first to assess test–retest reliability in measuring presence and severity of movement disorders in DCP. The test–retest reliability of the total DIMS score, DIMS-D subscale and DIMS-CA subscale was moderate to excellent, with correlation coefficients of 0.80, 0.93 and 0.51 respectively. The test–retest reliability for the total duration factor and amplitude factor of the DIMS was also good, with coefficients 0.76 and 0.84. Excellent test–retest reliability was obtained for the DIMS-D subscale both for the duration factor, amplitude factor and the summation of both factors. In–depth analysis of the DIMS-D region scores showed moderately high to excellent test–retest reliability for all constructs, which implies that the presence and severity of dystonia during powered mobility can be reliably measured over time, both for the voluntary and overflow movements. Test–retest reliability was lower for the DIMS-CA subscale when compared to the DIMS-D subscale. These low test–retest coefficients of the DIMS-CA may be because of scores at the proximal part of the left arm (i.e., arm LP). This is most likely related to the relatively small between–subject variation compared to within–subject variation of the different independent raters [
23]. To explore in more depth, the arm LP scores for the DIMS-CA subscale, the raw data of the arm LP was visually inspected. This informed that for two of the participants, the presence and severity of choreoathetosis indeed changed drastically when comparing one week to the other. For one participant, the presence and severity of choreoathetosis largely decreased, while for the other participant, a large increase was seen. This could be an explanation of the obtained ICCs for the arm LP. An additional test–retest statistical analysis for the DIMS-CA subscale was performed by excluding the scores of the arm LP (
Table A2). Consequently, higher test–retest reliability coefficients were obtained for the total DIMS-CA subscale, total duration factor and amplitude factor, including higher test–retest coefficients of the total DIMS. The test–retest coefficients of the DIMS-CA for the remaining neck and arm regions (i.e., arm RP, arm RD and arm LD) were moderate to excellent, suggesting that the DIMS can reliably measure the presence and severity of choreoathetosis over time.
The internal consistency of the DIMS was good, with Cronbach’s α ranging between 0.69 and 0.81 for the total score of the DIMS and the DIMS-D and DIMS-CA subscales. This indicates a stable rating construct in measuring the movement disorders during mobility tasks in children with DCP which is comparable with the internal consistency of the DIS scale [
14,
15]. Although the DIMS could potentially become a tool to use in longitudinal follow–ups or intervention studies, future research should also focus in assessing its responsiveness.
The concurrent validity was assessed between the DIMS scores and the DIS scores (i.e., requested voluntary activities, rest postures and overflow movements) of the same participants. Interestingly, for the neck region, both dystonia and choreoathetosis scores of the DIMS were correlated with the DIS neck rotation requested voluntary activity and no correlation was obtained with the DIS neck lateroflexion or DIS neck rest postures. The participants indeed use a rotation of the neck to be able to steer the wheelchair to the right or to the left; therefore, the obtained findings correspond with observations and knowledge from clinical practice. On the contrary, the DIMS scores of the arms region showed correlations with the arms rest postures of the DIS and not with overflow movements, except for the right distal arm. Research suggests that presence and severity of dystonia and choreoathetosis increase during requested voluntary activities as opposed to rest [
24]. As the arms are not doing any goal–directed activity while operating with the head/foot steering wheelchair, it is highly likely that the presence and severity of the movement disorders in the arms during powered mobility corresponds more to the resting postures of the participants rather than requested voluntary activities which are challenging to perform.
This study is the first to present a tool that reliably measures presence and severity of dystonia and choreoathetosis during powered mobility in children and youth with DCP. The DIMS and generated insights from its use have the potential to inform and help clinicians set up more a more straightforward and efficient mobility training based on structured guidelines. As a first tool to measure movement disorders relevant for DCP during powered mobility tasks, future studies using the DIMS will yield important insights on powered mobility in DCP, which is of crucial importance and yet underexplored in the target population. Nevertheless, this study warrants some reflections to consider. First, the sample size of this study is small, considering the challenging inclusion criteria like the rare DCP diagnosis and the use of their own head/foot steering wheelchair. However, the number of tasks and regions scored by three independent raters gives confidence in the reported results. The low number of included participants has likely a relatively negative impact on the reliability scores in comparison to a higher number of participants. That is, it is plausible that with more scores included in the reliability statistical analysis, the obtained reliability coefficients would be higher. Still, given the reported outcomes in this study, the DIMS can be perceived a reliable and valid measurement tool to measure presence and severity of dystonia and choreoathetosis during powered mobility. Second, the age range of the participants and their years of experience in driving a head/foot steering system is large. Again, this could have negatively affected our outcomes in terms of the reliability scores and concurrent validity scores of the DIMS. Therefore, future studies are also advised to consider categorizing the sample based on their age and years of experience to explore any differences and generate more in–depth insights. Finally, due to the importance of the quality of the video recordings, we would like to strongly advise to use high–quality cameras with a high resolution and zoom–in function.
5. Conclusions
This study developed the Dyskinesia Impairment Mobility Scale (DIMS), an adapted protocol of the existing Dyskinesia Impairment Scale (DIS), to evaluate the presence and severity of dystonia and choreoathetosis during powered mobility tasks in individuals with DCP. The DIMS is a reliable and valid measurement tool to determine presence and severity of dystonia and choreoathetosis during powered mobility. The DIMS showed moderately high to good interrater reliability, good internal consistency and moderate to excellent test–retest reliability for the voluntary and overflow movements. Concurrent validity showed, during mobility tasks, significant correlations with rest postures in the arm region, and with requested voluntary activity in the neck region.
In clinical practice, the DIMS could be a promising tool to assess and evaluate the presence and severity of dystonia and choreoathetosis during powered mobility tasks, and assist in accelerating the learning process of using a powered mobility wheelchair by providing baseline profiles and a reliable longitudinal follow–up of the severity of the movement disorders which greatly impact mobility. Increased insights in clinical movement disorders during powered mobility may generate knowledge on the powered mobility driving patterns which can be used by the clinicians to tailor individualized mobility training programs. Furthermore, in future research, the DIMS can be used to explore clinical patterns of dystonia and choreoathetosis during steering and be used as an evaluation tool of future mobility intervention studies. Moreover, the DIMS could inform on the impact of factors such as fatigue, stress or emotional arousal on movement disorders during powered mobility, leading to increased insights that could assist in the development of more straightforward mobility training guidelines.