Next Article in Journal
The Role of Neighborhood Air Pollution Exposure on Somatic Non-Small Cell Lung Cancer Mutations in the Los Angeles Basin (2013–2018)
Previous Article in Journal
Does China’s Eco-Province Policy Effectively Reduce the Pollutant Emission Intensities?
Previous Article in Special Issue
Adaptation and Validation of the Malay Version of the SAVE-9 Viral Epidemic Anxiety Scale for Healthcare Workers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board

by
Ángel Gabriel Estévez-Pedraza
1,2,†,
Enrique Hernandez-Laredo
1,†,
María Elena Millan-Guadarrama
3,
Rigoberto Martínez-Méndez
2,
María Fernanda Carrillo-Vega
4 and
Lorena Parra-Rodríguez
4,*
1
Faculty of Medicine, Universidad Autónoma del Estado de México, Toluca de Lerdo 50180, Mexico
2
Faculty of Engineering, Universidad Autónoma del Estado de México, Toluca de Lerdo 50100, Mexico
3
Faculty of Nursing and Obstetrics, Universidad Autónoma del Estado de México, Toluca de Lerdo 50180, Mexico
4
Research Department, Instituto Nacional de Geriatría, Mexico City 10200, Mexico
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2022, 19(17), 11026; https://doi.org/10.3390/ijerph191711026
Submission received: 19 July 2022 / Revised: 26 August 2022 / Accepted: 30 August 2022 / Published: 3 September 2022
(This article belongs to the Special Issue Instruments for Measuring Health)

Abstract

:
This paper analyzes the reliability and usability of a portable electronic instrument that measures balance and balance impairment in older adults. The center of pressure (CoP) metrics are measured with a modified Wii Balance Board (mWBB) platform. In the intra- and inter-rater testing, 16 and 43 volunteers (mean 75.66 and standard deviation (SD) of 7.86 years and 72.61 (SD 7.86) years, respectively) collaborated. Five volunteer raters (5.1 (SD 3.69) years of experience) answered the System Usability Scale (SUS). The most reliable CoP index in the intra-examiner tests was the 95% power frequency in the medial-lateral displacement of the CoP with closed-eyes. It had excellent reliability with an intraclass correlation coefficient ICC = 0.948 (C.I. 0.862–0.982) and a Pearson’s correlation coefficient PCC = 0.966 (p < 0.001). The best index for the inter-rater reliability was the centroidal frequency in the anterior-posterior direction closed-eyes, which had an ICC (2,1) = 0.825. The mWBB also obtained a high usability score. These results support the mWBB as a reliable complementary tool for measuring balance in older adults. Additionally, it does not have the limitations of laboratory-grade systems and clinical screening instruments.

1. Introduction

Human balance is a complex ability to achieve postural stability, which counteracts the inherently unstable perturbations and body sways induced by the gravitational effect [1]. An efficient balance control depends on the visual, vestibular, somatosensory, muscular, and nervous systems. Assessing human balance helps evaluate the integrity of these systems. In this regard, it is well known that the aging process involves a reduction in physiological capacities and balance [2]. These conditions usually lead to falls which directly and negatively impact older adults’ quality of life [3]. According to the World Health Organization (WHO), 28–35% of the elderly population (above 65 years old) fall each year, reaching 32–42% for adults over 70 years old. This means that the frequency of falls increases with age and frailty level [4]. The relevance of this public health problem is remarkable due to the accelerated growth of the world population of older adults, the intrinsic and extrinsic multifactorial nature of falls [5], and the negative economic impact of attending to the problem, both personally and for governmental health institutions and systems [6,7]. Thus, the correct and timely diagnosis regarding balance anomalies can lead to clinical actions to avoid their impact.
Current balance assessment is based on clinical screening tools and technological systems [8]. The former comprise functional tests of gait, strength, balance, posture, and physical examination that allow the evaluator to diagnose the postural condition and predict patients’ fall risk. However, performance and predictive validity have been questionable because these instruments lack sufficient precision [9]. On the other hand, these tools are not equivalent. They must be selected according to the evaluator’s experience and the clinical context, so their application is usually subjective [10]. These limitations can be reduced using technologies such as instrumented insoles, camera systems, and force platforms. Currently, force platforms are considered the gold standard in clinical practice. These instruments can register stability limits and measure the trajectory of the center of pressure (CoP) [11]. The latter is a biomechanical point where the ground reaction forces are located and concentrated when a person is standing on a flat surface. The CoP measurement allows the characterization of the body sway using metrics and graphs. Despite the usefulness of these tools, they are not routinely used due to their relatively high cost, the complexity of their use, and the reduced portability. Usually, only specialized gait and balance clinics can afford these technologies.
In recent years, the Wii Balance Board (WBB), a device designed for video games, has drawn the attention of scientists and health professionals involved in functional assessment and physical rehabilitation due to its accessibility, cost, portability, and duration of the evaluation [12]. Since its release in 2007, interest in using the WBB for research purposes has grown, the word “Wii-search” was coined [13], and custom-designed modifications, applications, and software were made to use alongside the device [14,15,16,17,18]. It has been used for balance assessment [19] in the fields of neurorehabilitation [13], balance training, and balance and fall risk assessment applications [13,20,21]. It has proven to be an affordable alternative to laboratory-grade force platforms [18,20,22,23], valid and reliable for assessing standing balance [18,19], and precise and reliable for body stability quantitative measures in healthy older women [24].
However, some studies have reported limitations regarding the use of the WBB due to the unstable sampling rate (time jitter), data transmission, low signal-to-noise ratio, and occasional missing data in the acquisition process (glitches in the data) [23]. Additionally, concerns have been raised regarding the accuracy of the WBB sensors, the applicability and practicalities of using the WBB in a clinical setting, and the quality control in the manufacturing process [25,26,27,28,29,30,31,32].
In 2020, the design and construction of a portable electronic device based on a modified WBB (mWBB) capable of measuring and evaluating the balance of human equilibrium were reported [20]. The mWBB is an integrated-embedded device that does not require additional peripherals, such as computers or interfaces, to perform a balance assessment. After modifying the internal electronics of the WBB, the mWBB resolves the technical problems mentioned above: time jitter, data transmission, low signal-to-noise-ratio, and glitches in the data. The technical specifications of the WBB modifications (sensors, signal conditioning, processing, user interface, and data storage) can be found in [20]. These modifications were conducted for research purposes and are based on reverse engineering for interoperability interfacing by developing an electronic module. The practice of reverse engineering is legal, does not violate any patent copyrights, and does not require permission from Nintendo [33,34].
Our previous research verified the criterion validity of the mWBB and its capability to quantify balance deficits in older adults [35]. However, evaluating its intra-rater and inter-rater reliability is necessary when assessing static standing balance. Additionally, it is important to assess if health professionals would find it useful for their general practice. Thus, the present study aims to evaluate the reliability of the CoP indices obtained by the mWBB and to explore the device’s usability.

2. Materials and Methods

2.1. Study Population

Participants were recruited voluntarily from different nursing homes, universities, and neighborhoods of the cities of Toluca, Metepec, and Villa Guerrero in the State of Mexico, Mexico. Persons eligible to participate were those aged 65 years and over, who could stand for at least 2 min, even using assistive devices. Individuals who drank alcoholic beverages or coffee in the last 24 h or could not complete the physical performance tests (described below) were excluded. The mWBB raters were invited through an open call at the School of Medicine and the School of Nursing and Obstetrics of the Autonomous University of the State of Mexico. All raters were undergraduate students undertaking a bachelor’s degree or had an upper degree in gerontology, physical therapy, nursing, or geriatrics, and had over one year experience in geriatric care and management.

2.2. Variables

A total of 78 CoP indices (39 with open-eyes and 39 with closed-eyes) previously described [36] were estimated using the mWBB. Table A1 contains the description of the CoP indices used in this study. For this purpose, subjects were placed on the platform surface with their feet together (closely positioned, side by side, and no opening angle), barefoot, assuming the most upright posture possible, with the arms crossed over the chest [37]. Individuals were asked to focus on a fixed point in front, located half a meter apart in the distance and at a height of 1.5 m above the ground. Participants stood on the mWBB; after a 5-s countdown, the device automatically records the CoP data for one minute. Immediately after, through an auditory stimulus, the subjects were instructed to close their eyes, recording another minute. The test was carried out once. The CoP trajectory data were recorded at a stable sampling rate of 50 Hz, with a resolution of 1/100th of a millimeter and saved in a MicroSD card.
Age in years was used as a continuous variable and sex as a dichotomic variable (woman/man) to describe the sample. Anthropometry (height in cm and weight in kg) was determined following validated methodology and by standardized personnel.
Gait was assessed by the time in seconds taken to complete the Timed Up and Go (TUG) test [38]. Gait deficit (yes/no) was defined when participants took 12 s or more to complete the test. Leg strength was assessed by the number of full stands achieved when performing the 30-s Chair Stand test, and strength in legs deficit (yes/no) was adjusted by sex and age [39]. Balance was assessed with the 4-Stage Balance Test; a balance deficit (yes/no) was present if the individual could not hold their feet-together, semi-tandem, and in tandem positions for ten seconds without moving the feet or needing support, or when participants could not maintain the one-legged stance for five seconds [40].
The use of gait assistive devices, the presence of lower limb prostheses, complete or partial visual and hearing impairments, diagnosis of diabetes or hypertension, fear of falling (FES-I score ≥ 23 [41]) and if the participants fell in the previous year of the study (yes/no) were also analyzed.
The usability of the mWBB was assessed with a custom System Usability Scale (SUS) questionnaire (see Table A2). It has a continuous scale ranging from 0 to 100, administered to all raters immediately upon completion of the reliability tests. The age of the raters, years of experience in geriatric care and management, profile, and score of the SUS test were also recorded.

2.3. Reliability

All raters gave standardized instructions to the participants on each trial for the reliability tests. Intra-rater reliability (also known as test–retest reliability) consisted of the same examiner applying the balance test to the same participants twice but at different days in the same room. Based on a previous systematic review [19], the time between the test and retest used for the present study was the closest to 48 h.
Several examiners applied the balance test to the same participants for inter-rater reliability. Each rater repeated one test within an interval closest to 48 h in the same room and the order of raters was randomized [19].

2.4. Statistical Analysis

A descriptive analysis of the sample characteristics, the 78 CoP indices for the reliability tests, the characteristics of the raters, and the results of the usability questionnaire was performed. Continuous variables were represented using means and standard deviations (SD), and categorical variables were expressed as numbers and percentages. The normality of the continuous variables was assessed using a Shapiro–Wilk test with α = 0.05. Comparisons of individuals included in the intra-rater and inter-rater tests were estimated through a Wilcoxon test for continuous variables, and a χ2 test for categorical variables.
For the intra-rater reliability tests, comparisons of the 78 CoP indices of the test vs. the retest were performed using a t-test for dependent variables for indices with normal distribution. A Wilcoxon test was used for non-parametric indices. To measure the test–retest reliability of the normally distributed CoP indices, Pearson’s correlation coefficient (PCC), and intraclass correlation coefficient (ICC) at 95% confident intervals based on a single rater/measurement, absolute agreement, and two-way mixed effects model [42], were estimated. For those CoP indices that are not normally distributed, Spearman’s Correlation Coefficient (SCC) and ICC at 95% confidence intervals were estimated by the bootstrap technique.
For the inter-rater reliability, a Maulchy’s W test was used to check sphericity. Comparisons of the 78 CoP indices among raters were performed using a Friedman test for non-parametric indices. For normally distributed indices with homogeneity of variances, a dependent variables one-way ANOVA test was used by the Pillai trace statistic. For metrics with normal distribution and heterogeneity of variances, a dependent variables one-way ANOVA test was performed by the Greenhouse–Geisser statistic. To measure the test reliability of the normally distributed CoP indices, PCC, intraclass correlation coefficient (ICC (2,1)) and their 95% confident intervals based on a single measurement, absolute agreement, and two-way random effects model [29] were estimated. For those CoP indices that were not normally distributed, the SCC, ICC (2,1), and their 95% confidence intervals were calculated by the bootstrap technique.
For the usability tests, the correlation between age and years of experience in geriatric care and management versus SUS scores was calculated by the SCC. For the estimation of the degree of usability, SUS scores between 50 and 70 indicate deficient usability, SUS scores above 70 indicate acceptable usability, and values above 90 indicate excellent usability [43,44].
For the reliability tests, it was assumed that 95% confidence interval limits of the ICC below 0.5 indicate poor reliability, values between 0.5 and 0.75 indicate moderate reliability, values between 0.75 and 0.9 indicate good reliability, and values above 0.90 indicate excellent reliability [42].
For Spearman and Pearson correlation coefficients, it was assumed that values between 0.90 and 1.00 indicate very high correlation, values between 0.70 and 0.90 high correlation, values between 0.50 and 0.70 moderate correlation, values between 0.30 and 0.50 low correlation, and values between 0.00 and 0.30 indicate insignificant correlation [45].
The discrimination accuracy of presenting a balance deficit for the 78 CoP indices was assessed using the Hosmer–Lemeshow Goodness of Fit test and the area under the receiver-operating characteristic curve (AUC). The optimal cut-off points were obtained for the indices with the higher AUC that best distinguished between people with and without a balance deficit based on Youden’s statistic. The accuracy of the classification was evaluated with the AUC, sensitivity, and specificity.
All statistical tests were performed with α = 0.05 using IBM SPSS Statistics (version 26.0, Armonk, NY, USA), except for the bootstrap technique and the discrimination accuracy run in Stata Statistical Software (version 15, College Station, TX, USA).

2.5. Sample Size Calculation

The sample size for the test–retest reliability was calculated using the correlation coefficient formula (Equation (1)) [46]:
n T R T = z α + z β 0.5   ln 1 + r 1 r 2 + 3 .
where:
  • n T R T is the sample size for the test–retest reliability,
  • z α = 1.64 , assuming a 95% confidence level,
  • z β = 1.44 , assuming a β error of 0.075, and
  • r = 0.70 , is the expected correlation coefficient.
This calculation resulted in 16 participants needed to achieve the desired correlation coefficient.
For the estimation of inter-rater reliability, it is necessary to establish the rho ( ρ ) level, the proportion of variation between subjects in relation to the total variation [47]. The sample size can be calculated by using Equation (2):
n I R = 8 z α / 2 2 1 ρ ¯   2 1 + n 1 ρ ¯ 2 ω 2 n n 1 + 1 .
where:
  • n I R is the sample size for the inter-rater reliability,
  • z α / 2 = 1.96 , assuming a 95% confidence level,
  • ρ ¯ = 0.70 , is the expected correlation coefficient,
  • ω = 0.25 , is the width of the confidence interval,
  • n = 3 , is the number of examiners.
This formula resulted in 43 participants needed to achieve the desired correlation coefficient.

3. Results

In total, 19 individuals aged 65 and older took part in the intra-rater reliability tests. One participant dropped out of the study, and two were excluded because they could not complete the physical performance tests. Therefore, 16 individuals were included in the test–retest reliability analysis. The mean age of these participants was 75.7 (SD 7.6) years and 56.3% of the sample were women. In total, 13 (81.3%) of all individuals presented gait and balance deficits, and 4 (25%) used assistive gait devices and lower limb prostheses. A total of 3 participants (18.3%) reported visual and hearing impairments. The complete sample had a leg strength deficit. Diabetes was present in 37.5%, fear of falling in 56.3%, and 56.3% of the individuals suffered a fall in the previous year.
Of the 46 individuals who participated in the inter-rater reliability tests, 2 dropped out of the study, and 1 did not complete the physical performance tests. Thus, 43 individuals, of whom 19 (44.2%) were women, were included in the inter-rater analysis. The mean age was 72.6 (SD 7.9) years. In total, 27 individuals (62.8%) presented a gait deficit, 30 (69.8%) a balance deficit, 27 (62.8%) had a fear of falling, 21 (48.8%) reported having suffered a fall in the previous year, and 12 (27.9%) were diagnosed with hypertension. All participants had a leg-strength deficit. No significant difference was found between people who participated in the intra-rater tests and individuals who participated in the inter-rater tests. A complete description of the samples is shown in Table 1.
For intra-rater reliability, there was no significant difference in any CoP index between the test and retest mean values (see Table A3). Table 2 shows the 17 indices with ICC higher than 0.80. The CoP indices with the best level of reliability in the intra-rater tests are POWER95MLCE (ICC = 0.948 and PCC = 0.966), MVELMLOE (ICC = 0.920 and PCC = 0.926), and RDISTMLOE (ICC = 0.883 and PCC = 0.880). A total of 41 indices (52.6%) presented an ICC higher than 0.7 and a correlation coefficient higher than 0.7 (see Table A4 for full results).
For the inter-rater reliability, there was no significant difference in all COP indices between the three examiners, except for MFREQOE, POWER50APOE, FREQDMLOE and FREQDAPOE (see Table A5 for complete results). Table 3 shows the 11 indices with ICC (2,1) higher than 0.75. The CoP indices with the best level reliability in the inter-rater tests are CFREQAPCE (ICC(2,1) = 0.825 (0.717–0.934)), MFREQAPCE (ICC(2,1) = 0.819 (0.711–0.927)) and POWER95APCE (ICC(2,1) = 0.809 (0.701–0.918)). When comparing the three examiners, 30 indices (38.46%) presented an ICC (2,1) higher than 0.7. The correlation coefficient was higher than 0.7 for 46 indices (59.0%) when comparing Rater 1 vs. Rater 2, for 25 indices (32.05%), when comparing Rater 1 vs. Rater 3, and for 23 indices (29.5%) and when comparing Rater 2 vs. Rater 3 (the complete set of the reliability results can be consulted in Table A6).
Three gerontology students and two physiotherapists participated in the usability study. The rater that performed the test–retest trials also attended as one of the three evaluators in the inter-rater test (Rater 1 in Table 3 and Table 4). The two evaluators (Raters 4 and 5) who participated in our previous study [35] also responded to the SUS questionnaire. The five female raters (age: 25.8 (SD 7.12) years; experience in geriatric care and management: 5.1 (SD 3.69) years) answered the SUS questionnaire at the end of all the experimental balance tests.
The results indicate that the mWBB has a mean SUS score of 92.5 points and a standard deviation of 6.84 points. On the other hand, 4 out of 5 raters rank the usability of the WBB as excellent. Only one operator indicated that the WBB has acceptable usability (see the scores in Table 4). The evaluators’ age and years of experience seem not to be related to the SUS scores.
To estimate the discrimination accuracy of the mWBB when presenting a balance alteration, we considered all measurements taken by Rater 1. The first trial of the 16 participants of the intra-rater tests and the results obtained from evaluating the 43 older adults included in the inter-rater tests. A Youden index analysis was run to calculate the optimal cut-off values that provide the best trade-off between sensitivity and specificity for identifying a balance deficit. Then, a ROC analysis was carried out and 10 CoP indices with the highest AUC were obtained (Table 5). The highest AUC was found for the mean frequency of the anterior-posterior CoP time series with eyes open, MFREQAPOE (AUC = 0.778, sensitivity = 0.93, specificity = 0.625). The mean CoP velocity in the anterior-posterior direction and the range of the anterior-posterior CoP presented AUC, sensitivity, and specificity higher than 0.7.

4. Discussion

When assessing static balance in a group of individuals aged 65 years and over with a high prevalence of poor physical performance, the most reliable CoP index in the intra-rater tests was the 95% power frequency in the medial-lateral displacement of the CoP with closed-eyes (POWER95MLCE). It had an excellent reliability with an ICC = 0.948 (0.862–0.982) and a PCC = 0.966. The best index for the inter-rater reliability was the centroidal frequency in the anterior-posterior direction with closed-eyes (CFREQAPCE), which had an ICC (2,1) = 0.825. The mWBB also obtained an excellent average usability score of 92.5, showing that the examiners found it useful and easy to use. They will recommend it to other health professionals, regardless of their age or professional experience.
The key indicators when measuring an instrument’s quality are validity and reliability [48]. The first estimates the extent to which a measure agrees with the gold standard. Thus, it has been demonstrated that the WBB is a valid instrument that performs comparably to a laboratory-grade force platform for static standing computerized posturography [18]. Furthermore, previous research showed that the mWBB is a valid device that identifies balance alterations in independent, active older adults with no acute condition. Seventy-three percent of the CoP indices obtained with the mWBB were able to detect balance alterations, with the mean velocity of the CoP in the antero-posterior direction with open-eyes (MVELAPOE) being the best at discriminating between groups [35].
Reliability is defined by the consistency among successive measurements of a variable, on the same subject, and under similar conditions [49]. Some of the instrument’s most critical reliability tests are inter-device, intra-rater, and inter-rater reliability.
Inter-device reliability refers to the consistency of measurements carried out by different devices. Several studies have shown that the WBB presents low inter-device variability [23]. Even after years of use, these devices do not present significant alterations in their measurements, and the battery charge level does not affect the sensor data [50].
Intra-rater reliability refers to the consistency of measurements performed under similar assessment conditions at two separate times by the same examiner (test–retest). On the other hand, inter-rater reliability points to the consistency of measurements carried out by different examiners. Previous evidence [18] has indicated that the WBB is a reliable, safe, and feasible tool to assess static balance in highly functional individuals [51], older adults at risk of falls [52], and adults with stroke [53]. The primary reported drawback of using the WBB for medical assessment is the inconsistent sampling frequency [19]. However, in the design of the mWBB, this problem was addressed and solved [20]. The number of available variables derived from the trajectory of the CoP recorded in quiet stand varies greatly in the literature [54,55]. Most studies only analyze the total length of the CoP path and velocity in stance (time-domain “distance” measures), but further analysis of the other CoP indices can be useful to improve the reliability results, as shown in the present study, where time-domain “area”, time-domain “hybrid”, and frequency domain measures appear between the most reliable indices [36].
It is important to note that there was a high prevalence of physical deficit in both reliability test groups. All the participants presented strength deficits, and over 60% of the sample showed gait and balance deficits. The decline in balance with increased gait variability and lower limb strength [56,57] is associated with an increased risk of falls, resulting in measurements varying wildly from test to test. Despite this, the reliability results of the mWBB corroborate the hypothesis that it is a reliable instrument for assessing the balance in older adults.
For the inter-rater reliability, it is interesting to notice that four indices showed significant differences between raters. Comparisons between pairs of raters indicated that the number of highly correlated indices decreased when comparing Raters 1 and 2 with Rater 3 (see Table A6). The repeatability of the tests could be affected by the degree of the physical decline of the participants. Additionally, the little experience of the raters attending older adults with these characteristics also affected these results. Specifically, Rater 3 had shorter experience in geriatric care.
Our results showed that the CoP indices in the ML direction are the most reliable for intra-rater tests (Table 2). On the other hand, the parameters in the AP direction indicated greater reliability for the inter-rater tests (Table 3). The direction of the variation of the CoP indices depends on the muscles involved in maintaining balance and the contribution of the joints to postural oscillations [55,58]. Clinical and anthropometric factors influencing the CoP variables include sex, presence of vestibular impairments, comorbidities, height, weight, maximum foot width, base of support area, and foot opening angle [55,59]. However, as shown in Table 1, no significant difference was found in the characteristics between the individuals in the two samples. Therefore, given the high degree of physical deterioration of the participants, other features affect the sway direction in both reliability tests. Future research should include variables that affect balance in older people, such as the presence of dementia, depression, sarcopenia, or frailty [60,61,62,63].
Usability is one of the crucial requirements for health technology [64]. The System Usability Scale (SUS) is frequently used because of its validity and availability and its easy score interpretation. However, it is important to notice that it is a weak indicator of critical and severe usability issues compared to the task completion rates. It is a subjective evaluation instrument and only provides a general score of the usability [65]. Furthermore, a larger sample size of evaluators is needed to generalize the results. Therefore, despite the high usability score obtained by the mWBB, further research is needed to establish its use among health professionals who care for older adults.
Due to the high variability between methodological variables, there is no universal consensus on which CoP indices are the best to assess balance and risk of falling [35,55]. The majority of studies show AUC values between 0.7 and 0.8, most of them presenting sensitivity or specificity below 0.7 [35,66,67,68,69,70,71] (comparisons between studies can be found in [35]). Therefore, it is interesting to note that for the classification accuracy, the mean CoP velocity in the anterior-posterior direction with open-eyes (MVELAPOE) and the range of the anterior-posterior CoP with open-eyes (RANGEAPOE) presented: AUC = 0.747, sensitivity = 0.744, and specificity = 0.75 (equality of values for both indices is a coincidence). Furthermore, in our previous study of predictive validity [35], MVELAPOE had the best value of AUC to identify a balance deficit (AUC = 0.714, sensibility = 0.478, specificity = 0.930). We attributed the low level of sensibility to the fact that the studied population in [35] was independent, active, and without any acute conditions. Thus, further research is needed to select indices with high sensibility and specificity in intergroup classifications, depending on the origin of the equilibrium alterations.
Despite all benefits the WBB could bring as a measurement tool in clinical settings [24,72,73], there is an ongoing debate concerning its scientific value [12,25,26,27,28,29,30,31,32]. Some studies have raised concerns about the accuracy of the WBB, the interchangeability of the device with other force platforms, and its use in clinical applications. On the other hand, scientists and clinicians have drawn attention to the need for affordable evaluation tools in non-specialized clinics and less developed countries, regular follow-ups to adapt treatment according to the patient’s performance, and access to tools to prevent the risk of falls. The mWBB presented in this work aims to contribute to the development of more agile and better-adapted hardware and methods that can be available to more patients than current high-end solutions by solving the technical drawbacks of the WBB, and by demonstrating its capability to quantify balance deficits in older adults and the reliability of its measurements.
This study has some limitations. First, reliability tests should be performed under similar assessment conditions and the high degree of physical deterioration of the participants could have affected the tests. However, the results showed which indices were the most appropriate to assess older adults with these characteristics. Second, the difference between the years of experience of the evaluators could have affected the inter-rater reliability tests. Third, a larger sample of experienced personnel is required to generalize the usability results. Fourth, a larger sample is needed to verify the classification accuracy. Finally, like most mass-produced technology, the WBB has a defined life cycle of availability and Nintendo is no longer producing it. However, as prior research has shown similar results between new and used WBBs [74], old platforms could still be used for physical function assessments. Furthermore, the same principle used on these boards is used in electronic bath scales still widely used and produced; these devices are also susceptible to be modified to serve as low-cost balance assessment devices.

5. Conclusions

Adding to the literature on the WBB as an acceptable, low-cost, portable, easy to use, and valid device for balance measurement, the mWBB is a reliable device to quantify the CoP displacement during balance tests in older adults, capable of discriminating between people with and without balance deficits.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph191711026/s1 CSV File: database.csv—Database used for the analysis.

Author Contributions

Conceptualization, E.H.-L., Á.G.E.-P. and L.P.-R.; Methodology, E.H.-L., Á.G.E.-P. and L.P.-R.; validation, Á.G.E.-P. and L.P.-R.; formal analysis, E.H.-L. and Á.G.E.-P.; investigation, E.H.-L., Á.G.E.-P. and M.E.M.-G.; resources, Á.G.E.-P.; data curation, E.H.-L. and L.P.-R.; writing—original draft preparation, E.H.-L., Á.G.E.-P., M.E.M.-G., R.M.-M., M.F.C.-V. and L.P.-R.; writing—review and editing, E.H.-L., Á.G.E.-P., M.E.M.-G., R.M.-M., M.F.C.-V. and L.P.-R.; visualization, E.H.-L. and L.P.-R.; supervision, Á.G.E.-P., R.M.-M., M.F.C.-V. and L.P.-R.; funding acquisition, L.P.-R. All authors have read and agreed to the published version of the manuscript.

Funding

The publication of this paper was supported by Instituto Nacional de Geriatría, México.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, approved by the Research Ethics Committee of the Faculty of Medicine of the Universidad Autónoma del Estado de México (registration number CONBIOETICA-15-CEI-002-20210531).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data bases are anonymized and available as Supplementary Material named database.csv.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyzes, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results. No support was received from Nintendo, the authors are not related in any form to Nintendo nor their subsidiaries, and the purpose of this project is purely scientific, dedicated to the development of knowledge.

Appendix A

Table A1. Description of the center of pressure (CoP) indices.
Table A1. Description of the center of pressure (CoP) indices.
CoP IndicesUnitsDescriptionFormula
RDmmResultant Distance time series R D n   =   A P n 2 + M L n 2 1 / 2     n   =   1 , ,   N .
MDISTmmMean Distance M D I S T = 1 / N R D n
MDISTMLmmMean Distance in Medial-Lateral displacement M D I S T M L = 1 / N M L n
MDISTAPmmMean Distance in Anterior-Posterior displacement M D I S T A P = 1 / N A P n
RDISTmmRMS distance value from the mean CoP R D I S T = 1 / N R D n 2 1 / 2
RDISTMLmmRMS distance of the Medial-Lateral time series R D I S T M L = 1 / N M L n 2 1 / 2
RDISTAPmmRMS distance of the Anterior-Posterior time series R D I S T A P = 1 / N A P n 2 1 / 2
RANGEmmMaximum distance between any two points (p1, p2) on the CoP path R A N G E = M a x d p 1 , p 2
RANGEMLmmRange of Medial-Lateral CoP time series R A N G E X = M a x M L
RANGEAPmmRange of Anterior-Posterior CoP time series R A N G E Y = M a x A P
MVELmm/sMean Velocity of the CoP M V E L O = T O T E X / T
MVELMLmm/sMean CoP Velocity in Medial-Lateral direction M V E L O M L = T O T E X M L / T
MVELAPmm/sMean CoP Velocity in Anterior-Posterior direction M V E L O A P = T O T E X A P / T
sRDmmStandar Deviation of the RD time series s R D = R D I S T 2 M D I S T 2 1 / 2
sAPMLmm2Covariance of Medial-Lateral & Anterior-Posterior data s A P M L = 1 / N M L n A P n
AREACCmm295% Confidence Circle Area A R E A C C = π M D I S T + 1.645   s R D 2
AREACEmm295% Confidence Ellipse Area A R E A C E = 6 π R D I S T A P 2   R D I S T M L 2 s A P M L 2 1 / 2
AREASWmm2/sSway Area of the CoP path per unit of time A R E A S W = 1 / 2 T n = 1 N 1 A P n + 1 M L n M L n + 1 A P n
MFREQHzMean Frequency of CoP M F R E Q = M V E L O / 2 π M D I S T
MFREQMLHzMean Frequency of Medial-Lateral CoP time series M F R E Q M L = M V E L O M L / 4 2 M D I S T M L
MFREQAPHzMean Frequency of Anterior-Posterior CoP time series M F R E Q A P = M V E L O A P / 4 2 M D I S T A P
FDPD-Fractal dimension that models the area of the stabilogram with a circle of diameter d = range F D P D = log N / log N d / T O T E X
FDCC-Fractal dimension based on AREACC F D C C = log N / log 2 N M D I S T + 1.645 s R D / T O T E X
FDCE-Fractal dimension based on AREACE F D C E = log N / log N 24 R D I S T A P 2   R D I S T M L 2 S A P M L 2 1 / 2 1 / 2 / T O T E X
TPOWERRDmm2/HzTotal Power of CoP Resultant Distance data μ 0 = m = 3 100 G R D m
TPOWERMLmm2/HzTotal Power of CoP Medial-Lateral data μ 0 M L = m = 3 100 G M L m
TPOWERAPmm2/HzTotal Power of CoP Anterior-Posterior data μ 0 A P = m = 3 100 G A P m
POWER50RDHz50% Power Frequency of Resultant Distance CoP data P O W E R 50 R D = m = 3 u G R D m 0.5 μ 0
POWER50MLHz50% Power Frequency of Medial-Lateral CoP data P O W E R 50 M L = m = 3 u G M L m 0.5 μ 0 M L
POWER50APHz50% Power Frequency of Anterior-Posterior CoP data P O W E R 50 A P = m = 3 u G A P m 0.5 μ 0 A P
POWER95RDHz95% Power Frequency of Resultant Distance CoP data P O W E R 95 R D = m = 3 u G R D m 0.95 μ 0
POWER95MLHz95% Power Frequency of Medial-Lateral CoP data P O W E R 95 M L = m = 3 u G M L m 0.95 μ 0 M L
POWER95APHz95% Power Frequency of Anterior-Posterior CoP data P O W E R 95 A P = m = 3 u G A P m 0.95 μ 0 A P
CFREQRDHzCentroidal Frequency of Resultant Distance CoP data C F R E Q R D = m = 3 100 m Δ f 2 G R D m /   μ 0 1 / 2  
CFREQMLHzCentroidal Frequency of Medial-Lateral CoP data C F R E Q M L = m = 3 100 m Δ f 2 G M L m / μ 0 M L   1 / 2
CFREQAPHzCentroidal Frequency of Anterior-Posterior CoP data C F R E Q A P = m = 3 100 m Δ f 2 G A P m   /   μ 0 A P   1 / 2
FREQDRD-Frequency Dispersion of Resultant Distance CoP data F R E Q D R D = 1 m = 3 100 m Δ f G R D m 2 / μ 0 m = 3 100 m Δ f 2 G R D m 1 / 2    
FREQDML-Frequency Dispersion of Medial-Lateral CoP data F R E Q D M L = 1 m = 3 100 m Δ f G M L m 2 / μ 0 M L m = 3 100 m Δ f 2 G M L m 1 / 2    
FREQDAP-Frequency Dispersion of Anterior-Posterior CoP data F R E Q D A P = 1 m = 3 100 m Δ f G A P m 2 / μ 0 A P m = 3 100 m Δ f 2 G A P m 1 / 2    
N is the number of data points included in the CoP time series (N = 2400 with open eyes and with closed eyes). T is the period of the time selected for analysis (T = 48 s in this work). G_x (m) is the discrete power spectral density (x stands for RD, ML or AP). u is the smallest integer that converges in recursive sums.

Appendix B

Table A2. Rater questionnaire on the usability of the modified Wii Balance Board (mWBB).
Table A2. Rater questionnaire on the usability of the modified Wii Balance Board (mWBB).
Strongly
Disagree
Strongly
Agree
1. I think I would like to use the mWBB frequently.1 ☐2 ☐3 ☐4 ☐5 ☐
2. I find the mWBB very complex.1 ☐2 ☐3 ☐4 ☐5 ☐
3. I think the mWBB is easy to use.1 ☐2 ☐3 ☐4 ☐5 ☐
4. I think I would need technical support to make use of the mWBB.1 ☐2 ☐3 ☐4 ☐5 ☐
5. I find the various functions of the mWBB well integrated.1 ☐2 ☐3 ☐4 ☐5 ☐
6. I think there is too much inconsistency in the mWBB.1 ☐2 ☐3 ☐4 ☐5 ☐
7. I think most people would learn to use the mWBB quickly.1 ☐2 ☐3 ☐4 ☐5 ☐
8. I find the mWBB quite uncomfortable to use.1 ☐2 ☐3 ☐4 ☐5 ☐
9. I feel very confident in using the mWBB.1 ☐2 ☐3 ☐4 ☐5 ☐
10. I needed to learn a lot of things before I could operate the mWBB properly.1 ☐2 ☐3 ☐4 ☐5 ☐

Appendix C

Table A3. Statistical analysis 78 CoP indices intra-rater.
Table A3. Statistical analysis 78 CoP indices intra-rater.
CoP IndicesTest
Mean (SD)
Retest
Mean (SD)
p-Value Shapiro–Wilk Testp-Value Means Difference Test
RDOE13,913.74 (6860.32)15,163.36 (6547.64)0.8100.268
MDISTOE5.79 (2.85)6.31 (2.72)0.8100.268
MDISTMLOE3.45 (1.83)3.96 (1.98)0.6380.063
MDISTAPOE3.83 (2.06)4.09 (1.86)0.6320.550
RDISTOE6.72 (3.37)7.22 (3.08)0.6290.311
RDISTMLOE4.41 (2.4)4.98 (2.49)0.9740.079
RDISTAPOE4.91 (2.69)5.06 (2.27)0.5580.772
RANGEOE33.09 (17.77)33.54 (15.78)0.7540.871
RANGEMLOE25.36 (15.46)28.23 (17.17)0.6730.237
RANGEAPOE30.14 (17.27)27.16 (12.31)0.9670.280
MVELOE21.52 (14.2)21.97 (13.75)0.021 *0.642
MVELMLOE9.65 (7.25)10.49 (8.04)1.0000.288
MVELAPOE17.09 (11.39)16.86 (10.41)0.002 *0.918
sRDOE3.39 (1.81)3.48 (1.51)0.0560.684
sAPMLOE−3.14 (5.91)−0.48 (14.53)0.3760.524
AREACCOE507.37 (497.54)534.65 (497.19)0.028 *0.535
AREACEOE480.76 (467.52)492.03 (501.33)0.1000.883
AREASWOE47.95 (52.87)51.52 (68.26)0.013 *0.501
MFREQOE0.58 (0.19)0.58 (0.35)0.000 *0.278
MFREQMLOE0.49 (0.17)0.48 (0.2)0.3970.817
MFREQAPOE0.78 (0.33)0.77 (0.47)0.030 *0.438
FDPDOE1.78 (0.14)1.78 (0.18)0.5290.930
FDCCOE1.94 (0.17)1.93 (0.26)0.0620.827
FDCEOE1.95 (0.16)1.96 (0.25)0.003 *0.569
TPOWERRDOE9.65 (12.65)8.67 (10.11)0.000 *1.000
TPOWERMLOE12.43 (16.54)12.39 (17.96)0.8210.985
TPOWERAPOE18.56 (30.14)13.01 (14.87)0.000 *0.836
POWER50RDOE0.52 (0.13)0.55 (0.28)0.006 *0.816
POWER50MLOE0.41 (0.1)0.37 (0.08)0.024 *0.265
POWER50APOE0.53 (0.17)0.58 (0.24)0.1130.389
POWER95RDOE2.08 (0.65)2.09 (0.81)0.4960.853
POWER95MLOE1.44 (0.82)1.37 (0.68)0.002 *0.820
POWER95APOE1.99 (0.68)2.08 (0.86)0.3150.466
CFREQRDOE1.02 (0.24)1.03 (0.4)0.044 *0.756
CFREQMLOE0.72 (0.24)0.7 (0.21)0.4630.484
CFREQAPOE0.98 (0.24)1.03 (0.39)0.2980.408
FREQDRDOE0.67 (0.04)0.66 (0.04)0.8780.582
FREQDMLOE0.63 (0.07)0.64 (0.05)0.1790.410
FREQDAPOE0.66 (0.06)0.64 (0.05)0.9680.297
RDCE16,923.1 (6812.85)17,838.53 (7641.53)0.005 *0.501
MDISTCE7.05 (2.83)7.43 (3.18)0.005 *0.501
MDISTMLCE4.02 (2.13)4.77 (2.41)0.1380.166
MDISTAPCE4.85 (2.03)4.69 (1.83)0.2100.565
RDISTCE8.14 (3.37)8.55 (3.69)0.023 *0.642
RDISTMLCE5.12 (2.82)6.08 (3.11)0.1180.156
RDISTAPCE6.08 (2.58)5.9 (2.3)0.2020.604
RANGECE40.48 (18.09)42.18 (20.48)0.7250.644
RANGEMLCE29.8 (17.87)36.98 (22.15)0.7880.159
RANGEAPCE35.53 (16.66)34.04 (12.66)0.2430.574
MVELCE27.49 (18.03)29.91 (14.18)0.7110.375
MVELMLCE12.42 (8.85)14.65 (8.18)0.8520.213
MVELAPCE21.84 (14.39)22.66 (11.35)0.035 *1.000
sRDCE4.06 (1.86)4.21 (1.94)0.8700.694
sAPMLCE−1.93 (10.24)0.57 (16.89)0.3000.449
AREACCCE694.38 (495.01)764.61 (562.87)0.023 *0.605
AREACECE634.3 (471.31)739.93 (544.89)0.001 *0.148
AREASWCE74.12 (73.45)79.52 (54.79)0.020 *0.569
MFREQCE0.59 (0.22)0.68 (0.38)0.000 *0.569
MFREQMLCE0.58 (0.3)0.57 (0.23)0.1340.822
MFREQAPCE0.77 (0.34)0.89 (0.56)0.000 *0.679
FDPDCE1.78 (0.13)1.83 (0.20)0.2200.268
FDCCCE1.95 (0.18)2.01 (0.27)0.004 *0.501
FDCECE1.98 (0.17)2.02 (0.26)0.031 *0.796
TPOWERRDCE12.27 (10.66)12.94 (10.68)0.2800.780
TPOWERMLCE19.79 (21.94)25.63 (26.64)0.007 *0.642
TPOWERAPCE20.89 (14.7)20.88 (15.75)0.9960.996
POWER50RDCE0.57 (0.12)0.66 (0.38)0.010 *0.495
POWER50MLCE0.4 (0.1)0.39 (0.13)0.2930.793
POWER50APCE0.54 (0.17)0.54 (0.28)0.008 *0.470
POWER95RDCE2.26 (0.64)2.3 (0.95)0.8540.817
POWER95MLCE1.5 (0.82)1.59 (0.99)0.5900.225
POWER95APCE2.04 (0.81)2.09 (0.84)0.6850.754
CFREQRDCE1.08 (0.23)1.14 (0.48)0.1150.487
CFREQMLCE0.74 (0.25)0.79 (0.36)0.0710.347
CFREQAPCE0.99 (0.3)1.04 (0.42)0.0540.524
FREQDRDCE0.66 (0.03)0.65 (0.05)0.4550.287
FREQDMLCE0.64 (0.07)0.65 (0.07)0.6980.752
FREQDAPCE0.66 (0.03)0.66 (0.04)0.7190.574
* p-value < 0.05.
Table A4. Statistical analysis of intra-rater reliability 78 CoP indices.
Table A4. Statistical analysis of intra-rater reliability 78 CoP indices.
CoP IndicesCorrelation Coefficientp-Value Correlation CoefficientICC (IC 95%)
RDOE0.7910.000 *0.787 (0.502–0.919)
MDISTOE0.7910.000 *0.787(0.502–0.919)
MDISTMLOE0.8570.000 *0.832 (0.563–0.939)
MDISTAPOE0.6060.013 *0.612 (0.182–0.845)
RDISTOE0.8260.000 *0.882 (0.572–0.993)
RDISTMLOE0.8800.000 *0.883 (0.640–0.951)
RDISTAPOE0.6800.004 *0.683 (0.292–0.877)
RANGEOE0.7940.000 *0.799 (0.510–0.925)
RANGEMLOE0.8430.000 *0.834 (0.597–0.938)
RANGEAPOE0.7920.000 *0.745 (0.423–0.902)
MVELOE0.6290.009 *0.743 (0.491–0.995)
MVELMLOE0.9260.000 *0.920 (0.792–0.971)
MVELAPOE0.5940.015 *0.628 (0.263–0.993)
sRDOE0.8790.000 *0.868 (0.664–0.952)
sAPMLOE-0.1180.6620.086 (0.000–0.577)
AREACCOE0.7740.000 *0.817 (0.637–0.996)
AREACEOE0.8070.000 *0.815 (0.545–0.932)
AREASWOE0.7790.000 *0.788 (0.581–0.995)
MFREQOE0.7590.001 *0.627 (0.261–0.993)
MFREQMLOE0.7140.002 *0.719 (0.356–0.893)
MFREQAPOE0.6680.005 *0.561(0.131–0.991)
FDPDOE0.7800.000 *0.772 (0.455–0.995)
FDCCOE0.8020.000 *0.746 (0.406–0.904)
FDCEOE0.7650.001 *0.687 (0.380–0.994)
TPOWERRDOE0.6970.003 *0.660 (0.330–0.990)
TPOWERMLOE0.8540.000 *0.859 (0.640–0.949)
TPOWERAPOE0.6970.003 *0.590 (0.187–0.992)
POWER50RDOE0.5450.029 *0.409 (0.000–0.989)
POWER50MLOE0.4150.1100.492 (0.000–0.990)
POWER50APOE0.4510.0800.426 (0.000–0.753)
POWER95RDOE0.8840.000 *0.869 (0.665–0.952)
POWER95MLOE0.6040.013 *0.817 (0.638–0.996)
POWER95APOE0.8050.000 *0.788 (0.489–0.920)
CFREQRDOE0.7590.001 *0.792 (0.588–0.995)
CFREQMLOE0.8360.000 *0.834 (0.594–0.939)
CFREQAPOE0.8250.000 *0.734 (0.400–0.898)
FREQDRDOE0.2930.2720.300 (0.000–0.687)
FREQDMLOE0.7790.000 *0.762 (0.450–0.909)
FREQDAPOE0.1870.4890.183 (0.000–0.608)
RDCE0.6970.003 *0.789 (0.574–0.995)
MDISTCE0.6770.003 *0.784 (0.573–0.996)
MDISTMLCE0.6020.014 *0.581 (0.162–0.828)
MDISTAPCE0.8510.000 *0.851 (0.629–0.945)
RDISTCE0.6410.007 *0.780 (0.566–0.995)
RDISTMLCE0.6290.009 *0.608 (0.201–0.840)
RDISTAPCE0.8510.000 *0.852 (0.629–0.945)
RANGECE0.7290.001 *0.734 (0.387–0.898)
RANGEMLCE0.5490.028 *0.518 (0.078–0.796)
RANGEAPCE0.7840.000 *0.763 (0.445–0.910)
MVELCE0.8090.000 *0.788 (0.503–0.920)
MVELMLCE0.6770.004 *0.665 (0.288–0.867)
MVELAPCE0.7760.000 *0.809 (0.622–0.996)
sRDCE0.6890.003 *0.700 (0.324–0.884)
sAPMLCE0.6450.007 *0.578 (0.136–0.829)
AREACCCE0.6650.005 *0.622 (0.253–0.991)
AREACECE0.6940.003 *0.599 (0.205–0.992)
AREASWCE0.7710.000 *0.665 (0.337–0.993)
MFREQCE0.6560.006 *0.387 (0.000–0.989)
MFREQMLCE0.8030.000 *0.786 (0.485–0.920)
MFREQAPCE0.5150.041 *0.315 (0.000–0.986)
FDPDCE0.3370.1500.336 (0.000–0.701)
FDCCCE0.5790.019 *0.413 (0.000–0.984)
FDCECE0.7710.000 *0.648 (0.303–0.993)
TPOWERRDCE0.6150.011 *0.629 (0.200–0.854)
TPOWERMLCE0.7320.001 *0.441 (0.000–0.990)
TPOWERAPCE0.7530.001 *0.763 (0.438–0.911)
POWER50RDCE0.2830.2880.257 (0.000–0.986)
POWER50MLCE0.2000.4570.204 (0.000–0.633)
POWER50APCE0.7080.002 *0.488 (0.000–0.990)
POWER95RDCE0.6420.007 *0.611 (0.170–0.846)
POWER95MLCE0.9660.000 *0.948 (0.862–0.982)
POWER95APCE0.7880.000 *0.797(0.509–0.924)
CFREQRDCE0.6400.008 *0.511 (0.037–0.797)
CFREQMLCE0.8730.000 *0.819 (0.565–0.932)
CFREQAPCE0.8020.000 *0.763 (0.447–0.910)
FREQDRDCE0.4870.0560.431 (0.000–0.753)
FREQDMLCE0.2940.2690.306 (0.000–0.692)
FREQDAPCE0.0840.7570.083 (0.000–0.552)
* p-value < 0.05.

Appendix D

Table A5. Statistical analysis 78 CoP Indices inter-raters.
Table A5. Statistical analysis 78 CoP Indices inter-raters.
CoP IndicesRater 1
Mean (SD)
Rater 2
Mean (SD)
Rater 3
Mean (SD)
p-Value Shapiro–Wilk Testp-Value
Mauchly
Test
p-Value Means Difference Test
RDOE13,058.98 (4666.8)13,137.28 (4445.82)13,303.54 (5218.12)0.001 *-0.739
MDISTOE5.44 (1.94)5.47 (1.85)5.54 (2.17)0.001 *-0.739
MDISTMLOE3.32 (1.42)3.27 (1.41)3.26 (1.55)0.000 *-0.850
MDISTAPOE3.57 (1.28)3.69 (1.4)3.74 (1.59)0.002 *-0.911
RDISTOE6.26 (2.31)6.24 (2.1)6.39 (2.51)0.000 *-0.559
RDISTMLOE4.27 (1.91)4.06 (1.69)4.15 (1.98)0.000 *-0.643
RDISTAPOE4.48 (1.6)4.59 (1.7)4.7 (1.96)0.005 *-0.911
RANGEOE30.32 (16.01)29.17 (10.93)30.57 (13.21)0.021 *-0.614
RANGEMLOE25.38 (15.41)22.37 (9.53)24.19 (13)0.011 *-0.559
RANGEAPOE24.67 (9.47)24.89 (9.29)25.84 (10.76)0.028 *-0.911
MVELOE17.02 (8.98)15.88 (8.48)15.74 (8.08)0.000 *-0.368
MVELMLOE9.02 (3.8)8.58 (4.09)8.94 (5.07)0.000 *-0.327
MVELAPOE12.37 (7.77)11.44 (7.07)10.93 (5.84)0.000 *-0.404
sRDOE3.04 (1.37)2.98 (1.03)3.16 (1.3)0.000 *-0.521
sAPMLOE−0.3 (6.98)0.56 (9.96)1.78 (5.86)0.014 *-0.231
AREACCOE393.14 (311.15)376.14 (291.78)418.76 (346.14)0.000 *-0.811
AREACEOE381.28 (284.2)351.21 (282.74)394.51 (330.28)0.000 *-0.739
AREASWOE32.94 (27.16)30.43 (30.14)31.51 (33.39)0.000 *-0.320
MFREQOE0.51 (0.25)0.46 (0.18)0.45 (0.13)0.8270.003 *0.050 *
MFREQMLOE0.52 (0.21)0.49 (0.16)0.5 (0.16)0.3140.1630.532
MFREQAPOE0.62 (0.37)0.55 (0.27)0.53 (0.18)0.5330.0520.106
FDPDOE1.73 (0.14)1.71 (0.13)1.70 (0.11)0.3420.7110.105
FDCCOE1.88 (0.19)1.84 (0.16)1.84 (0.12)0.1660.1370.096
FDCEOE1.88 (0.19)1.86 (0.15)1.85 (0.13)0.9260.019 *0.092
TPOWERRDOE6.65 (5.67)5.86 (5.01)7.42 (7.04)0.000 *-0.534
TPOWERMLOE10.03 (8.78)8.62 (10.03)10.4 (13.03)0.000 *-0.811
TPOWERAPOE10.31 (9.12)10.09 (10.49)12.01 (13.45)0.000 *-0.643
POWER50RDOE0.51 (0.18)0.5 (0.15)0.47 (0.14)0.2090.021 *0.119
POWER50MLOE0.42 (0.14)0.41 (0.11)0.38 (0.1)0.2110.0610.172
POWER50APOE0.47 (0.17)0.43 (0.13)0.4 (0.12)0.1620.4560.017 *
POWER95RDOE1.81 (0.63)1.85 (0.64)1.79 (0.51)0.4710.2360.780
POWER95MLOE1.29 (0.5)1.3 (0.48)1.31 (0.35)0.1780.5650.924
POWER95APOE1.61 (0.77)1.59 (0.63)1.51 (0.54)0.2230.6550.478
CFREQRDOE0.91 (0.28)0.92 (0.27)0.89 (0.22)0.015 *-0.404
CFREQMLOE0.69 (0.21)0.69 (0.19)0.67 (0.15)0.9900.1050.703
CFREQAPOE0.83 (0.33)0.79 (0.25)0.76 (0.21)0.3690.1170.171
FREQDRDOE0.64 (0.04)0.64 (0.03)0.65 (0.04)0.7990.4640.170
FREQDMLOE0.6 (0.05)0.61 (0.04)0.63 (0.05)0.1060.5130.024 *
FREQDAPOE0.64 (0.05)0.65 (0.04)0.66 (0.05)0.8450.7420.040 *
RDCE17,296.17 (6462.15)16,478.23 (6700.75)16,437.95 (6259.03)0.1770.008 *0.470
MDISTCE7.2 (2.69)6.86 (2.79)6.84 (2.6)0.1770.008 *0.470
MDISTMLCE4.55 (2.14)4.36 (2.09)4.18 (2.02)0.5400.043 *0.395
MDISTAPCE4.6 (1.69)4.34 (1.71)4.48 (1.65)0.9160.0960.414
RDISTCE8.22 (3.11)7.88 (3.15)7.88 (2.98)0.1740.015 *0.565
RDISTMLCE5.67 (2.68)5.5 (2.61)5.32 (2.53)0.3500.033 *0.559
RDISTAPCE5.78 (2.13)5.51 (2.14)5.65 (2.09)0.5360.0900.515
RANGECE38.13 (15.11)37.76 (15.42)38.45 (15.66)0.8950.0630.958
RANGEMLCE31.05 (14.78)31.14 (14.65)30.89 (14.76)0.6580.016 *0.985
RANGEAPCE33.05 (13.42)32.77 (13.53)33.22 (14.29)0.1460.1650.979
MVELCE24.58 (12.71)23.4 (11.36)24.24 (15.06)0.000 *-0.977
MVELMLCE13.27 (6.89)13.19 (6.82)13.15 (8.9)0.000 *-0.739
MVELAPCE17.64 (10.32)16.3 (8.69)17.32 (10.98)0.000 *-0.739
sRDCE3.94 (1.61)3.85 (1.5)3.89 (1.49)0.4240.1100.866
sAPMLCE−1.05 (9.57)−0.48 (13.63)−0.7 (8.4)0.006 *-0.298
AREACCCE675.17 (529.15)631.34 (506.34)628.7 (433.01)0.5990.018 *0.720
AREACECE659.68 (539.88)628.36 (497.18)606.75 (428.13)0.9440.015 *0.702
AREASWCE63.54 (54.17)60.29 (55.83)60.86 (61.35)0.000 *-0.850
MFREQCE0.55 (0.25)0.55 (0.17)0.57 (0.23)0.009 *-0.433
MFREQMLCE0.55 (0.24)0.56 (0.19)0.56 (0.2)0.3150.1140.870
MFREQAPCE0.69 (0.36)0.68 (0.28)0.69 (0.33)0.004 *-0.850
FDPDCE1.78 (0.15)1.76 (0.13)1.76 (0.13)0.9910.0830.483
FDCCCE1.93 (0.2)1.92 (0.15)1.93 (0.18)0.2570.9960.961
FDCECE1.93 (0.2)1.93 (0.15)1.94 (0.18)0.026 *-0.739
TPOWERRDCE11.47 (9.05)11.18 (9.65)10.6 (8.64)0.003 *-0.643
TPOWERMLCE20.93 (23.84)21.43 (28.32)17.82 (21.91)0.000 *-0.811
TPOWERAPCE20.44 (18.44)19.18 (23.21)19.05 (17.26)0.000 *-0.521
POWER50RDCE0.52 (0.16)0.55 (0.14)0.54 (0.16)0.021 *-0.452
POWER50MLCE0.41 (0.14)0.41 (0.13)0.42 (0.12)0.2610.5890.897
POWER50APCE0.44 (0.15)0.46 (0.14)0.45 (0.15)0.003 *-0.180
POWER95RDCE1.98 (0.69)2.04 (0.6)2.06 (0.69)0.1850.035 *0.429
POWER95MLCE1.36 (0.54)1.42 (0.46)1.43 (0.42)0.6740.1280.444
POWER95APCE1.71 (0.76)1.74 (0.65)1.71 (0.69)0.025 *-0.959
CFREQRDCE0.97 (0.28)1 (0.25)1 (0.26)0.037 *-0.211
CFREQMLCE0.71 (0.23)0.74 (0.19)0.74 (0.18)0.2870.009 *0.477
CFREQAPCE0.84 (0.3)0.87 (0.28)0.84 (0.26)0.007 *-0.811
FREQDRDCE0.65 (0.04)0.64 (0.03)0.64 (0.04)0.2320.1290.880
FREQDMLCE0.61 (0.05)0.63 (0.05)0.62 (0.05)0.5580.1260.149
FREQDAPCE0.66 (0.06)0.65 (0.05)0.65 (0.05)0.7330.4170.816
* p-value < 0.05.
Table A6. Statistical analysis of inter-rater reliability 78 CoP indices.
Table A6. Statistical analysis of inter-rater reliability 78 CoP indices.
Cop IndicesICC(2,1) (CI 95%)Correlation Coefficient (p-Value)
Test 1–Test 2Test 1–Test 3Test 2–Test 3
RDOE0.714 (0.555–0.874)0.612 (0.000 *)0.635 (0.000 *)0.802 (0.000 *)
MDISTOE0.714 (0.541–0.888)0.612 (0.000 *)0.635 (0.000 *)0.802 (0.000 *)
MDISTMLOE0.665 (0.473–0.858)0.564 (0.000 *)0.591 (0.000 *)0.718 (0.000 *)
MDISTAPOE0.549 (0.295–0.803)0.419 (0.005 *)0.486 (0.001 *)0.633 (0.000 *)
RDISTOE0.722 (0.558–0.886)0.624 (0.000 *)0.622 (0.000 *)0.760 (0.000 *)
RDISTMLOE0.631 (0.392–0.871)0.577 (0.000 *)0.574 (0.000 *)0.698 (0.000 *)
RDISTAPOE0.571 (0.324–0.817)0.487 (0.001 *)0.543 (0.000 *)0.629 (0.000 *)
RANGEOE0.603 (0.439–0.743)0.646 (0.000 *)0.551 (0.000 *)0.544 (0.000 *)
RANGEMLOE0.432 (0.118–0.746)0.576 (0.000 *)0.529 (0.000 *)0.612 (0.000 *)
RANGEAPOE0.686 (0.533–0.840)0.599 (0.000 *)0.649 (0.000 *)0.551 (0.000 *)
MVELOE0.789 (0.676–0.901)0.782 (0.000 *)0.724 (0.000 *)0.719 (0.000 *)
MVELMLOE0.739 (0.594–0.884)0.645 (0.000 *)0.720 (0.000 *)0.597 (0.000 *)
MVELAPOE0.789 (0.665–0.914)0.844 (0.000 *)0.815 (0.000 *)0.866 (0.000 *)
sRDOE0.639 (0.441–0.836)0.643 (0.000 *)0.594 (0.000 *)0.645 (0.000 *)
sAPMLOE0.047 (0.000–0.585)0.072 (0.649)0.333 (0.029 *)0.132(0.400)
AREACCOE0.717 (0.569–0.865)0.623 (0.000 *)0.598 (0.000 *)0.720 (0.000 *)
AREACEOE0.732 (0.583–0.880)0.684 (0.000 *)0.613 (0.000 *)0.697 (0.000 *)
AREASWOE0.768 (0.604–0.932)0.730 (0.000 *)0.666 (0.000 *)0.638 (0.000 *)
MFREQOE0.652 (0.500–0.778)0.773 (0.000 *)0.679 (0.000 *)0.754 (0.000 *)
MFREQMLOE0.656 (0.506–0.781)0.643 (0.000 *)0.681 (0.000 *)0.697 (0.000 *)
MFREQAPOE0.584 (0.417–0.728)0.731 (0.000 *)0.610 (0.000 *)0.613 (0.000 *)
FDPDOE0.629 (0.473–0.761)0.722 (0.000 *)0.612 (0.000 *)0.591 (0.000 *)
FDCCOE0.712 (0.576–0.820)0.765 (0.000 *)0.716 (0.000 *)0.776 (0.000 *)
FDCEOE0.745 (0.620–0.842)0.783 (0.000 *)0.740 (0.000 *)0.825 (0.000 *)
TPOWERRDOE0.663 (0.482–0.844)0.777 (0.000 *)0.701 (0.000 *)0.613 (0.000 *)
TPOWERMLOE0.655 (0.413–0.898)0.671 (0.000 *)0.696 (0.000 *)0.711 (0.000 *)
TPOWERAPOE0.706 (0.557–0.855)0.740 (0.000 *)0.767 (0.000 *)0.709 (0.000 *)
POWER50RDOE0.639 (0.484–0.768)0.789 (0.000 *)0.537 (0.000 *)0.621 (0.000 *)
POWER50MLOE0.516 (0.341–0.677)0.691 (0.000 *)0.434 (0.004 *)0.486 (0.001 *)
POWER50APOE0.556 (0.382–0.708)0.602 (0.000 *)0.609 (0.000 *)0.570 (0.000 *)
POWER95RDOE0.663 (0.513–0.786)0.762 (0.000 *)0.658 (0.000 *)0.565 (0.000 *)
POWER95MLOE0.728 (0.596–0.830)0.799 (0.000 *)0.763 (0.000 *)0.661 (0.000 *)
POWER95APOE0.659 (0.508–0.783)0.688 (0.000 *)0.697 (0.000 *)0.642 (0.000 *)
CFREQRDOE0.739 (0.582–0.895)0.715 (0.000 *)0.574 (0.000 *)0.533 (0.000 *)
CFREQMLOE0.702 (0.563–0.813)0.830 (0.000 *)0.665 (0.000 *)0.624 (0.000 *)
CFREQAPOE0.720 (0.588–0.825)0.795 (0.000 *)0.746 (0.000 *)0.750 (0.000 *)
FREQDRDOE0.482 (0.303–0.650)0.500 (0.001 *)0.572 (0.000 *)0.389 (0.010 *)
FREQDMLOE0.424 (0.241–0.602)0.527 (0.000 *)0.490 (0.001 *)0.298 (0.053)
FREQDAPOE0.608 (0.445–0.746)0.575 (0.000 *)0.653 (0.000 *)0.672 (0.000 *)
RDCE0.663 (0.514–0.786)0.800 (0.000 *)0.655 (0.000 *)0.527 (0.000 *)
MDISTCE0.663 (0.514–0.786)0.800 (0.000 *)0.655 (0.000 *)0.527 (0.000 *)
MDISTMLCE0.647 (0.494–0.774)0.785 (0.000 *)0.600 (0.000 *)0.549 (0.000 *)
MDISTAPCE0.670 (0.522–0.790)0.717 (0.000 *)0.729 (0.000 *)0.559 (0.000 *)
RDISTCE0.666 (0.517–0.788)0.798 (0.000 *)0.652 (0.000 *)0.536 (0.000 *)
RDISTMLCE0.644 (0.490 -0.772)0.788 (0.000 *)0.581 (0.000 *)0.550 (0.000 *)
RDISTAPCE0.673 (0.527–0.793)0.738 (0.000 *)0.714 (0.000 *)0.560 (0.000 *)
RANGECE0.609 (0.455–0.747)0.725 (0.000 *)0.594 (0.000 *)0.496 (0.001 *)
RANGEMLCE0.598 (0.432–0.740)0.766 (0.000 *)0.497 (0.001 *)0.515 (0.000 *)
RANGEAPCE0.580 (0.410–0.726)0.643 (0.000 *)0.619 (0.000 *)0.467 (0.002 *)
MVELCE0.724 (0.567–0.880)0.734 (0.000 *)0.800 (0.000 *)0.706 (0.000 *)
MVELMLCE0.684 (0.495–0.872)0.749 (0.000 *)0.762 (0.000 *)0.764 (0.000 *)
MVELAPCE0.752 (0.594–0.911)0.788 (0.000 *)0.838 (0.000 *)0.696 (0.000 *)
sRDCE0.635 (0.477–0.766)0.752 (0.000 *)0.613 (0.000 *)0.519 (0.000 *)
sAPMLCE0.276 (0.000–0.667)0.276 (0.073)0.174 (0.264)0.213 (0.171)
AREACCCE0.571 (0.401–0.720)0.752 (0.000 *)0.618 (0.000 *)0.341 (0.025 *)
AREACECE0.587 (0.420–0.731)0.768 (0.000 *)0.597 (0.000 *)0.363 (0.017 *)
AREASWCE0.581 (0.312–0.850)0.829 (0.000 *)0.709 (0.000 *)0.698 (0.000 *)
MFREQCE0.732 (0.584–0.880)0.742 (0.000 *)0.800 (0.000 *)0.659 (0.000 *)
MFREQMLCE0.606 (0.442–0.745)0.633 (0.000 *)0.557 (0.000 *)0.662 (0.000 *)
MFREQAPCE0.819 (0.711–0.927)0.753 (0.000 *)0.849 (0.000 *)0.689 (0.000 *)
FDPDCE0.751 (0.628–0.846)0.834 (0.000 *)0.702 (0.000 *)0.741 (0.000 *)
FDCCCE0.766 (0.648–0.856)0.804 (0.000 *)0.788 (0.000 *)0.730 (0.000 *)
FDCECE0.742 (0.595–0.890)0.793 (0.000 *)0.806 (0.000 *)0.701 (0.000 *)
TPOWERRDCE0.499 (0.202–0.796)0.685 (0.000 *)0.597 (0.000 *)0.708 (0.000 *)
TPOWERMLCE0.320 (0.000–0.716)0.728 (0.000 *)0.659 (0.000 *)0.714 (0.000 *)
TPOWERAPCE0.370 (0.000–0.745)0.629 (0.000 *)0.641 (0.000 *)0.612 (0.000 *)
POWER50RDCE0.511 (0.270–0.752)0.419 (0.006 *)0.558 (0.000 *)0.598 (0.000 *)
POWER50MLCE0.550 (0.376–0.704)0.642 (0.000 *)0.497 (0.001 *)0.495 (0.001 *)
POWER50APCE0.762 (0.622–0.902)0.743 (0.000 *)0.769 (0.000 *)0.744 (0.000 *)
POWER95RDCE0.774 (0.660–0.861)0.860 (0.000 *)0.777 (0.000 *)0.697 (0.000 *)
POWER95MLCE0.725 (0.594–0.828)0.827 (0.000 *)0.680 (0.000 *)0.687 (0.000 *)
POWER95APCE0.809 (0.701–0.918)0.746 (0.000 *)0.813 (0.000 *)0.736 (0.000 *)
CFREQRDCE0.746 (0.606–0.885)0.707 (0.000 *)0.756 (0.000 *)0.683 (0.000 *)
CFREQMLCE0.711 (0.575–0.819)0.845 (0.000 *)0.631 (0.000 *)0.681 (0.000 *)
CFREQAPCE0.825 (0.717–0.934)0.743 (0.000 *)0.824 (0.000 *)0.753 (0.000 *)
FREQDRDCE0.485 (0.303–0.654)0.471 (0.005 *)0.471 (0.005 *)0.622 (0.000 *)
FREQDMLCE0.606 (0.444–0.744)0.713 (0.000 *)0.489 (0.000 *)0.623 (0.000 *)
FREQDAPCE0.568 (0.397–0.717)0.640 (0.000 *)0.519 (0.000 *)0.547 (0.000 *)
* p-value < 0.05

References

  1. Peterka, R.J. Sensory Integration for Human Balance Control. Handb. Clin. Neurol. 2018, 159, 27–42. [Google Scholar] [CrossRef] [PubMed]
  2. Matsumura, B.A.; Ambrose, A.F. Balance in the Elderly. Clin. Geriatr. Med. 2006, 22, 395–412. [Google Scholar] [CrossRef]
  3. Noh, J.W.; Kim, K.B.; Lee, J.H.; Lee, B.H.; Kwon, Y.D.; Heui Lee, S. The Elderly and Falls: Factors Associated with Quality of Life A Cross-Sectional Study Using Large-Scale National Data in Korea. Arch. Gerontol. Geriatr. 2017, 73, 279–283. [Google Scholar] [CrossRef] [PubMed]
  4. WHO. WHO Global Report on Falls Prevention in Older Age; WHO Library Cataloguing-in-Publication Data: Geneva, Switzerland, 2007; ISBN 978 92 4 156353 6. [Google Scholar]
  5. Oliver, D.; Daly, F.; Martin, F.C.; McMurdo, M.E.T. Risk Factors and Risk Assessment Tools for Falls in Hospital In-Patients: A Systematic Review. Age Ageing 2004, 33, 122–130. [Google Scholar] [CrossRef]
  6. Cost of Older Adult Falls | Home and Recreational Safety | CDC Injury Center. Available online: https://www.cdc.gov/homeandrecreationalsafety/falls/data/fallcost.html (accessed on 11 April 2021).
  7. Florence, C.S.; Bergen, G.; Atherly, A.; Burns, E.; Stevens, J.; Drake, C. Medical Costs of Fatal and Nonfatal Falls in Older Adults. J. Am. Geriatr. Soc. 2018, 66, 693–698. [Google Scholar] [CrossRef]
  8. Mancini, M.; Horak, F.B. The Relevance of Clinical Balance Assessment Tools to Differentiate Balance Deficits. Eur. J. Phys. Rehabil. Med. 2010, 46, 239. [Google Scholar] [PubMed]
  9. Park, S.H. Tools for Assessing Fall Risk in the Elderly: A Systematic Review and Meta-Analysis. Aging Clin. Exp. Res. 2018, 30, 1–16. [Google Scholar] [CrossRef]
  10. Renfro, M.; Maring, J.; Bainbridge, D.; Blair, M. Fall Risk among Older Adult High-Risk Populations: A Review of Current Screening and Assessment Tools. Curr. Geriatr. Rep. 2016, 5, 160–171. [Google Scholar] [CrossRef]
  11. Chen, B.; Liu, P.; Xiao, F.; Liu, Z.; Wang, Y. Review of the Upright Balance Assessment Based on the Force Plate. Int. J. Environ. Res. Public Health 2021, 18, 2696. [Google Scholar] [CrossRef] [PubMed]
  12. Bonnechère, B.; Jansen, B.; van Sint Jan, S. Cost-Effective (Gaming) Motion and Balance Devices for Functional Assessment: Need or Hype? J. Biomech. 2016, 49, 2561–2565. [Google Scholar] [CrossRef]
  13. Goble, D.J.; Cone, B.L.; Fling, B.W. Using the Wii Fit as a Tool for Balance Assessment and Neurorehabilitation: The First Half Decade of “Wii-Search”. J. Neuroeng. Rehabil. 2014, 11, 12. [Google Scholar] [CrossRef] [PubMed]
  14. Young, W.; Ferguson, S.; Brault, S.; Craig, C. Assessing and Training Standing Balance in Older Adults: A Novel Approach Using the “Nintendo Wii” Balance Board. Gait Posture 2011, 33, 303–305. [Google Scholar] [CrossRef] [PubMed]
  15. Sgrò, F.; Monteleone, G.; Pavone, M.; Lipoma, M. Validity Analysis of Wii Balance Board Versus Baropodometer Platform Using an Open Custom Integrated Application. AASRI Procedia 2014, 8, 22–29. [Google Scholar] [CrossRef]
  16. Kennedy, M.W.; Schmiedeler, J.P.; Crowell, C.R.; Villano, M.; Striegel, A.D.; Kuitse, J. Enhanced Feedback in Balance Rehabilitation Using the Nintendo Wii Balance Board. In Proceedings of the 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services, HEALTHCOM 2011, Columbia, MO, USA, 13–15 June 2011; pp. 162–168. [Google Scholar] [CrossRef]
  17. Menzies, R.J.; Rogers, S.J.; Phillips, A.M.; Chiarovano, E.; de Waele, C.; Verstraten, F.A.J.; MacDougall, H. An Objective Measure for the Visual Fidelity of Virtual Reality and the Risks of Falls in a Virtual Environment. Virtual Real. 2016, 20, 173–181. [Google Scholar] [CrossRef]
  18. Clark, R.A.; Bryant, A.L.; Pua, Y.; McCrory, P.; Bennell, K.; Hunt, M. Validity and Reliability of the Nintendo Wii Balance Board for Assessment of Standing Balance. Gait Posture 2010, 31, 307–310. [Google Scholar] [CrossRef]
  19. Clark, R.A.; Mentiplay, B.F.; Pua, Y.H.; Bower, K.J. Reliability and Validity of the Wii Balance Board for Assessment of Standing Balance: A Systematic Review. Gait Posture 2018, 61, 40–54. [Google Scholar] [CrossRef]
  20. Estévez-Pedraza, Á.G.; Martínez-Méndez, R.; Portillo-Rodríguez, O.; Parra-Rodríguez, L. Portable Device for the Measurement and Assessment of the Human Equilibrium. Ann. Biomed. Eng. 2020, 49, 933–945. [Google Scholar] [CrossRef]
  21. Pivnickova, L.; Dolinay, V.; Vasek, V. Evaluation of Static Posturography via the Wii Balance Board. In Proceedings of the 2014 15th International Carpathian Control Conference, ICCC 2014, Velke Karlovice, Czech Republic, 28–30 May 2014; IEEE Computer Society: Washington, DC, USA, 2014; pp. 437–441. [Google Scholar]
  22. Nagymate, G.; Vamos, B.; Kiss, R.M. Validation of the Nintendo Wii Balance Board for Stabilometry Measurements. In Proceedings of the 2016 International Symposium on Small-Scale Intelligent Manufacturing Systems, SIMS 2016, Narvik, Norway, 21–24 June 2016; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2016; pp. 111–114. [Google Scholar]
  23. Leach, J.M.; Mancini, M.; Peterka, R.J.; Hayes, T.L.; Horak, F.B. Validating and Calibrating the Nintendo Wii Balance Board to Derive Reliable Center of Pressure Measures. Sensors 2014, 14, 18244–18267. [Google Scholar] [CrossRef]
  24. Monteiro-Junior, R.; Ferreira, A.; Puell, V.; Lattari, E.; Machado, S.; Otero Vaghetti, C.; da Silva, E. Wii Balance Board: Reliability and Clinical Use in Assessment of Balance in Healthy Elderly Women. CNS Neurol. Disord. Drug Targets 2015, 14, 1165–1170. [Google Scholar] [CrossRef]
  25. Pagnacco, G.; Bundle, M.W.; Carrick, F.R.; Wright, C.H.G.; Oggero, E. Comments to the Replies to the to Letter to the Editor “Validity and Reliability of the Nintendo Wii Balance Board for Assessment of Standing Balance” by R.A. Clark et al. [Gait & Posture 31 (2010) 307–310]: Are the Conclusions Stated by the Authors Justified? Gait Posture 2014, 39, 1158–1161. [Google Scholar] [CrossRef]
  26. Zabjek, K. Emerging Technology within the Field of Active Gaming: Towards the Establishment of Evidence. Gait Posture 2014, 39, 1157–1158. [Google Scholar] [CrossRef] [PubMed]
  27. Young, W.R. We Need a Balanced Perspective in Wii-Search. Gait Posture 2014, 39, 1156–1157. [Google Scholar] [CrossRef] [PubMed]
  28. Reed-Jones, R.J. Current Limitations of the Wii’s Validity and What Should Be Considered for the Future. Gait Posture 2014, 39, 1155–1156. [Google Scholar] [CrossRef] [PubMed]
  29. Bingham, J.T. Technology from Non-Traditional Sources Should Not Be Immune from Scientific Rigor. Gait Posture 2014, 39, 1154–1155. [Google Scholar] [CrossRef]
  30. Stoffregen, T.A.; Bardy, B.G. When the WBB Is Useful, and When It Isn’t. Gait Posture 2014, 39, 1154. [Google Scholar] [CrossRef]
  31. Clark, R.A.; Hunt, M.; Bryant, A.L.; Pua, Y.-H. Author Response to the Letter: On “Validity and Reliability of the Nintendo Wii Balance Board for Assessment of Standing Balance”: Are the Conclusions Stated by the Authors Justified? Gait Posture 2014, 39, 1151–1154. [Google Scholar] [CrossRef]
  32. Pagnacco, G.; Bundle, M.W.; Carrick, F.R.; Wright, C.H.G.; Oggero, E. Letter to the Editor: On “Validity and Reliability of the Nintendo Wii Balance Board for Assessment of Standing Balance” by R.A. Clark et al. [Gait & Posture 31 (2010) 307–310]: Are the Conclusions Stated by the Authors Justified? Gait Posture 2014, 39, 1150–1151. [Google Scholar] [CrossRef]
  33. GHB Intellect. Is Reverse Engineering Legal? Available online: https://ghbintellect.com/is-reverse-engineering-legal/ (accessed on 8 August 2022).
  34. Legal Information Institute—Cornell Law School. Reverse Engineering. Available online: https://www.law.cornell.edu/wex/reverse_engineering#:~:text=Reverse%20engineering%20is%20generally%20legal,engineering%20is%20not%20a%20defense (accessed on 8 August 2022).
  35. Estévez-Pedraza, Á.G.; Parra-Rodríguez, L.; Martínez-Méndez, R.; Portillo-Rodríguez, O.; Ronzón-Hernández, Z. A Novel Model to Quantify Balance Alterations in Older Adults Based on the Center of Pressure (CoP) Measurements with a Cross-Sectional Study. PLoS ONE 2021, 16, e0256129. [Google Scholar] [CrossRef]
  36. Prieto, T.E.; Myklebust, J.B.; Hoffmann, R.G.; Lovett, E.G.; Myklebust, B.M. Measures of Postural Steadiness: Differences between Healthy Young and Elderly Adults. IEEE Trans. Biomed. Eng. 1996, 43, 956–966. [Google Scholar] [CrossRef] [PubMed]
  37. Khasnis, A.; Gokula, R.M. Romberg’s Test. J. Postgrad. Med. 2003, 49, 169. [Google Scholar]
  38. Centers for Disease Control and Prevention. Assessment Timed Up & Go (TUG). Available online: https://www.cdc.gov/steadi/pdf/STEADI-Assessment-TUG-508.pdf (accessed on 4 September 2021).
  39. Centers for Disease Control and Prevention. Assessment 30-Second Chair Stand. Available online: https://www.cdc.gov/steadi/pdf/STEADI-Assessment-30Sec-508.pdf (accessed on 4 September 2021).
  40. Centers for Disease Control and Prevention. The 4-Stage Balance Test. Available online: https://www.cdc.gov/steadi/pdf/4-Stage_Balance_Test-print.pdf (accessed on 4 September 2021).
  41. Yardley, L.; Beyer, N.; Hauer, K.; Kempen, G. Development and Initial Validation of the Falls Efficacy Scale-International (FES-I). Age Ageing 2005, 34, 614–619. [Google Scholar] [CrossRef] [PubMed]
  42. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155. [Google Scholar] [CrossRef] [PubMed]
  43. Brooke, J. SUS: A “Quick and Dirty” Usability Scale. Usability Eval. Ind. 1996, 207–212. [Google Scholar] [CrossRef]
  44. Bangor, A.; Kortum, P.T.; Miller, J.T. An Empirical Evaluation of the System Usability Scale. Int. J. Hum.-Comput. Interact. 2008, 24, 574–594. [Google Scholar] [CrossRef]
  45. Mukaka, M.M. A Guide to Appropriate Use of Correlation Coefficient in Medical Research. Malawi Med. J. 2012, 24, 69. [Google Scholar]
  46. Hulley, S.B.; Cummings, S.R.; Browner, W.S.; Grady, D.G.; Newman, T.B. Estimating Sample Size and Power: Applications and Examples. In Designing Clinical Research, 4th ed.; LWW: Philadelphia, PA, USA, 2013; pp. 55–83. [Google Scholar]
  47. Shieh, G. Sample Size Requirements for the Design of Reliability Studies: Precision Consideration. Behav. Res. Methods 2014, 46, 808–822. [Google Scholar] [CrossRef] [PubMed]
  48. Kimberlin, C.L.; Winterstein, A.G. Validity and Reliability of Measurement Instruments Used in Research. Am. J. Health Syst. Pharm. 2008, 65, 2276–2284. [Google Scholar] [CrossRef]
  49. Higgins, P.A.; Straub, A.J. Understanding the Error of Our Ways: Mapping the Concepts of Validity and Reliability. Nurs. Outlook 2006, 54, 23–29. [Google Scholar] [CrossRef]
  50. Weaver, T.B.; Ma, C.; Laing, A.C. Use of the Nintendo Wii Balance Board for Studying Standing Static Balance Control: Technical Considerations, Force-Plate Congruency, and the Effect of Battery Life. J. Appl. Biomech. 2017, 33, 48–55. [Google Scholar] [CrossRef]
  51. Scaglioni-Solano, P.; Aragón-Vargas, L.F. Validity and Reliability of the Nintendo Wii Balance Board to Assess Standing Balance and Sensory Integration in Highly Functional Older Adults. Int. J. Rehabil. Res. 2014, 37, 138–143. [Google Scholar] [CrossRef]
  52. Lee, J.; Webb, G.; Shortland, A.P.; Edwards, R.; Wilce, C.; Jones, G.D. Reliability and Feasibility of Gait Initiation Centre-of-Pressure Excursions Using a Wii® Balance Board in Older Adults at Risk of Falling. Aging Clin. Exp. Res. 2019, 31, 257. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Bower, K.J.; McGinley, J.L.; Miller, K.J.; Clark, R.A. Instrumented Static and Dynamic Balance Assessment after Stroke Using Wii Balance Boards: Reliability and Association with Clinical Tests. PLoS ONE 2014, 9, e115282. [Google Scholar] [CrossRef] [PubMed]
  54. Quijoux, F.; Vienne-Jumeau, A.; Bertin-Hugault, F.; Zawieja, P.; Lefèvre, M.; Vidal, P.-P.; Ricard, D. Center of Pressure Displacement Characteristics Differentiate Fall Risk in Older People: A Systematic Review with Meta-Analysis. Ageing Res. Rev. 2020, 62, 101117. [Google Scholar] [CrossRef]
  55. Quijoux, F.; Nicolaï, A.; Chairi, I.; Bargiotas, I.; Ricard, D.; Yelnik, A.; Oudre, L.; Bertin-Hugault, F.; Vidal, P.; Vayatis, N.; et al. A Review of Center of Pressure (COP) Variables to Quantify Standing Balance in Elderly People: Algorithms and Open-access Code. Physiol. Rep. 2021, 9, e15067. [Google Scholar] [CrossRef]
  56. Osoba, M.Y.; Rao, A.K.; Agrawal, S.K.; Lalwani, A.K. Balance and Gait in the Elderly: A Contemporary Review. Laryngoscope Investig. Otolaryngol. 2019, 4, 143–153. [Google Scholar] [CrossRef]
  57. Cho, K.H.; Bok, S.K.; Kim, Y.J.; Hwang, S.L. Effect of Lower Limb Strength on Falls and Balance of the Elderly. Ann. Rehabil. Med. 2012, 36, 386–393. [Google Scholar] [CrossRef] [PubMed]
  58. Winter, D.A.A. Human Balance and Posture Control during Standing and Walking. Gait Posture 1995, 3, 193–214. [Google Scholar] [CrossRef]
  59. Chiari, L.; Rocchi, L.; Cappello, A. Stabilometric Parameters Are Affected by Anthropometry and Foot Placement. Clin. Biomech. 2002, 17, 666–677. [Google Scholar] [CrossRef]
  60. Schülein, S.; Sieber, C.C.; Gaßmann, K.-G.; Ritt, M. Frail Older Individuals Maintaining a Steady Standing Position: Associations Between Sway Measurements with Frailty Status Across Four Different Frailty Instruments. Clin. Interv. Aging 2020, 15, 451–467. [Google Scholar] [CrossRef]
  61. Gadelha, A.B.; Neri, S.G.R.; de Oliveira, R.J.; Bottaro, M.; de David, A.C.; Vainshelboim, B.; Lima, R.M. Severity of Sarcopenia Is Associated with Postural Balance and Risk of Falls in Community-Dwelling Older Women. Exp. Aging Res. 2018, 44, 258–269. [Google Scholar] [CrossRef]
  62. Iaboni, A.; Flint, A.J. The Complex Interplay of Depression and Falls in Older Adults: A Clinical Review. Am. J. Geriatr. Psychiatry 2013, 21, 484–492. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Mc Ardle, R.; Pratt, S.; Buckley, C.; del Din, S.; Galna, B.; Thomas, A.; Rochester, L.; Alcock, L. Balance Impairments as Differential Markers of Dementia Disease Subtype. Front. Bioeng. Biotechnol. 2021, 9, 639337. [Google Scholar] [CrossRef] [PubMed]
  64. ISO 9241-11:2018 (En); Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts. ISO: Geneva, Switzerland, 2018. Available online: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:en (accessed on 27 June 2022).
  65. Broekhuis, M.; van Velsen, L.; Hermens, H. Assessing Usability of EHealth Technology: A Comparison of Usability Benchmarking Instruments. Int. J. Med. Inform. 2019, 128, 24–31. [Google Scholar] [CrossRef] [PubMed]
  66. Oliveira, M.R.; Vieira, E.R.; Gil, A.W.O.; Fernandes, K.B.P.; Teixeira, D.C.; Amorim, C.F.; da Silva, R.A. One-Legged Stance Sway of Older Adults with and without Falls. PLoS ONE 2018, 13, e0203887. [Google Scholar] [CrossRef]
  67. Fino, P.C.; Mojdehi, A.R.; Adjerid, K.; Habibi, M.; Lockhart, T.E.; Ross, S.D. Comparing Postural Stability Entropy Analyses to Differentiate Fallers and Non-Fallers. Ann. Biomed. Eng. 2016, 44, 1636–1645. [Google Scholar] [CrossRef]
  68. Howcroft, J.; Lemaire, E.D.; Kofman, J.; McIlroy, W.E. Elderly Fall Risk Prediction Using Static Posturography. PLoS ONE 2017, 12, e0172398. [Google Scholar] [CrossRef]
  69. Audiffren, J.; Bargiotas, I.; Vayatis, N.; Vidal, P.-P.; Ricard, D. A Non Linear Scoring Approach for Evaluating Balance: Classification of Elderly as Fallers and Non-Fallers. PLoS ONE 2016, 11, e0167456. [Google Scholar] [CrossRef]
  70. Kwok, B.-C.; Clark, R.A.; Pua, Y.-H. Novel Use of the Wii Balance Board to Prospectively Predict Falls in Community-Dwelling Older Adults. Clin. Biomech. 2015, 30, 481–484. [Google Scholar] [CrossRef]
  71. Hsieh, K.L.; Roach, K.L.; Wajda, D.A.; Sosnoff, J.J. Smartphone Technology Can Measure Postural Stability and Discriminate Fall Risk in Older Adults. Gait Posture 2019, 67, 160–165. [Google Scholar] [CrossRef]
  72. Clark, R.A.; Bell, S.W.; Feller, J.A.; Whitehead, T.S.; Webster, K.E. Standing Balance and Inter-Limb Balance Asymmetry at One Year Post Primary Anterior Cruciate Ligament Reconstruction: Sex Differences in a Cohort Study of 414 Patients. Gait Posture 2017, 52, 318–324. [Google Scholar] [CrossRef]
  73. Clark, R.A.; Seah, F.J.-T.; Chong, H.-C.; Poon, C.L.-L.; Tan, J.W.-M.; Mentiplay, B.F.; Pua, Y.-H. Standing Balance Post Total Knee Arthroplasty: Sensitivity to Change Analysis from Four to Twelve Weeks in 466 Patients. Osteoarthr. Cartil. 2017, 25, 42–45. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. Bartlett, H.L.; Ting, L.H.; Bingham, J.T. Accuracy of Force and Center of Pressure Measures of the Wii Balance Board. Gait Posture 2014, 39, 224–228. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Table 1. Characteristics of older adults that participated in the reliability tests.
Table 1. Characteristics of older adults that participated in the reliability tests.
CharacteristicIntra-Rater
n = 16
Inter-Rater
n = 43
p-Value
Age (years)75.66 (7.62)72.61 (7.86)0.264
Sex (women)9 (56.3%)19 (44.2%)0.409
Height (cm)154.68 (9.89)158.83 (11.17)0.191
Weight (kg)59.79 (9.54)65.09 (10.82)0.100
Gait deficit13 (81.3%)27 (62.8%)0.177
Leg-strength deficit16 (100%)43 (100%)-
Balance deficit13 (81.3%)30 (69.8%)0.378
Use of gait assistive devices4 (25%)9 (20.9%)0.737
Presence of lower limb prostheses4 (25%)6 (14%)0.315
Complete or partial visual impairment3 (18.3%)4 (9.3%)0.318
Partial hearing impairment3 (18.3%)3 (7%)0.183
Diabetes6 (37.5%)10 (23.3%)0.274
Hypertension4 (25%)12 (27.9%)0.823
Fear of falling (FES-I score ≥ 23)9 (56.3%)27 (62.8%)0.647
Fell last year9 (56.3%)21 (48.8%)0.613
Continuous variables are presented as Means and Standard Deviation (SD); categorical variables are presented as Frequencies (percentages). For intra-rater variables, there were one missing data for age and weight. For inter-rater variables, there were one missing data for age and height and two missing data for weight.
Table 2. Statistical analysis of CoP indices with the best level of reliability in intra-rater (test–retest) reliability.
Table 2. Statistical analysis of CoP indices with the best level of reliability in intra-rater (test–retest) reliability.
CoP IndicesTest
Mean (SD)
Retest
Mean (SD)
ICC (IC 95%)Correlation Coefficient
POWER95MLCE1.5 (0.82)1.59 (0.99)0.948 (0.862–0.982)0.966
MVELMLOE9.65 (7.25)10.49 (8.04)0.920 (0.792–0.971)0.926
RDISTMLOE4.41 (2.4)4.98 (2.49)0.883 (0.640–0.951)0.880
RDISTOE6.72 (3.37)7.22 (3.08)0.882 (0.572–0.993)0.826
POWER95RDOE2.08 (0.65)2.09 (0.81)0.869 (0.665–0.952)0.884
sRDOE3.39 (1.81)3.48 (1.51)0.868 (0.664–0.952)0.879
TPOWERMLOE12.43 (16.54)12.39 (17.96)0.859 (0.640–0.949)0.854
RDISTAPCE6.08 (2.58)5.9 (2.3)0.852 (0.629–0.945)0.851
MDISTAPCE4.85 (2.03)4.69 (1.83)0.851 (0.629–0.945)0.851
RANGEMLOE25.36 (15.46)28.23 (17.17)0.834 (0.597–0.938)0.843
CFREQMLOE0.72 (0.24)0.7 (0.21)0.834 (0.594–0.939)0.836
MDISTMLOE3.45 (1.83)3.96 (1.98)0.832 (0.563–0.939)0.857
CFREQMLCE0.74 (0.25)0.79 (0.36)0.819 (0.565–0.932)0.873
POWER95MLOE1.44 (0.82)1.37 (0.68)0.817 (0.638–0.996)0.604
AREACCOE507.37 (497.54)534.65 (497.19)0.817 (0.637–0.996)0.774
AREACEOE480.76 (467.52)492.03 (501.33)0.815 (0.545–0.932)0.807
MVELAPCE21.84 (14.39)22.66 (11.35)0.809 (0.622–0.996)0.776
All p-values of the correlation coefficients ≤ 0.001. For the intra-rater reliability, there was not a significant difference in any CoP indices between test and retest mean values. See Appendix C for the full results.
Table 3. Statistical analysis of CoP indices with the best level of reliability in the inter-rater.
Table 3. Statistical analysis of CoP indices with the best level of reliability in the inter-rater.
CoP IndicesRater 1
Mean (SD)
Rater 2
Mean (SD)
Rater 3
Mean (SD)
ICC(2,1) (CI 95%)
CFREQAPCE0.84 (0.3)0.87 (0.28)0.84 (0.26)0.825 (0.717–0.934)
MFREQAPCE0.69 (0.36)0.68 (0.28)0.69 (0.33)0.819 (0.711–0.927)
POWER95APCE1.71 (0.76)1.74 (0.65)1.71 (0.69)0.809 (0.701–0.918)
MVELAPOE12.37 (7.77)11.44 (7.07)10.93 (5.84)0.789 (0.665–0.914)
MVELOE17.02 (8.98)15.88 (8.48)15.74 (8.08)0.789 (0.676–0.901)
POWER95RDCE1.98 (0.69)2.04 (0.6)2.06 (0.69)0.774 (0.660–0.861)
AREASWOE32.94 (27.16)30.43 (30.14)31.51 (33.39)0.768 (0.604–0.932)
FDCCCE1.93 (0.2)1.92 (0.15)1.93 (0.18)0.766 (0.648–0.856)
POWER50APCE0.44 (0.15)0.46 (0.14)0.45 (0.15)0.762 (0.622–0.902)
MVELAPCE17.64 (10.32)16.3 (8.69)17.32 (10.98)0.752 (0.594–0.911)
FDPDCE1.78 (0.15)1.76 (0.13)1.76 (0.13)0.751 (0.628–0.846)
See Appendix D for the full results.
Table 4. Characteristics of raters that participated in the usability study.
Table 4. Characteristics of raters that participated in the usability study.
ID Age
[Years]
Experience in Geriatric Care and Management [Years]Professional ProfileSUS Score
Rater 1213.5Gerontology student100
Rater 2212.5Gerontology student90
Rater 3201.5Gerontology student82.5
Rater 43510Physiotherapist92.5
Rater 5328Physiotherapist97.5
Table 5. Statistical analysis of the 10 CoP indices with the highest area under the curve (AUC) related to presenting a balance deficit, optimal cut-off values for the indices, sensitivity and specificity.
Table 5. Statistical analysis of the 10 CoP indices with the highest area under the curve (AUC) related to presenting a balance deficit, optimal cut-off values for the indices, sensitivity and specificity.
CoP IndicesWithout Balance Deficit
n = 16
Mean (SD)
With Balance
Deficit
n = 43
Mean (SD)
Optimal Cut-Off PointAUCSensitivitySpecificity
MFREQAPOE0.59 (0.52)0.70 (0.30)0.43830.7780.930.625
AREASWOE18.50 (15.0)43.91 (39.24)15.47710.7740.8610.688
MVELOE12.51 (6.92)20.37 (11.15)15.84590.75210
MVELAPOE8.64 (5.96)15.52 (9.34)10.25510.7470.7440.75
RANGEAPOE18.89 (7.53)28.87 (12.52)20.36110.7470.7440.75
RANGEOE22.54 (10.35)34.25 (17.18)22.03630.7430.8610.625
RANGEXOE18.36 (9.44) 27.99 (16.29)18.20510.7390.7910.688
TPOWERAPOE6.16 (6.84)14.93 (19.72)6.98550.73210
sRDOE2.37 (1.05)3.43 (1.55)2.13030.7230.8840.563
AREACCOE256.28 (233.49)486.57 (393.27) 150.50370.6920.8840.5
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Estévez-Pedraza, Á.G.; Hernandez-Laredo, E.; Millan-Guadarrama, M.E.; Martínez-Méndez, R.; Carrillo-Vega, M.F.; Parra-Rodríguez, L. Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board. Int. J. Environ. Res. Public Health 2022, 19, 11026. https://doi.org/10.3390/ijerph191711026

AMA Style

Estévez-Pedraza ÁG, Hernandez-Laredo E, Millan-Guadarrama ME, Martínez-Méndez R, Carrillo-Vega MF, Parra-Rodríguez L. Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board. International Journal of Environmental Research and Public Health. 2022; 19(17):11026. https://doi.org/10.3390/ijerph191711026

Chicago/Turabian Style

Estévez-Pedraza, Ángel Gabriel, Enrique Hernandez-Laredo, María Elena Millan-Guadarrama, Rigoberto Martínez-Méndez, María Fernanda Carrillo-Vega, and Lorena Parra-Rodríguez. 2022. "Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board" International Journal of Environmental Research and Public Health 19, no. 17: 11026. https://doi.org/10.3390/ijerph191711026

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop