Next Article in Journal
A Portable, Neurostimulation-Integrated, Force Measurement Platform for the Clinical Assessment of Plantarflexor Central Drive
Previous Article in Journal
Feasibility of an Application-Based Outpatient Rehabilitation Program for Stroke Survivors: Acceptability and Preliminary Results for Patient-Reported Outcomes
Previous Article in Special Issue
A Biomechanical Simulation of Forearm Flexion Using the Finite Element Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill

Faculty of Sport and Health Sciences, University of Jyväskylä, 88610 Jyväskylä, Finland
*
Author to whom correspondence should be addressed.
Bioengineering 2024, 11(2), 136; https://doi.org/10.3390/bioengineering11020136
Submission received: 21 December 2023 / Revised: 23 January 2024 / Accepted: 26 January 2024 / Published: 29 January 2024
(This article belongs to the Special Issue Biomechanics-Based Motion Analysis, Volume II)

Abstract

:
In this study, we developed a deep learning-based 3D markerless motion capture system for skate skiing on a treadmill and evaluated its accuracy against marker-based motion capture during G1 and G3 skating techniques. Participants performed roller skiing trials on a skiing treadmill. Trials were recorded with two synchronized video cameras (100 Hz). We then trained a custom model using DeepLabCut, and the skiing movements were analyzed using both DeepLabCut-based markerless motion capture and marker-based motion capture systems. We statistically compared joint centers and joint vector angles between the methods. The results demonstrated a high level of agreement for joint vector angles, with mean differences ranging from −2.47° to 3.69°. For joint center positions and toe placements, mean differences ranged from 24.0 to 40.8 mm. This level of accuracy suggests that our markerless approach could be useful as a skiing coaching tool. The method presents interesting opportunities for capturing and extracting value from large amounts of data without the need for markers attached to the skier and expensive cameras.

1. Introduction

Marker-based motion capture systems have been used extensively in biomechanics research. Infrared marker-based systems are considered an accurate method, but with some challenges and disadvantages. Traditionally, marker-based systems are time-consuming, often limited to laboratory environments, and require expensive equipment and high-level expertise. It is challenging or impossible to use marker-based motion capture systems in several cases, for example, in sports competitions or games. There are also challenges related to the use of markers, such as soft tissue artifact and marker placement errors [1,2,3]. Moreover, marker-based systems show errors when compared with biplanar videoradiography [1,2]. For example, root mean squared error (RMSE) angular differences ranging between 1.06° and 8.31° have been observed during walking and running [2].
Deep learning-based human pose estimation methods have been extensively studied in the computer vision literature, especially during the past 10 years [4], and this provides opportunities for applying these methods to multiple use cases like markerless motion capture. Nowadays, several deep learning-based markerless methods provide opportunities for detecting human movements with moderate accuracy [5,6]. Markerless methods can facilitate the understanding of human movement in different contexts, for example, in sports biomechanics, sports medicine, injury risk assessment, and rehabilitation [7,8]. There are several open-source pose estimation algorithms available such as OpenPose [9] and DeepLabCut [10], and also some commercial products such as Theia3D (Theia Markerless Inc., Kingston, ON, Canada) and Microsoft Kinect V2. Naturally, there are some challenges with markerless methods, such as mistakes in manual labelling during model training and issues related to the training data quantity and quality [11].
Several studies have used markerless open-source deep learning-based methods to perform 2D kinematic analyses using a single-camera view [12,13,14,15]. For example, high Pearson correlations (>0.97) were found for shoulder and knee angles during static hold arm-raises and squats when evaluated against marker-based motion capture [14]. With multiple calibrated cameras, 2D open-source pose estimation methods can be used to successfully detect the 3D position of human joint centers, joint angles, and segment angles [16,17,18,19,20]. When compared with marker-based motion capture data, differences in joint center locations were approximately 15–50 mm for activities such as throwing, walking, running, and jumping [16,17,18]. Some differences were also found between different pose estimation algorithms such as OpenPose, AlphaPose, and DeepLabCut during walking, running, and jumping [17]. The characteristics of markerless video cameras were also found to have small effects on the results [16]. In some studies, lower limb joint angles and segment angles were primarily calculated when evaluating markerless motion analyses against marker-based systems [18,19]. In a fully automated 3D markerless motion capture workflow with OpenPose, lower limb joint angles were detected with mean differences ranging between −3.9° and 10.5°, and RMSEs ranging between 1.2° and 7.4° for hip, knee, and ankle joint rotations during jumping, walking, and running [19]. In a clinical approach, lower limb joint angles were detected with an RMSE ranging between 3.16° and 11.90° [18]. In addition, studies using the commercial markerless product Theia3D obtained quite similar results than with open-source methods [21,22,23]. For example, RMSDs were less than 2.5 cm for joint centers except the hip, and less than 5.5° for segment angles when comparing Theia3D markerless to marker-based motion capture during treadmill walking [22].
Cross-country skiing and especially skate skiing is a complex movement involving both lower and upper body muscles and skiing equipment. To date, studies have focused on the biomechanics of skiing when skiers need to quickly modify skiing techniques at different speeds and on different terrains [24]. It would be of interest to study whether a markerless system would be accurate enough to analyze and provide feedback on a skier’s skiing technique.
This study presents a DeepLabCut-based method that can be used for the 3D kinematic analysis of skate skiing on a treadmill. The method was used to determine joint centers and joint angles. The aim of this study was to compare our markerless motion capture system with a marker-based system in terms of skate skiing on a treadmill. It was hypothesized that our markerless motion capture system would be able to detect the joint centers and joint angles with about the same level of accuracy as previous similar studies, i.e., mean differences less than 50 mm for joint centers and mean differences between −5° and 5° for joint angles.

2. Materials and Methods

2.1. Participants and Experimental Protocol

Data from 13 female [Age: 21.7 ± 4.6 years] and 19 male [Age: 20.6 ± 7.5 years] athletes roller skiing with the G3 skating technique on a skiing treadmill were used to train the markerless model. The athletes were part of the Finnish junior national teams in cross-country skiing, biathlon and Nordic combined, and some were part of Vuokatti-Ruka sport academy. The athletes provided their consent to use their skiing videos in the development of the markerless models. Training data were collected during the athletes’ normal training sessions. The angle of the skiing treadmill ranged between two and three degrees, and the speed ranged between 12 and 30 km per hour in the training sessions. Two 20 s videos were recorded with two cameras from each athlete.
A total of 10 experienced skiers who were familiar with roller skiing on a skiing treadmill (5 females [Age: 21.0 ± 3.1 years; height: 1.73 ± 0.49 m; weight: 63.9 ± 7.3 kg] and 5 males [Age: 24.4 ± 10.7 years; height: 1.85 ± 0.69 m; weight: 81.0 ± 4.1 kg]) volunteered in the evaluation study and provided written informed consent. The participants used the same pair of roller skis (Marwe, Skating 620 XC, wheel No. 0) and poles of suitable length (Swix, Triac 3.0). Each participant had a single testing session, which included a static calibration where the participant stood still on the skiing treadmill to make sure that all markers were visible, and that the systems were working correctly. Then, the participant performed four roller skiing trials with the G1 skating technique (two for both sides), and three roller skiing trials with the G3 skating technique. The G1 skating technique is “a skating form of the diagonal stride technique of classic skiing, in which the leg and arm are employed diagonally, with a single pole-push with each contra-lateral leg-push in a skating-like fashion” [25]. With the G3 skating technique, the skier performs “one double-pole together with every leg push” [25]. Each roller skiing trial started when the skier struck the treadmill with the ski pole to enable the systems to be synchronized, and then included at least thirty seconds of skiing. G1 trials included about 20 skiing cycles, and G3 trials included at least 15 skiing cycles. A skate skiing cycle includes each leg pushing once. A G1 cycle includes one impact of the poles, and G3 cycle includes two impacts of the poles. The roller skiing trial protocol is shown in Table 1.

2.2. Motion Capture Systems and Laboratory Configuration

This study was conducted at the Skiing Laboratory of the University of Jyväskylä in Vuokatti, which is equipped with a 2.7 m × 3.5 m skiing treadmill (RL3500E, Rodby Innovation AB, Vänge, Sweden). In this study, we used two motion capture systems concurrently. Marker-based data were captured using an infrared 8-camera marker-based motion capture system (100 Hz, Vicon, Oxford, UK) and NEXUS 2.8.1 software (Vicon, Oxford, UK). The cameras were positioned around the skiing treadmill on the ceiling at a height of about 2.5 m. In addition, the Skiing Laboratory was equipped with video cameras (LILIN, Taiwei, New Taipei City, Taiwan) and a Coachtech online measurement and feedback system [26]. In this study, two video cameras capable of capturing 1280 × 720 resolution videos at 100 Hz were used for markerless motion capture. Videos were recorded using the Coachtech system. A sampling frequency of 100 Hz was used in both motion capture systems, as this was the maximum rate possible for the video cameras. The video cameras were positioned to the right side (Cam0, perpendicular to skiing direction) and right obliquely (Cam1, 45 degrees to skiing direction) from the skiing treadmill. Cam0 was at a height of 1.05 m and a distance of 2.00 m from the skiing treadmill. Cam1 was at a height of 2.5 m and a distance of 1.90 m from the skiing treadmill. The Skiing Laboratory configuration and both system’s camera placements are shown in Figure 1.

2.3. Markerless Model Development

A total of 64 videos from both markerless video cameras were used in the development of the markerless model. Markerless 3D models were developed using DeepLabCut, which is an open-source pose estimation method based on transfer learning with deep neural networks [10]. Two-dimensional models were trained for both video cameras separately using DeepLabCut, and pixel coordinates were later transformed to global 3D coordinates using the Direct Linear Transformation (DLT) algorithm [27]. Training images were selected randomly from the videos using DeepLabCut’s frame extraction method and imgaug algorithm. From each video, 15–20 images were selected, and about 1000 images per camera were used to train each 2D model. The images were manually labeled using DeepLabCut’s graphical user interface. Manually labeled markers were placed on the joint centers of the wrist, elbow, shoulder, hip, knee, and ankle. In addition, the tip of the skiing boot was labeled to reflect toe position. In the 2D models, only the right side of the skier was detected, as well as the right pole and right roller ski. Examples of the output of both 2D models are shown in Figure 2.
The labeled images were then used to train deep neural networks. Labeled images were collected and divided randomly into a 95% training and 5% test split using DeepLabCut’s training set creation method and imgaug algorithm. DeepLabCut’s default network configuration parameters were used. ResNet50 models for both video cameras were initialized with weights trained on ImageNet, and the cross-entropy loss between the predicted score map and the ground truth score map was minimized using stochastic gradient descent. The deep neural networks were trained with 700,000 iterations, and after training, the 2D models were evaluated using the 5% test split. The mean training error was 1.80 pixels (approximately 0.61 cm), and the mean test error was 2.27 pixels (approximately 0.77 cm) for the model of Cam0. The mean training error was 2.10 pixels (approximately 0.72 cm), and the mean test error was 2.63 pixels (approximately 0.89 cm) for the model of Cam1.

2.4. System Calibration Procedure

Both motion capture systems were calibrated before the measurements. The same origin and axis directions were used for both systems. The configuration of the coordinate system is shown in Figure 1. The origin was defined at the left side of the skiing treadmill. The x-axis (black in Figure 1) was defined as the latitudinal axis of the treadmill, the y-axis (gray in Figure 1) as the longitudinal axis of the treadmill, and the z-axis (black dashed line in Figure 1) as perpendicular to the treadmill, pointing upward.
With the markerless system, a calibration procedure was performed using an aluminum calibration cube that was 2 m long in each dimension. The calibration cube was placed on the skiing treadmill with one corner placed at the origin. The placements of the calibration cube and origin are shown in Figure 3. Eight points were selected, marked, and measured from the calibration cube. The selected points were used as calibration points resulting in eight known 3D coordinates. These calibration points were manually digitized from both markerless video cameras. Using these calibration coordinates, both video camera’s x- and y-coordinates were transformed to global 3D coordinates using the DLT algorithm [27].
For the marker-based system, the coordinate system was defined by placing a Vicon L-Frame on the treadmill, allowing the coordinate system origin and axis directions to be defined. The marker-based system calibration was performed using Vicon NEXUS 2.8.1 software.

2.5. Data Collecting and Processing

In the evaluation study, markerless data were captured using the Coachtech system with two video cameras. Videos were analyzed using the developed 2D models, and markerless data were filtered using a 4th order low-pass Butterworth filter (cut-off frequency, 12 Hz). The synchronization of the videos was ensured using the strokes of the pole on the treadmill from the beginning of each trial. The pixel coordinates were transformed to global 3D coordinates with the DLT algorithm. These 3D coordinates were further filtered with a 4th order low-pass Butterworth filter (cut-off frequency, 6 Hz). The filtering and coordinate transformation were performed using Matlab (v2021b, MathWorks, Inc., Natick, MA, USA).
Marker-based data were captured using a modified marker set comprising 39 individual passive reflective markers on the participant and 12 markers on the skiing equipment: three markers on both roller skis and three markers on both poles. The marker set is shown in Appendix A. The recorded data were labeled and visually verified using Vicon NEXUS 2.8.1 software. Marker trajectory data gap filling and marker-based data filtering with a 4th order low-pass Butterworth filter (cut-off frequency, 6 Hz) were performed using Vicon NEXUS 2.8.1 software. The joint centers of the wrist, elbow, knee, and ankle were computed from the mid-points of the lateral and medial markers. The shoulder joint center was computed from the mid-points of the anterior and posterior shoulder markers. The hip joint center was calculated using the method described by Bell et al. (1989) [28]. Toe markers were placed on top of the skiing boots due to the movement of the skiing boots and roller skis during skiing, so the toe marker positions slightly differed from the points detected by the markerless system. The toe marker placements for both systems are shown Figure 4. Static calibrations were used to determine the difference in each participant’s right toe placement between systems, and this was considered before statistical analysis. The joint center calculation and defining displacements of the right toe placement between systems were performed using Matlab.
From each skiing trial, 10 skiing cycles were selected and time normalized. The skiing cycles were defined using the right pole markers. The start of each skiing cycle was defined as the point at which the right pole touched the treadmill. To compare the performance of the markerless and marker-based systems, the 3D Euclidean distances of each right-side joint center and toe placement at each time point were calculated. In addition, the vector angles at the elbow, shoulder, hip, knee, and ankle were calculated from both systems to describe the movements of skiing. The elbow angle was defined as the supplement of the angle between the two 3D vectors connecting the elbow position to the wrist and shoulder positions. The hip angle was defined as the supplement of the angle between the two 3D vectors connecting the hip position to the shoulder and knee positions. The knee angle was defined as the supplement of the angle between the two 3D vectors connecting the knee position to the hip and ankle positions. These are thus a simplified proxy for the elbow, hip, and knee flexion angles. The shoulder angle was defined as the angle between the two vectors connecting the shoulder position to the elbow and hip positions. The shoulder angle thus reflects the angle between the upper arm and the upper body. The ankle angle was defined as the complement of the angle between the two vectors connecting the ankle position to the knee and toe positions. The ankle angle is thus a simplified proxy for the ankle plantar/dorsiflexion angle. All angles were calculated using Matlab.

2.6. Statistical Analysis

The systems were compared using Bland–Altman analyses [29]. For the joint centers and toe placements, the mean difference (bias), standard deviation (SD) and 95% limits of agreement (LoA) were calculated with a one-sample t-test. For the vector angles, the bias, SD, and LoA were calculated with a paired-sample t-test. Additionally, for the vector angles, the root mean squared errors (RMSE), Pearson correlations (r), and intra-class correlation coefficient (ICC) were computed to indicate validity between systems. For the Pearson correlations, coefficients were interpreted with values of <0.30, 0.30–0.50, 0.50–0.70, 0.70–0.90, and >0.90 representing negligent, low, moderate, high, and very high correlations, respectively [30]. The ICCs for absolute agreement were estimated based on a single measurement and two-way mixed effects model. The ICCs were used to indicate the agreement, with values of <0.50, 0.50–0.75, 0.75–0.90, and >0.90 representing the quality thresholds for poor, moderate, good, and excellent validity, respectively [31]. The statistical analyses were performed using SPSS 28.0.1.1 (IBM Corporation, Armonk, NY, USA), and the significance level was set at p ≤ 0.05.

3. Results

A total of 70 trials with 700 skiing cycles were compared between the markerless and marker-based systems: 40 trials with the G1 technique and 30 trials with the G3 technique. The results from the participants’ right sides are reported below.

3.1. Joint Centers and Toe Placements

The results of the comparisons between the systems for joint centers and toe placements are shown in Table 2.
For all participants, the mean difference ranged from 24 to 41 mm at the wrist, elbow, shoulder, hip, knee, and ankle joint centers and toe positions. For both techniques, the smallest systematic differences and LoA were observed at the shoulder joint center (G1: 26.6 mm; G3: 24.0 mm) with standard deviations of 19.7 mm (G1) and 14.1 mm (G3). The wrist joint center and toe placement displayed the largest systematic differences with the highest standard deviation and LoA with both techniques. The elbow, hip, knee, and ankle joint center mean differences were typically larger than those at the shoulder but smaller than that at the wrist or toe with their standard deviation and LoA following the same trend.
For both techniques, the mean (black) ± SD (gray, shaded area) time-series differences in the joint centers and toe placements are shown for a single participant in Figure 5. Two trials were selected from both techniques, so 20 time-normalized skiing cycles are included for each.

3.2. Joint Vector Angles

The results of the comparisons between the systems for joint vector angles are shown in Table 3.
Good levels of agreement were observed between the markerless and marker-based results. The Pearson correlations showed high to very high agreement between systems with the highest agreement in the elbow (0.97) and hip (0.97) angles for the G3 technique. The lowest Pearson correlations were observed for ankle angles with r-values of 0.82 and 0.84. The Pearson correlations were statistically significant (p < 0.001) for all joint vector angles and for both techniques. The ICC values also showed good to excellent validity between systems with the highest agreements in the elbow (0.97), shoulder (0.97), and hip (0.97) angles for the G3 technique. The lowest ICCs were observed for ankle angles with values of 0.80 and 0.77.
The mean differences in joint vector angles ranged between −2.47 and 3.69 degrees. The lowest systematic differences were observed at the elbow (<1°), but the standard deviation was the largest (>5°). For hip and knee angles, good agreement was observed with low mean differences (<1.1°) and a low standard deviation (<4°). The largest mean differences were observed for shoulder angles, most notably with the G1 technique with a mean difference and standard deviation of 3.69° ± 3.84°.
RMSE values ranged between 3.01 and 7.23 degrees for the joint vector angles. The lowest RMSE values were observed at the knee (<3.5°). For hip and knee angles, quite good agreement was observed with RMSE values < 5°. The largest RMSE values were observed for elbow angles (>5°).
For both skating techniques, time-normalized markerless (blue) and marker-based (red) joint vector angles and mean (black) ± SD (gray, shaded area) time-series differences for a single participant (P03) from a single skiing trial are shown in Figure 6. For both techniques, two trials and 20 skiing cycles are included.

4. Discussion

This study presents an evaluation of a 3D markerless motion capture system for skate skiing on a treadmill, focusing on the skier’s right-side joint centers and joint vector angles. Our markerless motion capture system was able to detect 3D kinematics with a good level of agreement relative to the marker-based motion analysis, most notably for the joint vector angles (Table 3).
Our markerless motion capture system can correctly detect joint centers during skate skiing (Table 2). The mean differences and standard deviations were generally lower with the G3 skating technique compared to with the G1 technique, which is probably because the markerless model was developed using videos from the G3 skating technique. It is noteworthy that during the skiing cycle, the accuracy of the markerless method varied slightly, even for the same participant (Figure 5). These results are in line with earlier studies, where the joint centers were detected using open-source markerless methods and marker-based systems during throwing, jumping, walking, and running [16,17,18]. Quite similar results were observed in an earlier study in detecting joint centers using OpenPose, AlphaPose, and DeepLabCut during walking, running, and jumping, with mean differences between 14 and 58 mm [17]. Similar results were also obtained in another previous study, where joint centers were detected using OpenPose with multiple synchronized video cameras during walking, countermovement jumping, and ball throwing, with mean absolute errors (MAE) of less than 30 mm in 80% of the trials [16]. Compared to a commercial markerless product, Theia3D, the results of joint center detection are also quite similar to those obtained with open-source markerless methods. For example, Theia3D detected lower limb joint centers with a root mean square of the 3D distances (RMSD) between 20 and 30 mm during countermovement jumping [21]. In another study, Theia3D detected lower and upper limb joint centers with average 3D Euclidean distances between 11 and 36 mm [22].
In the present study, the elbow, shoulder, hip, and knee joint vector angles consistently demonstrated very high levels of agreement between the markerless and marker-based systems, while the ankle joint vector angles demonstrated high levels of agreement (Table 3). These findings demonstrate that our 3D markerless motion capture system can correctly reproduce the movements of skate skiing. Additionally, the calculated joint vector angles differ slightly between systems during the skiing cycle (Figure 6), because joint center detection varies between systems (Figure 5). Our joint angle results are quite similar to those of previous studies using open-source markerless methods and commercial markerless products [19,23,32]. For example, joint angles have been detected using OpenPose during jumping, walking, and running with higher mean differences (between −3.9° and 10.5°) but lower standard deviations (between 1.8° and 4.4°) than in this study [19]. In another study, lower limb joint angles during gait in clinical patients were detected using Theia3D with RMSDs generally less than 6° [23]. Upper limb joint angles have been detected during static postures and basic movements (holding boxes) using Microsoft Kinect V2 with MAEs from 2.5° to 12.9° and using the Captiv system (L7000) with MAEs from 1.9° to 14.9° when compared to a goniometer [32]. The results of our study are therefore in line with those of previous studies related to open-source markerless methods and commercial markerless products.
The results of this evaluation study are highly promising, and the differences between systems typically fell within the known uncertainties of marker-based motion capture. The development process of the markerless model influences the system’s accuracy because the training images were labeled by a human and may thus include errors of judgement. In addition, the number, placements, and characteristics of the video cameras can affect the accuracy of a markerless motion capture system. However, marker-based systems also have inherent errors, which are mainly due to skin artifact. In previous studies, errors of up to ~8° have been reported when comparing marker-based motion capture to biplanar videoradiography for ankle joint rotations during walking and running [2], and knee flexion/extension angles during jumping [1]. Additionally, one previous study reported marker displacements of up to ~20 mm due to the effects of soft tissue artefacts at the knee during stair ascent using 3D fluoroscopy and a marker-based system [3]. It is noteworthy that the accuracies of marker-based systems also vary during the detected cycles (walking, running, jumping, and throwing) [1,2,3].
The differences observed in this study generally fall within the known challenges of marker-based motion capture, and it seems that our markerless motion capture system could be used especially as a skiing coaching tool. Cross-country skiing is developing all the time, with new modifications of subtechniques such as the “double-push” skating technique [33]. Race speeds have also increased, and this increases the importance of both skiing technique and skiing equipment [24]. Our markerless motion capture system presents interesting opportunities for cross-country skiing technique research and coaching. The markerless system combined with Coachtech system provides the results automatically [26], so changes in skiing technique could be viewed during training. There are several possibilities for using the markerless system from the coaching perspective. For example, the system provides possibilities for analyzing several parameters connected to technique in addition to joint angles, like body position and forward lean. Typically, the coach provides some instructions to the skier to change the skiing technique during training. With this markerless system, it can be determined whether the athlete has modified their skiing technique accordingly. In addition, it can be monitored how these technique changes influence, for example, the skiing economy and/or maximal skiing performance. In addition, this approach provides opportunities for capturing large amounts of skiing technique data. In the future, we could develop markerless models for other skating techniques (G4 and G5) and classic skiing.
Previous studies have provided information about propulsive forces during skiing [34,35]. In addition, the analysis of propulsive forces is important in the biomechanics of cross-country skiing, because it significantly affects the skiing speed. In the future, our markerless motion capture system could be used simultaneously with force sensors, for example, with the recently developed force measurement roller skis [36]. Thus, a more comprehensive analysis of the biomechanics of cross-country skiing could be obtained without additional equipment or markers.
In conclusion, we present and validate a markerless motion capture system that is low cost and easy to use for researchers and coaches. This markerless motion capture system could be used as a real-time coaching tool to monitor and improve skiing techniques.

Author Contributions

Conceptualization, P.T., S.Z., K.S.R., N.C., O.O. and V.L.; methodology, P.T., S.Z., K.S.R., N.C., O.O. and V.L.; software, P.T.; validation, P.T., K.S.R. and S.Z.; formal analysis, P.T.; investigation, P.T., K.S.R. and S.Z.; resources, P.T., K.S.R. and S.Z.; data curation, P.T.; writing—original draft preparation, P.T.; writing—review and editing, P.T., K.S.R., S.Z., N.C., O.O. and V.L.; visualization, P.T.; supervision, V.L.; project administration, V.L.; funding acquisition, V.L. All authors have read and agreed to the published version of the manuscript.

Funding

Research was funded partly by the “Smart Track” project (ERDF, 11853/09 020101/2021 Kainuu).

Institutional Review Board Statement

Ethical review and approval were waived for this study because the Human Sciences Ethics Committee of the University of Jyväskylä concluded that an ethical review, in this case, was not required.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are not publicly available because ethical restrictions were placed upon this data. In the informed consent form that was approved by the Research Ethical Committee, we stated that all data are confidential and will not be provided to third parties. Since it may be possible to identify individuals even after the anonymization of these data, our data cannot be shared publicly. Possible requests for limited data should be sent either to [email protected], to [email protected], or to the Secretary of the University of Jyvaskyla Ethical Committee at [email protected].

Acknowledgments

The authors would like to thank Timo Rantalainen for helping out in the coding process and all the athletes for participating.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

The marker set that was used in the evaluation study is shown in Table A1.
Table A1. Names, definitions, and positions for markers.
Table A1. Names, definitions, and positions for markers.
Marker NameDefinitionPosition on Participant/Skiing Equipment
OFFSETRight backAnywhere over the right scapula
LSHOLeft shoulderOn the acromioclavicular joint
LSHFLeft shoulder frontHumerus lesser tubercle
LSHBLeft shoulder backSame position as LSHF on the posterior side
LUPALeft upper armOn the upper lateral 1/3 surface of the left arm (placed asymmetrically with RUPA)
LELBLeft elbowOn the lateral epicondyle
LELBMLeft elbow medialOn the medial epicondyle
LFRMLeft forearmOn the lower lateral 1/3 surface of the left forearm (placed asymmetrically with RFRM)
LWRALeft wrist marker AAt the thumb side of a bar attached to a wristband on the posterior of the left wrist, as close to the wrist joint center as possible. Loose markers can be used, but for better tracking of the axial rotations, a bar is recommended.
LWRBLeft wrist marker BAt the little finger side of a bar attached to a wristband on the posterior of the left wrist, as close to the wrist joint center as possible. Loose markers can be used, but for better tracking of the axial rotations, a bar is recommended.
RSHORight shoulderOn the acromioclavicular joint
RSHFRight shoulder frontHumerus lesser tubercle
RSHBRight shoulder backSame position as RSHF on the posterior side
RUPARight upper armOn the lower lateral 1/3 surface of the right arm (placed asymmetrically with LUPA)
RELBRight elbowOn the lateral epicondyle approximating the elbow joint axis
RELBRight elbowOn the lateral epicondyle
RFRMRight forearmOn the lower lateral 1/3 surface of the right forearm (placed asymmetrically with LFRM)
RWRARight wrist marker AAt the thumb side of a bar attached symmetrically with a wristband on the posterior of the right wrist, as close to the wrist joint center as possible
RWRBRight wrist marker BAt the little finger side of a bar attached symmetrically with a wristband on the posterior of the right wrist, as close to the wrist joint center as possible
RPSIRight PSISRight posterior superior iliac spine (immediately below the sacroiliac joints, at the point where the spine joins the pelvis)
RASIRight ASISRight anterior superior iliac spine
LPSILeft PSISLeft posterior superior iliac spine (immediately below the sacroiliac joints, at the point where the spine joins the pelvis)
LASILeft ASISLeft anterior superior iliac spine
LTHILeft thighOver the lower lateral 1/3 surface of the left thigh
LKNELeft kneeOn the flexion–extension axis of the left knee
LTIBLeft tibiaOver the lower 1/3 surface of the left shank
LANKLeft ankleOn the lateral malleolus along an imaginary line that passes through the transmalleolar axis
LHEELeft heelOn the calcaneus at the same height above the plantar surface of the foot as the toe marker
LTOELeft toeOver the second metatarsal head, on the mid-foot side of the equinus break between forefoot and mid-foot
RTHIRight thighOver the upper lateral 1/3 surface of the right thigh
RKNERight kneeOn the flexion–extension axis of the right knee.
RTIBRight tibiaOver the upper 1/3 surface of the right shank
RANKRight ankleOn the lateral malleolus along an imaginary line that passes through the transmalleolar axis
RHEERight heelOn the calcaneus at the same height above the plantar surface of the foot as the toe marker
RTOERight toeOver the second metatarsal head, on the mid-foot side of the equinus break between forefoot and mid-foot
LKNEMLeft knee medialLeft medial femur condyles
RKNEMRight knee medialRight medial femur condyles
LANKMLeft ankle medialLeft medial malleolus
RANKMRight ankle medialRight medial malleolus
LSKI1Left Ski 1On the front side of the binding of the left roller ski, on the left edge, on the front side of LSKI2
LSKI2Left Ski 2On the front side of the binding of the left roller ski, on the left edge, on the back side of LSKI1
LSKI3Left Ski 3On the front side of the binding of the left roller ski, on the right edge, placed asymmetrically with LSKI1
RSKI1Right Ski 1On the front side of the binding of the right roller ski, on the right edge, on the front side of RSKI2
RSKI2Right Ski 2On the front side of the binding of the right roller ski, on the right edge, on the back side of RSKI1
RSKI3Right Ski 3On the front side of the binding of the right roller ski, on the left edge, placed asymmetrically with RSKI1
LPOLE1Left Pole 1At the top of the left pole, below the handle of the pole
LPOLE2Left Pole 2In the middle of the left pole, below LPOLE1
LPOLE3Left Pole 3At the bottom of the left pole, below LPOLE2
RPOLE1Right Pole 1At the top of the right pole, below the handle of the pole
RPOLE2Right Pole 2In the middle of the right pole, below RPOLE1
RPOLE3Right Pole 3At the bottom of the left pole, below RPOLE2

References

  1. Miranda, D.L.; Rainbow, M.J.; Crisco, J.J.; Fleming, B.C. Kinematic Differences between Optical Motion Capture and Biplanar Videoradiography during a Jump–Cut Maneuver. J. Biomech. 2013, 46, 567–573. [Google Scholar] [CrossRef]
  2. Kessler, S.E.; Rainbow, M.J.; Lichtwark, G.A.; Cresswell, A.G.; D’andrea, S.E.; Konow, N.; Kelly, L.A. A Direct Comparison of Biplanar Videoradiography and Optical Motion Capture for Foot and Ankle Kinematics. Front. Bioeng. Biotechnol. 2019, 7, 474006. [Google Scholar] [CrossRef]
  3. Tsai, T.-Y.; Lu, T.-W.; Kuo, M.-Y.; Lin, C.-C. Effects of Soft Tissue Artifacts on the Calculated Kinematics and Kinetics of the Knee during Stair-Ascent. J. Biomech. 2011, 44, 1182–1188. [Google Scholar] [CrossRef]
  4. Zheng, C.; Chen, C.; Yang, T.; Zhu, S.; Shah, M.; Wu, W.; Shen, J.; Kehtarnavaz, N.; Zheng, C.; Wu, W.; et al. Deep Learning-Based Human Pose Estimation: A Survey. J. ACM 2023, 56, 1–37. [Google Scholar] [CrossRef]
  5. Wang, J.; Tan, S.; Zhen, X.; Xu, S.; Zheng, F.; He, Z.; Shao, L. Deep 3D Human Pose Estimation: A Review. Comput. Vis. Image Underst. 2021, 210, 103225. [Google Scholar] [CrossRef]
  6. Desmarais, Y.; Mottet, D.; Slangen, P.; Montesinos, P. A Review of 3D Human Pose Estimation Algorithms for Markerless Motion Capture. Comput. Vis. Image Underst. 2021, 212, 103275. [Google Scholar] [CrossRef]
  7. Mündermann, L.; Corazza, S.; Andriacchi, T.P. The Evolution of Methods for the Capture of Human Movement Leading to Markerless Motion Capture for Biomechanical Applications. J. Neuroeng. Rehabil. 2006, 3, 6. [Google Scholar] [CrossRef] [PubMed]
  8. Colyer, S.L.; Evans, M.; Cosker, D.P.; Salo, A.I.T. A Review of the Evolution of Vision-Based Motion Analysis and the Integration of Advanced Computer Vision Methods Towards Developing a Markerless System. Sport. Med. Open 2018, 4, 24. [Google Scholar] [CrossRef] [PubMed]
  9. Cao, Z.; Hidalgo, G.; Simon, T.; Wei, S.E.; Sheikh, Y. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Trans. Pattern. Anal. Mach. Intell. 2021, 43, 172–186. [Google Scholar] [CrossRef] [PubMed]
  10. Mathis, A.; Mamidanna, P.; Cury, K.M.; Abe, T.; Murthy, V.N.; Mathis, M.W.; Bethge, M. DeepLabCut: Markerless Pose Estimation of User-Defined Body Parts with Deep Learning. Nat. Neurosci. 2018, 21, 1281–1289. [Google Scholar] [CrossRef] [PubMed]
  11. Cronin, N.J. Using Deep Neural Networks for Kinematic Analysis: Challenges and Opportunities. J. Biomech. 2021, 123, 110460. [Google Scholar] [CrossRef] [PubMed]
  12. Cronin, N.J.; Rantalainen, T.; Ahtiainen, J.P.; Hynynen, E.; Waller, B. Markerless 2D Kinematic Analysis of Underwater Running: A Deep Learning Approach. J. Biomech. 2019, 87, 75–82. [Google Scholar] [CrossRef] [PubMed]
  13. Vonstad, E.K.; Su, X.; Vereijken, B.; Bach, K.; Nilsen, J.H. Comparison of a Deep Learning-Based Pose Estimation System to Marker-Based and Kinect Systems in Exergaming for Balance Training. Sensors 2020, 20, 6940. [Google Scholar] [CrossRef] [PubMed]
  14. Slowik, J.S.; McCutcheon, T.W.; Lerch, B.G.; Fleisig, G.S. Comparison of a Single-View Image-Based System to a Multi-Camera Marker-Based System for Human Static Pose Estimation. J. Biomech. 2023, 159, 111746. [Google Scholar] [CrossRef] [PubMed]
  15. Kidziński, Ł.; Yang, B.; Hicks, J.L.; Rajagopal, A.; Delp, S.L.; Schwartz, M.H. Deep Neural Networks Enable Quantitative Movement Analysis Using Single-Camera Videos. Nat. Commun. 2020, 11, 4054. [Google Scholar] [CrossRef]
  16. Nakano, N.; Sakura, T.; Ueda, K.; Omura, L.; Kimura, A.; Iino, Y.; Fukashiro, S.; Yoshioka, S. Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras. Front. Sport Act. Living 2020, 2, 538330. [Google Scholar] [CrossRef] [PubMed]
  17. Needham, L.; Evans, M.; Cosker, D.P.; Wade, L.; McGuigan, P.M.; Bilzon, J.L.; Colyer, S.L. The Accuracy of Several Pose Estimation Methods for 3D Joint Centre Localisation. Sci. Rep. 2021, 11, 20673. [Google Scholar] [CrossRef]
  18. Ripic, Z.; Nienhuis, M.; Signorile, J.F.; Best, T.M.; Jacobs, K.A.; Eltoukhy, M. A Comparison of Three-Dimensional Kinematics between Markerless and Marker-Based Motion Capture in Overground Gait. J. Biomech. 2023, 159, 111793. [Google Scholar] [CrossRef]
  19. Needham, L.; Evans, M.; Wade, L.; Cosker, D.P.; McGuigan, M.P.; Bilzon, J.L.; Colyer, S.L. The Development and Evaluation of a Fully Automated Markerless Motion Capture Workflow. J. Biomech. 2022, 144, 111338. [Google Scholar] [CrossRef]
  20. Ripic, Z.; Theodorakos, I.; Andersen, M.S.; Signorile, J.F.; Best, T.M.; Jacobs, K.A.; Eltoukhy, M. Prediction of Gait Kinetics Using Markerless-Driven Musculoskeletal Modeling. J. Biomech. 2023, 157, 111712. [Google Scholar] [CrossRef]
  21. Strutzenberger, G.; Kanko, R.; Selbie, S.; Schwameder, H.; Deluzio, K. Assessment of Kinematic CMJ Data using a Deep Learning Algorithm-Based Markerless Motion Capture System. ISBS Proc. Arch. 2021, 39, 61. [Google Scholar]
  22. Kanko, R.M.; Laende, E.K.; Davis, E.M.; Selbie, W.S.; Deluzio, K.J. Concurrent Assessment of Gait Kinematics Using Marker-Based and Markerless Motion Capture. J. Biomech. 2021, 127, 110665. [Google Scholar] [CrossRef] [PubMed]
  23. Wren, T.A.L.; Isakov, P.; Rethlefsen, S.A. Comparison of Kinematics between Theia Markerless and Conventional Marker-Based Gait Analysis in Clinical Patients. Gait Posture 2023, 104, 9–14. [Google Scholar] [CrossRef] [PubMed]
  24. Sandbakk, Ø.; Holmberg, H.-C. A Reappraisal of Success Factors for Olympic Cross-Country Skiing. Int. J. Sport Physiol. Perform. 2014, 9, 117–121. [Google Scholar] [CrossRef] [PubMed]
  25. Pellegrini, B.; Sandbakk, Ø.; Stöggl, T.; Supej, M.; Ørtenblad, N.; Schürer, A.; Steiner, T.; Lunina, A.; Manhard, C.; Liu, H.; et al. Methodological Guidelines Designed to Improve the Quality of Research on Cross-Country Skiing. J. Sci. Sport Exerc. 2021, 3, 207–223. [Google Scholar] [CrossRef]
  26. Ohtonen, O.; Ruotsalainen, K.; Mikkonen, P.; Heikkinen, T.; Hakkarainen, A.; Leppävuori, A.; Linnamo, V. Online Feedback System for Athletes and Coaches. In Proceedings of the 3rd International Congress on Science and Nordic Skiing, Vuokatti, Finland, 5 June 2015; p. 35. [Google Scholar]
  27. Abdel-aziz, Y.; Karara, H. Direct Linear Transformation from Comparator to Object Space Coordinates in Close-Range Pho-Togramme. Photogramm. Eng. Remote Sens. 2015, 81, 103–107. [Google Scholar] [CrossRef]
  28. Bell, A.L.; Brand, R.A.; Pedersen, D.R. Prediction of Hip Joint Centre Location from External Landmarks. Hum. Mov. Sci. 1989, 8, 3–16. [Google Scholar] [CrossRef]
  29. Bland, J.M.; Altman, D.G. Measuring Agreement in Method Comparison Studies. Stat. Methods Med. Res. 1999, 8, 135–160. [Google Scholar] [CrossRef]
  30. Mukaka, M. Statistics Corner: A Guide to Appropriate Use of Correlation Coefficient in Medical Research. Malawi Med. J. 2012, 24, 69–71. [Google Scholar]
  31. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef]
  32. Steinebach, T.; Grosse, E.; Glock, C.; Wakula, J.; Lunin, A. Accuracy Evaluation of Two Markerless Motion Capture Systems for Measurement of Upper Extremities: Kinect V2 and Captiv. Hum. Factors Ergon. Manuf. Serv. Ind. 2020, 30, 291–302. [Google Scholar] [CrossRef]
  33. Stöggl, T.; Müller, E.; Lindinger, S. Biomechanical Comparison of the Double-Push Technique and the Conventional Skate Skiing Technique in Cross-Country Sprint Skiing. J. Sport Sci. 2008, 26, 1225–1233. [Google Scholar] [CrossRef] [PubMed]
  34. Stöggl, T.; Holmberg, H.-C. Three-Dimensional Force and Kinematic Interactions in V1 Skating at High Speeds. Med. Sci. Sport Exerc. 2015, 47, 1232–1242. [Google Scholar] [CrossRef] [PubMed]
  35. Göpfert, C.; Pohjola, M.V.; Linnamo, V.; Ohtonen, O.; Rapp, W.; Lindinger, S.J. Forward Acceleration of the Centre of Mass during Ski Skating Calculated from Force and Motion Capture Data. Sport Eng. 2017, 20, 141–153. [Google Scholar] [CrossRef]
  36. Zhao, S.; Linnamo, V.; Ruotsalainen, K.; Lindinger, S.; Kananen, T.; Koponen, P.; Ohtonen, O. Validation of 2D Force Measurement Roller Ski and Practical Application. Sensors 2022, 22, 9856. [Google Scholar] [CrossRef]
Figure 1. Skiing Laboratory configuration, camera placements, and coordinate system configuration.
Figure 1. Skiing Laboratory configuration, camera placements, and coordinate system configuration.
Bioengineering 11 00136 g001
Figure 2. Examples of images labeled by our 2D models: (a) from Cam0 and (b) from Cam1.
Figure 2. Examples of images labeled by our 2D models: (a) from Cam0 and (b) from Cam1.
Bioengineering 11 00136 g002
Figure 3. Placements of the calibration cube and origin (red circle) in the Skiing Laboratory: (a) from Cam0 and (b) from Cam1.
Figure 3. Placements of the calibration cube and origin (red circle) in the Skiing Laboratory: (a) from Cam0 and (b) from Cam1.
Bioengineering 11 00136 g003
Figure 4. (a) Toe marker placements for both the markerless and marker-based systems are shown in the red circle. The markerless toe marker is indicated by the yellow circle, and the marker-based marker appears as a gray circle. (b) Marker-based toe marker placement viewed from a different direction.
Figure 4. (a) Toe marker placements for both the markerless and marker-based systems are shown in the red circle. The markerless toe marker is indicated by the yellow circle, and the marker-based marker appears as a gray circle. (b) Marker-based toe marker placement viewed from a different direction.
Bioengineering 11 00136 g004
Figure 5. Example mean ± SD differences between markerless and marker-based joint centers and toe placements of a single participant (P03) during G1 and G3 skating technique cycles. The mean difference is shown as a black line, and the standard deviation as the shaded gray area.
Figure 5. Example mean ± SD differences between markerless and marker-based joint centers and toe placements of a single participant (P03) during G1 and G3 skating technique cycles. The mean difference is shown as a black line, and the standard deviation as the shaded gray area.
Bioengineering 11 00136 g005
Figure 6. Columns 1 and 3—Example time-normalized markerless (blue) and marker-based (red) joint vector angles for a single participant (P03) during G1 and G3 skating technique cycles. Columns 2 and 4—Mean (black) and ± SD (gray, shaded area) differences for each calculated joint vector angle during G1 and G3 skating technique cycles. For both skating techniques, two skiing trials are included, so 20 skiing cycles are visualized.
Figure 6. Columns 1 and 3—Example time-normalized markerless (blue) and marker-based (red) joint vector angles for a single participant (P03) during G1 and G3 skating technique cycles. Columns 2 and 4—Mean (black) and ± SD (gray, shaded area) differences for each calculated joint vector angle during G1 and G3 skating technique cycles. For both skating techniques, two skiing trials are included, so 20 skiing cycles are visualized.
Bioengineering 11 00136 g006
Table 1. Protocol of roller skiing trials, including the skiing technique, speed of treadmill, and angle of treadmill for each trial. Note that for G3, treadmill speeds differed for males (m) and females (f).
Table 1. Protocol of roller skiing trials, including the skiing technique, speed of treadmill, and angle of treadmill for each trial. Note that for G3, treadmill speeds differed for males (m) and females (f).
TrialSkiing TechniqueSpeed of Treadmill (km/h)Angle of Treadmill (deg)
1G185
2G168
3G185
4G168
5G312 f/14 m2
6G318 f/20 m2
7G324 f/26 m2
Table 2. Mean difference, standard deviation, and 95% limits of agreement for joint centers and toe placements.
Table 2. Mean difference, standard deviation, and 95% limits of agreement for joint centers and toe placements.
Detected PointSkiing TechniqueMean Difference (Bias) [mm]±SD [mm]95% LoA Lower/Upper
WristG140.330.140.4/40.5
G338.322.638.1/38.5
ElbowG133.628.933.3/33.8
G329.517.529.4/29.7
ShoulderG126.619.726.4/26.8
G324.014.123.9/24.1
HipG131.914.931.8/32.0
G331.316.131.2/31.5
KneeG130.516.630.4/30.7
G330.220.230.0/30.4
AnkleG131.517.031.4/31.6
G332.422.932.2/32.6
ToeG140.821.340.6/41.0
G339.429.739.1/39.7
Table 3. Mean difference, standard deviation, 95% limits of agreement, RMSE, Pearson correlation, and intra-class correlation coefficient for joint vector angles.
Table 3. Mean difference, standard deviation, 95% limits of agreement, RMSE, Pearson correlation, and intra-class correlation coefficient for joint vector angles.
AngleSkiing TechniqueMean Difference (Bias) [deg]±SD [deg]95% LoA
Lower/Upper
RMSE [deg]r
Pearson Correlation
p-ValueICC [Mean (95% Confidence Interval)]
ElbowG10.997.160.94/1.067.230.96<0.0010.96 (0.95/0.96)
G30.605.690.55/0.665.720.97<0.0010.97 (0.96/0.97)
ShoulderG13.693.843.66/3.725.330.94<0.0010.92 (0.87/0.97)
G32.713.762.68/2.744.640.96<0.0010.97 (0.95/0.98)
HipG11.084.061.05/1.124.210.94<0.0010.94 (0.92/0.95)
G30.743.480.72/0.783.560.97<0.0010.97 (0.96/0.97)
KneeG11.153.061.13/1.183.270.96<0.0010.95 (0.93/0.97)
G30.822.890.80/0.853.010.96<0.0010.96 (0.95/0.97)
AnkleG1−2.474.31−2.51/−2.444.960.82<0.0010.77 (0.59/0.86)
G3−2.034.23−2.07/−1.994.690.84<0.0010.80 (0.68/0.86)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Torvinen, P.; Ruotsalainen, K.S.; Zhao, S.; Cronin, N.; Ohtonen, O.; Linnamo, V. Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill. Bioengineering 2024, 11, 136. https://doi.org/10.3390/bioengineering11020136

AMA Style

Torvinen P, Ruotsalainen KS, Zhao S, Cronin N, Ohtonen O, Linnamo V. Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill. Bioengineering. 2024; 11(2):136. https://doi.org/10.3390/bioengineering11020136

Chicago/Turabian Style

Torvinen, Petra, Keijo S. Ruotsalainen, Shuang Zhao, Neil Cronin, Olli Ohtonen, and Vesa Linnamo. 2024. "Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill" Bioengineering 11, no. 2: 136. https://doi.org/10.3390/bioengineering11020136

APA Style

Torvinen, P., Ruotsalainen, K. S., Zhao, S., Cronin, N., Ohtonen, O., & Linnamo, V. (2024). Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill. Bioengineering, 11(2), 136. https://doi.org/10.3390/bioengineering11020136

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop