Next Article in Journal
Gain-Phase Errors Calibration for a Linear Array Based on Blind Signal Separation
Next Article in Special Issue
Using Magneto-Inertial Measurement Units to Pervasively Measure Hip Joint Motion during Sports
Previous Article in Journal
A Systematic Review of IoT Solutions for Smart Farming
Previous Article in Special Issue
The Influence of Proprioceptive Training with the Use of Virtual Reality on Postural Stability of Workers Working at Height
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Classification of Alpine Skiing Styles Using GNSS and Inertial Measurement Units

1
Salzburg Research Forschungsgesellschaft m.b.H., Techno-Z III, Jakob-Haringer-Straße 5, 5020 Salzburg, Austria
2
Department of Sport and Exercise Science, University of Salzburg, Schlossallee 49, 5400 Hallein/Rif, Austria
3
Athlete Performance Center—Red Bull Sports, 5020 Salzburg, Austria
4
Atomic Austria GmbH, Atomic Strasse 1, 5541 Altenmarkt, Austria
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(15), 4232; https://doi.org/10.3390/s20154232
Submission received: 26 May 2020 / Revised: 22 July 2020 / Accepted: 28 July 2020 / Published: 29 July 2020
(This article belongs to the Special Issue Human and Animal Motion Tracking Using Inertial Sensors)

Abstract

:
In alpine skiing, four commonly used turning styles are snowplow, snowplow-steering, drifting and carving. They differ significantly in speed, directional control and difficulty to execute. While they are visually distinguishable, data-driven classification is underexplored. The aim of this work is to classify alpine skiing styles based on a global navigation satellite system (GNSS) and inertial measurement units (IMU). Data of 2000 turns of 20 advanced or expert skiers were collected with two IMU sensors on the upper cuff of each ski boot and a mobile phone with GNSS. After feature extraction and feature selection, turn style classification was applied separately for parallel (drifted or carved) and non-parallel (snowplow or snowplow-steering) turns. The most important features for style classification were identified via recursive feature elimination. Three different classification methods were then tested and compared: Decision trees, random forests and gradient boosted decision trees. Classification accuracies were lowest for the decision tree and similar for the random forests and gradient boosted classification trees, which both achieved accuracies of more than 93% in the parallel classification task and 88% in the non-parallel case. While the accuracy might be improved by considering slope and weather conditions, these first results suggest that IMU data can classify alpine skiing styles reasonably well.

1. Introduction

The increasing miniaturization and efficiency of sensing hardware enable novel applications for low-friction activity monitoring. Today, a plethora of wearable consumer devices is available (see [1]). One category of sensors, the inertial measurement unit (IMU), is used in many consumer electronics to track motion and orientation in three-dimensional (3D) space [2]. They are a popular choice for health and sports applications, where they are mainly used to track equipment (e.g., [3,4]) and the human body (e.g., [5,6]).
This work classifies alpine skiing turns into four alpine skiing styles: snowplow, snowplow-steering, drifted and carved based on a global navigation satellite system (GNSS) and IMU data. These four skiing styles can be better understood as falling into one of two broad categories: Parallel and non-parallel. In parallel skiing, both skis act parallel to one another, while during non-parallel skiing, the skis are placed in a wedge [7].
This wedge position, commonly called snowplow, prevents acceleration while the skis are in the fall-line and is therefore a technique used frequently by skiing instructors for beginner skiers. As skiers develop more skills, they may initiate the turn using a snowplow but then complete the turn with the skis parallel. This technique is referred to as snowplow-steering and is the bridge between parallel and non-parallel turns [7]. In the drifting technique, the skier actively steers the skis throughout the turn. This can be accomplished by creating both an angle between the ski and snow (roll or edge-angle) and an angle between the ski and ski trajectory (yaw or steering angle) [8]. Finally, carving refers to the parallel technique in which the ski’s tip creates a groove in the snow which is followed by the rest of the ski, resulting in a self-steering effect [9]. Carving is the more dynamic of the two parallel styles and, generally, this technique used by competitive skiers during racing [10].
These four skiing styles are easily distinguishable by simply looking at the athlete’s posture, the skis’ orientations and their effect on the snow. However, an IMU-based system does not record these visual phenomena—at least, not directly. They record 3D acceleration and angular velocity, and any further features have to be derived in a feature extraction step (c.f. [11], step 3). Such derived features with relevance to alpine skiing include estimated inclination angle [12] and ski symmetry.
IMUs have already been used widely in the field of skiing to estimate skier pose or kinetics [13]. Estimated parameters range from whole body pose [14], trunk orientation [15] or center of mass kinematics [16] to quantification of vibration load on the lower back [17]. While these works present useful tools for performance evaluation or injury risk assessment, they are not feasible for implementation in a wearable system prepared for “plug-and-play” use. Current IMU based methods require calibration, large sensor-networks and offline post-processing in order to produce motion data. Recent work by this group has developed a framework and method for the automated online assessment of alpine skiing turns using a wearable system of IMUs [3,11,18].
Previous works have already used machine learning for classification problems in the context of winter sports. Various authors tried to classify IMU data into cross-country skiing techniques. Rindal et al. [19] used neural networks, while Jang et al. [20] compared convolutional neural networks and long-short term memory based deep learning classification models with k-nearest neighbor classification. Stöggl et al. [21] used Markov chains of Gaussian distributions. Groh et al. [22] classified freestyle snowboarding tricks using inertial-magnetic measurement unit data and naïve Bayes classifiers. There has been work done to use machine learning techniques to classify alpine skiing activities using IMUs [23,24]. However, the algorithm proposed by Han et al. [23] only classified between different activities, such as riding a chairlift, skiing groomed snow or skiing in slush; it did not classify within a skiing activity itself. Pawlyta et al. [24] focused on the analysis of skiing activity recognition, such as the recognition of the turn, the leg lift, the ski orientation and body position.
The purpose of this work was to develop an IMU based classifier, feasible for online implementation in a wearable system, to differentiate between skiing styles. We first conduct a pre-classification into parallel and non-parallel, perform a feature extraction, compare models with a variety of performance metrics and finally identify the most important features distinguishing between the four skiing techniques. The classified skiing turns can be further implemented within a framework such as the extended activity recognition chain (eARC) proposed by Brunauer and colleagues [11].

2. Materials and Methods

2.1. Sensors

The wearable system used to produce the data consisted of two IMUs (configuration: 2.5 × 3 × 1 Hz 0.83 mm, ±8 g and ±500 dps full scale resolution, board by Movesense [25]) mounted to the upper posterior cuff of each ski boot using a custom housing and strap. This housing was directed, i.e., it was impossible to attach the sensor to the boot in any other than the intended way. It also applied clamping pressure to the sensor, which together with the strap ensured that the sensor was not dislocated during skiing.
The Y axis of the IMU was aligned with the vertical axis of the boot pointing superiorly, the X with the lateral axis pointing to the right and the Z with the roll axis pointing posteriorly (see Figure 1). The output data rates of both 3D accelerometer and gyroscope were set to 833 Hz. The accelerometer signal was filtered by an analog anti-aliasing low-pass filter and again after analog/digital conversion by a digital low pass filter (cutoff 416.5 Hz). The gyroscope signal was filtered by a digital low-pass filter (cutoff 245 Hz). The filtered signals were sampled and transmitted via Bluetooth at 54 Hz to a smartphone running a custom Android application, where they were stored for further processing.
The IMU chips are factory-calibrated. A central requirement of the wearable system is its “plug and play” character; therefore, no further in-field sensor calibration was performed. While we understand that changes in environmental conditions could influence the measurements, we could not discern any differences between experiments and between individual systems, suggesting that external conditions have negligible impact. In addition, GNSS signals of a mobile phone (iPhone 6) were recorded at a sampling rate of 1 Hz.

2.2. Data

2.2.1. Data Generation

Twenty advanced skiers were recruited to participate in this study. All participants were either ski instructors or competitive alpine skiers, including three former FIS World Cup athletes. Participants were informed of the testing procedures in detail, including possible risks and benefits of the investigation, prior to signing the consent form as approved by the local ethics committee (EK-GZ. 11/2018). This experiment was conducted in accordance with the Declaration of Helsinki.
In order to construct a dataset containing as many skiing styles as possible, participants completed a series of nine skiing runs, performing at least ten consecutive turns of a given style per run. Video footage of each run confirmed that the participants were skiing according to the instructions.
The target turn radii were defined relative to the width of a snowcat track, which is approximately five meters. During the parallel-style runs (carving and drifting), participants completed one run each of long radius turns (≥three times snowcat track width ≈12 m), medium radius turns (≥two times snowcat track width ≈8 m) and short radius turns (<two times snowcat track width). Participants skied a total of six parallel-style runs.
During the non-parallel-style runs, participants performed a pure snowplow run and a snowplow-steering run in which the turn initiation and turning phases were skied in a snowplow, and the completion phase was skied in the parallel technique [8]. Finally, participants completed a “race” run, where participants were instructed to ski at their highest intensity or maximum performance. All trials were supervised by an investigator and repeated if the trial was not completed according to instructions.
All data collection occurred between January and March 2019 at three Austrian ski resorts. In order to control for slope conditions, all data collection took place on blue or red slopes. Data were collected in various snow conditions including freshly groomed, icy, soft and up to 10 cm of fresh snow. Table A5 in the Appendix A gives an overview of the snow conditions during data collection. Although not conducted in a systematic manner, this provides a diverse dataset of skiing with which to train a robust classifier.
All participants skied on the same commercially available recreational race skis. Long and medium radius turns were performed on giant slalom skis (Atomic Redster G9, 171/177/183 cm length, 18.6 m radius). Short radius and non-parallel turns were performed on slalom skis (Atomic Redster S9, 155/165 cm length, 12.7 m radius). Participants completed 2–3 runs on each ski prior to testing to familiarize themselves with the test skis.

2.2.2. Data Pre-Processing

The IMU hardware assigned a relative timestamp (i.e., milliseconds since power on) to each data point. In order to synchronize left and right IMU, the smartphone replaced the original timestamp with the phone’s timestamp at the time of data arrival minus some offset. This offset was half of the Bluetooth connection’s round-trip time, which was continuously re-calculated to avoid clock drift. With both IMU and GNSS data on the same timeline, the application resampled the IMU data together with the speed values at 54 Hz with linear interpolation. In case one of the two IMUs lost connection, the data of the still operational IMU were treated as both the left and right signal until the connection was automatically re-established. If both IMU lost connection simultaneously, the application stopped recording after 60 missed values (~1.1 s). Finally, one trial produced one labeled, multivariate time series of IMU data from both ski boots, synchronized to an absolute timestamp. For further analysis, the data from both accelerometer and gyroscope were filtered with a zero-lag, 4th order, low-pass Butterworth filter with a cutoff frequency of 6 Hz. This filter cutoff was chosen in order to maintain 95% of the signal power.
To give an idea of the signal shape for each style, Figure 2 and Figure 3 show the mean and standard deviation of the time normalized filtered absolute accelerometer and gyroscope signal of all turns within a run (without the first two “warm-up” turns). The data for these figures were extracted from one exemplary subject.
With respect to the extended activity recognition chain [11], these time series were pre-processed and segmented into individual turns before classification. This was implemented according to Martínez et al. [3,18]. This turn detection algorithm was designed specifically for alpine skiing and is not only accurate and precise but can process live data streams, meaning that turns can be automatically detected during the actual skiing activity without any additional action from the user. The first and last turn of each run were discarded to eliminate potentially atypical acceleration or deceleration. The final enriched and pre-processed data set used for classification consisted of 2063 individual turns (851 drifting, 920 carving, 201 snowplow and 91 snowplow-steering), each with 57 features (after feature extraction; see Section 2.3.2). Figure 4 illustrates the entire classification process.

2.2.3. Training and Testing Data

In order to train the classifiers and evaluate their performance, the enriched turn data were split into two subsets (see Figure 5). A total of 75% of all turns were used as the training set with which the models were generated using 5-fold cross validation. The remaining 25% served as test data to validate the trained model, discover possible overfitting and compare the final classification models. The turns were assigned randomly to either the training or the testing data set. As participants were a relatively heterogeneous mix of experts, runs were split record-wise in order to include a high number of heterogeneous participants and in order to avoid an underfitting of the model and a high classification error (see [26,27,28] for discussions on the topic of data splits).

2.3. Methods

2.3.1. Pre-Classification into Parallel and Non-Parallel

For pre-classification of the turn into parallel and non-parallel, a single decision tree was built with three features selected based on domain knowledge and visual data analysis over all available features: the maximum symmetry of the roll axis angular velocity, the maximum symmetry of the yaw axis angular velocity and the maximum absolute roll axis angular velocity. Figure 6 shows the distribution of these three features dependent on the skiing style. The boxplots indicate that the maximum roll axis angular velocity was much higher for parallel (carved and drifted) than for non-parallel turns (snowplow-steered and snowplow). The maximum symmetry of the yaw and roll axis angular velocity was on average smaller for parallel turns than for non-parallel.
After training the decision tree with 75% of the training data, the best model was determined to be a two-knot tree based on two final features: maximum absolute roll axis angular velocity (max_TD_AbsRate_Roll) and the maximum symmetry of the roll axis angular velocity (max_TD_Symmetry_Roll). Testing the tree with the 25% remaining test data resulted in an accuracy of 95.85%. Figure 7 shows the decision tree of the pre-classification model visually.

2.3.2. Feature Extraction

As visualized in Figure 4 several features were extracted from each turn’s filtered and unfiltered accelerometer and gyroscope signals. The extracted features can be broadly categorized into (i) statistics (mean, max, min, standard deviation) of the average filtered and unfiltered signal of the left and right IMU combined (e.g., the maximum gyroscope roll axis angular velocity of the turn), (ii) symmetry (i.e., absolute distance) between the left IMU and right IMU signal, (iii) features estimated from the phone’s GPS (speed and turn size) and (iv) skiing specific features, such as inclination angle [12] and resultant acceleration. Further descriptions of the features extracted and used for classification are listed in Table A2 and Table A3 in the Appendix A. The features extracted for this model are limited to those which can be calculated online during the feature extraction step (step 3, Figure 4) of the activity recognition chain.

2.3.3. Feature Selection

In order to decrease the number of features that were used to develop the following skiing style classification models, a preliminary feature selection was applied. Starting with a candidate feature set of 57 features per turn, we performed recursive feature elimination in combination with random forests, as explained by Granitto et al. [29]. In recursive feature elimination, the model is first fit with all candidate features. Then, the features are sorted by their importance in the model. At each iteration of the algorithm, only the top ranked features are kept and the model is refit with this reduced set of candidate features. In this work, models of the size 1, 2, 3, 4, 5, 10, 15 and 20 and all features as input variables were tested and compared via the accuracy metric on a cross-validated data set.

2.3.4. Classification Methods

This work compares three different classification approaches and focuses on tree-based algorithms for the classification of the alpine skiing style. In order to identify important features, we focused on algorithms whose explanation and interpretation degree are higher than in deep learning models [30,31]. The proposed methods are either directly explainable or interpretable post-hoc [31], which can therefore identify the distinction of alpine skiing styles’ important features: (i) decision trees [32], (ii) random forest [33] and (iii) gradient boosted decision trees [34].
Gupta et al. [35] mention advantages of decision trees, such as the easy interpretability and visualization, the possibility to handle categorical as well as numerical outcomes and the little data preparation that is required.
The random forest developed by Leo Breiman [33] is a bagging method and consists of multiple independent trees. Each tree is grown randomly by a bootstrapped sample of the training set. For each node, a subset of features is selected at random. Their best split is used to split the node [33].
The main idea of boosting is to combine a lot of weak classifiers and increase the accuracy due to this combination [36]. Boosted decision trees are a combination of a lot of weak decision trees and are explained by Hastie et al. [34]. Random forests and gradient boosted trees are slower to construct, but they are usually more robust and have better performance than single decision trees [37].
We generated three models using each of these learning algorithms and our training data set. To generate the simple decision tree, we used a recursive partitioning algorithm [38] which is mainly based on the classification and regression tree (CART) algorithm [32]. For the gradient boosted decision trees, the extreme gradient boosting (xgboost) algorithm [39] was applied.
Several parameters of the learning algorithms, such as the number of trees in a random forest, have to be chosen before model training. In order to find the best parameter setup for each model, cross-validation was used and the model parameters with the highest mean accuracy of the folds were chosen. Table A4 in the Appendix A lists the parameters used for all three algorithms. The feature selection as well as the model fitting were applied separately for parallel and non-parallel turns.

2.3.5. Performance Measures

In order to compare the classification performance of the models, four metrics for comparison were used: Accuracy, sensitivity, specitivity and the geometric mean. Furthermore, confusion matrices for a visual interpretation of the results are provided. In the alpine skiing ski style classification, two outcome classes for each of the two style classification problems exist. An unknown turn can be thus, if parallel, classified into drifting or carving or, if non-parallel, into snowplow-steering or snowplow. As the turn may be classified either correctly or incorrectly, four possible outputs exist for each of the two classification problems. Table 1 and Table 2 show the confusion matrices for the two classification cases in general.
Table 3 summarizes the performance metrics that were used for model comparison of the classifications numerically. Performance measures for classfication problems are described in detail by [40,41,42]. In the field of sports analytics, the most commonly used performance metric is accuracy [43]. In addition to accuracy, we also calculate sensititvity and specificity and report the geometric mean, as this measure is less sensitive to imbalanced data than other metrics [42].

2.4. Software

The algorithms and methods of this paper were calculated with the statistical software R [44]. The algorithms and libraries used for this analysis are listed in Table A1 in the Appendix A of this work.

3. Results

3.1. Feature Selection

The recursive feature elimination of the parallel turns showed that the accuracy of the cross-validated data set increased depending on the number of input features from 0.603 for one feature to 0.928 for all 57 features. As there was no large increase in accuracy between 25 and 57 features used (0.001 points—See Figure A1 in the Appendix A), the final prediction model for the parallel turns was calculated with the most important 25 features, which are listed in Table A2 in the Appendix A of this article.
In the case of the non-parallel turns, the recursive feature elimination process showed (see Figure A1 in the Appendix A) that accuracy was highest with 0.923 in the model containing 20 explanatory features and lowest with 0.752 for the single feature model. The list of the 20 features used for the classification of non-parallel turns is attached in Table A3 in the Appendix A.

3.2. Important Features for Classifcation of the Alpine Skiing Styles

The most important variables of the final decision tree for the parallel classification task were the maximum speed per turn, the standard deviation of the absolute roll axis angular velocity of the turn and the standard deviation of the gyroscope roll axis angular velocity of the turn. The non-parallel classification tree consisted of the mean of the maximum estimated inclination angle of the left and right foot of the turn, the mean of the maximum of the acceleration of the X-axis of left and right foot of the turn and the turn duration (see Figure A2 and Figure A3 in the Appendix A).
Figure 8 and Figure 9 show the 10 most important features for ski style classification of the gradient boosted tree and the random forest based on importance metrics. These metrics display the contribution of each variable based on the total gain of this variable’s splits and the mean decrease in Gini impurity (see [39,45] for descriptions of the metrics). The most important features for the classification models of the parallel turns were speed (maximum, minimum and mean of each turn), the standard deviation of the yaw axis angular velocity and the maximum gyroscope roll axis angular velocity of the turn.
For the non-parallel turn classification, the most important features in the models were the mean estimated inclination angle, the maximum symmetry of the roll axis angular velocity of the turn and the mean yaw axis angular velocity of the acceleration.

3.3. Comparison of Model Performance

Table 4 and Table 5 summarize the performance metrics of the three models. In the parallel case, the random forest and the gradient boosted decision tree performed similarly well. In the non-parallel case, the accuracy for the test set ranged from 0.822 to 0.890 and the geometric mean from 0.769 to 0.807. Again, as in the non-parallel case, the performance of the random forest and the boosted decision tree was similar, but sensitivity was smaller than specificity. This implies that the two non-parallel skiing styles were not predicted equally well.
Table 6, Table 7, Table 8, Table 9, Table 10 and Table 11 summarize the results of the decision tree, the random forest and the gradient boosted decision tree prediction with confusion matrices visually.
The classification of the parallel turns into carving and drifting with random forest and gradient boosted decision tree showed similar results. The random forest predicted 227 out of 242 carved and 193 out of 201 drifted turns correctly. The gradient boosted tree explained 232 out of 242 carved and 190 out of 201 drifted alpine skiing turns.
In the non-parallel classification task, the performance of the random forest and the gradient boosted tree were again similar. The random forest predicted 11 out of 16 snowplow-steering and 54 out of 57 snowplow turns correctly. The gradient boosted tree also explained 11 out of 16 snowplow-steering and 53 out of 57 snowplow turns.

4. Discussion

4.1. Classification Performance

The simplest method, a decision tree, is easily interpretable but performed worse compared to the other two classification methods applied in the current study. Both random forest and gradient boosted classification trees achieved accuracies of more than 93% in the parallel classification task (drifted versus carved) and 88% in the non-parallel case (snowplow versus snowplow-steering). This classification accuracy might be improved by considering slope and weather conditions. One further reason for the lower classification accuracy of the non-parallel turns may be due to the smaller sample size of the non-parallel turns available for the training of the algorithm.
Within the class of parallel turns, the drifted and carved turns were equally well predictable. As for non-parallel turns, the snowplow and snowplow-steered turn classifier showed smaller sensitivity than specificity, indicating that snowplow-steered turns were predicted more accurately than snowplow turns. Looking at individual misclassified turns did not imply a unique reason for turn style misclassification. Some misclassified carving turns that were incorrectly classified as drifted turns were slower and smaller turns than the corrected classified carved turns. On the other hand, some misclassified drifted turns that were misclassified as carved showed higher mean estimated inclination angle values than the corrected classified drifted turns. Additionally, in the non-parallel case, misclassified snowplow-steered turns that were wrongly classified as snowplow turns had lower mean and maximum estimated inclination angle values compared to correctly classified snowplow-steered turns.

4.2. Limitations

Although the classification models achieved an accuracy between 88.5% and 95.3% for parallel and 82.2% and 89.0% for non-parallel turns, the compared methods have disadvantages. Decision trees based on the CART algorithms may be unstable and split only by one variable [35]. Random forests, on the other hand, are more robust than decision trees but may be slow to construct [37]. Additionally, gradient boosted trees are slow to train and may suffer from overfitting [37].
Currently, the classification is based on a two-step process where the turn is first classified into parallel or non-parallel and then classified again into the detailed skiing styles. Further research may test and compare a one-step classification where the final skiing style is classified in a single step for a more general model.
As reported in the Methods section, the data for the trained model were generated by a limited number of participants and under controlled skiing conditions. Therefore, this algorithm is adequately prepared to classify skiing performed on moderate slopes with limited fresh snowfall. In order to validate the model with other conditions, such as powder snow, bumpy or mogul slopes, the model would need to be tested on additional data sets containing well labeled data from those conditions. In the same context, it is not yet known whether this model will be able to accurately classify skiing styles on various other slopes, such as flatter beginner slopes or extremely steep expert slopes.
As the turns included in this study were generated by intermediate and expert skiers, the classifier has only been validated for those skier abilities. Therefore, we suggest further validation of the algorithm on datasets containing additional skier abilities, including beginner skiers, that also can test the current trained model of possible overfitting.
In order to check the robustness of the suggested models, different random seeds for the splitting of the turns into training and testing data were set, and new models, based on these different random seeds, were developed with the different training sets. These models showed very similar classification performances for the parallel classification. Accuracies were lowest for the decision trees and highest for the gradient boosted trees. The random forest and gradient boosted tree showed accuracies between 92% and 94% for the parallel classification. Additionally, for the non-parallel classification, task accuracies were lowest for the decision tree. However, the accuracies of the non-parallel turns varied between 87% and 95% depending on the different seeds, which is why we conclude that the model for the non-parallel classification is not as robust as the parallel classification model. Although accuracies of the non-parallel classification were always larger than 87%, the models performed worse and were more unstable than the models for the parallel classification. We therefore suggest additional data collection of especially non-parallel skiing turns (snowplow-steering and snowplow) as additional observations of non-parallel turns may improve the model accuracies for the non-parallel classification.
Furthermore, instead of considering an isolated, single and independent turn for classification, it might be beneficial for the prediction accuracy to also consider recent turns when classifying the current turn and to account for dependencies between the turns. Applying deep learning methods, such as a convolutional neural network or a long short-term memory network [46] may also improve classification performance.

4.3. Application of the Classifier

The results of the proposed classifier are suitable for implementation within a framework such as the extended activity recognition chain (eARC) proposed by Brunauer and colleagues [11]. Previous work by this group has already implemented the preprocessing, segmentation [3,18] and feature extraction [12] steps of the eARC. This work presents a concrete example of the eARC’s fourth step-classification-and by doing so furthers the development of a data-driven, automated motor training and coaching system, as suggested by Kos et al. [47]. All algorithms used in the proposed processing chain are capable of analyzing live data streams and produce information about individual turns with little delay.

4.4. Sensor Setup

The sensor setup is simple, uses widely available hardware and can be replicated with low cost. It requires neither calibration routines nor any other special attention from the user. However, the proposed classification method uses two IMU sensors simultaneously for capturing left and right boot dynamics, respectively. This setup was able to capture symmetry information, which was shown to be an important factor for classifying the non-parallel styles. Future work could further investigate the relationship of the left and right ski and its impact on skiing performance.

5. Conclusions

We have presented a classifier based on GNSS and IMU data that is able to distinguish turns into four ski turn styles: drifting and carving (i.e., parallel turns) and snowplow and snowplow-steering (i.e., non-parallel turns). Overall, the gradient boosted decision trees produced slightly better models than the random forest. The prediction accuracy of the best models is over 95% and 89% for the classification of parallel and non-parallel turns, respectively. Nevertheless, we recommend further research that validates the accuracy of the boosted classification model with respect to different snow and slope conditions and various skill levels of the skiers.

Author Contributions

Conceptualization, C.S., R.B. and T.S.; methodology, C.N.; writing—original draft preparation, C.S., C.N. and W.K.; validation, C.N. and W.K.; formal analysis, C.N.; resources, H.H., C.S. and T.S.; data curation C.S.; writing—review and editing, T.S and R.B.; visualization, C.N. and W.K.; supervision, T.S.; project administration, T.S.; funding acquisition, T.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was partly funded by the Austrian Federal Ministry for Transport, Innovation and Technology, the Austrian Federal Ministry for Digital and Economic Affairs and the federal state of Salzburg.

Acknowledgments

The authors would like to thank the skiers for their participation and Verena Venek and Elisabeth Häusler for their support during the project.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1 lists the R packages and their versions (without package dependencies) used in this analysis. R was applied in version 3.6.1. [44].
Table A1. R packages.
Table A1. R packages.
R Package NameVersion
caret [48]6.0–84
data.table [49]1.12.2
tidyr [50]1.0.0
dplyr [51]0.8.3
packrat [52]0.5.0
randomForest [45]4.6–14
xgboost [39]0.90.0.2
rpart [38]4.1–15
rpart.plot [53]3.0.8
ggplot2 [54]3.2.1
Table A2 and Table A3 list the features used for alpine skiing style classification. Table A2 contains the used features for the prediction of drifted and carved turns based on recursive feature elimination. Table A3 lists the features for the prediction of the snowplow-steered and snowplow turns.
Table A2. List of features for drifted and carved turn prediction.
Table A2. List of features for drifted and carved turn prediction.
FeatureDescription
sd_TD_Gyro_YawStandard deviation of gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
max_SpeedMaximum speed of turn (m/s)
mean_SpeedMean speed of turn (m/s)
max_TD_Gyro_RollMax gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
min_SpeedMinimum speed of turn (m/s)
mean_EA_Edge_AngleMean estimated inclination angle of turn (mean of left and right boot) (rad/s)
Turn_DurationSecDuration of turn (s)
sd_TD_Gyro_RollStandard deviation of gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
sd_TD_Decision_YawStandard deviation of filtered (using a fourth-order, zero-lag, low-pass Butterworth filter with cut-off frequency of 0.5 Hz) yaw axis angular velocity of turn (mean of left and right boot) (rad/s)
max_TD_Gyro_YawMaximum yaw axis angular velocity of turn (mean of left and right boot) (rad/s)
mean_GYRO_Z_filtMean of the maximum of the gyroscope of the Z-axis of left and right foot of turn (rad/s)
max_TD_AbsRRate_RollMaximum absolute roll axis angular velocity of turn (mean of left and right boot) (rad/s)
max_TD_Decision_RollMaximum filtered (using a fourth-order, zero-lag, low-pass Butterworth filter with cut-off frequency of 0.5 Hz) roll axis angular velocity of turn (mean of left and right boot) (rad/s)
Turn_SizeSize of turn
sd_TD_AbsRRate_RollStandard deviation of absolute roll axis angular velocity of turn (mean of left and right boot) (rad/s)
sd_TD_Decision_RollStandard deviation of filtered (using a fourth-order, zero-lag, low-pass Butterworth filter with cut-off frequency of 0.5 Hz) roll axis angular velocity of turn (mean of left and right boot) (rad/s)
mean_TD_Gyro_Roll_filtMean gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
max_TD_Decision_YawMaximum filtered (using a fourth-order, zero-lag, low-pass Butterworth filter with cut-off frequency of 0.5 Hz) yaw axis angular velocity of turn (mean of left and right boot) (rad/s)
max_TD_Symmetry_RollMaximum symmetry of the roll axis angular velocity of turn between left and right boot (rad/s)
mean_GYRO_Y_filtMean of the maximum of the gyroscope Y-axis of left and right foot of turn (rad/s)
mean_TD_Gyro_YawMean gyroscope yaw axis angular velocity of turn (mean of left and right boot) (rad/s)
sd_TD_Symmetry_RollStandard deviation of the symmetry of the roll axis angular velocity of turn between left and right boot (rad/s)
mean_TD_Gyro_RollMean gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
max_EA_Edge_AngleMaximum estimated inclination angle of turn (mean of left and right boot) (degree)
EADiff_Left_RightMean difference of the absolute estimated inclination angle of left and estimated inclination angle of right foot of turn (degree)
Table A3. List of features for snowplow and snowplow-steered turn prediction.
Table A3. List of features for snowplow and snowplow-steered turn prediction.
FeatureDescription
Turn_DurationSecDuration of Turn (s)
mean_TD_Gyro_Roll_filtMean gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
max_TD_Symmetry_RollMaximum symmetry of the roll axis angular velocity of turn between left and right boot (rad/s)
max_EA_Edge_AngleMaximum estimated inclination angle of turn (mean of left and right boot) (degree)
locEA_Edge_AnglePosition (1–100) of the max estimated inclination angle of the turn
mean_EA_Edge_AngleMean estimated inclination angle of turn (mean of left and right boot) (degree)
mean_EA_Edge_AngleLeftRightMean of the maximum estimated inclination angle of the left and right foot of turn (degree)
mean_ACC_Z_filtMean of the maximum of the acceleration of the Z-axis of left and right foot of turn (m/s2)
mean_ACC_Y_filtMean of the maximum of the acceleration of the Y-axis of left and right foot of turn (m/s2)
mean_ACC_X_filtMean of the maximum of the acceleration of the X-axis of left and right foot of turn (m/s2)
mean_GF_GForce_PitchYawMean resultant frontal plane acceleration of turn (mean of left and right boot) (m/s2)
max_GF_GForce_PitchYawMaximum resultant frontal plane of turn (mean of left and right boot) (m/s2)
mean_GF_GForce_PitchYaw_LeftRightMean of the maximum resultant frontal plane acceleration of the left and right foot of turn (m/s2)
Left_Right_Acc_filtMean of the maximal acceleration of the left and right foot of each turn (m/s2)
mean_TD_AbsRRate_RollMean absolute roll axis angular velocity (mean of left and right boot) (rad/s)
mean_TD_Decision_RollFiltered (using a fourth-order, zero-lag, low-pass Butterworth filter with cut-off frequency of 0.5 Hz) roll axis angular velocity (mean of left and right boot) (rad/s)
mean_TD_Gyro_RollMean gyroscope roll axis angular velocity of turn (mean of left and right boot) (rad/s)
mean_TD_Symmetry_RollMean symmetry roll axis angular velocity of turn between left and right boot (rad/s)
sd_TD_Symmetry_RollStandard deviation of symmetry of the roll axis angular velocity of turn between left and right boot (rad/s)
sd_TD_Symmetry_YawStandard deviation of symmetry of the yaw axis angular velocity of turn between left and right boot (rad/s)
Table A4 lists the parameters used in the classification models.
Table A4. List of parameters used in models.
Table A4. List of parameters used in models.
ModelParameters
Parallel TurnsNon-Parallel Turns
Decision tree (package: rpart [38])cp = 0.05076923.cp = 0
Random Forest (package: randomForest [45])mtry= 2, ntree = 1000mtry= 13, ntree = 1000
Gradient boosted decision tree (package: xgboost [39])max.depth = 3
eta = 0.4
nrounds = 150
gamma =0
colsample_bytree = 0.68
min_child_weight = 1
subsample = 1
max.depth = 3
eta = 0.3
nrounds = 150
gamma =0
colsample_bytree = 0.6
min_child_weight = 1
subsample = 1
Table A5. Gives an overview of the snow conditions during data collection.
Table A5. Gives an overview of the snow conditions during data collection.
IDSnow Conditions
S01hard groomed
S03hard groomed
S04soft (5 cm new snow)
S05hardpack
S06hardpack
S07soft groomed
S08soft groomed
S09soft groomed
S10hard groomed
S11hard groomed
S12hard groomed
S14hardpack
S15hardpack
S16soft (6 cm new snow)
S17hardpack
S19hardpack
S20hardpack
S21hardpack groomed
S23ice
S24refrozen spring snow
Figure A1 displays the accuracy measure for the different subset sizes during the feature selection process for the parallel and non-parallel classification tasks.
Figure A1. Optimal number of features for the parallel and non-parallel model.
Figure A1. Optimal number of features for the parallel and non-parallel model.
Sensors 20 04232 g0a1
Figure A2 and Figure A3 plot the decision tree for the classification of the parallel and non-parallel turns.
Figure A2. Decision tree for the classification of the parallel turns (max_Speed = maximum speed of turn, sd_TD_AbsRRate_Roll = standard deviation of absolute roll axis angular velocity of turn, sd_TD_Gyro_Yaw = standard deviation of gyroscope roll axis angular velocity of the turn).
Figure A2. Decision tree for the classification of the parallel turns (max_Speed = maximum speed of turn, sd_TD_AbsRRate_Roll = standard deviation of absolute roll axis angular velocity of turn, sd_TD_Gyro_Yaw = standard deviation of gyroscope roll axis angular velocity of the turn).
Sensors 20 04232 g0a2
Figure A3. Decision tree for the classification of the non-parallel turns (mean_EA_Edge_AngleLeftRight = mean of the maximum estimated inclination angle of the left and right foot of turn, mean_ACC_X_filt = mean of the maximum of the acceleration of the X-axis of left and right foot of turn, Turn_DurationSec = duration of turn (in seconds)).
Figure A3. Decision tree for the classification of the non-parallel turns (mean_EA_Edge_AngleLeftRight = mean of the maximum estimated inclination angle of the left and right foot of turn, mean_ACC_X_filt = mean of the maximum of the acceleration of the X-axis of left and right foot of turn, Turn_DurationSec = duration of turn (in seconds)).
Sensors 20 04232 g0a3

References

  1. Peake, J.M.; Kerr, G.; Sullivan, J.P. A Critical Review of Consumer Wearables, Mobile Applications, and Equipment for Providing Biofeedback, Monitoring Stress, and Sleep in Physically Active Populations. Front. Physiol. 2018, 9, 1–19. [Google Scholar] [CrossRef] [PubMed]
  2. Aroganam, G.; Manivannan, N.; Harrison, D. Review on Wearable Technology Sensors Used in Consumer Sport Applications. Sensors 2019, 19, 1983. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Martínez, A.; Jahnel, R.; Buchecker, M.; Snyder, C.; Brunauer, R.; Stöggl, T. Development of an Automatic Alpine Skiing Turn Detection Algorithm Based on a Simple Sensor Setup. Sensors 2019, 19, 902. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. King, K.; Perkins, N.C.; Churchill, H.; McGinnis, R.; Doss, R.; Hickland, R. Bowling ball dynamics revealed by miniature wireless MEMS inertial measurement unit. Sport. Eng. 2011, 13, 95–104. [Google Scholar] [CrossRef]
  5. Al-Amri, M.; Nicholas, K.; Button, K.; Sparkes, V.; Sheeran, L.; Davies, J.; Al-Amri, M.; Nicholas, K.; Button, K.; Sparkes, V.; et al. Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity. Sensors 2018, 18, 719. [Google Scholar] [CrossRef] [Green Version]
  6. Aminian, K.; Najafi, B. Capturing human motion using body-fixed sensors: Outdoor measurement and clinical applications. Comput. Animat. Virtual Worlds 2004, 15, 79–94. [Google Scholar] [CrossRef]
  7. Hintermeister, R.A.; O’Connor, D.D.; Lange, G.W.; Dillman, C.J.; Steadman, J.R. Muscle activity in wedge, parallel, and giant slalom skiing. Med. Sci. Sports Exerc. 1997, 29, 548–553. [Google Scholar] [CrossRef] [Green Version]
  8. Mueller, E.; Schwameder, H. Biomechanical aspects of new techniques in alpine skiing and ski-jumping. J. Sports Sci. 2003, 21, 679–692. [Google Scholar] [CrossRef]
  9. Federolf, P.; Roos, M.; Lüthi, A.; Dual, J. Finite element simulation of the ski-snow interaction of an alpine ski in a carved turn. Sport. Eng. 2010, 12, 123–133. [Google Scholar] [CrossRef]
  10. Reid, R.C.; Haugen, P.; Gilgien, M.; Kipp, R.W.; Smith, G.A. Alpine Ski Motion Characteristics in Slalom. Front. Sport. Act. Living 2020, 2, 25. [Google Scholar] [CrossRef] [Green Version]
  11. Brunauer, R.; Kremser, W.; Stöggl, T. From Sensor Data to Coaching in Alpine Skiing—A Software Design to Facilitate Immediate Feedback in Sports. In Proceedings of the 12th International Symposium on Computer Science in Sport, Moscow, Russia, 8–10 July 2019. [Google Scholar]
  12. Snyder, C.; Martínez, A.; Brunauer, R.; Stöggl, T. Validation of a Wearable System for Edge Angle Estimation during Alpine Skiing; Karczewska-Lindinger, M., Hakkarainen, A., Linnamo, V., Lindinger, S., Eds.; University of Jyväskylä: Jyväskylä, Finland, 2020. [Google Scholar]
  13. Camomilla, V.; Bergamini, E.; Fantozzi, S.; Vannozzi, G. Trends Supporting the In-Field Use of Wearable Inertial Sensors for Sport Performance Evaluation: A Systematic Review. Sensors 2018, 18, 873. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Nemec, B.; Petric, T.; Babic, J.; Supej, M. Estimation of Alpine Skier Posture Using Machine Learning Techniques. Sensors 2014, 14, 18898–18914. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Spörri, J.; Kröll, J.; Haid, C.; Fasel, B.; Müller, E. Potential Mechanisms Leading to Overuse Injuries of the Back in Alpine Ski Racing: A Descriptive Biomechanical Study. Am. J. Sports Med. 2015, 8, 2042–2048. [Google Scholar] [CrossRef] [PubMed]
  16. Fasel, B.; Spörri, J.; Gilgien, M.; Boffi, G.; Chardonnens, J.; Müller, E.; Aminian, K. Three-Dimensional Body and Centre of Mass Kinematics in Alpine Ski Racing Using Differential GNSS and Inertial Sensors. Remote Sens. 2016, 8, 671. [Google Scholar] [CrossRef] [Green Version]
  17. Spörri, J.; Kröll, J.; Fasel, B.; Aminian, K.; Müller, E. The Use of Body Worn Sensors for Detecting the Vibrations Acting on the Lower Back in Alpine Ski Racing. Front. Physiol. 2017, 8, 522. [Google Scholar] [CrossRef]
  18. Martínez, A.; Brunauer, R.; Venek, V.; Snyder, C.; Jahnel, R.; Buchecker, M.; Thorwartl, C.; Stöggl, T. Development and Validation of a Gyroscope-Based Turn Detection Algorithm for Alpine Skiing in the Field. Front. Sport. Act. Living 2019, 1, 18. [Google Scholar] [CrossRef] [Green Version]
  19. Rindal, O.M.H.; Seeberg, T.M.; Tjønnås, J.; Haugnes, P.; Sandbakk, Ø. Automatic Classification of Sub-Techniques in Classical Cross-Country Skiing Using a Machine Learning Algorithm on Micro-Sensor Data. Sensors 2017, 18, 75. [Google Scholar] [CrossRef] [Green Version]
  20. Jang, J.; Ankit, A.; Kim, J.; Jang, Y.J.; Kim, H.Y.; Kim, J.H.; Xiong, S.; Jang, J.; Ankit, A.; Kim, J.; et al. A Unified Deep-Learning Model for Classifying the Cross-Country Skiing Techniques Using Wearable Gyroscope Sensors. Sensors 2018, 18, 3819. [Google Scholar] [CrossRef] [Green Version]
  21. Stöggl, T.; Holst, A.; Jonasson, A.; Andersson, E.; Wunsch, T.; Norström, C.; Holmberg, H.-C. Automatic Classification of the Sub-Techniques (Gears) Used in Cross-Country Ski Skating Employing a Mobile Phone. Sensors 2014, 14, 20589. [Google Scholar] [CrossRef]
  22. Groh, B.H.; Fleckenstein, M.; Eskofier, B.M. Wearable trick classification in freestyle snowboarding. In Proceedings of the 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), San Francisco, CA, USA, 14–17 June 2016; pp. 89–93. [Google Scholar]
  23. Han, B.; Ryu, J.; Kim, S. Context-Aware Winter Sports Based on Multivariate Sequence Learning. Sensors 2019, 19, 3296. [Google Scholar] [CrossRef] [Green Version]
  24. Pawlyta, M.; Hermansa, M.; Szczesna, A.; Janiak, M.; Wojciechowski, K. Deep Recurrent Neural Networks for Human Activity Recognition During Skiing. In Proceedings of the Man-Machine Interactions 6—6th International conference on Man-Machine Interactions, ICMMI, Cracow, Poland, 2–3 October 2019; pp. 136–145. [Google Scholar]
  25. Movesense. Available online: https://www.movesense.com/wp-content/uploads/2017/11/Movesense-Sensor-Datasheet-_-20171109.pdf (accessed on 20 May 2020).
  26. Saeb, S.; Lonini, L.; Jayaraman, A.; Mohr, D.; Kording, K. The need to approximate the use-case in clinical machine learning. Gigascience 2017, 6, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Little, M.A.; Varoquaux, G.; Saeb, S.; Lonini, L.; Jayaraman, A.; Mohr, D.C.; Kording, K.P. Using and understanding cross-validation strategies. Perspectives on Saeb et al. Gigascience 2017, 6, 1–6. [Google Scholar] [CrossRef]
  28. Neto, E.C.; Pratap, A.; Perumal, T.M.; Tummalacherla, M. Detecting the impact of subject characteristics on machine learning-based diagnostic applications. NPJ Digit. Med. 2019, 2. [Google Scholar] [CrossRef] [Green Version]
  29. Granitto, P.M.; Furlanello, C.; Biasioli, F.; Gasperi, F. Recursive feature elimination with random forest for PTR-MS analysis of agroindustrial products. Chemom. Intell. Lab. Syst. 2006, 83, 83–90. [Google Scholar] [CrossRef]
  30. Rosenfeld, A.; Richardson, A. Explainability in human–agent systems. Auton. Agent. Multi. Agent. Syst. 2019, 33, 673–705. [Google Scholar] [CrossRef] [Green Version]
  31. Barredo Arrieta, A.; Díaz-Rodríguez, N.; Del Ser, J.; Bennetot, A.; Tabik, S.; Barbado, A.; Garcia, S.; Gil-Lopez, S.; Molina, D.; Benjamins, R.; et al. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. Inf. Fusion 2020, 82–115. [Google Scholar] [CrossRef] [Green Version]
  32. Breiman, L.; Friedman, J.H.; Olshen, R.A.; Stone, C.J. Classification and Regression Trees; Chapman and Hall/CRC: Boca Raton, FL, USA, 1984; ISBN 9781138469525. [Google Scholar]
  33. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar]
  34. Hastie, T.; Tibshirani, R.; Friedman, J. The Elements of Statistical Learning; Springer Series in Statistics; Springer: New York, NY, USA, 2009; ISBN 978-0-387-84857-0. [Google Scholar]
  35. Gupta, B.; Rawat, A.; Jain, A.; Arora, A.; Dhami, N. Analysis of Various Decision Tree Algorithms for Classification in Data Mining. Int. J. Comput. Appl. 2017, 163, 15–19. [Google Scholar] [CrossRef]
  36. Schapire, R.E. The strength of weak learnability. Mach. Learn. 1990, 5, 197–227. [Google Scholar] [CrossRef] [Green Version]
  37. James, G.; Witten, D.; Hastie, T.; Tibshirani, R. An Introduction to Statistical Learning: With Applications in R, 7th ed.; Springer: New York, NY, USA, 2013; ISBN 9781461471370. [Google Scholar]
  38. Therneau, T.; Atkinson, B. rpart: Recursive Partitioning and Regression Trees, R Package Version 4.1-15; 2019. Available online: https://cran.r-project.org/package=rpart (accessed on 20 May 2020).
  39. Chen, T.; He, T.; Benesty, M.; Khotilovich, V.; Tang, Y.; Cho, H.; Chen, K.; Mitchell, R.; Cano, I.; Zhou, T.; et al. xgboost: Extreme Gradient Boosting, R Package Version 0.90.0.2; 2019. Available online: https://cran.r-project.org/package=xgboost (accessed on 20 May 2020).
  40. Hossin, M.; Sulaiman, M.N. A Review on Evaluation Metrics for Data Classification Evaluations. Int. J. Data Min. Knowl. Manag. Process 2015, 5, 1–11. [Google Scholar]
  41. Stehman, S.V. Selecting and interpreting measures of thematic classification accuracy. Remote Sens. Environ. 1997, 62, 77–89. [Google Scholar] [CrossRef]
  42. Tharwat, A. Classification assessment methods. Appl. Comput. Informa. 2018, in press. [Google Scholar] [CrossRef]
  43. Cust, E.E.; Sweeting, A.J.; Ball, K.; Robertson, S. Machine and deep learning for sport-specific movement recognition: A systematic review of model development and performance. J. Sports Sci. 2019, 37, 568–600. [Google Scholar] [CrossRef] [PubMed]
  44. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019; Available online: https://www.r-project.org/ (accessed on 20 May 2020).
  45. Liaw, A.; Wiener, M. Classification and Regression by randomForest. R News 2002, 2, 18–22. [Google Scholar]
  46. Hochreiter, S.; Schmidhuber, J. Long Short-term Memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
  47. Kos, A.; Wei, Y.; Tomažič, S.; Umek, A. The role of science and technology in sport. Procedia Comput. Sci. 2018, 129, 489–495. [Google Scholar] [CrossRef]
  48. Kuhn, M.; Wing, J.; Weston, S.; Williams, A.; Keefer, C.; Engelhardt, A.; Cooper, T.; Mayer, Z.; Kenkel, B.; the R Core Team; et al. Caret: Classification and Regression Training, R Package Version 6.0-84; 2019. Available online: https://cran.r-project.org/package=caret (accessed on 20 May 2020).
  49. Dowle, M.; Srinivasan, A. data.table: Extension of ‘data.frame’, R Package Version 1.12.2; 2019. Available online: https://cran.r-project.org/package=data.table (accessed on 20 May 2020).
  50. Wickham, H.; Henry, L. tidyr: Tidy Messy Data, R Package Version 1.0.0; 2019. Available online: https://cran.r-project.org/package=tidyr (accessed on 20 May 2020).
  51. Wickham, H.; François, R.; Henry, L.; Müller, K. dplyr: A Grammar of Data Manipulation, R Package Version 0.8.1; 2019. Available online: https://cran.r-project.org/package=dplyr (accessed on 20 May 2020).
  52. Ushey, K.; McPherson, J.; Cheng, J.; Atkins, A.; Allaire, J.J. Packrat: A Dependency Management System for Projects and Their R Package Dependencies, R Package Version 0.5.0; 2018. Available online: https://cran.r-project.org/package=packrat (accessed on 20 May 2020).
  53. Milborrow, S. rpart.plot: Plot “rpart” Models: An Enhanced Version of “plot.rpart”, R Package Version 3.0.8; 2019. Available online: https://cran.r-project.org/package=rpart.plot (accessed on 20 May 2020).
  54. Wickham, H. ggplot2: Elegant Graphics for Data Analysis; Springer: New York, NY, USA, 2016; ISBN 978-3-319-24277-4. [Google Scholar]
Figure 1. Inertial measurement unit (IMU) axes (accelerometer and gyroscope).
Figure 1. Inertial measurement unit (IMU) axes (accelerometer and gyroscope).
Sensors 20 04232 g001
Figure 2. Accelerometer data for each style.
Figure 2. Accelerometer data for each style.
Sensors 20 04232 g002
Figure 3. Gyroscope data for each style.
Figure 3. Gyroscope data for each style.
Sensors 20 04232 g003
Figure 4. Flowchart from raw data to classification.
Figure 4. Flowchart from raw data to classification.
Sensors 20 04232 g004
Figure 5. Training and testing data set.
Figure 5. Training and testing data set.
Sensors 20 04232 g005
Figure 6. Features for the parallel/non-parallel distinction. The features are visualized via boxplots which show the summary statistics. The box represents the interquartile range (IQR = third quartile–first quartile), the thick line the median. The whiskers show the minimum and maximum values without outliers (1.5*IQR), the black dots the outliers which lie outside 1.5*IQR.
Figure 6. Features for the parallel/non-parallel distinction. The features are visualized via boxplots which show the summary statistics. The box represents the interquartile range (IQR = third quartile–first quartile), the thick line the median. The whiskers show the minimum and maximum values without outliers (1.5*IQR), the black dots the outliers which lie outside 1.5*IQR.
Sensors 20 04232 g006
Figure 7. Decision tree for pre-classification (max_TD_AbsRate_Roll = maximum absolute roll axis angular velocity, max_TD_Symmetry_Roll = maximum symmetry of the roll axis angular velocity).
Figure 7. Decision tree for pre-classification (max_TD_AbsRate_Roll = maximum absolute roll axis angular velocity, max_TD_Symmetry_Roll = maximum symmetry of the roll axis angular velocity).
Sensors 20 04232 g007
Figure 8. Variable importance plot of the 10 most important variables of the gradient boosted tree.
Figure 8. Variable importance plot of the 10 most important variables of the gradient boosted tree.
Sensors 20 04232 g008
Figure 9. Variable importance plot of the 10 most important variables of the random forest.
Figure 9. Variable importance plot of the 10 most important variables of the random forest.
Sensors 20 04232 g009
Table 1. Confusion matrix for parallel turns.
Table 1. Confusion matrix for parallel turns.
Parallel TurnsActual
DriftingCarving
PredictedDriftingTrue drifting turns (tp)False carving turns (fn)
CarvingFalse drifting turns (fp)True carving turns (tn)
Table 2. Confusion matrix for non-parallel turns.
Table 2. Confusion matrix for non-parallel turns.
Non-Parallel TurnsActual
SnowplowSnowplow-Steering
PredictedSnowplowTrue snowplow turns (tp)False snowplow-steering turns (fn)
Snowplow-SteeringFalse snowplow turns (fp)True snowplow-steering turns (tn)
Table 3. Performance metrics for model comparison (for the abbreviations, please see Table 1 or Table 2).
Table 3. Performance metrics for model comparison (for the abbreviations, please see Table 1 or Table 2).
MetricsFormula
Accuracy (acc) A c c u r a c y = t p + t n t p + t n + f p + f n
Sensitivity (sn) S e n s i t i v i t y = t p t p + f n
Specificity (sp) S p e c i f i c i t y = t n t n + f p
Geometric mean G e o m e t r i c   M e a n = s n s p
Table 4. Performance measures for classification of parallel turns on test data set.
Table 4. Performance measures for classification of parallel turns on test data set.
AccuracySensitivitySpecificityGeometric Mean
Decision Tree0.8850.9010.8660.883
Random Forest0.9480.9380.9600.949
Boosted Tree0.9530.9590.9450.951
Table 5. Performance measures for classification of non-parallel turns on test data set.
Table 5. Performance measures for classification of non-parallel turns on test data set.
AccuracySensitivitySpecificityGeometric Mean
Decision Tree0.8220.6880.8600.769
Random Forest0.8900.6880.9470.807
Boosted Tree0.8770.6880.9300.800
Table 6. Confusion matrix for parallel turns—Decision tree.
Table 6. Confusion matrix for parallel turns—Decision tree.
Parallel TurnsActual
CarvingDrifting
PredictedCarving218 (90.1%)27 (13.4%)
Drifting24 (9.9%)174 (86.6%)
Table 7. Confusion matrix for parallel turns—Random forest.
Table 7. Confusion matrix for parallel turns—Random forest.
Parallel TurnsActual
CarvingDrifting
PredictedCarving227 (93.8%)8 (4.0%)
Drifting15 (6.2%)193 (96.0%)
Table 8. Confusion matrix for parallel turns—Gradient boosted tree.
Table 8. Confusion matrix for parallel turns—Gradient boosted tree.
Parallel TurnsActual
CarvingDrifting
PredictedCarving232 (95.6%)11 (5.5%)
Drifting10 (4.1%)190 (94.5%)
Table 9. Confusion matrix for non-parallel turns—Decision tree.
Table 9. Confusion matrix for non-parallel turns—Decision tree.
Non-Parallel TurnsActual
Snowplow-SteeringSnowplow
PredictedSnowplow-Steering11 (68.8%)8 (14.0%)
Snowplow5 (31.2%)49 (86.0%)
Table 10. Confusion matrix for non-parallel turns—Random forest.
Table 10. Confusion matrix for non-parallel turns—Random forest.
Non-Parallel TurnsActual
Snowplow-SteeringSnowplow
PredictedSnowplow-Steering11 (68.5%)3 (5.3%)
Snowplow5 (31.2%)54 (94.7%)
Table 11. Confusion matrix for non-parallel turns—Gradient boosted tree.
Table 11. Confusion matrix for non-parallel turns—Gradient boosted tree.
Non-Parallel TurnsActual
Snowplow-SteeringSnowplow
PredictedSnowplow-Steering11 (68.5%)4 (7.0%)
Snowplow5 (31.2%)53 (93.0%)

Share and Cite

MDPI and ACS Style

Neuwirth, C.; Snyder, C.; Kremser, W.; Brunauer, R.; Holzer, H.; Stöggl, T. Classification of Alpine Skiing Styles Using GNSS and Inertial Measurement Units. Sensors 2020, 20, 4232. https://doi.org/10.3390/s20154232

AMA Style

Neuwirth C, Snyder C, Kremser W, Brunauer R, Holzer H, Stöggl T. Classification of Alpine Skiing Styles Using GNSS and Inertial Measurement Units. Sensors. 2020; 20(15):4232. https://doi.org/10.3390/s20154232

Chicago/Turabian Style

Neuwirth, Christina, Cory Snyder, Wolfgang Kremser, Richard Brunauer, Helmut Holzer, and Thomas Stöggl. 2020. "Classification of Alpine Skiing Styles Using GNSS and Inertial Measurement Units" Sensors 20, no. 15: 4232. https://doi.org/10.3390/s20154232

APA Style

Neuwirth, C., Snyder, C., Kremser, W., Brunauer, R., Holzer, H., & Stöggl, T. (2020). Classification of Alpine Skiing Styles Using GNSS and Inertial Measurement Units. Sensors, 20(15), 4232. https://doi.org/10.3390/s20154232

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop