1. Introduction
The vertical jump (VJ) is one of the most widely used performance tests. Its popularity is due both to its simplicity and effectiveness [
1], and to the similarity between its movement patterns and sports, explosiveness, speed, and intensity [
2,
3]. Moreover, it is a useful tool to assess physical fitness in a healthy population (i.e., children, adults, and elderly people) [
4,
5,
6], and to control an adequate musculoskeletal injury recovery [
7]. There are different jump protocols; two of the most frequently used are: (1) The squat jump (SJ), which provides a basic leg strength parameter and is described by some authors as pure concentric [
3]; (2) the counter movement jump (CMJ) adds an elastic-reactive component of the subject. It is estimated that the CMJ value can be up to 25% higher than the SJ in athletes [
8]. Their performance has been used to: (1) monitor the positive effects of strength, plyometric, resistance, and speed training; and (2) control mechanical and neuromuscular fatigue status in individual and team sports [
9]. Several researchers have found that CMJ performance is an interesting objective marker of fatigue and overcompensation for athlete performance [
9], being one of the factors related to the high incidence of injuries (e.g., muscle overload) in the lower limb muscles [
10,
11]. Thus, a relationship has been observed between height loss in the CMJ and metabolic markers such as lactate or ammonium in the sprint [
12], and after a Wingate test [
13]. This suggests that through decreases in the CMJ’s mechanical variables such as jump height (JH), it should be possible to estimate the metabolic stress, neuromuscular fatigue, and overload of the subject [
5,
12,
14].
Specific performance factors for both the CMJ and SJ include a number of different kinematic and kinetic variables. Some of these variables are more sensitive than others to determine an athlete’s neuromuscular status and may depends of the age and level of the subjects: JH, power, velocity and force (peak, relative peak, and mean of the last three), rate of force development (RFD), and mean impulse [
9]. In addition, it has been proven that it is better to average the number of jumps executed than to choose the one that obtained the maximum height [
9].
To obtain the height value of the jump we can use two variables: the take-off velocity (TOV) or the flight time (FT) [
15,
16]:
The TOV is the vertical velocity of the center of mass at takeoff. The height value of the jump will be the result of velocity at takeoff squared divided by twice the gravity:
The FT is the time period between takeoff and land contact (i.e., the subject is on the air, without land contact). The height value of the jump will be the result of the gravity value multiplied by FT squared, divided by eight:
There are many tools used to evaluate the performance of the jump (e.g., force platforms (FP), contact mats, video analysis through a smartphone applications (APPs), accelerometers, infrared systems,
Vertec Vertical Jump Measuring Device). Most devices use the FT to calculate the JH [
17]. However, to measure it in an accurate manner, the height of the center of mass at takeoff and landing has to be the same. Any difference between the athlete’s takeoff and landing center of mass position (e.g., different joint position of ankle, knee, or hip) could increase or decrease the FT, and then change the result of the JH estimation [
15,
17]. Considering these technical implications, TOV has been suggested as the more suitable method to evaluate the JH [
18]. If the TOV can be measured easily by a FP, then it is considered the gold standard for measuring the height of the VJ [
19,
20]. A FP can measure and use either the FT or the TOV methodology, the latter being the most accurate method for determining the height of the VJ [
19].
The need to quantitatively evaluate the performance of the athlete’s JH has promoted the emergence of APPs for this purpose. Some authors have reported that these APPs have a high reliability and accuracy in their measures [
21,
22], while others qualify their results as equivocal, so it is not yet clear what is the ideal methodology to use [
23].
Although the VJ and its performance can be extrapolated to any sport level, the greater the level the subjects have, the more correlation exists in its variables, so it is in high performance sport where it has more utility [
24]. Moreover, the accuracy of the results is essential from a competitive point of view in high-level sports, for example in elite-cyclists improvements of around 0.6% are sufficient to make a difference [
25].
Therefore, the main purpose of this study was to compare the validity of the TOV method using a FP versus the FT method using a FP and a smartphone application to measure jumping performance or neuromuscular fatigue-overload in professional female football players.
2. Materials and Methods
2.1. Participant Selection: Inclusion and Exclusion Criteria
A total of eight healthy professional female football players of the First and Second Spanish Football Divisions (Liga Iberdrola and Reto Iberbrola, respectively) (aged 27.25 ± 6.48 years; body mass 56.73 ± 4.86 kg; height 1.61 ± 0.06 m. Values expressed as mean ± standard deviation) participated in this study.
Inclusion criteria were: (1) playing in a female professional soccer league; (2) not having suffered a musculoskeletal injury one year prior to the date of the protocol (i.e., checked through a previous exclusion questionnaire); (3) not presenting any cardiovascular, musculoskeletal, and/or neurological disease, nor previous ones that could affect participation in the study. Exclusion criteria were: (1) aged younger than 18 years; (2) having consumed any narcotic and/or psychotropic agents or drugs during the test. We have selected this specific study population to homogenize the level of the sample and to deepen the knowledge of women’s professional soccer.
At the study outset, participants were informed of the study protocol, schedule, and nature of the exercises and tests to be performed before signing an informed consent form. The study protocol adhered to the tenets of the Declaration of Helsinki and was approved by the Ethics Committee of the Technical University of Madrid (Madrid, Spain).
2.2. Experimental Design
This study consisted of a single evaluation session (see
Figure 1) in a laboratory in the same time frame to avoid the detrimental performance effects associated with circadian rhythm [
26]. Subjects were required to avoid physically demanding activity in the 24 h prior to the session.
Three valid trials of a CMJ and SJ were conducted with each subject, with 60 s recovery between trials, and three minutes between each jump test (see
Figure 1). All jumps were measured at the same time with the mobile application and on the FP.
The sessions began with a 10-min general warm up consisting of continuous running, specific running, joint mobility, and ballistic stretching exercises, followed by a specific pre-test warm-up where participants performed five SJs and CMJs with 30 s between each jump. After three minutes of rest, the participants started the jumping test.
2.3. Vertical Jump Test
The VJs included in the present study were the CMJ and SJ, which have been previously demonstrated to be reliable measures (intraclass correlation coefficient (ICC) = 0.97 and 0.96, respectively) [
27]. All participants were completely familiarized with both techniques (i.e., they realized these tests during the soccer season). Moreover, they practice before the test during the specific warm-up (see warm-up description above). Participants were always instructed to jump as high as possible, keeping their hands on their hips and that their legs should remain straight during flight, making contact with the ground with the tips of their feet and knees extended [
28]. In both modalities, the aim was to reach the maximum height by means of the jump; nevertheless, each modality of jump consists of different characteristics [
29].
The CMJ (
Figure 2a) initial position consists of a static standing position with hands on the hips. From this position, a continuous and fast triple hip, knee, and ankle flexion movement is executed until reaching ≈ 90° of knee flexion, followed by the triple extension of the same joints in a fluid, fast, and continuous way [
29]. In this type of VJ, there is a stretching-shortening cycle (SSC), which takes place during the consecutive eccentric, isometric, and concentric phases [
29].
The SJ (
Figure 2b) only presents the concentric component. The initial position consists of maintaining the hips and knees flexed at ≈ 90° for approximately four seconds to avoid countermovement and the elastic component. From this position, the concentric phase of the jump with an explosive extension of the lower limb joints is performed. All participants were asked to jump as high as possible and without performing a SSC [
29]. The SJ forces before takeoff were checked on the FP to ensure that the participant did not perform countermovement.
For both jumps, participants were asked to take off and land at the same place to avoid lateral or horizontal displacement. Only successful trials were considered. Participants were asked to repeat the trial if a jump was incorrectly performed.
2.4. Instruments
2.4.1. Force Platform
Two 600 mm × 400 mm piezoelectric platforms (Type 9286AA; Kistler Instruments AG, Winterthur, Switzerland) mounted together on the floor according to the manufacturer’s instructions, were used in this experiment. The force sensors of these platforms were constituted by piezoelectric transducers 5 kN, total max 20 kN. Data were recorded at a sampling frequency of 1000 Hz. The FPs were connected to a portable computer with specific software, the Measurement, Analysis and Reporting Software “Kistler MARS” (Kistler Instruments AG, Winterthur, Switzerland).
2.4.2. Smartphone Application
The validated smartphone application used to measure the performance of the jump was My Jump2 (APP) [
30] installed on a mobile phone (iPhone 6s Apple, Cupertino, CA, USA) at a sampling rate of 240 Hz. My Jump was designed for analyzing VJ measuring the time (in ms) between two frames selected by the user and subsequently to calculate the JH using the equation based on FT. The position of the camera was always at ~1.5 m from the middle line of the subject so that it was constantly aligned with the reference joint points.
After the recording, one researcher manually selected the frames in which the subject performed exactly the moments of take-off and landing. A second person was consulted in case of doubt when analyzing the jumps with the APP. The JH was calculated based on the FT between the selected take-off and landing frame, as previously described [
30].
2.5. Statistical Analysis
The normality and homogeneity of the data were analyzed using the Shapiro–Wilk and Levene tests, respectively. The normality and homogeneity of the dependent variables was confirmed (p > 0.05); all of the data are provided as their means and standard deviations.
Various statistical analyses were used to prove the APP validity and reliability in comparison with the FP using FT and TOV to calculate JH. The Pearson correlation coefficient (r) was used to calculate the concurrent validity between the APP and the FP using different measurement methods.
To expound the magnitude of the relationship between height measurements by the APP and the FP, Cohen’s convention was used. To measure reliability between the APP and the FP, the coefficient of variation (CV), an absolute agreement Intraclass Correlation Coefficient (ICC), and Cronbach’s Alpha were used. The CV was used to observe the uniformity of the values with respect to the mean. A Bland–Altman plot was created to graphically represent the agreement between the APP’s measured heights and FP FT measured heights.
The mean differences between the measurements for each jump (SJ and CMJ) and for both jumps together (CMJ + SJ) were calculated through a one-way ANOVA, and Tukey’s post-hoc test was used to analyze pairwise comparisons between means. The standard error of estimate (SEE) was used to show the typical error in measurement. Significance was set at p < 0.05. All statistical analyses were performed using the software package SPSS® version 25 (IBM Co., USA).
3. Results
The coefficients of variation values were very small for the CMJs with the FP through the TOV, the FP through the FT and the APP (2.82%, 3.56%, and 3.55%, respectively), and for the SJ (12.44%, 5.24%, and 4.88%, respectively).
The Pearson’s correlation showed a poor relationship and a small reliability between the JH measured through the FT and the TOV, both measured with the FP (r = 0.028,
p > 0.84, ICC = −0.026, 95% CI = −0.276–0.24) (
Figure 3), and between the JH measured with the FP through the TOV and the APP (r = −0.116,
p > 0.43, ICC = −0.094, 95% CI = −0.314–0.157) (
Figure 4).
On the other hand, a high and significant relationship between the JH measured with the FP through the FT and the APP (r = 0.872,
p < 0.01) was found (
Figure 5). Moreover, there was a very high agreement between these two variables as revealed by the ICC = 0.843 (95% CI = 0.681–0.919) and Bland–Altman plots (
Figure 6).
The one-way ANOVA shows a significant difference between the JH measured with the FP through the TOV versus the APP (
p = 0.002), and a trend versus the FP through the FT (
p = 0.052). Finally, the JH analyzed with the FP through the FT and the APP did not differ (
p = 0.457) (
Table 1). The eta squared of the one-way ANOVA was η2 = 0.085.
Specifically, in SJ, the one-way ANOVA shows a significant difference in JH measured with the FP through the TOV versus the FP and the APP both through the FT (
p < 0.01). Finally, the JH analyzed with the FP through FT and the APP did not differ (
p = 0.826) (
Table 2). The eta squared of the one-way ANOVA used to compare SJ was η2 = 0.374.
Lastly, in CMJ, the one-way ANOVA did not show significant differences between JH measured by the different methods (
p = 0.07, η2 = 0.073) (
Table 3).
4. Discussion
The main purpose of this study was to compare the validity of the TOV method using a FP versus the FT method using a FP and a smartphone application to measure jumping performance or neuromuscular fatigue-overload in professional female soccer players.
The major findings were the lack of reliability and validity between JH measured with the FP through the TOV and JH measured through the FT either by the FP (r = 0.028,
p > 0.84, ICC = –0.026 (–0.276–0.24)) or the APP (r = 0.116,
p > 0.43, ICC = −0.094 (−0.314–0.157)). To our knowledge, this is the first study that has researched the JH of SJ and CMJ together (SJ + CMJ) with these technologies: FP trough the TOV and trough FT, and APP through FT. Two previous studies [
20,
31] have analyzed the SJ, CMJ and CMJ with arms (CMJA), together comparing JH with FP vs. contact mat (both through FT method) [
20], and with FP (TOV and FT methods) vs. contact mat (FT method) [
31]. This latter study [
31] concluded that the TOV must be used instead of the FT as a more valid and accurate way to calculate the VJ performance. It provides a more sensitive approach to scientifically establishing jump determinants, greater sensitivity in analyzing changes in performance factors after training (i.e., overcompensation, overload), and greater accuracy in monitoring performance within the session (i.e., fatigue) [
18,
19]. Further, the mean comparison shows a significant difference between the JH measured with the FP through the TOV versus the APP (
p = 0.002), and a trend versus the FP through the FT (
p = 0.052). To our knowledge, there is only one previous study that researched the differences between the FP through the TOV versus a smartphone application (FT method) [
19], and it showed near perfect correlations (ICC = 0.996;
p < 0.001). These differences with our results may be explain by some reasons: 1) In our study the subjects performed three different CMJs and SJs, while in the previous study the subjects performed five CMJs [
19]; (2) The distance between the researcher and the subject was of 1 m in the previous study [
19], while in our study it was of 1.5 m; (3) In addition, rest between jumps was not specified in the previous study [
19], so it is not possible to know if fatigue could have affected their results through the FT method (i.e., Different joint position between take-off and landing), whilst our subjects rested 60 s between trials and three minutes between each jump test. Despite these methodological differences, their results comparing the FP through the TOV versus a smartphone application (FT method) regarding only CMJ did not differ with our CMJ results. Based on the present study and the literature [
19,
20], it seems that the flight time method, independent of the technology used (e.g., FP, contact mat, smartphone application), is an imprecise means of assessment.
On the other hand, there is a high correlation and good reliability between the JH SJ+CMJ measured through the FT with the FP and the APP (r = 0.872,
p < 0.01, ICC = 0.843, CV = 4.88%). These results are in accordance with other studies that compare the SJ+CMJ+CMJA height using a FP and a contact mat (both through FT) (r = 0.99,
p < 0.001, ICC = 0.985, CV% = 2.7) [
21]. Additionally, the mean comparison of the present study shows that the JH analyzed with the FP through the FT and the APP did not differ (
p = 0.457). Therefore, the APP and the contact mat seem to equal the accuracy of the FP with the FT method. However, it is important to highlight the fact that some studies compare the My Jump APP based on FT, with other instruments also based on FT (i.e., contact mat or FP through the FT) [
21,
30,
31], instead of comparing it with the FP through the TOV (gold standard) [
16]. Therefore, all these technologies that use the FT method are not as precise as the TOV method. Bearing in mind that the most accurate and considered the gold standard method to measure the height of the jump is the FP based on the TOV [
19,
20], these are the results that should be trusted.
Analyzing specifically the different jumps, it was found in SJ significant differences between the JH measured with the FP through the TOV and the FP and the APP through the FT (
p < 0.01 in both cases). However, we found no significant difference comparing the JH measured with the FP and the APP (both through the FT) (
p = 0.826). Further, CMJ data showed no significant differences among the three methods (i.e., FP through the TOV versus the FP and the APP through the FT) (
p > 0.05 in both cases). Our results are in line with the only one previous study that researched the differences between the FP through the TOV versus a smartphone application (FT method) [
19], and it showed near perfect correlations (ICC = 0.996;
p < 0.001). Results of the reliability and validity obtained in the present study comparing the CMJ height through the FT with the FP and the APP (r = 0.872,
p < 0.01, ICC = 0.843 and CV = 4.88%) are in accordance with the first validation study of My Jump App [
30] that compare the CMJ height using a FP through FT (r = 0.995,
p < 0.001, ICC = 0.997, CV% = 3.5), and other study that compare the CMJ height using a contact mat and the My Jump App (both through FT) (r = 0.999,
p < 0.001, ICC = 0.948, CV% = 10.096) [
21]. Despite the differences between the sampling frequency of the devices (i.e., FP ≈1000 Hz and the smartphone camera ≈ 240 Hz), the height values obtained were very similar between the two methods, as reflected by the ICC.
The literature that evaluates the smartphone applications in this area has analyzed the CMJ as the only vertical jump option discarding the SJ [
19,
21]. However, with this study it has been demonstrated that the results of the CMJ cannot be extrapolated to the SJ. The height of the SJ and CMJ is defended by several authors as a method to detect fatigue and individualize load prescriptions, so the reduction of the height of the VJ can be interpreted as evidence of the deterioration of neuromuscular function (i.e., fatigue, neuromuscular overload) [
12]. Its measurement could provide a relatively simple and accessible tool for quantifying the degree of neuromuscular, mechanical, and metabolic fatigue [
5,
12,
32]. This fatigue can remain for up to 48–72 h after a high-intensity session [
33]. It could therefore provide useful feedback to coaches to determine the impact of training loads on player recovery and performance [
12]. The neuromuscular factor is considered the most influential factor in training and is also an intrinsic risk factor of an athlete’s injury [
34]. The lack of strength and poor coordination capacity are part of it [
35]. Several studies have observed that after a fatiguing exercise bout and during the landing phase of different jump types, there is a change in the neuromuscular control strategies used by these subjects [
36,
37]. These motor control alterations are associated with different injury risk factors, such as reduced knee and hip flexion, increased knee valgus, increased ground reaction force, and greater stabilization time [
37]. In high-level sports, measurement accuracy is critical in the assessment of performance and in the control and assimilation of training loads to avoid muscle–tendon overloads [
25]. In addition, some authors recommend the evaluation of jumping performance, especially at high and elite levels [
24]. In this sense and referring to the exclusive sample of this study, as they are professional female soccer players, these small variations described above should be considered and limited as far as possible. In our study, the differences in JH between the FP through the TOV versus through the FT was 5.23% (1.84 cm) and the differences between the FP through the TOV versus the APP was 7.90% (2.78 cm). The only previous study that researched the differences between the FP (TOV method) versus a smartphone application (FT method) [
19], found a small overestimated JH obtained from the APP of 0.78% compared to the FP based on TOV [
19]. This small difference (0.78%) is more than ten times lower than the differences reported by us (7.90%), more than six times the difference between FP–TOV vs. FT methods (5.23%), and more than three times lower than the differences between the FP (FT method) and the APP (2.8%). This latter difference reported in the present study between the FP (FT method) and the APP agree with other studies comparing the My Jump application and a FP (FT method) [
30], and an infrared contact mat and a FP (both through the FT method) [
19]. More research regarding the issue is needed to clarify if smartphone applications may replace a FP (TOV method) in professional environments where accuracy is a key factor (i.e., high-level sport, medical clinic).
Furthermore, we observed that the difference of JH between the FP and the APP both through the FT was smaller, only 2.8% (0.94 cm). These latter results are in accordance with previous studies that observed differences in JH between an infrared contact mat and a FP, both through the FT of ≈ 2.5% (1.06 cm) [
19], and between the My Jump application and a FP both through the FT (1.1 ± 0.5 cm) [
30]. These concordances are produced because they use the FT method (i.e., less accurate) to compare different technologies. When the FT method is used with any technology, even the FP, there are many possibilities to produce measurement errors because the takeoff and the landing positions are different (e.g., different degree of lower limbs joint/s flexion) [
38]. Then, it seems recommendable that high-level sportswomen and men should be assessed with this gold standard technology and method (i.e., FP and TOV method) to ensure correct performance and/or overload control during the sport season.