1. Introduction
Change of direction and jumping abilities represent an expression of the reactive strength, which has been defined as “the ability to quickly switch from an eccentric contraction to a concentric contraction” [
1]. The coupling of an eccentric and concentric contraction refers to the stretch-shortening cycle [
2]. Both change of direction and jumping abilities rely on the stretch-shortening cycle. Change of direction is a preplanned action and a critical performance determinant in many team sports. It refers to the ability to decelerate (i.e., eccentric component) in the shortest time and quickly re-accelerate (i.e., concentric component) in a new direction while running or sprinting [
3,
4,
5]. The jumping ability can be exerted in a vertical, horizontal, or lateral direction or their combination. Since the nature of the team sports performance is characterized by multidirectional movements, testing athletes under different sport-related performances could be used to ascertain training responses and adaptations, to monitor fatigue and recovery status [
6,
7,
8], and to recognize weaknesses in young athletes and better address talent development [
9,
10]. Considering that athletes could be tested using a laboratory- and/or a field-based approach, the most suitable and practical approach should be decided based on availability of instruments, time, space, and money.
The use of the force plate in a laboratory setting is considered the “gold standard” [
11,
12,
13] for the measurements of kinetic variables, such as ground reaction force and contact time, hence it is widely used for the evaluation of the jumping ability. However, the force plate still maintains some limitations due to the high cost, the heavy weight and voluminous shape, the installation procedures, the limited portable use, and the experimental procedures [
13]. In fact, whilst the force plate installation is permanent or semi-permanent in a laboratory setting, the difficulty to embed it into the floor and the high cost of this operation strongly limit its use on the field in a setting reproducing real movements [
13]. Therefore, alternative solutions have been proposed for field-based assessments, such as yardsticks [
14], linear position transducers, contact mats [
15], and photoelectric cells. The latter (i.e., Optojump photoelectric system) became predominant due to several advantages, such as easy to transport and handle, more suitable for portable applications, and relatively cost effective. In particular, the great advantage of this system is that the two parallel bars (receiver and transmitter units) can be positioned at the floor level of several sport surfaces (except sand), hence maintaining the regular athlete–surface interaction and the content validity [
13]. Being commonly used by researchers and practitioners for sport performance investigation, the validity and reliability of the Optojump system has been previously investigated for the evaluation of the vertical jumping ability (i.e., squat and countermovement jump) using the parameters flight time and jump height [
12,
13,
16,
17]. However, the Optojump system could also be set up for testing athletes under different movement patterns, particularly if a modular configuration with a longer pathway (i.e., >1 m) is applied. Together with the flight time, the Optojump system can provide other functional parameters of the gait analysis, such as the contact time and displacement. In this regard, these parameters could be used to investigate the change of direction and lateral jumping abilities in team sports athletes. However, to the authors’ knowledge, no studies have attempted to evaluate the validity and reliability of the Optojump system for the measurement of contact time and displacement using tests exerted in directions different from the vertical one. Therefore, the first purpose of this study was to investigate the concurrent validity and internal consistency reliability of the Optojump system for the measurement of the contact time during change of direction and lateral jumping abilities. The second purpose of this study was to investigate the internal consistency reliability of the Optojump system for the evaluation of lateral jumping distance. In light of previous literature demonstrating the validity and reliability of the Optojump system in estimating jumping height during vertical jump modalities [
12,
13,
16,
17], it was hypothesized that the Optojump system could be also a valid and reliable instrument for measuring contact time in change of direction and lateral jumping abilities and for measuring lateral displacement.
2. Materials and Methods
This study was approved by the University of Taipei Institutional Review Board (Taipei, Taiwan, reference number: IRB-2018-093) and was conducted in accordance with the Declaration of Helsinki. All participants were recruited through flyers and presentation of the study inside the university and gave their informed written consent.
2.1. Participants
Thirty male and female collegiate athletes (25 males: height = 179.7 ± 7.4 cm; body mass = 76.3 ± 10.5 kg; 5 females: height = 162.9 ± 7.0 cm; body mass = 58.4 ± 9 kg) were recruited to participate in this study being eligible in accordance to the following inclusion criteria: (a) age 18–25 years; (b) experience of basketball practice for at least five years; (c) absence of known cardiovascular, pulmonary, metabolic, bone, or joint diseases; (d) no smoking; (e) no muscle and joint injuries during the last six months. For each participant, the preferred stance leg (SL) was identified as the stance leg used to jump off when performing a right-handed running basketball lay-up [
18], whilst the opposite leg was declared as the leg used to kick a ball (KL). Participants were required to avoid exercising during the 72 h prior to each experimental session and to abstain from alcohol and caffeine consumption during the 12 h prior to each experimental session.
2.2. Procedures
Participants reported to the laboratory on three occasions separated by a 72 h resting period. During the first experimental session, participants were familiarized with all instructions to perform the tests. Moreover, height (cm) and body mass (kg) were measured to the nearest decimal using a Jenix DS-102 stadiometer (Dong Sahn Jenix Co., Ltd., Seoul, Korea). Leg length was measured using a retractable tape from the greater trochanter to the lateral malleolus by the same experimenter. During the second and the third experimental session, participants performed the change of direction and the lateral jump tests, in a randomized order. All participants used basketball shoes to reduce the variability given by the use of different type of sport shoes. Before each experimental session, participants completed a standardized warm up involving 3 min of jogging on a treadmill followed by dynamic stretching, squats, frontal and lateral lunges, submaximal jumps (in vertical, frontal, and horizontal directions), short accelerations, directional changes, and submaximal trials of the tests.
The experimental protocol consisted of a series of change of direction and lateral jump tests executed in a laboratory setting with the simultaneous use of two adjacent embedded force plates (60 × 90 cm; BMS 600900 OPTIMA
TM Biomechanics Measurement Series, AMTI, Watertown, MA, USA) with a sampling rate of 2400 Hz and an Optojump photoelectric system (OptojumpNext, Microgate, Bolzano, Italy) placed beside the force plates (
Figures S1–S3). The change of direction ability was tested under two conditions: (1) a 10 m sprint with a 60° change of direction at 5 m (COD60) in which participants were required to sprint forward for 5 m, make a COD while on the force plate and sprint for another 5 m [
19]; (2) a 10 m shuttle sprint with a 180° change of direction at 5 m (COD180) in which participants were required to sprint forward for 5 m, make a COD while on the force plates and sprint back for another 5 m. Participants were instructed to push their foot on an area of the force plate near the middle highlighted by an X. The lateral jumping ability was tested under four conditions: (1) controlled lateral rebound jump (CLRJ); (2) maximal lateral rebound jump (MLRJ); (3) lateral countermovement jump (LCMJ); (4) and lateral squat jump (LSJ). Participants were asked to keep their hands on their hips to eliminate arm swing and to stand on a force plate with a single leg at a distance of 1 m from the middle of the second force plate. For CLRJ, participants were required to jump laterally with one leg (e.g., right leg), rebound (pushing on the second force plate) with the other leg (e.g., left leg) as fast as possible coming back and landing on the starting point with the starting leg. The instantaneous video analysis provided by the Optojump system software was used to ascertain that participants returned to the starting point. For MLRJ, participants were required to jump laterally with one leg (e.g., right leg), rebound (pushing on the second force plate) with the other leg (e.g., left leg) as fast as possible but trying to reach the maximal lateral jumping distance (i.e., as far as possible) landing on the starting leg [
20]. They were instructed to push in the middle of the force plate highlighted by an X. Controlled and maximal jumps were chosen in order to investigate the rebound phase when participants had to control the movement or to exert their maximal effort. For LCMJ and LSJ, participants were required to jump laterally with one leg with and without a countermovement, respectively. For the LCMJ, participants were required to bend their knee and self-select the amplitude of the countermovement to avoid changes in the coordination pattern [
21]. The order of the tests was randomized within each experimental session in order to avoid excessive fatigue effects. For the first purpose of the study, the contact time measured by the two devices was considered the dependent variable. Data from the force plate were collected using Cortex software (version 3.6.0; Motion Analysis Corp., Santa Rosa, CA, USA) and imported and analyzed with Excel (Microsoft Corp., Redmond, WA, USA). The contact time was derived considering a 10 N threshold of ground reaction force for initial contact and push-off of the foot with the force plate [
19]. The contact time from Optojump system was directly provided by the dedicated software (version, 1.12.15, OptojumpNext, Microgate, Bolzano, Italy). For the second purpose of this study, lateral jumping distance was measured only by the Optojump system to the nearest of 1 cm for the MLRJ (i.e., the distance from the rebounding leg to the starting leg, normalized by each leg length and expressed in arbitrary unit [AU]), and for LCMJ and LSJ (i.e., the distance from the starting leg to the landing leg, normalized by each leg length and expressed in arbitrary unit [AU]). The evaluation of validity of the Optojump system for the measurement of lateral jumping distance was not applicable because of the lack of a criterion measure (i.e., force plate). Participants performed five to seven trials of every test for each leg (alternating one trial for each leg) with a 2 min resting period in between. The five optimal executions were considered suitable for analysis (if participants did not push on the middle of the force plate the trial was not considered appropriate). For the change of direction tests, the trials resulting with the highest and lowest contact time from the force plate were excluded, as well as the corresponding data from the Optojump system. Similarly, for lateral jump tests, the trials resulting with the longest and shortest lateral distance from the Optojump system were excluded, as well as the corresponding data from the force plate.
2.3. Statistical Analysis
Data were analyzed using the Statistical Package for the Social Science, version 25.0 (SPSS Inc., Chicago, IL, USA). The level of statistical significance was set at p < 0.05 for all computations. Prior to the analysis, the Shapiro–Wilk test was applied to ascertain the normality of data distribution for each trial. Since prior analysis did not detect any gender differences, the sample was combined.
For COD60, COD180, CLRJ, and MLRJ, repeated measures ANOVAs were applied to ascertain the effect of leg (i.e., stance and kicking leg), device (i.e., force plate and Optojump system), and trials (three times for each leg and device) on the dependent variable contact time. For MLRJ, LCMJ, and LSJ, repeated-measures ANOVAs were applied to ascertain the effect of leg (i.e., stance and kicking leg) and trials (three times for each leg) on the dependent variable lateral jumping distance. Effects sizes were calculated as partial eta squared (ηp2) for ANOVA results.
Pearson product moment correlation was used to assess the strength of the association between the Optojump system and force plate (i.e., the criterion measure) as a measure of concurrent validity for the parameter contact time [
22]. Pearson correlation coefficients were calculated considering the average value of the three trials for each leg (i.e., stance and kicking leg). The strength of association was quantified according to the following criteria: ≤0.1 (trivial), 0.1–0.3 (small), 0.3–0.5 (moderate), 0.5–0.7 (large), 0.7–0.9 (very large), and ≥0.9 (almost perfect) [
17].
Intraclass correlation coefficients (ICCs) (2,1) and the 95% confidence intervals (CIs) [
23] were used for the analysis of internal consistency reliability of the measurement of contact time considering three trials for each leg (i.e., stance and kicking leg) and device (i.e., force plate and Optojump system). ICC and 95% CI values less than 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and greater than 0.90 revealed poor, moderate, good, and excellent reliability, respectively [
24]. Absolutely reliability was evaluated with coefficient of variation, standard error of measurement, and Bland and Altman’s 95% limits of agreement methods [
22]. Coefficient of variation (CV = (SD/mean)·100) and 95% confidence intervals (CI = (mean ± (2·SE)) were calculated considering the mean, standard deviation, and standard error (SE) of the three trials for each leg and device. Standard error of measurement (SEM) was calculated from the square root of the mean square error term in a repeated measures ANOVA of the three trials. A Bland–Altman plot was used to assess agreement between the force plate and Optojump system plotting the measurement differences (errors) against the respective means [
25]. The average value of the three trials for each device was used for the computation of the measurement differences and the respective means. Linear regression analysis was performed considering the measurement differences as dependent variable and the mean as the independent variable. Moreover, the presence of heteroscedasticity or homoscedasticity was detected by calculating the Kendall’s tau (τ) correlation between the measurement differences and the respective means. A τ > 0.1 denotes heteroscedasticity, whilst a τ < 0.1 or negative denotes homoscedasticity [
23]. ICC, SEM, and CV were also calculated for the analysis of internal consistency reliability of the Optojump system for the measurement of lateral jumping distance during MLRJ, LCMJ, and LSJ tests.
4. Discussion
The main purpose of this study was to investigate the validity and reliability of the Optojump system for testing change of direction and lateral jumping abilities. This study demonstrated for the first time that the Optojump system (OptojumpNext, Microgate) cannot provide a valid measurement of contact time for all the conditions tested, whilst it exhibited a “good” internal consistency reliability for the measurement of the contact time during change of direction and lateral jump tests. Furthermore, for the first time this study proved a “good” to “excellent” internal consistency reliability of the Optojump system for the measurement of the lateral jumping distance. Therefore, these novel findings can further augment the applicability of the Optojump system.
The force plate is always considered the “gold standard” for the evaluation of the jumping ability [
11,
12,
13], even though its application cannot be pursued by researchers and practitioners for every investigation on sport performance. Therefore, the use of alternative systems was deemed necessary in order to enlarge the evaluation with a field-based approach. However, the validity and reliability of any device and experimental procedure should be evaluated and disseminated in order to guarantee valid and reliable measurements. In fact, if standard procedures are maintained, data can be used to detect performance improvements, to compare different groups or conditions, to monitor fatigue and recovery. Since its introduction in 1995, the Optojump system has been tested for its validity versus force plate only considering vertical jump test. Glatthorn and colleagues [
13] reported a nearly perfect correlation coefficient of 0.99 between Optojump and force plate when jumping height was evaluated in several vertical jump modalities. Comparably, a nearly perfect correlation coefficient (r = 0.99) for flight time was found in a subsequent investigation [
16]. Similarly, Slomka and colleagues [
12] found very high correlation coefficients during both countermovement jump (r range = 0.91–0.99) and squat jump (r range = 0.95–0.99) using different algorithms. Recently, Rago and colleagues [
17] reported very high correlation coefficients for both flight time (r = 0.98) and jumping height (r = 0.90) in countermovement jump. In accordance with the previous investigations, this study demonstrated the concurrent validity of the Optojump only for the conditions of COD180, CLRJ, and MLRJ, as demonstrated by the almost perfect correlation coefficients. Conversely, the Optojump system did not provide a valid measure for COD60, due to the obtained systematic bias. Similarly, the previous investigations also found a systematic bias between the Optojump and force plate for the parameter flight time [
13,
16]. Therefore, although being commonly used, the Optojump system might still display a systematic bias compared to the force plate.
Nevertheless, almost perfect correlation coefficients were found between the Optojump system and force plate for lateral jump tests during which mediolateral and anterior–posterior components of force application are also very important [
19,
26,
27]. Therefore, the application of Optojump system for the measurement of contact time during lateral jump tests seems to be less susceptible to bias.
During a change of direction task, the expression of the stretch-shortening cycle is based on the coupling of the two actions, such as deceleration (i.e., eccentric component) and re-acceleration (i.e., concentric component) in the new direction. The temporal action of the change of direction should be minimized in order to exert a powerful movement. Indeed, faster and sharper changes of direction are considered more successful in sport performance [
19,
28]. However, since a “performance–injury conflict” may be generated, an angle velocity trade-off should be considered [
28]. Therefore, the analysis of complex motor abilities, as the change of direction, may require a comprehensive assessment taking into account several factors influencing the performance, such as the technical execution [
9,
19] and contact time during the directional change. However, caution is required due to possible systematic bias obtained with the measurement of contact time.
The analysis of reliability of the Optojump system and force plate was conducted considering several methods. Differently from previous investigations [
12,
13,
17,
29], the present study focused on change of direction and lateral jumping abilities with the measurement of different parameters, such as contact time and lateral displacement. Considering the contact time, the ICC values showed a trend of “good” internal consistency reliability, unless for two conditions. In particular, the force plate and Optojump system demonstrated a “moderate” internal consistency reliability for kicking leg in CLRJ (ICC = 0.730) and COD180 (ICC = 0.697), respectively. Therefore, the findings of the present study did not demonstrate an “excellent” internal consistency reliability of the Optojump system. However, also the force plate, which is considered the “gold standard”, did not show an “excellent” internal consistency reliability. Therefore, caution is required when complex motor abilities are evaluated. It might be speculated that the higher coordinative requirements for the execution of the change of direction and lateral jump tests might cause a higher probability of measurement error.
The choice of using SEM or CV for the interpretation of absolute reliability should be based on the prior analysis for the presence of heteroscedasticity or homoscedasticity [
23]. The present data demonstrated to be homoscedastic, therefore SEM method should be preferred. In this study, the SEM values could be considered very low, furtherly demonstrating the good reliability of the Optojump system for measuring contact time and lateral displacement. Combined with the lack of heteroscedasticity, the Bland–Altman analysis demonstrated a small bias of −0.010, −0.004, −0.014, −0.016 s for COD60, COD180, CLRJ, and MLRJ, respectively, being significant only for COD60. Graphical inspection of the Bland–Altman plots (
Figure 3) highlights a lower dispersion for COD60 and CLRJ compared with COD180 and MLRJ. However, the regression analysis demonstrated the presence of a fixed bias for COD60 and COD180, whilst a proportional bias for CLRJ and MLRJ, meaning that the measurement of contact time during change of direction tests with the Optojump system might be higher at a constant rate compared with force plate, whilst for the lateral rebound jumps the measurement with the Optojump system might be proportionally higher compared with force plate [
30].
Regarding the lateral jumping distance, for the first time this study demonstrated a “good” to “excellent” internal consistency reliability of the Optojump system for the measurement of lateral displacement during lateral jump tests. Indeed, except for stance leg in MLRJ (ICC = 0.872; rated as “good”), all the ICC values were rated as “excellent”, with low standard error of measurements (≤0.055 cm) and coefficients of variation (<10%). Therefore, the findings of the present study on lateral displacement are in line with previous investigations demonstrating an “excellent” reliability of the Optojump system in assessing vertical displacement [
13,
17,
29], fostering the use of the Optojump system for the evaluation of the lateral jump abilities.
In this study, the lateral rebound jumps were performed with a controlled and maximal execution with the aim of assessing the validity and reliability of the Optojump system in measuring performances when athletes have to either control their movement or exert their maximal effort. In fact, not all performances rely on maximal effort and higher postural control and coordinative requirements are necessary when movements are exerted with a controlled effort [
31].
It should be noted that different results for validity and reliability may be attributed to the different abilities investigated. The complexity of movement patterns may differ among vertical (i.e., countermovement and squat jump) and lateral (i.e., lateral countermovement, squat, and rebound jump) jumping modalities, and even more when sprinting with different angles of change of direction. The contribution of the three components of ground reaction force could vary during movement patterns executed in different directions [
19,
32,
33]. Furthermore, factors common to all tests (i.e., global) and factors unique to specific tests (i.e., sport-specific) can affect the analysis of reliability of any testing procedure [
34].
This study showed a first attempt to investigate the concurrent validity and internal consistency reliability of the Optojump system during change of direction and lateral jump abilities, augmenting the use of the Optojump system for the evaluation of sport-related abilities using a field-based approach, even though a possible measurement error can still be obtained. It is undoubted that the Optojump system proves to be portable, easy to install, and intuitive, hence allowing a broad application in sport performance investigation. Considering all these positive qualities, the Optojump system has been also used as a criterion method when the force plate was not available to assess the validity of other systems [
35,
36].
The present study has some limitations that need to be addressed and could serve as a guidance for future research. As main limitation, the participants of the present study were representative of a single sport (i.e., basketball) and were an athletic population of collegiate-aged students. Therefore, future studies could explore the reliability and validity of the Optojump system for the proposed change of direction and lateral jump tests also considering other team sports and elite athletes. Moreover, the evaluation of the test–retest reliability was not applicable in the present study since a single testing session for each test has been executed. Even though the findings of this study are in line with those of a previous study design [
12], future research could replicate the same experimental procedures but performing two experimental sessions and evaluate the test–retest reliability of the Optojump system. Finally, the validity of the Optojump system for the measurement of lateral jumping distance was not evaluated due to the lack of a criterion measure (i.e., force plate). Therefore, future research for the evaluation of validity could be performed if a long pathway of force plate is available (longer than 2 m).