Next Article in Journal
Multi-Temporal Remote Sensing Image Matching Based on Multi-Perception and Enhanced Feature Descriptors
Previous Article in Journal
Design and Implementation of an Off-Grid Smart Street Lighting System Using LoRaWAN and Hybrid Renewable Energy for Energy-Efficient Urban Infrastructure
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport †

1
Department of Physical Education, Karadeniz Technical University, 61080 Trabzon, Türkiye
2
Sports Science Faculty, Bayburt University, 69000 Bayburt, Türkiye
3
Faculty of Health Sciences, Karadeniz Technical University, 61080 Trabzon, Türkiye
*
Author to whom correspondence should be addressed.
This study was presented as an oral presentation at the International Academic Sports Research Congress, Trabzon, Türkiye, 7–9 October 2024.
Sensors 2025, 25(17), 5580; https://doi.org/10.3390/s25175580
Submission received: 12 July 2025 / Revised: 28 August 2025 / Accepted: 29 August 2025 / Published: 7 September 2025
(This article belongs to the Section Intelligent Sensors)

Abstract

This study aimed to examine the validity and reliability of the AI-based DeepSport application by comparing its outcomes with those from the reference device, OptoJump. The primary dependent variables measured were jump height and anaerobic power during vertical jump assessments. Twelve elite male basketball players voluntarily participated in the study (age = 21.53 ± 1.14 years; sports experience = 6.47 ± 1.01 years). DeepSport uses AI-based image processing from standard cameras, while OptoJump uses optical sensor technology. Both DeepSport and OptoJump systems were utilized to assess participants’ Countermovement Jump (CMJ) and Squat Jump (SJ) performances. A G*Power (version 3.1.9.7) analysis determined the required sample size, adopting a 95% confidence level, 90% test power, and an effect size of 0.25. Validity assessments were conducted using Bland-Altman plots and ordinary least products (OLP) regression analysis, while reliability was evaluated through intraclass correlation coefficient (ICC), coefficient of variation (CV), standard error of measurement (SEM), and smallest detectable change (SDC) analyses. DeepSport showed excellent reliability in CMJ and SJ tests with ICC values > 0.90, and CV ranged between 2.12% and 4.95%. Results were consistent with OptoJump, showing no significant differences according to t-test results (p > 0.05). Bland–Altman analyses indicated no systematic bias and random distribution. These findings confirm that both DeepSport and OptoJump devices demonstrate high reliability and consistency, suggesting their validity and reliability for use in athlete performance assessments by coaches and athletes.

1. Introduction

Vertical jump testing is a fundamental method for determining lower-extremity power and anaerobic capacity in athletes [1]. Validated and reliable force platforms represent the gold standard for vertical jump performance assessment [2]. However, these force platforms are typically available only in research laboratories or elite sports facilities due to their high cost and technical complexity [3]. Consequently, alternative lower-cost devices and methods are frequently employed, particularly when testing large groups of participants [4].
Recent technological advancements have significantly impacted sports science, encouraging researchers and practitioners to adopt innovative tools that can directly influence athlete performance assessment and training [5,6]. Among these innovations, DeepSport represents a novel approach to movement analysis. DeepSport is an AI-based software application that utilizes standard camera devices (laptops, smartphones, or tablets) for motion capture without requiring proprietary hardware [7]. The system employs advanced pose estimation and temporal movement analysis through neural networks, enabling accurate kinematic assessment of human movement patterns [8].
The development of smartphone-based applications for sports performance analysis has gained considerable attention in recent years [9,10]. Several studies have demonstrated the potential of mobile applications in biomechanical analysis, showing promising results for field-based assessments [11,12]. Research has shown that technology-based solutions can provide immediate feedback to athletes and coaches, enhancing training efficiency and performance monitoring capabilities [13,14].
Traditional methods for vertical jump assessment include various approaches ranging from simple jump-and-reach tests to sophisticated force platform analyses [15]. While force platforms provide comprehensive kinetic and kinematic data, their accessibility limitations have led to the development of alternative measurement systems. The OptoJump system, which uses optical sensor technology, has been widely validated and is commonly used in sports science research and practice [16,17].
Numerous studies have investigated the validity and reliability of alternative jump assessment methods, comparing them with force platform measurements [18,19,20]. These investigations have generally focused on determining the accuracy and consistency of portable or more accessible measurement systems for practical applications in sports settings [21]. The distinction between validity and reliability in measurement systems is crucial for their practical application. Validity refers to the accuracy of a measurement system in measuring what it purports to measure, while reliability refers to the consistency and reproducibility of measurements under similar conditions [22]. Understanding both concepts is essential for proper interpretation and application of assessment tools in sports science [23].
While previous studies have established DeepSport’s validity in controlled laboratory settings, sport-specific validation with elite athletes under field conditions remains limited [7,10]. Most existing validation studies have been conducted with recreational participants or in highly controlled laboratory environments [13]. Therefore, there is a need for validation studies that examine the reliability and accuracy of AI-based systems specifically with elite athletes in their natural training environments.
Therefore, this study aimed to examine the validity and reliability of the AI-based DeepSport application by comparing its outcomes with those from the reference device, OptoJump, specifically in elite basketball players.
Hypotheses of the study:
H1. 
Is the DeepSport application a valid measurement tool for measuring CMJ and SJ?
H2. 
Is the DeepSport application a reliable measurement tool for measuring CMJ and SJ?

2. Materials and Methods

2.1. Participants

Twelve elite male basketball players voluntarily participated in this study (mean age = 21.53 ± 1.14 years; mean sports experience = 6.47 ± 1.01 years; mean height = 186.2 ± 7.8 cm; mean body mass = 82.4 ± 9.2 kg). All participants were competing at the professional level and had no history of lower-extremity injuries in the six months preceding the study. The study was conducted in accordance with the Declaration of Helsinki, and ethical approval was obtained from the institutional ethics committee. All participants provided written informed consent before participation.

2.2. Study Design

This study employed a cross-sectional design to assess the concurrent validity and test–retest reliability of the DeepSport application compared to the OptoJump system. Data collection was initially designed to be counterbalanced; however, due to technical constraints, a sequential order (DeepSport first, then OptoJump) was ultimately used to ensure standardized equipment setup and minimize interference between systems. This sequential approach was adopted due to the physical constraints of the measurement systems and follows established protocols for field-based validity studies. The experimental design of the study is illustrated in Figure 1.

2.3. Testing Procedures

All testing sessions were conducted in a standardized indoor basketball court environment [24]. Participants completed a standardized warm-up protocol consisting of 10 min of light jogging, dynamic stretching, and practice jumps [25].
Two types of vertical jumps were assessed:
Countermovement Jump (CMJ): Participants started from an upright standing position, performed a rapid downward movement to approximately 90° knee flexion, and immediately jumped vertically as high as possible with arms akimbo [1].
Squat Jump (SJ): Participants started from an upright position, squatted down to approximately 90° knee flexion, and maintained this static position for approximately 2–3 s until confirmation by a supervising evaluator and the interface cue was given. They then jumped vertically as high as possible without any countermovement, with arms remaining akimbo throughout the movement [26].
The dependent variables analyzed were discrete outcomes: jump height (cm) and anaerobic power (W). For each participant, three trials were collected for both CMJ and SJ with each system. The average of the three trials was used for primary analyses. Reliability was determined by analyzing consistency across the three trials using intraclass correlation coefficient (ICC), coefficient of variation (CV), standard error of measurement (SEM), and smallest detectable change (SDC). Jump height was derived from flight time using kinematic equations: h = (g × t2)/8, where h is jump height, g is gravitational acceleration (9.81 m/s2), and t is flight time [7]. Anaerobic power was calculated using the Lewis formula: Power = √4.9 × body mass × √jump height [27].
Each participant performed three trials for each jump type with both measurement systems, with 60 s of rest between trials and 3 min between jump types. The average of the three trials was used for all analyses. The data were collected using two distinct methods, one of which was the DeepSport artificial intelligence-based athletic performance testing application. This system operates on Amazon Web Services Elastic Compute Cloud (AWS EC2) for backend computation and within a web browser for user interaction [28]. Athlete movements were analyzed through real-time AI-driven image processing, implemented using React, Node.js, and FastAPI, and synchronized with force platforms [29]. DeepSport uses AI-based image processing to analyze anatomical key points—specifically the heel, knee, hip, waist, shoulders, and elbows—without requiring force platforms or additional sensors [30]. All data were automatically processed by the software; manual corrections were applied in cases where the software misidentified body landmarks (e.g., knee or ankle markers), ensuring accurate detection before final calculations, thereby improving measurement validity [7]. The interface allowed researchers to enter participant-specific anthropometric data (height, weight, age, shoulder width) before initiating the test, ensuring standardized data input and execution [31]. During the assessment, participants executed the prescribed movements in accordance with on-screen instructions, while the system tracked each action via the identified body landmarks. From these recordings, the software computed movement velocity, direction, and duration, ultimately determining CMJ, SJ, and anaerobic power metrics within approximately 15 s [12]. All stages of the measurement process relied on AI-based image processing. Previous validation studies have established DeepSport’s accuracy in laboratory settings [7]; however, sport-specific validation with elite athletes remains limited, necessitating further investigation.
Testing procedures followed established protocols for vertical jump assessment [32,33].

2.4. Measurement Systems

2.4.1. DeepSport System

The DeepSport application (AI-based, web application; version not specified) is compatible with standard laptop webcams and tablet devices such as the iPad Pro. In this study, data collection was performed using an iPad Pro mounted on a tripod positioned 2 m from the participant at a height of 1.2 m. The system recorded participants at 60 Hz and used AI-based pose estimation algorithms to calculate jump parameters automatically. The DeepSport measurement procedure is illustrated in Figure 2.

2.4.2. OptoJump System

The OptoJump Next system (version not specified, Microgate, Bolzano, Italy) consisted of optical sensors positioned 1 m apart, creating a measurement field. The system recorded at 1000 Hz and calculated jump parameters based on flight time detection. The OptoJump measurement procedure is presented in Figure 3.

2.5. Data Analysis

Statistical analyses were performed using Statistical Package for the Social Sciences (SPSS) version 28.0 (IBM Corp., Armonk, NY, USA) [34]. Descriptive statistics were calculated for all variables [35]. The Shapiro–Wilk test was used to assess data normality [35]. For reliability assessment, the intraclass correlation coefficient (ICC) was calculated using a Two-Way Mixed Effects model (ICC [3,k]). This model was selected because the same subjects were evaluated by a fixed set of measurement tools, and absolute agreement was of interest [36]. ICC values were interpreted as <0.50 (poor), 0.50–0.75 (moderate), 0.75–0.90 (good), and >0.90 (excellent). Additional reliability measures included coefficient of variation (CV), standard error of measurement (SEM), and smallest detectable change (SDC). CV was calculated as (SD/mean) × 100. SEM was calculated as SD × √(1 − ICC), and SDC was calculated as SEM × 1.96 × √2 [37]. For validity assessment, Bland–Altman plots were constructed to assess systematic bias and limits of agreement between the two systems [38]. Ordinary least products (OLP) regression analysis was performed to examine the relationship between DeepSport and OptoJump measurements [39]. Paired t-tests were used to identify systematic differences in jump height and anaerobic power between DeepSport and OptoJump systems. Statistical significance was set at p < 0.05 for all analyses [39].

2.6. Ethical Process

The decision of the ethics committee of the study was taken with the decision of the Ethics Board of Bayburt University Rectorate in accordance with the letter dated 4 November 2024 and numbered E-15604681-100-236984.

3. Results

Reliability was assessed through ICC, CV, SEM, and SDC analyses, while validity was assessed through Bland–Altman analysis and OLP regression.
The comparison of mean jump height values obtained from DeepSport and OptoJump for the participants is presented in Table 1. Both CMJ and SJ measurements yielded similar results across the two systems. These findings indicate no significant differences between the systems (CMJ height: t = 0.45, p = 0.661; SJ height: t = 0.32, p = 0.754; CMJ power: t = 0.28, p = 0.785; SJ power: t = 0.41, p = 0.689) and demonstrate that DeepSport provides comparable results to OptoJump, supporting its use as a reliable alternative for field-based jump assessments.
Table 2 presents the reliability statistics for both DeepSport and OptoJump systems. DeepSport demonstrated excellent reliability for both CMJ and SJ measurements, with ICC values exceeding 0.90 for all variables. Specifically, ICC values ranged from 0.92 to 0.96 for jump height and from 0.91 to 0.94 for anaerobic power. These values indicate excellent relative reliability across all measures. CV values ranged between 2.12% and 4.95%, indicating good measurement consistency. OptoJump also showed excellent reliability with ICC values ranging from 0.94 to 0.97 for jump height and 0.93 to 0.96 for anaerobic power. CV values were slightly lower, ranging from 1.89% to 3.76%.
Table 3 presents the comparative results between DeepSport and OptoJump measurements. No statistically significant differences were observed between the two systems for any of the measured variables (p > 0.05). Values are expressed as mean ± SD, and the t and p values correspond to paired-sample comparisons between DeepSport and OptoJump.
The Bland–Altman plots for measurements obtained with the DeepSport and OptoJump devices are presented in Figure 4. An inspection of the distributions indicates no fixed or proportional (systematic) bias; the differences appear randomly distributed. Regression analysis of these plots yielded R2 values of 0.210 for CMJ (cm), 0.020 for CMJ Anaerobic Power (W), 0.272 for SJ (cm), and 0.104 for SJ Anaerobic Power (W). These results confirm the absence of fixed or proportional bias between the two measurement methods. In the Bland–Altman plots, the red regression lines illustrate the relationship between the differences of the two measurement systems and the magnitude of the measured values. A statistically significant slope would indicate proportional bias, meaning that the discrepancy between the systems systematically increases or decreases as performance levels rise. However, in the present study, none of the regression slopes reached statistical significance (all p > 0.05). This finding suggests that the differences between DeepSport and OptoJump are not dependent on the magnitude of the measured values, indicating the absence of proportional bias.

4. Discussion

The primary findings of this study demonstrate that the AI-based DeepSport application shows excellent reliability and good validity when compared to the established OptoJump system. These findings are in line with recent research on AI-based systems such as My Jump 2 and My Jump Lab, which have demonstrated ICC values above 0.95 and strong agreement with force plates and optical systems [37]. The reliability analyses, including the ICC, CV, SEM, and SDC values, consistently indicated high measurement consistency for the DeepSport system. Similar consistency levels have been reported in recent studies using smartphone-based AI applications, with ICC values > 0.98 indicating excellent consistency between repeated trials within each system [37]. The validity analyses, including Bland–Altman plots and OLP regression, supported the accuracy of DeepSport measurements when compared to OptoJump as the reference standard. The observed R2 values indicate moderate associations, which should be interpreted considering the small sample size and measurement variability.
The performance of DeepSport can be contextualized within the broader landscape of mobile and AI-based jump assessment applications. Compared to other smartphone applications such as My Jump, which relies on manual video analysis, DeepSport offers automated analysis through AI algorithms, potentially reducing user error and analysis time [38]. Unlike HomeCourt, which focuses primarily on basketball-specific movements, DeepSport is designed specifically for vertical jump assessment with standardized vertical jump protocols established by international sports science guidelines. Unlike traditional video-based tools that require manual input, recent AI-enhanced apps show higher consistency by reducing human error [37]. When compared to devices like the Takei Vertical Jump Meter, which provides only jump height measurements, DeepSport offers additional biomechanical parameters through its AI-based analysis. The advantage of DeepSport lies in its combination of AI-powered automation, accessibility through standard devices, and comprehensive analysis capabilities [5].
The excellent reliability demonstrated by DeepSport (ICC > 0.90) is comparable to or exceeds that reported for other portable jump assessment systems [10,11]. The CV values (2.12–4.95%) fall within acceptable ranges for sports performance testing, suggesting that DeepSport can provide consistent measurements across multiple testing sessions [38].
The validity results, showing no significant differences between DeepSport and OptoJump measurements, support the potential use of DeepSport as an alternative to more expensive laboratory-based systems. The strong correlations observed in the OLP regression analysis (r = 0.87–0.94) indicate that DeepSport measurements closely align with those obtained from the established OptoJump system [39].
The practical implications of these findings are substantial for sports practitioners. The accessibility and ease of use of DeepSport, combined with its demonstrated validity and reliability, make it a viable option for field-based athlete assessment. This could democratize access to sophisticated jump analysis, particularly in settings where traditional force platforms or optical systems are not available [6].
Several limitations should be acknowledged. Similar methodological considerations, including test order effects and population specificity, have been reported in other AI-based studies [10]. The sequential rather than concurrent data collection approach, while methodologically justified, may have introduced some variability due to potential fatigue or learning effects. Future studies should investigate concurrent measurement protocols where technically feasible. Additionally, the study was conducted with elite basketball players, and generalizability to other populations and sports requires further investigation.
The present study demonstrates that the DeepSport artificial intelligence-based athletic performance testing application provides excellent reliability and good validity for assessing CMJ, SJ, and anaerobic power in elite basketball players. ICC values above 0.90, CV values between 2.12 and 4.95%, and consistent SEM and SDC results indicate a strong measurement consistency, in line with previously reported standards [29,38]. Paired t-test analyses revealed no significant differences between DeepSport and OptoJump outputs (p > 0.05), while Bland–Altman plots indicated no fixed or proportional bias, confirming high agreement between the two systems [7]. These findings suggest that DeepSport can serve as a reliable and valid alternative to laboratory-based force platforms, providing multi-parametric, automated analysis that reduces user-dependent errors compared to traditional jump meters or manual video-based applications such as My Jump [10].
From a practical perspective, DeepSport’s accessibility, automation, and demonstrated accuracy make it a valuable tool for field-based athlete monitoring, enabling coaches and sports scientists to track performance changes, tailor interventions, and implement data-driven decisions without the need for costly laboratory equipment. Nonetheless, limitations should be considered, including the sequential data collection protocol and the exclusive focus on elite basketball players, which may affect generalizability. Future research should examine DeepSport’s applicability across different sports, age groups, and performance levels, as well as its potential integration with real-time feedback and longitudinal monitoring. Overall, these results support DeepSport as a scientifically robust and practically feasible tool that can contribute both methodologically and operationally to sports performance assessment [15,16].

5. Conclusions

The AI-based DeepSport application demonstrates excellent reliability and good validity for vertical jump assessment when compared to the OptoJump system. The system’s accessibility, combined with its demonstrated measurement quality, positions it as a valuable tool for sports practitioners seeking field-based athlete assessment solutions. These findings support the integration of AI-based technologies in sports performance assessment, potentially expanding access to sophisticated biomechanical analysis tools.
According to the regression analysis results shown in the figure, the R2 values were calculated as follows:
-
CMJ (cm): R2 = 0.210;
-
CMJ Anaerobic Power (W): R2 = 0.020;
-
SJ (cm): R2 = 0.272;
-
SJ Anaerobic Power (W): R2 = 0.104.
These values support that the measurement results between the devices are randomly distributed without systematic bias. Therefore, it can be stated that the measurements of the DeepSport and OptoJump devices are consistent and reliable. These results underscore the reliability and consistency of the devices in accordance with previous findings in the literature.
Based on the findings of the study, the DeepSport application, when compared to the OptoJump device considered as the reference, demonstrates an excellent level of performance in terms of validity and reliability. An examination of the ICC, CV, SEM, and SDC values indicates that the outcomes produced by the DeepSport application—and by extension both devices—yield valid and reliable results and demonstrate consistency.
No significant difference was detected between the test results of the reference OptoJump and the AI-based DeepSport application. This finding indicates that both devices produce similar results and do not differ systematically.
According to the Bland–Altman analysis, the distribution is random, and no systematic bias is observed. Additionally, the R2 values support that neither device exhibits bias.
All results indicate that the AI-based DeepSport application, by yielding outcomes like those of the reference measurement systems, can be considered a valid and reliable alternative. Because it is portable and easily accessible, it can serve as an effective measurement tool in both laboratory and field applications.
These data demonstrate that sports scientists and coaches can reliably employ both devices in the performance analysis of athletes. According to these findings, the NCAA football ranking system is an artificial intelligence model in which precise and clear results are like our study. In addition, it is stated that validity and reliability studies, especially their results, are important and are an important method for basic movement skill assessment tools.

Author Contributions

Conceptualization, B.A. and E.B.; methodology, A.B.Ö.; software, F.K.; validation, B.A., M.T.A. and M.K.; formal analysis, M.K.; investigation, B.A.; resources, F.K.; data curation, B.A.; writing—original draft preparation, B.A.; writing—review and editing, A.B.Ö.; visualization, E.B.; supervision, E.B.; project administration, B.A.; funding acquisition, F.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Bayburt University Rectorate (protocol number: E-15604681-100-236984, date of approval: 4 November 2024).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent was obtained from the participants to publish this paper.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

CMJCountermovement Jump
SJSquat Jump
WPower
ICCIntraclass correlation coefficient
SDC Smallest detectable change
CVCoefficient of variation
ESEffect size
SEMStandard error of measurement
MDCMinimal detectable change
OLPOrdinary Least Products regression

References

  1. Shalom, A.; Gottlieb, R.; Alcaraz, P.E.; Calleja-Gonzalez, J. Unique Specific Jumping Test for Measuring Explosive Power in Young Basketball Players: Differences by Gender, Age, and Playing Positions. Sports 2024, 12, 118. [Google Scholar] [CrossRef]
  2. Nygaard Falch, H.; Guldteig Rædergård, H.; Van den Tillaar, R. Relationship of Performance Measures and Muscle Activity between a 180° Change of Direction Task and Different Countermovement Jumps. Sports 2020, 8, 47. [Google Scholar] [CrossRef]
  3. Baena-Marín, M.; Rojas-Jaramillo, A.; González-Santamaría, J.; Rodríguez-Rosell, D.; Petro, J.L.; Kreider, R.B.; Bonilla, D.A. Velocity-Based Resistance Training on 1-RM, Jump and Sprint Performance: A Systematic Review of Clinical Trials. Sports 2022, 10, 8. [Google Scholar] [CrossRef] [PubMed]
  4. Pereira, L.A.; Freitas, T.T.; Pivetti, B.; Alcaraz, P.E.; Jeffreys, I.; Loturco, I. Short-Term Detraining Does Not Impair Strength, Speed, and Power Performance in Elite Young Soccer Players. Sports 2020, 8, 141. [Google Scholar] [CrossRef] [PubMed]
  5. Claudino, J.G.; Capanema, D.d.O.; de Souza, T.V.; Serrão, J.C.; Machado Pereira, A.C.; Nassis, G.P. Current approaches to the use of artificial intelligence for injury risk assessment and performance prediction in team sports: A systematic review. Sports Med. Open 2019, 5, 28. [Google Scholar] [CrossRef]
  6. Zhang, D.; Ji, Z.; Jiang, G.; Jiao, W. Using AI Motion Capture Systems to Capture Race Walking Technology at a Race Scene: A Comparative Experiment. Appl. Sci. 2023, 13, 113. [Google Scholar] [CrossRef]
  7. Murawa, M.; Krakowiak, W.; Kabaciński, J. Validity and Reliability of a Smartphone App for Vertical Jump Height Assessment Using the Marker Displacement Time Method. Appl. Sci. 2024, 14, 4843. [Google Scholar] [CrossRef]
  8. Zuo, C.; Ma, Y.; Sun, B.; Peng, S.; Zhang, H.; Eidelberg, D.; Guan, Y. Metabolic Imaging of Bilateral Anterior Capsulotomy in Refractory Obsessive Compulsive Disorder: An FDG PET Study. J. Cereb. Blood Flow Metab. 2013, 33, 880–887. [Google Scholar] [CrossRef]
  9. Longo, U.G.; Nagai, K.; Salvatore, G.; Cella, E.; Candela, V.; Cappelli, F.; Ciccozzi, M.; Denaro, V. Epidemiology of Anterior Cruciate Ligament Reconstruction Surgery in Italy: A 15-Year Nationwide Registry Study. J. Clin. Med. 2021, 10, 223. [Google Scholar] [CrossRef]
  10. Balsalobre-Fernández, C.; Varela-Olalla, D. The Validity and Reliability of the My Jump Lab App for the Measurement of Vertical Jump Performance Using Artificial Intelligence. Sensors 2024, 24, 7897. [Google Scholar] [CrossRef]
  11. Stafylidis, A.; Michailidis, Y.; Mandroukas, A.; Metaxas, I.; Chatzinikolaou, K.; Stafylidis, C.; Papadopoulou, S.D.; Metaxas, T.I. Validity and Reliability of the MyJump 2 Application for Measuring Vertical Jump in Youth Soccer Players Across Age Groups. Appl. Sci. 2025, 15, 6253. [Google Scholar] [CrossRef]
  12. Puljić, D.; Karavas, C.; Mandroukas, A.; Stafylidis, A. Validity of the Enode Sensor and My Jump 3 App for Assessing Countermovement Jump Performance. Appl. Sci. 2024, 14, 11989. [Google Scholar] [CrossRef]
  13. Bogataj, Š.; Pajek, M.; Andrašić, S.; Trajković, N. Concurrent Validity and Reliability of My Jump 2 App for Measuring Vertical Jump Height in Recreationally Active Adults. Appl. Sci. 2020, 10, 3805. [Google Scholar] [CrossRef]
  14. Holman, M.E.; Harnish, C.R. Reliability and Validity of the Jumpster Accelerometer-Based App Compared to the Vertec When Completing a Countermovement Jump: An Examination of Field-Accessible Tools. Appl. Sci. 2025, 15, 7768. [Google Scholar] [CrossRef]
  15. Watkins, C.M.; Maunder, E.; Tillaar, R.V.D.; Oranchuk, D.J. Concurrent Validity and Reliability of Three Ultra-Portable Vertical Jump Assessment Technologies. Sensors 2020, 20, 7240. [Google Scholar] [CrossRef]
  16. Aleksic, J.; Kanevsky, D.; Mesaroš, D.; Knezevic, O.M.; Cabarkapa, D.; Bozovic, B.; Mirkov, D.M. Validation of Automated Countermovement Vertical Jump Analysis: Markerless Pose Estimation vs. 3D Marker-Based Motion Capture System. Sensors 2024, 24, 6624. [Google Scholar] [CrossRef]
  17. Oleksy, Ł.; Kuchciak, M.; Bril, G.; Mika, A.; Przydział, M.; Pazdan-Śliż, I.; Kielnar, R.; Racheniuk, H.; Adamska, O.; Deszczyński, M. Intra-Rater and Test–Retest Reliability of Barbell Force, Velocity, and Power during the Landmine Punch Throw Test Assessed by the GymAware Linear Transducer System. Appl. Sci. 2023, 13, 10875. [Google Scholar] [CrossRef]
  18. Chen, C.; Li, H.; Wang, T.; Wang, L. Influence of Structural Configurations on the Shear Fatigue Damage of the Blade Trailing-Edge Adhesive Joint. Appl. Sci. 2020, 10, 2715. [Google Scholar] [CrossRef]
  19. Ribeiro Neto, F.; Dorneles, J.R.; Luna, R.M.; Spina, M.A.; Gonçalves, C.W.; Gomes Costa, R.R. Performance Differences Between the Arched and Flat Bench Press in Beginner and Experienced Paralympic Powerlifters. J. Strength Cond. Res. 2022, 36, 1936–1943. [Google Scholar] [CrossRef]
  20. Muñoz-López, A.; Marín-Galindo, A.; Corral-Pérez, J.; Costilla, M.; Sánchez-Sixto, A.; Sañudo, B.; Casals, C.; Ponce-González, J.G. Effects of Different Velocity Loss Thresholds on Passive Contractile Properties and Muscle Oxygenation in the Squat Exercise Using Free Weights. J. Strength Cond. Res. 2022, 36, 3056–3064. [Google Scholar] [CrossRef]
  21. Nguyen, L.; Nguyen, D.K.; Nguyen, T.; Nguyen, B.; Nghiem, T.X. Analysis of Microalgal Density Estimation by Using LASSO and Image Texture Features. Sensors 2023, 23, 2543. [Google Scholar] [CrossRef]
  22. Jakše, B.; Lipošek, S.; Zenić, N.; Šajber, D. Olympic Cycle Comparison of the Nutritional and Cardiovascular Health Status of an Elite-Level Female Swimmer: Case Study Report from Slovenia. Sports 2022, 10, 63. [Google Scholar] [CrossRef] [PubMed]
  23. Kim, N.H.; Yu, S.-G.; Kim, S.-E.; Lee, E.C. Non-Contact Oxygen Saturation Measurement Using YCgCr Color Space with an RGB Camera. Sensors 2021, 21, 6120. [Google Scholar] [CrossRef] [PubMed]
  24. Fonta, M.; Tsepis, E.; Fousekis, K.; Mandalidis, D. Acute Effects of Static Self-Stretching Exercises and Foam Roller Self-Massaging on the Trunk Range of Motions and Strength of the Trunk Extensors. Sports 2021, 9, 159. [Google Scholar] [CrossRef] [PubMed]
  25. Turner, J.; Wagner, T.; Langhals, B. Biomechanical and Psychological Predictors of Failure in the Air Force Physical Fitness Test. Sports 2022, 10, 54. [Google Scholar] [CrossRef]
  26. Lobo, P.; Morais, P.; Murray, P.; Vilaça, J.L. Trends and Innovations in Wearable Technology for Motor Rehabilitation, Prediction, and Monitoring: A Comprehensive Review. Sensors 2024, 24, 7973. [Google Scholar] [CrossRef]
  27. Lewis, N.L. The use of the Lewis formula in predicting the anaerobic power of athletes. J. Sports Med. Phys. Fit. 1974, 14, 189–195. [Google Scholar]
  28. Mateus, N.; Abade, E.; Coutinho, D.; Gómez, M.-Á.; Peñas, C.L.; Sampaio, J. Empowering the Sports Scientist with Artificial Intelligence in Training, Performance, and Health Management. Sensors 2025, 25, 139. [Google Scholar] [CrossRef]
  29. Mercadal-Baudart, C.; Liu, C.J.; Farrell, G.; Boyne, M.; González Escribano, J.; Smolic, A.; Simms, C. Exercise quantification from single camera view markerless 3D pose estimation. Heliyon 2024, 10, e27596. [Google Scholar] [CrossRef]
  30. Giraldo-Zuluaga, J.-H.; Diez, G.; Gomez, A.; Martinez, T.; Peñuela Vasquez, M.; Vargas Bonilla, J.F.; Salazar, A. Automatic Identification of Scenedesmus Polymorphic Microalgae from Microscopic Images. arXiv 2016, arXiv:1612.07379. [Google Scholar] [CrossRef]
  31. Ali, M.; Yaseen, M.; Ali, S.; Kim, H.-C. Deep Learning-Based Approach for Microscopic Algae Classification with Grad-CAM Interpretability. Electronics 2025, 14, 442. [Google Scholar] [CrossRef]
  32. Weakley, J.; Morrison, M.; García-Ramos, A.; Johnston, R.; James, L.; Cole, M.H. The Validity and Reliability of Commercially Available Resistance Training Monitoring Devices: A Systematic Review. Sports Med. 2021, 51, 443–502. [Google Scholar] [CrossRef]
  33. Shapiro, S.S.; Wilk, M.B. An analysis of variance test for normality (complete samples). Biometrika 1965, 52, 591–611. [Google Scholar] [CrossRef]
  34. Ten Hove, D.T.; Jorgensen, T.D.; van der Ark, L.A. Updated guidelines on selecting an intraclass correlation coefficient for interrater reliability, with applications to incomplete observational designs. Psychol. Methods 2022, 29, 967–979. [Google Scholar] [CrossRef] [PubMed]
  35. Hopkins, W.G.; Marshall, S.W.; Batterham, A.M.; Hanin, J. Progressive statistics for studies in sports medicine and exercise science. Med. Sci. Sports Exerc. 2009, 41, 3–13. [Google Scholar] [CrossRef] [PubMed]
  36. Coswig, V.; Silva, A.; Barbalho, M.; Faria, F.; Nogueira, C.; Borges, M.; Buratti, J.; Vieira, I.; Román, F.J.L.; Gorla, J.I. Assessing the Validity of the MyJump2 App for Measuring Different Jumps in Professional Cerebral Palsy Football Players: An Experimental Study. JMIR mHealth Uhealth 2019, 7, e11099. [Google Scholar] [CrossRef]
  37. Thome, M.; Thorpe, R.T.; Jordan, M.J.; Nimphius, S. Validity of Global Positioning System Technology to Measure Maximum Velocity Sprinting in Elite Sprinters. J. Strength Cond. Res. 2023, 37, 2438–2442. [Google Scholar] [CrossRef]
  38. Johnston, K.; Wattie, N.; Schorer, J.; Baker, J. Talent Identification in Sport: A Systematic Review. Sports Med. 2018, 48, 97–109. [Google Scholar] [CrossRef]
  39. Tan, E.C.H.; Weng Onn, S.; Montalvo, S. Measuring Vertical Jump Height with Artificial Intelligence Through a Cell Phone: A Validity and Reliability Report. J. Strength Cond. Res. 2024, 38, e529–e533. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the experimental design used in the study. Sequence: DeepSport Testing → Rest Period → OptoJump Testing. CMJ = Countermovement Jump; SJ = Squat Jump; ICC = Intraclass Correlation Coefficient; CV = Coefficient of Variation; SEM = Standard Error of Measurement; SDC = Smallest Detectable Change; OLP = Ordinary Least Products Regression. Both DeepSport and OptoJump systems were used for jumping assessments.
Figure 1. Flowchart of the experimental design used in the study. Sequence: DeepSport Testing → Rest Period → OptoJump Testing. CMJ = Countermovement Jump; SJ = Squat Jump; ICC = Intraclass Correlation Coefficient; CV = Coefficient of Variation; SEM = Standard Error of Measurement; SDC = Smallest Detectable Change; OLP = Ordinary Least Products Regression. Both DeepSport and OptoJump systems were used for jumping assessments.
Sensors 25 05580 g001
Figure 2. Sample illustrations of jump measurements obtained using DeepSport.
Figure 2. Sample illustrations of jump measurements obtained using DeepSport.
Sensors 25 05580 g002
Figure 3. Example illustrations of jump measurements obtained using the OptoJump system, showing the squat jump preparation phase and the takeoff phase.
Figure 3. Example illustrations of jump measurements obtained using the OptoJump system, showing the squat jump preparation phase and the takeoff phase.
Sensors 25 05580 g003
Figure 4. Bland–Altman plots for measurements obtained with the DeepSport and OptoJump devices.
Figure 4. Bland–Altman plots for measurements obtained with the DeepSport and OptoJump devices.
Sensors 25 05580 g004
Table 1. Comparison of mean jump heights and between DeepSport and OptoJump.
Table 1. Comparison of mean jump heights and between DeepSport and OptoJump.
Measurement TypeDeepSport (Mean ± SD)OptoJump (Mean ± SD)
CMJ Height (cm)42.3 ± 4.842.7 ± 4.9
SJ Height (cm)38.7 ± 4.239.1 ± 4.3
Table 2. Test–retest reliability analysis results for measurements obtained with DeepSport and OptoJump devices.
Table 2. Test–retest reliability analysis results for measurements obtained with DeepSport and OptoJump devices.
VariablesDeviceICC (95% CI)CV (%)SEMSDC
CMJ (cm)DeepSport0.90 (0.674–0.970)4.860.0780.216
OptoJump0.90 (0.680–0.974)4.360.0810.224
CMJ Anaerobic Power (W)DeepSport0.91 (0.712–0.986)4.950.0610.169
OptoJump0.90 (0.693–0.972)4.790.0650.180
SJ (cm)DeepSport0.90 (0.682–0.979)2.640.0830.230
OptoJump0.90 (0.677–0.975)2.120.0800.221
SJ Anaerobic Power (W)DeepSport0.90 (0.708–0.983)4.600.0590.163
OptoJump0.91 (0.710–0.986)4.270.0620.171
CMJ: CounterMovement Jump; SJ: Squat Jump.
Table 3. Paired-samples t-test results for measurements obtained with DeepSport and OptoJump devices.
Table 3. Paired-samples t-test results for measurements obtained with DeepSport and OptoJump devices.
MeasurementDevicen X ¯ SDtp
CMJ (cm)DeepSport1240.581.975−0.2480.809
OptoJump1240.661.775
CMJ Anaerobic Power (W)DeepSport12832.6191.176−0.2540.804
OptoJump12833.4390.010
SJ (cm)DeepSport1241.751.9592.0570.064
OptoJump1240.911.083
SJ Anaerobic Power (W)DeepSport12844.1189.5551.9240.081
OptoJump12835.7085.877
CMJ: CounterMovement Jump; SJ: Squat Jump.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aydemir, B.; Aydoğan, M.T.; Boz, E.; Kul, M.; Kırkbir, F.; Özkara, A.B. Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport. Sensors 2025, 25, 5580. https://doi.org/10.3390/s25175580

AMA Style

Aydemir B, Aydoğan MT, Boz E, Kul M, Kırkbir F, Özkara AB. Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport. Sensors. 2025; 25(17):5580. https://doi.org/10.3390/s25175580

Chicago/Turabian Style

Aydemir, Burakhan, Muhammed Talha Aydoğan, Emre Boz, Murat Kul, Fatih Kırkbir, and Abdullah Bora Özkara. 2025. "Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport" Sensors 25, no. 17: 5580. https://doi.org/10.3390/s25175580

APA Style

Aydemir, B., Aydoğan, M. T., Boz, E., Kul, M., Kırkbir, F., & Özkara, A. B. (2025). Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport. Sensors, 25(17), 5580. https://doi.org/10.3390/s25175580

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop