Abstract
The purpose of this study was to identify the sport psychological skills of Taekwondo athletes and to develop a scale measuring such skills. We collected preliminary data using an open-ended online survey targeting Taekwondo athletes from nine countries (South Korea, China, Malaysia, United States, Spain, France, Brazil, United Kingdom, and Taiwan) who participated in international competitions between 2019 and 2020. We extracted participants’ sport psychological skills from 75 survey responses, guided by expert meetings and a thorough literature review. We verified our Taekwondo psychological skill scale’s construct validity using 840 survey responses. We utilized V coefficients, parallel analysis, an exploratory structural equation model, maximum likelihood, confirmatory factor analysis, and multi-group confirmatory factor analysis for data analysis. We identified six core sport psychological skills: “goal setting,” “confidence,” “imagery,” “self-talk,” “fighting spirit,” and “concentration.” Our final measure, which demonstrated evidence of reliability and validity, comprises 18 items spanning 6 factors, with each item rated on a 3-point Likert scale.
1. Introduction
Athletes’ performance relies as much on mental strength as on physical strength and athletic skills. This means that psychological skills are crucial for optimal athletic performance [1]. According to a study by Orlick and Partington [2], the psychological readiness of Canadian national athletes competing in the 1984 Los Angeles Olympics majorly influenced the number of medals won. In other words, their psychological training process—including goal setting, psychological preparation for the actual competition, and coping strategies for uncertain situations—was highly effective. In agreement with this, studies on athletes’ psychological characteristics [3,4,5,6] show that high-performing athletes have higher confidence and lower anxiety levels than less successful athletes. Researchers also report that athletes with clear goals actively cope with anxiety and have excellent concentration, mental preparation, and ability to immerse themselves in the competition as well as to relax. Accordingly, it is becoming increasingly important for athletes to cultivate psychological coping abilities in games or training situations to maximize their performance.
The readiness to cope with various emotional or psychological problems in sports is referred to as sport psychological skills [7,8,9]. Sport psychological skills are techniques and strategies for achieving optimal performance by regulating negative psychological factors that interfere with the competition, such as anxiety, fear, and frustration [10]. Therefore, sport psychological skills are considered essential for stable athletic performance [11].
In sport classification, closed-skill sports and open-skill sports are divided according to the connection status of the mind–body feedback, and more than 80% of the performance in closed-skill sports is determined by psychological factors [12,13]. Accordingly, sport psychological skills have long been used in closed-loop skill sports such as shooting and archery, but their use is gradually expanding to open-loop skill sports such as skating and gymnastics [12,13].
Targets are also expanding, as even athletes who are not experiencing psychological problems can still apply these skills. In accordance with this trend, sport psychological skills are constantly changing and developing. It is possible to define known sport psychological skills as imagery, relaxation, goal setting, and concentration, so that they reflect the characteristics of specific sports and the diversity of the training and competitive conditions.
Taekwondo has 209 member countries, being a worldwide sport adopted in 16 single international competitions and 15 countries’ comprehensive international competitions [14]. Taekwondo is a martial art where victory or defeat in a match is determined by striking one’s opponent. Athletes face a great psychological burden during competitions; thus, not only strong physical strength and skills but also psychological management of fear and anxiety are important in Taekwondo [15]. There have been numerous studies of Taekwondo athletes’ psychological skills [15,16,17,18,19], revealing that relaxation, self-talk, and imagery are especially closely related to the athletic performance. However, despite uncovering the relationship between performance and sport psychological skills, these studies also have limitations, in that they did not determine the mechanisms or created measures of sport psychological skills specifically reflecting Taekwondo. Therefore, we argue that it is necessary to perform a structural exploration of Taekwondo athletes’ sport psychological skills and to develop a scale to measure them. This would lead to a more comprehensive understanding of Taekwondo athletes’ performance, including ways to maximize it through skills training.
Scale development studies in the social sciences and sports are largely divided into two categories: (1) those that use the ternary analysis of content validity, construct validity, and criterion-related validity along with the classical test theory [20] and (2) those that develop scales based on the Rasch model of item response theory and integrated validity as a criterion [21,22,23]. However, the ternary analysis method may distort the factor structure due to researchers’ subjectivity when creating items and extracting factors from the theoretical model [24]. Additionally, there are obstacles impairing the scale’s validity and reliability, including the inability to use various objective indicators, which reduces the replicability of the theoretical model captured by the scale [25,26,27,28,29,30]. To address these limitations, researchers have recently employed Benson’s [31] construct validity approach as an alternative scale development method that utilizes the item response theory and Messick’s [32] integrated validity concept as a criterion, which was adopted as a standard in the Standards for Educational and Psychological Testing suggested by the American Educational Research, American Psychological Association, and National Council on Measurement in Education [33]. Based on the integrated validity concept, Benson’s [31] construct validity approach considers not only the test subject’s validity and reliability but also the reliability and difficulty of the items themselves. Therefore, it has the advantage of being able to examine scales objectively, regardless of individuals’ characteristics [29]. In the process of developing a scale, the method also analyzes the constructs to be measured, using the common factor model and structural equation for each substantive, structural, and external domain; further, it utilizes all data from theoretical and practical perspectives to improve the scale’s psychometric properties [26,27,31]. Therefore, to develop a scale by empirically reflecting the given theoretical model and individuals’ psychological characteristics, the construct validity approach appears appropriate [31].
The purpose of this study was to explore Taekwondo athletes’ sport psychological skills by applying the integrated validity concept and construct validity approach, ultimately developing a scale measuring these skills. This study’s results may provide a strategic reference for identifying Taekwondo athletes’ psychological abilities and thereby improving their athletic performance.
2. Methods
2.1. Participants and Data Collection
Research participants included an expert group and an athlete group. The expert group enabled us to extract the sport psychological factors and to test the scale items’ content validity. Accordingly, we recruited sports psychology experts with professional knowledge or experience in Taekwondo, using the purposive sampling method, as shown in Table 1.
Table 1.
General characteristics of the expert group.
As shown in Table 2, the expert group consisted of three sports psychology professors, three national Taekwondo coaches with more than 10 years of experience, and three Taekwondo athletes with more than 5 years of national team experience.
Table 2.
General Characteristics of the Survey Participants.
Meanwhile, we conducted an online self-report survey with individuals from nine countries (South Korea, China, Malaysia, US, Spain, France, Brazil, UK, and Taiwan) who participated in international Taekwondo competitions between 2019 and 2020 to analyze the construct validity of our Taekwondo sport psychological skill scale.
The surveys took the form of either an open-ended questionnaire or Likert-scale items. We collected 75 total responses to the open-ended questionnaire and 882 total responses to the Likert-scale questionnaire. However, we eliminated 42 responses due to careless responding, which yielded a total of 840 responses for the analysis. Among these responses, we randomly divided those to the Likert-scale questionnaire in two groups (Group A/Group B) for analysis.
2.2. Data Analysis
In this study, we analyzed the substantive domain, structural domain, and external domain according to Benson’s [31] construct validity procedure, while also utilizing the Rasch model based on the concept of integrated validity in Table 3.
Table 3.
Composition of the questionnaire.
In the substantive domain, we generated items based on the conceptual structure of Taekwondo athletes’ sport psychological skills, and then experts evaluated the items’ appropriateness through content validity verification using Aiken’s [34] V factor. Additionally, using WINSTEPS 3.65 [35], we conducted unidimensionality verification and evaluated the appropriateness and relevance of the items’ response categories. In the structural domain, we conducted parallel analysis and used the exploratory structural equation model to explore the factor structure of the sport psychological skill scale using Mplus 7.4. To verify the suitability of the sport psychological skill factor structure yielded by the exploratory structural equation model, we conducted a confirmatory factor analysis. Lastly, in the external domain, we conducted a latent mean average analysis based on gender to determine the sport psychological skill scale’s validity.
3. Results
3.1. Substantive Domain
3.1.1. Extraction of Taekwondo Athletes’ Sport Psychological Skills
To identify Taekwondo athletes’ sport psychological skills, we conducted a thorough literature review [15,16,17,18,19] and administered an open-ended questionnaire to the partcipants. We extracted relaxation, self-talk, emotional regulation, imagery, goal setting, routine, self-confidence, and concentration as sport psychological skills based on the literature review. We further investigated these skills by asking the open-ended question “What kind of psychological control methods or techniques are applied during training and competition?” Responses to the open-ended questionnaire—discussed by experts using the domain-referenced test and clarity theoretical applications of Devellis [36] and Hively [37]—revealed the sport psychological skills of confidence, fighting spirit, will, and routine. Ultimately, the literature review and expert discussion of the open-ended questionnaire responses yielded 10 potential sport psychological skills used by Taekwondo athletes: relaxation, self-talk, emotion regulation, imagery, goal setting, routine, confidence, concentration, fighting spirit, and will in Table 4.
Table 4.
Taekwondo Athletes’ 10 Key Sport Psychological Skills.
3.1.2. Item Generation
We generated items through discussion among experts about the sports psychology skills of Taekwondo athletes identified through the classification process. Following the method suggested by Crocker and Algina [38], experts deliberated on five items for each factor considering the content, grammar, and meaning conveyed. Then, we applied a 5-point Likert scale to each item, finding the most common response category. To assess content validity, we utilized Aiken’s [34] V coefficient and the binomial probability distribution for each item in Table 5.
Table 5.
Items Assessing Taekwondo Athletes’ Sport Psychological Skills.
Consequently, 12 (#4, #7, #13, #14, #18, #21, #25, #30, #36, #43, #46, #48) of the original 50 items had V coefficients near 0, with significance levels of 0.05 or greater. This means that these items were not suitable for measuring the respective sport psychological skills. Therefore, we eliminated these items and subjected the remaining 38 items to further analysis.
3.1.3. Verification of Unidimensionality
Before examining the construct validity of the factor structure, we used principal components analysis to verify the construct’s unidimensionality, which is a prerequisite for applying the Rasch model. As shown in Table 6, the explained variance was 42.2%, so the criterion of 20% or higher observed variance, which is the condition for unidimensionality, was satisfied [39].
Table 6.
Verification of Unidimensionality.
3.1.4. Appropriateness of the Response Range
To verify the appropriateness of the 5-point Likert scale, we used the Rasch model’s rating scale analysis. The adequacy of the scale is based on the probability curve for each category, guided by the following questions. First, are there at least 10 observations (count) for each category? Second, are the frequencies and proportions of the categories evenly distributed? Third, as the categories increase, does the average measure of the categories increase? Fourth, do the standardized infit and outfit values of each category satisfy the fit criteria (7.50–1.30; [40]) Fifth, does the step calibration change from at least 1.4 to less than 5.0?
As shown in Table 7, the observed values, frequency (%), average measurement (AM), and infit and outfit values for each category, were within the acceptable range. However, step calibration values using the 2-point scale and 3-point scale, 4-point scale, and 5-point scale were less than 1.4. This means that they did not meet the eligibility criteria, so the 5-point Likert scale was inappropriate to measure these sports psychological skills.
Table 7.
Verification of the 5-point Likert Scale’s Appropriateness.
Accordingly, we conducted step calibration using the 3-point and 4-point Likert scales. As shown in Table 8, the 3-point Likert (11223) scale satisfied the fit criteria. Therefore, we concluded that the 3-point Likert scale was suitable for measuring Taekwondo athletes’ sport psychological skills.
Table 8.
Verification of 3-point Likert Scale’s Adequacy.
3.1.5. Item Relevance
To evaluate the scale items’ relevance, we applied the Rasch model’s rating scale [41]. Item relevance refers to the discriminatory level of each item. We evaluated the items’ suitability using the MNSQ index and the point-biserial correlation (PBC) coefficient in Table 9.
Table 9.
Results of Item Relevance Verification.
The value of the MNSQ index was between 0.75 and 1.30, the standard suggested by McNamara [40], and the point-biserial correlation coefficient was more than 0.30, the standard suggested by Wolfe and Smith [28]. The MNSQ index for 12 of the 38 items was less than 0.75 or greater than 1.30. This result means that these 12 items were not suitable for measuring Taekwondo athletes’ sport psychological skills; therefore, we eliminated them from the scale.
3.2. Structural Domain
3.2.1. Parallel Analysis
To investigate the scale’s factor structure, we used Mplus 7.4 to perform exploratory structural equation modeling and confirmatory factor analysis with the 26 items determined by the substantive domain. First, we conducted parallel analysis to determine the number of factors. As shown in Table 10, the real-data eigenvalue for Factor 6 was lower than 95% of random eigenvalues; thus, we concluded that using five factors to measure Taekwondo athletes’ sport psychological skills was appropriate [42].
Table 10.
Parallel Analysis Results.
3.2.2. Exploratory Structural Equation Model
With parallel analysis yielding a five-factor solution, we extracted factor structure utilizing a model fit index within the range of ±2 and the interpretability of the factor structure [36].
As shown in Table 11, the RMSEA for Factor 4 was less than 0.08; therefore, we identified a factor model with ideal interpretability [43,44] as the factor structure for our scale by comparing factor coefficients for Factors 4 through 7.
Table 11.
Comparison of Factors’ Fit.
We conducted the ESEM analysis based on the six factors because the six-factor structure was the most suitable theoretical model of Taekwondo athletes’ sport psychological skills (Table 12). In evaluating the six-factor structure through ESEM analysis, multidimensionality was statistically significant and greater than 0.20 for two or more factors. Therefore, through repeated estimation, we eliminated items demonstrating multidimensionality [45] and those hindering practical interpretation due to the factor’s item organization being completely different from the that of the theoretical model [36]. Through this process, we removed 8 total items, with the final scale comprising 18 items spanning 6 factors
Table 12.
Results of ESEM Analysis.
3.2.3. Maximum Likelihood Confirmatory Factor Analysis
We conducted a confirmatory factor analysis (CFA) with maximum likelihood (ML) estimation to verify the fit of the factor structure. As shown in Table 13, the RMSEA was 0.053, and the TLI was 0.910, indicating that the model satisfied the criteria for acceptable fit.
Table 13.
Factor Structure Model Fit.
Further, the analysis of the factor structure’s convergent validity and discriminant validity revealed that the AVE values and conceptual reliability values of each factor exceeded 0.50 and 0.70, respectively. These results indicated that our sport psychological skills scale for Taekwondo athletes demonstrated strong evidence of convergent validity in Table 14.
Table 14.
Results of ML CFA.
To evaluate discriminant validity, we compared the squared value of the correlation (0.487) between Factor B and Factor E (i.e., the highest inter-factor correlation) and the AVE values of Factors B and E. Because the latter exceeded the former, we concluded that there was strong evidence of the scale’s discriminant validity.
As mentioned previously, exploratory structural equation modeling and confirmatory factor analysis yielded a scale with 18 items spanning 6 factors. We named the factors based on the constituent items’ content (Table 12). Thus, we named the first factor “goal setting,” the second factor “confidence,” the third factor “imagery,” the fourth factor “self-talk,” the fifth factor “fighting spirit,” and the sixth factor “concentration.”
3.2.4. Reliability and Difficulty by Factor
To assess the scale’s reliability, we examined both the responses and the items. As shown in Table 15, the separation index and response reliability values for the factors exceeded 2.00 and 0.80, respectively. Further, the infit (internal fit) and outfit (external fit) fell between 0.75 and 1.30. These results indicated strong reliability for the items and the responses. Overall, we concluded that our scale can accurately measure Taekwondo athletes’ sport psychological skills.
Table 15.
Response and Item Reliability.
3.3. External Domain
Multi-Group Confirmatory Factor Analysis
To validate the scale, we conducted a measurement equivalence verification using multi-group confirmatory factor analysis (MCFA) by gender. As a result, the ∆X2 from the unconstrained model to the model with similarly constrained factor coefficients was nonsignificant at the 0.05 level (p = 0.122). This indicated that there were no gender differences with respect to the scale’s validity, further supporting the scale’s appropriateness for measuring Taekwondo athletes’ sport psychological skills in Table 16.
Table 16.
Results of the Verification of Measurement Equivalence by Gender.
4. Discussion
The purpose of the study was to explore the sport psychological skills exhibited by Taekwondo athletes and to develop a scale measuring these skills. We conducted a literature review and administered open-ended surveys, subsequently relying on expert deliberations using the domain-based method to classify Taekwondo athletes’ sport psychological skills. The expert meetings yielded the skills of relaxation, self-talk, emotion regulation, imagery, goal setting, routine, confidence, concentration, fighting spirit, and will. Next, experts generated items pertaining to each skill and examined their accuracy, grammar, and match with the purpose of each skill. They eliminated negative questions and double-choice questions, using the method suggested by Crocker and Algina [38]. To reduce the subjective biases introduced in the process of producing the questions [46], we verified the items’ content validity using Aiken’s [34] V coefficient.
We verified the construct validity of the scale through the integrated validity approach and the Rasch model. Then, we used parallel analysis and exploratory structural equation modeling to explore the factor structure. The exploratory factor analysis model has the advantage of being able to identify the optimal factor structure because it is possible to check the significance and effect size of the items’ factor coefficients and it is desirable to ascertain the interpretability of the factor structure. Therefore, we evaluated the items’ appropriateness based on the statistical significance of the factor coefficients, as proposed by Jennrich [47]. We refined the factor structure by eliminating items with low discriminatory power (significant cross-loadings with magnitudes of 0.20 or greater). This process ultimately yielded 6 factors and 18 total items, and ML CFA analysis confirmed the suitability of this structure. Finally, we confirmed the scale’s concentration validity, discriminant validity, and item and response reliability and we demonstrated through MCFA that the scale is suitable for measuring Taekwondo athletes’ sport psychological skills, irrespective of gender.
We found Taekwondo athletes’ primary sport psychological skills to be goal setting, confidence, imagery, self-talk, fighting spirit, and concentration. This finding expands on previous studies [15,16,17,18,19] identifying the key skills of self-talk, relaxation, and imagery. With respect to the newly identified skills, unlike in team sports, Taekwondo determines victory or defeat through a one-on-one match. To win a match, a strong mind, confidence, and fighting spirit are essential. Taekwondo coaches and athletes who attended our expert meetings also mentioned that having strong offensive power is a prerequisite for winning Taekwondo matches. Additionally, a strong concentration is required to react quickly and defend against opponents’ attacks. Therefore, the newly discovered skills of confidence, fighting spirit, and concentration can be regarded as accurately reflecting competitive Taekwondo scenarios.
On the other hand, Taekwondo athletes also reported self-talk, which is typically found in athletes of static sports such as golf, as a psychological technique they use. Self-talk involves turning negative emotions or psychological situations into positive ones. Therefore, although sports psychology skills depend on the characteristics of each sport, self-talk appears to be relatively universal.
5. Conclusions
From our exploration and development of a scale measuring Taekwondo athletes’ sport psychological skills, we can draw several conclusions. First, the six major sport psychological skills demonstrated by Taekwondo athletes in training and competition situations include goal setting, confidence, imagery, self-talk, fighting spirit, and concentration. Second, we found evidence supporting the psychometric soundness of a sport psychological skill scale for Taekwondo athletes consisting of 18 items spanning 6 factors, with each item rated on a 3-point Likert scale. Third, our multi-group confirmatory factor analysis verified the scale’s validity regardless of gender.
Suggestions for Future Research
Although this study investigated the sport psychological skills of Taekwondo athletes, it was not able to determine whether these skills are effective emotional regulation strategies for improving performance. Moreover, the study’s investigation of whether the integrated validity approach and item response theory effectively controlled the transformation of the scale’s factor structure, which is considered a problem with classical test theory in the scale development process, was limited. Therefore, we make several suggestions for future research.
First, studies have shown that sports psychology skills have a positive effect on Taekwondo athletes’ performance [2,3,4,5,6]. However, these studies have limitations in generalizing the contribution of sport psychological skills to Taekwondo based on their role in other sports. Therefore, we recommend follow-up studies investigating the relationship between psychological factors related to performance and sport psychological skills using the scale developed in this study.
Second, there has been insufficient research on improving sport psychological skills themselves and, thereby, Taekwondo athletes’ performance. Therefore, we recommend practical studies aimed at improving the level of sport psychological skills, including the skills of goal setting, confidence, imagery, self-talk, fighting spirit, and concentration identified in this study.
Finally, in general, there are reported differences in performance depending on athletes’ sport psychological skill levels. However, research has not identified such differences with respect to Taekwondo. Therefore, we recommend that future studies use our scale to identify the value and role of sport psychological skills in Taekwondo events according to the performance level.
Author Contributions
J.-H.N. designed the study and conducted research. E.-H.C. analyzed and described the data, and E.-J.K. and J.-H.N. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
IRB review exempted because the research was conducted using data held by universities in South Korea.
Informed Consent Statement
All participants gave their informed consent for inclusion before they participated in the study.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy issues.
Conflicts of Interest
The authors declare no conflict of interest. Furthermore, the funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
References
- Williams, J.M.; Andersen, M.B. Psychosocial antecedents of sport injury: Review and critique of the stress and injury model. J. Appl. Sport Psychol. 2000, 10, 98–106. [Google Scholar] [CrossRef]
- Orlick, T.; Partington, J. Mental links to excellence. Sport Psychol. 1988, 2, 105–130. [Google Scholar] [CrossRef]
- Ecklund, R.C.; Gould, D.; Jackson, S.A. Psychological foundation of Olympic wrestling excellence reconciling individual differences and nomothetic characterization. J. Appl. Sport Psychol. 1993, 5, 35–47. [Google Scholar] [CrossRef]
- Greenspan, M.J.; Feltz, D.L. Psychological interventions with athletes in competitive situations: A review. Sport Psychol. 1989, 3, 219–236. [Google Scholar] [CrossRef]
- Vealey, R.S. Current status and prominent issues in sport psychology intervention. Med. Sci. Sport Exerc. 1994, 26, 495–502. Available online: https://psycnet.apa.org/doi/10.1249/00005768-199404000-00015 (accessed on 20 July 2021). [CrossRef]
- Williams, J.M.; Krane, V. Psychological characteristics of peak performance. In Applied Sport Psychology: Personal Growth to Peak Performance; Williams, J., Ed.; Mayfield: Houston, TX, USA, 2001; pp. 162–178. [Google Scholar]
- Gould, D. 1988 US Olympic wrestling excellence: I. Mental preparation, precompetitive cognition, and affect. Sport Psychol. 1992, 6, 358–382. [Google Scholar] [CrossRef]
- Lee, J.K.; Nam, J.H.A. study on the development of sports psychology scale for aerobic gymnastics athletes. Korea J. Sports Sci. 2018, 27, 269–285. Available online: http://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE07587241 (accessed on 25 July 2021). [CrossRef]
- Vealey, R.S. Future. directions in psychological skills training. Sport Psychol. 1988, 2, 318–336. [Google Scholar] [CrossRef]
- Weinberg, R.S.; Gould, D. Foundations of Sport and Exercise Psychology; Human Kinetics: Champaign, IL, USA, 1995. [Google Scholar]
- Howe, B. Psychological skills and coaching. Sport Sci. Rev. 1993, 2, 30–47. [Google Scholar]
- Shin, J.T.; Choi, J.C.; Kwon, S.M. The effects of psychological skill training program on psychology and performance of Korea national fencing athletes participated in 2008 Beijing Olympic. Korean J. Sport Sci. 2009, 20, 360–371. [Google Scholar] [CrossRef]
- Lim, T.H. Effect of psychological skills training for athletes of Taekwondo national team in 2012 London Olympics. Korean J. Sport Sci. 2013, 24, 384–399. [Google Scholar] [CrossRef]
- World Taekwondo Federation on Website. 2017. Available online: http://www.worldtaekwondo.org/index.html (accessed on 2 April 2021).
- Eom, K.H.; Jang, S.Y.; Yang, D.S. The effect of applied psychological skill training program on business team Taekwondo athletes. J. Coach. Dev. 2013, 15, 57–63. Available online: http://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE02263378 (accessed on 22 June 2021).
- Bagherpour, T.; Hashim, H.A.; Saha, S.; Ghosh, A.K. Effects of progressive muscle relaxation and internal imagery on competitive state anxiety inventory–2R among Taekwondo athletes. Int. Proc. Econ. Dev. Res. 2012, 30, 218–224. Available online: http://www.ipedr.com/vol30/43-ICEMI%202012-M10020.pdf (accessed on 22 June 2021).
- Khanjari, Y.; Arab Ameri, E.; Garooei, R.; Motashareei, E.; Hemayattalab, R. The effect of a course of psychological skills training (PST) program on selected mental skills and the performance of teenager female taekwondo athletes of Iranian national team. J. Res. Sport Manag. Mot. Behav. 2013, 3, 25–34. Available online: https://jrsm.khu.ac.ir/article-1-1757-en.html (accessed on 22 June 2021).
- Yang, J.E.; Shin, J.T.; Kim, J.S. The effects of a psychological skills training on competitive anxiety, intrinsic motivation, sports self-confidence, performance strategy and perceived performance of high school Taekwondo athletes. J. Korean Soc. Wellness 2015, 10, 147–160. Available online: http://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE06602298 (accessed on 22 June 2021).
- Zetou, E.; Vernadakis, N.; Bebetsos, E.; Liadakis, N. The effect of self-talk on Tae-kwon-do skills’ learning of novice athletes and perceived use of it. J. Hum. Sport Exerc. 2014, 9, 124–135. Available online: https://www.redalyc.org/pdf/3010/301031526013.pdf (accessed on 22 June 2021). [CrossRef] [Green Version]
- Cronbach, L.J. Test validation. In Educational Measurement; Thorndike, R.L., Ed.; American Council on Education: Washington, DC, USA, 1971; pp. 443–507. [Google Scholar]
- Merbitz, C.; Morris, J.; Grip, J.C. Ordinal scales and foundations of misinference. Arch. Phys. Med. Rehabil. 1989, 70, 308–312. [Google Scholar] [CrossRef]
- Wright, B.D.; Linacre, J.M. Observations are always ordinal; measurement, however, must be interval. Arch. Phys. Med. Rehabil. 1989, 70, 857–860. Available online: https://europepmc.org/article/med/2818162 (accessed on 22 June 2021).
- Zhu, W.; Timm, G.; Ainsworth, B. Rasch calibration and optimal categorization of an instrument measuring women’s exercise perseverance and barriers. Res. Q. Exerc. Sport 2001, 72, 104–116. [Google Scholar] [CrossRef]
- Fabrigar, L.R.; Wegener, D.T.; MacCallum, R.C.; Strahan, E.J. Evaluating the use of exploratory factor analysis in psychological research. Psychol. Methods 1999, 4, 272–299. [Google Scholar] [CrossRef]
- Bond, T.G.; Fox, C.M. Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 2nd edRoutledge: Oxfordshire, UK, 2010. [Google Scholar]
- Nam, J.H. The development and validity of the sport coaching leadership scale. J. Coach. Dev. 2016, 18, 95–106. Available online: http://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE06739058 (accessed on 22 June 2021).
- Seo, E.C. A psychometric item goodness-of-fit of the coach-athletes relationship scale for elite athletes with disabilities: An application of Rasch model. Korean J. Meas. Eval. Phys. Educ. Sports Sci. 2016, 18, 31–44. [Google Scholar] [CrossRef]
- Wolfe, E.W.; Smith, E.V., Jr. Instrument development tools and activities for measure validation using Rasch models: Part I-instrument development tools. J. Appl. Meas. 2007, 8, 97–123. Available online: https://pubmed.ncbi.nlm.nih.gov/17215568/ (accessed on 22 June 2021).
- Wolfe, E.W.; Smith, E.V., Jr. Instrument development tools and activities for measure validation using Rasch models: Part II—Validation activities. J. Appl. Meas. 2007, 8, 204–234. Available online: https://pubmed.ncbi.nlm.nih.gov/17440262/ (accessed on 22 June 2021).
- Wright, B.D. Comparing Rasch measurement and factor analysis. Struct. Equ. Model. 1996, 3, 3–24. [Google Scholar] [CrossRef]
- Benson, J. Developing a strong program of construct validation: A test anxiety example. Educ. Meas. Issues Pract. 1998, 17, 10–17. [Google Scholar] [CrossRef]
- Messick, S. Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am. Psychol. 1995, 50, 741–751. Available online: https://psycnet.apa.org/doi/10.1037/0003-066X.50.9.741 (accessed on 22 June 2021). [CrossRef]
- American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for Educational and Psychological Testing; American Psychological Association: Washington, DC, USA, 1999. [Google Scholar]
- Aiken, L.R. Psychological Testing and Assessment; Allyn & Bacon: Boston, MA, USA, 1985. [Google Scholar]
- Linacre, J.M. A User’s Guide to WINSTEPS MINISTEP Rasch-Model Computer Programs. 2008. Available online: http://www.winsteps.com (accessed on 22 June 2021).
- DeVellis, R.F. Scale Development: Theory and Applications, 3rd ed.; Sage Publications: Thousand Oaks, CA, USA, 2012. [Google Scholar]
- Hively, W. Introduction to domain-referenced testing. Educ. Technol. 1974, 14, 5–10. Available online: https://www.jstor.org/stable/44420871 (accessed on 22 June 2021).
- Crocker, L.M.; Algina, J. Introduction to Classical and Modern Test Theory; Holt, Rinehart, and Winston: New York, NY, USA, 1986. [Google Scholar]
- DeMars, C. Item Response Theory; Oxford University Press: Oxford, UK, 2010. [Google Scholar]
- McNamara, T.F. Measuring Second Language Performance; Longman: London, UK, 1996. [Google Scholar]
- Andrich, D. A rating formulation for ordered response categories. Psychometrika 1978, 43, 561–573. Available online: https://link.springer.com/content/pdf/10.1007/BF02293814.pdf (accessed on 22 June 2021). [CrossRef]
- Timmerman, M.E.; Lorenzo-Seva, U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol. Methods 2011, 16, 209–211. Available online: https://psycnet.apa.org/doi/10.1037/a0023353 (accessed on 22 June 2021). [CrossRef]
- Costello, A.B.; Osborne, J.W. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10, 7. [Google Scholar] [CrossRef]
- Hu, L.Z.; Bentler, P.M. Cut off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Modeling A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Asparouhov, T.; Muthén, B. Exploratory structural equation modeling. Struct. Equ. Model. A Multidiscip. J. 2009, 16, 397–438. Available online: https://www.tandfonline.com/doi/abs/10.1080/10705510903008204 (accessed on 22 June 2021). [CrossRef]
- Oh, Y.S. Developing transformative leadership concepts and scale in sports situations. Korea J. Sports Sci. 2018, 27, 345–358. Available online: http://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE07482838 (accessed on 22 June 2021). [CrossRef]
- Jennrich, R.I. Rotation methods, algorithms, and standard errors. In Factor Analysis at 100: Historical Developments and Future Directions; MacCallum, R.C., Cudeck, R., Eds.; Lawrence Erlbaum: Mahwah, NJ, USA, 2007; pp. 315–337. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).