You are currently viewing a new version of our website. To view the old version click .
Children
  • Brief Report
  • Open Access

2 February 2023

Reliability and Validity of the Educational Stress Scale for Adolescents (ESSA) in a Sample of Greek Students

,
,
,
,
and
1
Postgraduate Course of Science of Stress and Health Promotion, School of Medicine, National and Kapodistrian University of Athens, 11527 Athens, Greece
2
University Research Institute of Maternal and Child Health Hospital and Precision Medicine and UNESCO Chair on Adolescent Health Care, Medical School, National and Kapodistrian University of Athens, Aghia Sophia Children’s Hospital, 11527 Athens, Greece
3
First Department of Pediatrics, Medical School, National and Kapodistrian University of Athens, Aghia Sophia Children’s Thivon & Papadiamantopoulou St., 11527 Athens, Greece
4
School of Medicine, University of Athens, Soranou Ephessiou Str. 4, 11527 Athens, Greece
This article belongs to the Special Issue Developmental and Behavioral Pediatrics - Volume II

Abstract

This research outlines the initial validation of a new instrument to quantify academic stress, the Educational Stress Scale for Adolescents (ESSA). A total of 399 students (61.9% females, 38.1% males), with a mean age of 16.3 years, participated in the research protocol. Cronbach’s α for the total 16-item ESSA scale was 0.878, suggesting good reliability. Cronbach’s α for each one of the five components were statistically positively significant. The Greek version of the Educational Stress Scale for Adolescents (ESSA) can be utilized as a valid tool to measure the perceived educational stress in adolescents.

1. Introduction

Educational (or academic) stress can be understood as the mental discomfort that results from an expected frustration over an academic failure [1]. Furthermore, in school conditions, during the educational process, students may experience excessive pressure to succeed, achieve high grades, or ensure their entry into higher education [2]. Excessive stress during this stage could lead to an increased prevalence of mental health problems, including anxiety and depressive feelings, which could eventually have an adverse effect on the outcomes achieved [3].
For students, the educational period is a long and complex cognitive process requiring them to muster both mental and physical strength, emotional stability, psychological balance, goal orientation, and ability to overcome stress-induced barriers, particularly during examination periods [4]. Inevitably, the difficulties educational stress gives rise to may affect several other sectors in an individual’s life; indeed, stress may gradually be-come generalized [4].
Regarding the Greek experience and, more specifically, the dimensions of educational stress in Greece, what emerges from the relevant literature is that there is currently an insufficient number of studies on the subject. Thus, there are no systematic research studies measuring educational/school-related stress and its cognitive, mental, or emotional repercussions in the life of adolescents. However, there are some validated instruments measuring certain aspects of educational stress, one of which is the Adolescent Stress Questionnaire, which comprises such scales as school performance, interaction with teachers, school attendance, and school/leisure conflict [5]. Another example is the widely used Test Anxiety Inventory, which is mainly focused on deficiencies arising from examination-induced stress and anxiety [6].
As the relevant Greek literature makes clear, there are no validated and cross-culturally adapted questionnaires on school-related stress that clearly measure the multifactorial nature of educational stress. School education and entry into higher educational institutions constitute a crucial stage in a Greek adolescents’ life [6]. This societally determined notion, which is of great importance to an individual’s personal, social, and economic development, has clearly influenced, in fact determined, the orientation of the Greek educational system at different levels [7]. As discussed above, it is important for the adolescent research community to study the risk factors that contribute to educational stress and also the protective factors for the mental health of this population [8]. The aim of this study is the validation of the Educational Stress Scale (ESSA) in Greek adolescents.

2. Materials and Methods

2.1. Translation Procedure

The questionnaire’s validation was based on the process of its translation into Greek and its cross-cultural adaptation. After contacting the author responsible for the questionnaire and obtaining his/her written consent for its validation in Greek adolescents (January 2020), the original questionnaire was translated (forward translation) by two bilingual translators; subsequently, the translated questionnaire was back translated into English, the questionnaire’s original language (backward translation). Then, a pilot test was conducted with the target population, who were provided with the questionnaire. Finally, the procedure of translation and cross-cultural adaptation was duly evaluated and completed.

2.2. Participants and Procedures

A convenience sample of 399 students (61.9% female; 38.1% male), with a mean age of 16.3 years, participated in the study, which took place in Athens, Greece, between November 2021 and April 2022. The study was conducted after the research protocol was approved by the Committee of Research Ethics and Deontology of the School of Medicine of the National and Kapodistrian University of Athens (Ref. 93776 8/11/2021). The questionnaires were administered to the adolescent students after their parent/caregivers’ written consent was obtained.

2.3. Ethical Considerations

The protocol of this research was approved by the ethics committee of the Medical School of the National and Kapodistrian University of Athens and was in accordance with the Declaration of Helsinki (2013). For the completion of the printed questionnaire, volunteers who participated in the study signed a form of information, consent, and confidentiality.

2.4. Measures

For the purposes of our research, participants were first provided with a demographics questionnaire, including questions about their gender, age, and school year, as well as their parents’ educational level and work status. The questionnaire’s demographic factors also included questions about the students’ study habits, the number of hours they devoted to the Internet or leisure, as well as questions about their overall way of life and habits, as adapted from Sun et al. (2011) [8].

2.4.1. Educational Stress Scale for Adolescents (ESSA)

This questionnaire under validation includes 16 items/questions aimed at assessing educational stress. Each question included a 5-point Likert-type scale (ranging from 1 = strongly disagree to 5 = strongly agree). The participants’ responses to the questions added up to a total score; moreover, 5 different factors resulted from the statistical analysis of their responses to the following: ‘Pressure from study’; ‘Work-load’; ‘Worry about grades’; ‘Self-expectation’, and ‘De-spondency’. Higher scores indicate greater stress. Published in English by Sun et al. (2011), the questionnaire has good internal consistency, with Cronbach’s α = 0.82 for the total scale and α = 0.79, α = 0.73, α = 0.69, α = 0.65, and α = 0.64 for the five factors, separately [8].

2.4.2. Adolescent Stress Questionnaire—ASQ

Adapted to Greek by Darviri et al. (2014), the ASQ measures various stress-inducing events and situations in the life of adolescents using a 5-point Likert-type scale (ranging from 1 = no stress to 5 = a lot of stress). The internal consistency was Cronbach’s α value (range: 0.70–0.86) and general value: 0.96 [5].

2.4.3. Rosenberg Self-Esteem Scale

This questionnaire measures self-esteem by employing a 4-point Likert-type scale (arranging from 1 = strongly agree to 4 = strongly disagree) with high reliability of α = 0.809. Higher scores in the scale indicate higher self-esteem levels [9].

2.4.4. State-Trait Anxiety Inventory (STAI)

This questionnaire uses two subscales to measure state and trait anxiety. Cronbach’s α was 0.93 for the state anxiety scale and 0.92 for the trait anxiety subscale. Higher scores in the scale indicate greater stress [10].

2.5. Data Analysis

For the categorical variables, data are presented as N (%) and for the quantitative variables as median (IQR) and mean (SD). An exploratory factor analysis (EFA) was conducted for the 16 items of the ESSA. The Kaiser–Meyer–Olkin (KMO) measure and Bartlett’s test of sphericity were used to evaluate the adequacy of the sample. Direct oblique rotation was used and eigenvalues near to 1 showed the appropriate number of factors. Items with factor loadings greater than 0.3 were assigned to the factors. Cronbach’s alpha was used to evaluate the internal consistency. Spearman’s rho coefficient was used to correlate the quantitative variables, due to the skewed distribution of the quantitative variables. Statistical analyses were performed using SPSS v.26 for Windows, and the significance level for all analyses was 0.05.

3. Results

The research sample’s main demographic characteristics are presented in Table 1. Overall, 399 students (61.9% female) participated in the research, with a mean (SD) age of 16.3 (1.4) years.
Table 1. Samples’ Sociodemographic characteristics (N = 399).
Most of the students responded that, over the past year, they had spent over 2 h per day on assigned homework (80.2%) and had attended private classes (87.5%). In addition, 51.1% of the students reported having classes during weekends or holidays. As far as their school performance was concerned, they had received high or very high grades (65.4%).
Regarding the 30-day period prior to participating in the research, most of the respondents reported that they enjoyed a good health status (73.7%), engaged in physical activity (77.4%), used the Internet (99.7%), and played electronic games (54.6%).

3.1. Table Analysis (Scales Examined)

The IQR and the mean (SD) for the ESSA examined are displayed in Table 2. More specifically, for the entire ESSA score, the mean (SD) was 47.7 (10.0); for the ‘Pressure from study’, ‘Workload’, ‘Worry about grades’, ‘Self-expectation’, and ‘Despondency’ subscales, the values were 12.0 (3.0), 9.9 (2.5), 8.4 (2.5), 9.5 (2.7), and 8.0 (2.3), respectively.
Table 2. Samples’ study’s measurements (N = 399).

3.2. ESSA Questionnaire—Principal Component Analysis

The factor loadings, resulting from the factor component analysis (FCA) of the ESSA Questionnaire’s 16 items, are presented in Table 3.
Table 3. Rotated factor loadings: Exploratory Factor analysis (EFA) results regarding the ESSA questionnaire’s 16 items (N = 399).
The following five components were extracted: ‘Self-expectation’, ‘Workload’, ‘Despondency’, ‘Pressure from study’, and ‘Worry about grades’. These components account for 36.3%, 10.9%, 7.1%, 6.1% and 5.9% of the fluctuation, respectively.
Table 3 shows the EFA results for the 16 items on the ESSA questionnaire, with direct oblique rotation. For examining the adequacy of the sample, the Kaiser–Meyer–Olkin (KMO) test and Barlett’s Sphericity Test were used. The KMO value was 0.883, and the significance of Bartlett’s test of sphericity was p < 0.001. The Scree plot, as a result of the EFA, indicated that five factors were extracted with an eigenvalue near to 1 (Figure 1). The 16 items explained the 66.27% of the total variance.
Figure 1. Depicts the Screen Plot, as a result of the EFA.
Cronbach’s α for the total 16-item ESSA range was 0.878, thus, suggesting good reliability (Table 4). Cronbach’s α for each one of the five components was 0.735, 0.768, 0.546, 0.685, and 0.621, respectively. All interitem correlations between the five components were statistically positively significant (Table 5, Spearman’s ρ: 0.324–0.627). Table 6 describes the correlations between the ESSA and its subscales with the other tools that were used in the study. There were statistically significant positive correlations between the ESSA subscales and those of the STAI and ASQ questionnaires (Table 6). The strongest correlations (ρ > 0.6) were observed between the scales of ‘Self-expectation’ and ‘STAI-trait’ (ρ = 0.668; p < 0.001), ‘Self-expectation’ and ‘STAI-state’ (ρ = 0.627; p < 0.001), ‘Pressure from study’ and ‘ASQ-Stress of Home Life’ (ρ = 0.617; p < 0.001), ‘Pressure from study’ and ‘ASQ-Stress of School Performance’ (ρ = 0.694; p < 0.001), ESSA total score and ‘STAI-trait’ (ρ = 0.678; p < 0.001), ESSA total score and ‘STAI-state’ (ρ = 0.618; p < 0.001), ESSA total score and ‘ASQ-Stress of Home Life’ (ρ = 0.646; p < 0.001), ESSA total score and ‘ASQ-Stress of School Performance (ρ = 0.709; p < 0.001), and ESSA total score and ‘ASQ-Stress of Future Uncertainty’ (ρ = 0.617; p < 0.001).
Table 4. Range, mean, standard deviation, correlations (item-total correlation), and Cronbach’s α coefficients for the ESSA questionnaire scales.
Table 5. Correlations (Spearman’s rho) between ESSA subscales (N = 399).
Table 6. Correlations (Spearman rho) between ESSA and STAI, self-esteem and ASQ subscales.
Statistically significant negative correlations were observed between the ESSA subscales and the ‘Self-esteem’ scale (ρ range: from −0.270 for the ‘Workload’ scale to −0.574 for the ‘Despondency’ scale).

4. Discussion

The ESSA questionnaire on adolescent educational stress was validated and cross-culturally adapted in this study. Furthermore, an exploratory factor analysis was conducted, and specific variables of the other questionnaires were examined. In the validation of the educational stress assessment instrument, 399 students took part, the majority of whom came from urban centres (89%). More specifically, based on the exploratory factor analysis (EFA) of the questionnaire’s 16 items, five components were extracted, as was the case with the original questionnaire [8], and the relevant variables were named: ‘Self-expectation’, ‘Workload’, ‘Despondency’, ‘Pressure from study’, and ‘Worry about grades’. These components account for 36.3%, 10.9%, 7.1%, 6.1%, and 5.9% of the fluctuation, respectively.
According to the statistical analysis conducted, Cronbach’s α reliability coefficient for the entire 16-item ESSA rate was 0.878, thus suggesting good reliability, as was also the case with the original questionnaire [8]. Furthermore, all of the interitem correlations between the five components were statistically positively significant (Spearman’s ρ range: 0.324–0.627).
Continuing with the correlations obtained from the analysis of the educational stress questionnaire and the remaining scales, a notable finding was the strong positive correlation between the ESSA scale “pressure from study” and the stress of home life scale (home life stress) from the ASQ Adolescent Stress Questionnaire. This particular finding is consistent with the literature where stress and conflict in the family environment influence and are influenced by the stress of studying [4]. Furthermore, a strong positive correlation was found between the ESSA scale “pressure from study” and the stress of school performance (ASQ-Stress of School Performance’ (rho = 0.694,·p < 0.001)). In addition, this finding of research is confirmed by the literature where it is known that the school performance of students is affected by the pressure of reading and studying [4].
Finally, statistically significant negative correlations were found between the ESSA subscales ‘workload’ and ‘despondency’ with the self-esteem scale. Adolescents who exhibited low levels of self-esteem scored higher on the educational stress scale, which is consistent with the existing literature and research hypotheses [11].
As with other similar research studies, this validation is not without some limitations. We used a ‘convenience sample’, in other words, an ‘opportunity sample’, i.e., lower and senior high school students who probably had some specific characteristics, which somewhat limited the generalizability of the findings. Moreover, the sample largely came from urban centres, as it was not possible to use additional samples from the provinces of Greece. This precluded taking into account potential geographical factors, which might influence educational stress variables.
In conclusion, the Greek version of the Educational Stress Scale for Adolescents generally has good psychometric properties, and it could safely be applied as a measure in future studies in Greece.

Author Contributions

Conceptualization, E.M., F.B. and C.D.; methodology, E.M. and K.M.; software, K.M.; validation, E.M., K.M. and F.B.; formal analysis, K.M.; investigation, E.M.; resources, E.M. and F.B.; data curation, K.M.; writing—original draft preparation, E.M. and K.M.; writing—review and editing, E.M., K.M. and G.P.C.; visualization, C.D. and G.P.C.; supervision, F.B. and C.D.; project administration F.B., C.K.-G., G.P.C. and C.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no funding.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and was approved by the Scientific and Ethics Committee of Research Ethics and Deontology of the School of Medicine, National and Kapodistrian University of Athens (Ref. 93776 8/11/2021 and date of approval 8 November 2021).

Acknowledgments

We thank George P. Chrousos, MD, ScD, MACE, FRCP, for his contribution in this research.

Conflicts of Interest

The authors declare no conflict of interest regarding the publication of this paper.

References

  1. Shankar, N.L.; Park, C.L. Effects of stress on students’ physical and mental health and academic success. Int. J. Sch. Educ. Psychol. 2016, 4, 5–9. [Google Scholar] [CrossRef]
  2. Dubczak, H. Psychological characteristics of educational stress of modern students. Soc. Welf. Interdiscip. Approach 2020, 9, 90–104. [Google Scholar] [CrossRef]
  3. Deb, S.; Strodl, E.; Sun, H. Academic stress, parental pressure, anxiety and mental health among Indian high school students. Int. J. Psychol. Behav. Sci. 2015, 5, 26–34. [Google Scholar]
  4. Lazaratou, H.; Anagnostopoulos, D.C.; Vlassopoulos, M.; Charbilas, D.; Rotsika, V.; Tsakanikos, E.; Tzavara, C.; Dikeos, D. Predictors and characteristics of anxiety among adolescent students: A Greek sample. Psychiatriki 2013, 24, 27–36. [Google Scholar] [PubMed]
  5. Darviri, C.; Legaki, P.-E.; Chatzioannidou, P.; Gnardellis, C.; Kraniotou, C.; Tigani, X.; Alexopoulos, E.C. Adolescent Stress Questionnaire: Reliability and validity of the Greek version and its description in a sample of high school (lyceum) students. J. Adolesc. 2014, 37, 1373–1377. [Google Scholar] [CrossRef] [PubMed]
  6. Sakka, S.; Nikopoulou, V.; Bonti, E.; Tatsiopoulou, P.; Karamouzi, P.; Giazkoulidou, A.; Tsipropoulou, V.; Parlapani, E.; Holeva, V.; Diakogiannis, I. Assessing test anxiety and resilience among Greek adolescents during COVID-19 pandemic. J. Mind Med. Sci. 2020, 7, 173–178. [Google Scholar] [CrossRef]
  7. OECD—Organisation for Economic Co-operation and Development. Education for a Bright Future in Greece. In Reviews of National Policies for Education; OECD Publishing: Paris, France, 2018. [Google Scholar]
  8. Sun, J.; Dunne, M.P.; Hou, X.; Xu, A. Educational Stress Scale for Adolescents. J. Psychoeduc. Assess. 2011, 29, 534–546. [Google Scholar] [CrossRef]
  9. Gray-Little, B.; Williams, V.S.L.; Hancock, T.D. An item response theory analysis of the Rosenberg Self-Esteem Scale. Personal. Soc. Psychol. Bull. 1997, 23, 443–451. [Google Scholar] [CrossRef]
  10. Fountoulakis, K.N.; Papadopoulou, M.; Kleanthous, S.; Papadopoulou, A.; Bizeli, V.; Nimatoudis, I.; Iacovides, A.; Kaprinis, G.S. Reliability and psychometric properties of the Greek translation of the State-Trait Anxiety Inventory form Y: Preliminary data. Ann. Gen. Psychiatry 2006, 5, 2. [Google Scholar] [CrossRef] [PubMed]
  11. Pascoe, M.; Bailey, A.P.; Craike, M.; Carter, T.; Patten, R.; Stepto, N.; Parker, A. Physical activity and exercise in youth mental health promotion: A scoping review. BMJ Open Sport Exerc. Med. 2020, 6, e000677. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.