Italian Validation of the Online Student Engagement Scale (OSE) in Higher Education
Abstract
:1. Introduction
2. Materials and Methods
2.1. Participants and Procedure
2.2. Instruments
2.3. Translation Process
2.4. Analytical Approach
3. Results
3.1. Preliminary Analyses and Descriptive Statistics
3.2. Factor Structure of the Italian Translation of the OSE Scale
3.3. Convergent Validity
4. Discussion
5. Limitations and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Hu, S.; Kuh, G.D. Being (dis)engaged in educationally purposeful activities: The influences of student and institutional characteristics. Res. High. Educ. 2002, 43, 555–575. [Google Scholar] [CrossRef]
- Astin, A.W. Student involvement: A developmental theory for higher education. J. Coll. Stud. Pers. 1984, 25, 297–308. [Google Scholar]
- Skinner, E.A.; Belmont, M.J. Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. J. Educ. Psychol. 1993, 85, 571–581. [Google Scholar] [CrossRef]
- Kuh, G.D. Assessing what really matters to student learning inside the national survey of student engagement. Change 2001, 33, 10–17. [Google Scholar] [CrossRef]
- Kuh, G.D. What we’re learning about student engagement from NSSE: Benchmarks for effective educational practices. Change 2003, 35, 24–32. [Google Scholar] [CrossRef]
- Kuh, G.D. The national survey of student engagement: Conceptual and empirical foundations. New Dir. Inst. Res. 2009, 141, 5–20. [Google Scholar] [CrossRef]
- Handelsman, M.M.; Briggs, W.L.; Sullivan, N.; Towler, A. A measure of college student course engagement. J. Educ. Res. 2005, 98, 184–191. [Google Scholar] [CrossRef]
- Vytasek, J.M.; Patzak, A.; Winne, P.H. Analytics for student engagement. In Intelligent Systems Reference Library: Machine Learning Paradigms; Virvou, M., Alepis, E., Tsihrintzis, G., Jain, L., Eds.; Springer: Cham, Switzerland, 2020; Volume 158, pp. 23–48. [Google Scholar] [CrossRef]
- Carini, R.M.; Kuh, G.D.; Klein, S.P. Student engagement and student learning: Testing the linkages. Res. High. Educ. 2006, 47, 1–32. [Google Scholar] [CrossRef] [Green Version]
- Fantinelli, S.; Esposito, C.; Carlucci, L.; Limone, P.; Sulla, F. The Influence of Individual and Contextual Factors on the Vocational Choices of Adolescents and Their Impact on Well-Being. Behav. Sci. 2023, 13, 233. [Google Scholar] [CrossRef]
- Junco, R. The relationship between frequency of Facebook use, participation in Facebook activities, and student engagement. Comput. Educ. 2012, 58, 162–171. [Google Scholar] [CrossRef]
- Moore, M.G.; Kearsley, G. Distance Education: A Systems View of Online Learning, 3rd ed.; Wadsworth, Cengage Learning: Belmont, CA, USA, 2012. [Google Scholar]
- Allen, I.E.; Seaman, J. Going the Distance: Online Education in the United States; The Online Learning Consortium. 2011. Available online: http://sloanconsortium.org/publications/survey/going_distance_2011 (accessed on 10 March 2023).
- Limone, P.; Di Fuccio, R. teleXbe 2021-The role of technologies in education and new trajectories of blended learning. In Proceedings of the Technology Enhanced Learning Environments for Blended Education—The Italian e-Learning Conference 2021, Foggia, Italy, 5–6 October 2021; pp. 1–6. Available online: https://www.semanticscholar.org/paper/teleXbe-2021-The-role-of-technologies-in-education-Limone-Fuccio/11781816fe534e86cec3ea2e48821a5804792e83 (accessed on 16 January 2023).
- Limone, P. Towards a hybrid ecosystem of blended learning within university contexts. In Proceedings of the Technology Enhanced Learning Environments for Blended Education—The Italian e-Learning Conference 2021, Foggia, Italy, 5–6 October 2021; pp. 1–7. Available online: https://www.semanticscholar.org/paper/Towards-a-hybrid-ecosystem-of-blended-learning-Limone/cbf475bdf39356b1027f22ae7bdd76376346247d (accessed on 16 January 2023).
- Limone, P.; Toto, G.A. Manuale T.I.C. Per una Didattica Inclusiva; [ICT Textbook for an Inclusive Education]; McGraw Hill: Milano, Italy, 2022. [Google Scholar]
- Limone, P. EduOpen network in Italy. In How to Design for Persistence and Retention in MOOCs? Brasher, A., Weller, M., McAndrew, P., Eds.; EADTU: Maastricht, The Netherlands, 2016; pp. 19–24. [Google Scholar]
- Limone, P.; Pati, S.; Toto, G.A.; Di Fuccio, R.; Baiano, A.; Lopriore, G. Literature Review on MOOCs on Sensory (Olfactory) Learning. Computers 2022, 11, 32. [Google Scholar] [CrossRef]
- Bacow, L.S.; Bowen, W.G.; Guthrie, K.M.; Lack, K.A.; Long, P.L. Barriers to Adoption of Online Learning Systems in U.S. Higher Education; Ithaka: New York, NY, USA, 2012; pp. 39–51. Available online: http://www.sr.ithaka.org/research-publications/barriers-adoption-online-learningsystems-us-higher-education (accessed on 10 March 2023).
- Sulla, F.; Camia, M.; Scorza, M.; Giovagnoli, S.; Padovani, R.; Benassi, E. The Moderator Effect of Subthreshold Autistic Traits on the Relationship between Quality of Life and Internet Addiction. Healthcare 2023, 11, 186. [Google Scholar] [CrossRef] [PubMed]
- Dixson, M.D. Creating effective student engagement in online courses: What do students find engaging? J. Scholarsh. Teach. Learn. 2012, 10, 1–13. Available online: https://scholarworks.iu.edu/journals/index.php/josotl/article/view/1744 (accessed on 10 March 2023).
- Dixson, M.D. Measuring Student Engagement in the Online Course: The Online Student Engagement Scale (OSE). Online Learn. 2015, 19, n4. [Google Scholar] [CrossRef] [Green Version]
- Xinlei, C.; Yiyang, L. Online Learning Engagement in International Collaborative Nursing Students: A Questionnaire Study. Bachelor’s Thesis, Lishui University, Lishui, China, 2022. [Google Scholar]
- Cole, A.W.; Lennon, L.; Weber, N.L. Student perceptions of online active learning practices and online learning climate predict online course engagement. Interact. Learn. Environ. 2021, 29, 866–880. [Google Scholar] [CrossRef]
- Quigley, M.; Bradley, A.; Playfoot, D.; Harrad, R. Personality traits and stress perception as predictors of students’ online engagement during the COVID-19 pandemic. Pers. Individ. Dif. 2022, 194, 111645. [Google Scholar] [CrossRef] [PubMed]
- Bolliger, D.U.; Halupa, C. Online student perceptions of engagement, transactional distance, and outcomes. Distance Educ. 2018, 39, 299–316. [Google Scholar] [CrossRef]
- Chan, S.L.; Lin, C.C.; Chau, P.H.; Takemura, N.; Fung JT, C. Evaluating online learning engagement of nursing students. Nurse Educ. Today 2021, 104, 104985. [Google Scholar] [CrossRef]
- Shcheglova, I.A. A cross-cultural comparison of the academic engagement of students. Sov. Educ. 2018, 60, 665–681. [Google Scholar] [CrossRef]
- Hofstede, G. Cultural differences in teaching and learning. Int. J. Intercult. Relat. 1986, 10, 301–320. [Google Scholar] [CrossRef]
- Loscalzo, Y.; Giannini, M. Study Engagement in Italian University Students: A Confirmatory Factor Analysis of the Utrecht Work Engagement Scale—Student Version. Soc. Indic. Res. 2019, 142, 845–854. [Google Scholar] [CrossRef]
- Ghorbani, H. Mahalanobis Distance and Its Application for detecting multivariate outliers. Facta Univ. Ser. Math. Inform. 2019, 34, 583–595. [Google Scholar] [CrossRef]
- Team R Core. A Language and Environment for Statistical Computing (Version 3.4.2); [Computer Software]; R Foundation for Statistical Computing: Vienna, Austria, 2017. [Google Scholar]
- Rosseel, Y. Lavaan: An R package for structural equation modeling. J. Stat. Softw. 2012, 48, 1–36. [Google Scholar] [CrossRef] [Green Version]
- Xia, Y.; Yang, Y. RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behav. Res. 2019, 51, 409–428. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fornell, C.; Larcker, D.F. Structural equation models with unobservable variables and measurement error: Algebra and statistics. J. Mark. Res. 1981, 18, 382–388. [Google Scholar] [CrossRef]
- Saunders, M.; Lewis, P.; Thornhill, A. Research Methods for Business Students; Pearson Education: Harlow, UK, 2009; ISBN 978-0-273-71686-0. [Google Scholar]
- Crossan, B.; Field, J.; Gallacher, J.; Merrill, B. Understanding participation in learning for nontraditional adult learners: Learning careers and the construction of learning identities. Br. J. Sociol. Educ. 2003, 24, 55–67. [Google Scholar] [CrossRef]
- Shernoff, D.J.; Schmidt, J.A. Further evidence of an engagement–achievement paradox among U.S. high school students. J. Youth Adolesc. 2008, 37, 564–580. [Google Scholar] [CrossRef]
- Lei, H.; Cui, Y.; Zhou, W. Relationships between student engagement and academic achievement: A meta-analysis. Self Identity 2018, 46, 517–528. [Google Scholar] [CrossRef]
- Pardo, A. Designing learning analytics experiences. In Learning Analytics; Larusson, J., White, B., Eds.; Springer: Cham, Switzerland, 2014; pp. 15–38. [Google Scholar] [CrossRef]
- Rajabalee, Y.B.; Santally, M.I. Learner satisfaction, engagement and performances in an online module: Implications for institutional e-learning policy. Educ. Inf. Technol. 2021, 26, 2623–2656. [Google Scholar] [CrossRef]
- Baloran, E.T.; Hernan, J.T.; Taoy, J.S. Course satisfaction and student engagement in online learning amid COVID-19 pandemic: A structural equation model. Turk. Online J. Distance Educ. 2021, 22, 1–12. [Google Scholar] [CrossRef]
- Lavidas, K.; Papadakis, S.; Manesis, D.; Grigoriadou, A.S.; Gialamas, V. The Effects of Social Desirability on Students’ Self-Reports in Two Social Contexts: Lectures vs. Lectures and Lab Classes. Information 2022, 13, 491. [Google Scholar] [CrossRef]
Items | Mean | SD | Skewness | Kurtosis |
---|---|---|---|---|
S1: Assicurarsi di studiare con regolarità (Making sure to study on a regular basis) | 3.61 | 0.91 | −0.47 | 0.14 |
S2: Stare al passo con le lezioni (Staying up on the readings) | 3.55 | 1.11 | −0.38 | −0.63 |
S3: Controllare gli appunti prima della lezione per essere certo di comprendere il materiale del corso (Looking over class notes) | 3.07 | 1.12 | −0.11 | −0.74 |
S4: Essere organizzatə (Being organized) | 3.99 | 0.99 | −0.84 | 0.28 |
S5: Prendere degli appunti accurati sulle lezioni, in PowerPoint o le video lezioni (Taking good notes over readings, PowerPoints or, video lectures) | 3.81 | 1.06 | −0.71 | −0.12 |
S6: Ascoltare/leggere attentamente (Listening/reading carefully) | 4.08 | 0.78 | −0.68 | 0.68 |
E1: Metterci molto impegno (Putting forth effort) | 4.18 | 0.76 | −0.76 | 0.67 |
E2: Trovare modi per rendere il materiale del corso pertinente con la mia vita (Finding ways to make the course materials relevant to my life) | 3.84 | 0.96 | −0.49 | −0.27 |
E3: Applicare i contenuti del corso alla mia vita (Applying course material to my life) | 3.95 | 0.91 | −0.61 | 0.01 |
E4: Trovare modi per rendere il corso interessante per me (Finding ways to make the course interesting to me) | 3.84 | 0.83 | −0.33 | −0.27 |
E5: Avere davvero voglia di imparare il materiale del corso (Really desiring to to learn the material) | 4.15 | 0.77 | −0.62 | 0.19 |
PA1: Divertirsi nelle chat online, discussioni o via email con il docente o gli altri studenti (Having fun in online chats) | 2.75 | 1.12 | 0.15 | −0.72 |
PA2: Partecipare in maniera attiva in discussioni in piccolo gruppo su forum (ad es. whatsapp, etc.) (Participating actively in small-group discussion forums) | 3.03 | 1.08 | 0.04 | −0.57 |
PA3: Aiutare ɜ colleghɜ (Helping fellow students) | 3.91 | 0.87 | −0.62 | 0.17 |
PA4: Partecipare a conversazioni online (chat, discussioni, email) sul corso (Engage in conversations online chat, discussions, email) | 2.99 | 1.09 | 0.07 | −0.58 |
PA5: Postare sul forum della piattaforma online (es. dolly, Teams) con regolarità (Posting in the discussion forum regularly) | 2.57 | 1.23 | 0.37 | −0.87 |
PA6: Riuscire a conoscere altr * collegh * che frequentano il corso (Getting to know other students in the class) | 3.47 | 1.12 | −0.45 | −0.41 |
PER1: Voler ottenere un buon voto (Getting a good grade) | 4.43 | 0.69 | −0.96 | 0.13 |
PER2: Avere buoni risultati nei [in eventuali] test/quiz [in itinere] (es. Kahoot) (Doing well in the tests/quizzes) | 3.91 | 0.97 | −0.71 | 0.17 |
Fit Index | Standard | Robust |
---|---|---|
CFI | 0.97 | 0.89 |
TLI | 0.96 | 0.88 |
RMSEA | 0.10 | 0.11 |
RMSEA 90% Confidence Interval-Lower | 0.09 | 0.10 |
RMSEA 90% Confidence Interval-Upper | 0.11 | 0.12 |
p Value RMSEA | <0.001 | <0.001 |
SRMR | 0.08 | 0.08 |
EST | SE | z-Value | p | |
---|---|---|---|---|
Skills =~ | ||||
S1: Assicurarsi di studiare con regolarità (Making sure to study on a regular basis) | 0.74 | 0.03 | 23.86 | <0.001 |
S2: Stare al passo con le lezioni (Staying up on the readings) | 0.64 | 0.03 | 17.04 | <0.001 |
S3: Controllare gli appunti prima della lezione per essere certo di comprendere il materiale del corso (Looking over class notes…) | 0.74 | 0.03 | 24.73 | <0.001 |
S4: Essere organizzatǝ (Being organized) | 0.69 | 0.04 | 18.98 | <0.001 |
S5: Prendere degli appunti accurati sulle lezioni, in PowerPoint o le video lezioni (Taking good notes over readings, PowerPoints or, video lectures) | 0.75 | 0.03 | 25.63 | <0.001 |
S6: Ascoltare/leggere attentamente (Listening/reading carefully) | 0.79 | 0.03 | 26.06 | <0.001 |
Emotional =~ | ||||
E1: Metterci molto impegno (Putting forth effort) | 0.75 | 0.04 | 18.79 | <0.001 |
E2: Trovare modi per rendere il materiale del corso pertinente con la mia vita (Finding ways to make the course materials relevant to my life) | 0.83 | 0.03 | 31.97 | <0.001 |
E3: Applicare i contenuti del corso alla mia vita (Applying course material to my life) | 0.78 | 0.03 | 28.54 | <0.001 |
E4: Trovare modi per rendere il corso interessante per me (Finding ways to make the course interesting to me) | 0.83 | 0.03 | 31.28 | <0.001 |
E5: Avere davvero voglia di imparare il materiale del corso (Really desiring to to learn the material) | 0.75 | 0.03 | 24.50 | <0.001 |
Participation =~ | ||||
PA1: Divertirsi nelle chat online, discussioni o via email con il docente o gli altri studenti (Having fun in online chats…) | 0.76 | 0.03 | 27.38 | <0.001 |
PA2: Partecipare in maniera attiva in discussioni in piccolo gruppo su forum (ad es. whatsapp, etc.) (Participating actively in small-group discussion forums) | 0.79 | 0.03 | 30.54 | <0.001 |
PA3: Aiutare ɜ colleghɜ (Helping fellow students) | 0.65 | 0.05 | 14.35 | <0.001 |
PA4: Partecipare a conversazioni online (chat, discussioni, email) sul corso (Engaging in conversations online (chat, discussions, email)) | 0.82 | 0.02 | 33.82 | <0.001 |
PA5: Postare sul forum della piattaforma online (es. dolly, Teams) con regolarità (Posting in the discussion forum regularly) | 0.71 | 0.03 | 22.01 | <0.001 |
PA6: Riuscire a conoscere altrɜ colleghɜ che frequentano il corso (Getting to know other students in the class) | 0.69 | 0.04 | 18.29 | <0.001 |
Performance =~ | ||||
PER1: Voler ottenere un buon voto (Getting a good grade) | 0.69 | 0.05 | 13.97 | <0.001 |
PER2: Avere buoni risultati nei (IN EVENTUALI) test/quiz (IN ITINERE) (es. Kahoot) (Doing well in the tests/quizzes) | 0.82 | 0.05 | 16.14 | <0.001 |
EST | SE | z-Value | p | |
---|---|---|---|---|
Skills ~~ | ||||
Emotional | 0.65 | 0.03 | 18.51 | <0.001 |
Participation | 0.59 | 0.04 | 13.47 | <0.001 |
Performance | 0.59 | 0.05 | 10.87 | <0.001 |
Emotional ~~ | ||||
Participation | 0.47 | 0.05 | 10.23 | <0.001 |
Performance | 0.46 | 0.06 | 7.38 | <0.001 |
Participation ~~ | ||||
Performance | 0.59 | 0.06 | 10.41 | <0.001 |
Vigor | Absorption | Dedication | |
---|---|---|---|
Skills | 0.47 *** | 0.42 *** | 0.29 *** |
Emotional | 0.34 *** | 0.42 *** | 0.45 *** |
Participation | 0.47 *** | 0.31 *** | 0.24 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sulla, F.; Harrad, R.; Tontodimamma, A.; Limone, P.; Aquino, A. Italian Validation of the Online Student Engagement Scale (OSE) in Higher Education. Behav. Sci. 2023, 13, 324. https://doi.org/10.3390/bs13040324
Sulla F, Harrad R, Tontodimamma A, Limone P, Aquino A. Italian Validation of the Online Student Engagement Scale (OSE) in Higher Education. Behavioral Sciences. 2023; 13(4):324. https://doi.org/10.3390/bs13040324
Chicago/Turabian StyleSulla, Francesco, Rachel Harrad, Alice Tontodimamma, Pierpaolo Limone, and Antonio Aquino. 2023. "Italian Validation of the Online Student Engagement Scale (OSE) in Higher Education" Behavioral Sciences 13, no. 4: 324. https://doi.org/10.3390/bs13040324