Beyond Quiz Scores: LMS Behavioral Metrics and Their Association with Summative Performance in Higher Education
Abstract
1. Introduction
Purpose of the Study
- How are ongoing quiz performance and quiz-related behavioral indicators associated with success on the final quiz?
- How is engagement with LMS course materials associated with final quiz performance?
- Which LMS behavioral and activity indicators are most strongly associated with success on the final quiz, beyond average quiz performance?
2. Literature Review
2.1. LMS Engagement as a Predictor of Academic Performance
2.2. Timing, Distributed Practice, and Procrastination
2.3. Self-Regulated Learning and Behavioral Indicators
2.4. Ongoing Quizzes as Learning and Analytics Tools
3. Materials and Methods
3.1. Sample
3.2. Instruments
3.2.1. Ongoing Quizzes
3.2.2. Final Quiz
3.2.3. LMS Activity Logs
3.3. Procedure
3.4. Statistical Analysis
3.5. Ethical Considerations
3.6. Data Availability
3.7. Use of Generative AI
4. Results
4.1. Relationship Between Weekly Quiz Completion and Final Exam Performance
4.2. Correlation Between Use of Learning Materials and Final Exam Performance
4.3. LMS Behavioral Indicators Beyond Average Quiz Score
5. Discussion
5.1. Interpretation of Key Results
5.2. Comparison with Previous Research
5.3. Limitations
6. Conclusions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
- Example 1.
- (a)
- Formal thinking is based on experience, whereas postformal thinking is based on abstract rules.
- (b)
- Postformal thinking considers context and contradictions, whereas formal thinking seeks one correct solution.
- (c)
- Formal thinking is characteristic of late adulthood, whereas postformal thinking is characteristic of adolescence.
- (d)
- Postformal thinking rejects logic, whereas formal thinking fully accepts it.
- Correct answer: (b)
- Example 2.
- (a)
- Emotional intelligence
- (b)
- Fluid intelligence
- (c)
- Crystallized intelligence
- (d)
- Spatial intelligence
- Correct answer: (c)
- Example 3.
- (a)
- Because adults are always right and must be respected.
- (b)
- Because adults’ experiences are the only source of knowledge.
- (c)
- Because adults connect learning with meaning and practical usefulness.
- (d)
- Because adults do not have access to theoretical sources.
- Correct answer: (c)
References
- Ahmadi, G., Mohammadi, A., Asadzandi, S., Shah, M., & Mojtahedzadeh, R. (2023). What are the indicators of student engagement in learning management systems? A systematized review of the literature. The International Review of Research in Open and Distributed Learning, 24(1), 117–136. [Google Scholar] [CrossRef]
- Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61(2), 213–238. [Google Scholar] [CrossRef]
- Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. [Google Scholar] [CrossRef]
- Bozkurt, A., Jung, I., Xiao, J., Vladimirschi, V., Schuwer, R., Egorov, G., Lambert, S., Al-Freih, M., Pete, J., Don Olcott, J., Rodes, V., Aranciaga, I., Bali, M., Alvarez, A. J., Roberts, J., Pazurek, A., Raffaghelli, J. E., Panagiotou, N., de Coëtlogon, P., & Paskevicius, M. (2020). A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education, 15(1), 1–126. [Google Scholar]
- Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13. [Google Scholar] [CrossRef]
- Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68–84. [Google Scholar] [CrossRef]
- Hailikari, T., Katajavuori, N., & Asikainen, H. (2021). Understanding procrastination: A case of a study skills course. Social Psychology of Education, 24(2), 589–606. [Google Scholar] [CrossRef]
- Ifenthaler, D., & Yau, J. Y.-K. (2020). Utilising learning analytics to support study success in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1961–1990. [Google Scholar] [CrossRef]
- Kim, K. R., & Seo, E. H. (2015). The relationship between procrastination and academic performance: A meta-analysis. Personality and Individual Differences, 82, 26–33. [Google Scholar] [CrossRef]
- Krause, U.-M., Stark, R., & Mandl, H. (2009). The effects of cooperative learning and feedback on e-learning in statistics. Learning and Instruction, 19(2), 158–170. [Google Scholar] [CrossRef]
- Martinie, M.-A., Potocki, A., Broc, L., & Larigauderie, P. (2023). Predictors of pro-crastination in first-year university students: Role of achievement goals and learning strategies. Social Psychology of Education, 26(2), 309–331. [Google Scholar] [CrossRef]
- McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology, 19(4–5), 494–513. [Google Scholar] [CrossRef]
- Pardo, A., Han, F., & Ellis, R. A. (2017). Combining university student self-regulated learning indicators and engagement with online learning events to predict academic performance. IEEE Transactions on Learning Technologies, 10(1), 82–92. [Google Scholar] [CrossRef]
- Radovan, M. (2026). Beyond Quiz Scores [Data set]. Zenodo. [Google Scholar] [CrossRef]
- R Core Team. (2024). R: A language and environment for statistical computing (Version 4.4) [Computer software]. Available online: https://cran.r-project.org (accessed on 13 April 2026).
- Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15(1), 20–27. [Google Scholar] [CrossRef] [PubMed]
- Roediger, H. L., III, & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. [Google Scholar] [CrossRef] [PubMed]
- Steel, P. (2007). The nature of procrastination: A meta-analytic and theoretical review of quintessential self-regulatory failure. Psychological Bulletin, 133(1), 65–94. [Google Scholar] [CrossRef] [PubMed]
- Steel, P., Brothen, T., & Wambach, C. (2001). Procrastination and personality, performance, and mood. Personality and Individual Differences, 30(1), 95–106. [Google Scholar] [CrossRef]
- Tan, T. Y., Jain, M., Obaid, T., & Nesbit, J. C. (2020). What can completion time of quizzes tell us about students’ motivations and learning strategies? Journal of Computing in Higher Education, 32(2), 389–405. [Google Scholar] [CrossRef]
- The jamovi Project. (2024). jamovi (Version 2.6) [Computer software]. Available online: https://www.jamovi.org (accessed on 13 April 2026).
- You, J. W. (2016). Identifying significant indicators using LMS data to predict course achievement in online learning. The Internet and Higher Education, 29, 23–30. [Google Scholar] [CrossRef]
- Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70. [Google Scholar] [CrossRef] [PubMed]
| Variable | N | M | SD | Min | Max |
|---|---|---|---|---|---|
| Quiz 1 | 37 | 8.43 | 2.08 | 2 | 10 |
| Quiz 2 | 29 | 9.55 | 3.38 | 0 | 12 |
| Quiz 3 | 27 | 7.67 | 2.15 | 0 | 10 |
| Quiz 4 | 34 | 9.64 | 2.69 | 2.55 | 12 |
| Quiz 5 | 33 | 7.33 | 2.86 | 0.88 | 12 |
| Quiz 6 | 36 | 8.4 | 3.76 | 1.43 | 12 |
| Quiz 7 | 37 | 10.39 | 3.07 | 1.82 | 12 |
| Quiz 8 | 36 | 8.94 | 3.29 | 1.43 | 12 |
| Quiz 9 | 37 | 8.9 | 2.74 | 1.82 | 12 |
| Quiz 10 | 30 | 10.46 | 2.75 | 0.7 | 12 |
| Average Result (Q1–10) | 37 | 8.7 | 2.19 | 3.2 | 11 |
| Final Quiz Score | 37 | 18.76 | 1.12 | 15 | 20 |
| Variable | Final Quiz Score | 95% CI |
|---|---|---|
| Quiz 1 | 0.38 * | [0.067, 0.629] |
| Quiz 2 | 0.29 | [−0.087, 0.593] |
| Quiz 3 | 0.13 | [−0.259, 0.489] |
| Quiz 4 | 0.06 | [−0.288, 0.387] |
| Quiz 5 | −0.04 | [−0.380, 0.305] |
| Quiz 6 | −0.02 | [−0.344, 0.313] |
| Quiz 7 | 0.08 | [−0.253, 0.392] |
| Quiz 8 | −0.11 | [−0.423, 0.227] |
| Quiz 9 | 0.05 | [−0.279, 0.367] |
| Quiz 10 | 0.14 | [−0.228, 0.479] |
| Highest score | 0.21 | [−0.184, 0.547] |
| Average quiz result | 0.08 | [−0.249, 0.396] |
| Time taken to complete | −0.50 ** | [−0.710, −0.212] |
| Average latency | −0.70 *** | [−0.836, −0.490] |
| Number of attempts | 0.48 ** | [0.112, 0.730] |
| FQ | H | TM | AR | ML | |
|---|---|---|---|---|---|
| Final Quiz Score (FQ) | — | ||||
| Handout (H) | 0.61 *** [0.36, 0.78] | — | |||
| Topic Materials (TM) | 0.12 [−0.21, 0.43] | 0.06 [−0.27, 0.38] | — | ||
| Additional Reading (AR) | 0.35 * [0.03, 0.61] | 0.23 [−0.10, 0.51] | 0.16 [−0.18, 0.46] | — | |
| Moodle Lesson (ML) | 0.34 * [0.02, 0.60] | 0.25 [−0.08, 0.53] | −0.26 [−0.54, 0.07 | −0.03 [−0.35, 0.30] | — |
| Padlet (P) | 0.40 * [0.09, 0.64] | 0.03 [−0.30, 0.35] | 0.07 [−0.26, 0.38] | 0.22 [−0.12, 0.51] | 0.41 * [0.10, 0.65] |
| Variables | Control Variable | Partial | 95% CI | |
|---|---|---|---|---|
| Final Quiz Result and Average Latency | Average Quiz Result | −0.70 | [−0.84, −0.49] | <0.001 |
| Total Attempts | Average Quiz Result | 0.40 | [0.09, 0.65] | 0.045 |
| Presentation Handout Views | Average Quiz Result | 0.61 | [0.35, 0.78] | <0.001 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Radovan, M. Beyond Quiz Scores: LMS Behavioral Metrics and Their Association with Summative Performance in Higher Education. Educ. Sci. 2026, 16, 772. https://doi.org/10.3390/educsci16050772
Radovan M. Beyond Quiz Scores: LMS Behavioral Metrics and Their Association with Summative Performance in Higher Education. Education Sciences. 2026; 16(5):772. https://doi.org/10.3390/educsci16050772
Chicago/Turabian StyleRadovan, Marko. 2026. "Beyond Quiz Scores: LMS Behavioral Metrics and Their Association with Summative Performance in Higher Education" Education Sciences 16, no. 5: 772. https://doi.org/10.3390/educsci16050772
APA StyleRadovan, M. (2026). Beyond Quiz Scores: LMS Behavioral Metrics and Their Association with Summative Performance in Higher Education. Education Sciences, 16(5), 772. https://doi.org/10.3390/educsci16050772

