Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System
Abstract
:1. Introduction
2. Research Objectives
3. Materials and Methods
3.1. Materials and Subjects
3.2. Method
3.2.1. Learning Analytics Using Social Network Analysis
3.2.2. Bayesian Network
4. Results
4.1. Social Network Analysis
4.2. Bayesian Network
5. Discussion
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Bennett, R.E. Formative assessment: A critical review. Assess. Educ. Princ. Policy Pract. 2011, 18, 5–25. [Google Scholar] [CrossRef]
- Black, P.; Wiliam, D. Assessment and Classroom Learning. Assess. Educ. Princ. Policy Pract. 1998, 5, 7–74. [Google Scholar] [CrossRef]
- Khan, R.A.; Jawaid, M. Technology Enhanced Assessment (TEA) in COVID 19 Pandemic. Pak. J. Med. Sci. 2020, 36, 108. [Google Scholar] [CrossRef] [PubMed]
- Nagandla, K.; Sulaiha, S.; Nalliah, S. Online formative assessments: Exploring their educational value. J. Adv. Med. Educ. Prof. 2018, 6, 51–57. [Google Scholar]
- Kusairi, S.; Noviandari, L.; Parno, P.; Pratiwi, H.Y. Analysis of Students’ Understanding of Motion in Straight Line Concepts: Modeling Instruction with Formative E-Assessment. Int. J. Instr. 2019, 12, 353–364. [Google Scholar] [CrossRef]
- McCallum, S.; Milner, M.M. The effectiveness of formative assessment: Student views and staff reflections. Assess. Eval. High. Educ. 2020, 1–16. [Google Scholar] [CrossRef]
- Shaffer, D.W.; Hatfield, D.; Svarovsky, G.N.; Nash, P.; Nulty, A.; Bagley, E.; Frank, K.; Rupp, A.A.; Mislevy, R. Epistemic Network Analysis: A Prototype for 21st-Century Assessment of Learning. Int. J. Learn. Media 2009, 1, 33–53. [Google Scholar] [CrossRef] [Green Version]
- Mislevy, R.J.; Almond, R.G.; Lukas, J.F. A brief introduction to evidence-centered design. ETS Res. Rep. Ser. 2003, 2003, i-29. [Google Scholar] [CrossRef]
- Mislevy, R.J. Evidence and inference in educational assessment. Psychometrika 1994, 59, 439–483. [Google Scholar] [CrossRef]
- Mislevy, R.J. Probability-based inference in cognitive diagnosis. ETS Res. Rep. Ser. 1994, 1994, i-31. [Google Scholar] [CrossRef]
- Pellegrino, J.W.; Chudowsky, N.; Glaser, R. Knowing What Students Know: The Science and Design of Educational Assessment; National Academy Press: Washington, DC, USA, 2001. [Google Scholar]
- Mislevy, R.J. The Concept of Validity: Revisions, New Directions and Applications; Information Age Publishing: Charlotte, NC, USA, 2009. [Google Scholar]
- Rupp, A.A.; Templin, J.L. Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art. Meas. Interdiscip. Res. Perspect. 2008, 6, 219–262. [Google Scholar] [CrossRef]
- Qian, M.; Clark, K.R. Game-based Learning and 21st century skills: A review of recent research. Comput. Hum. Behav. 2016, 63, 50–58. [Google Scholar] [CrossRef]
- Taub, M.; Azevedo, R. Using Sequence Mining to Analyze Metacognitive Monitoring and Scientific Inquiry Based on Levels of Efficiency and Emotions during Game-Based Learning. J. Educ. Data Min. 2018, 10, 1–26. [Google Scholar]
- Hwa, S.P. Pedagogical change in mathematics learning: Harnessing the power of digital game-based learning. J. Educ. Technol. Soc. 2018, 21, 259–276. [Google Scholar]
- Van Laar, E.; Van Deursen, A.J.; Van Dijk, J.A.; De Haan, J. The relation between 21st-century skills and digital skills: A systematic literature review. Comput. Hum. Behav. 2017, 72, 577–588. [Google Scholar] [CrossRef]
- Rios, J.A.; Ling, G.; Pugh, R.; Becker, D.; Bacall, A. Identifying Critical 21st-Century Skills for Workplace Success: A Content Analysis of Job Advertisements. Educ. Res. 2020, 49, 80–89. [Google Scholar] [CrossRef] [Green Version]
- Howard, P. Twenty-First Century Learning as a Radical Re-Thinking of Education in the Service of Life. Educ. Sci. 2018, 8, 189. [Google Scholar] [CrossRef] [Green Version]
- Howard, P.; O’Brien, C.; Kay, B.; O’Rourke, K. Leading Educational Change in the 21st Century: Creating Living Schools through Shared Vision and Transformative Governance. Sustainability 2019, 11, 4109. [Google Scholar] [CrossRef] [Green Version]
- Polyak, S.T.; Von Davier, A.A.; Peterschmidt, K. Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills. Front. Psychol. 2017, 8, 2029. [Google Scholar] [CrossRef] [Green Version]
- Von Davier, A.A.; Deonovic, B.; Yudelson, M.; Polyak, S.T.; Woo, A. Computational Psychometrics Approach to Holistic Learning and Assessment Systems. Front. Educ. 2019, 4, 69. [Google Scholar] [CrossRef] [Green Version]
- Branden, K.V.D. Sustainable Education: Exploiting Students’ Energy for Learning as a Renewable Resource. Sustainability 2015, 7, 5471–5487. [Google Scholar] [CrossRef] [Green Version]
- Carter, T.B.; Hunter, D.; Hancock, M. The Network Package. R Package. 2008. Available online: http://statnet.org (accessed on 10 May 2020).
- Almond, R.G.; Dibello, L.V.; Moulder, B.; Zapata-Rivera, D. Modeling Diagnostic Assessments with Bayesian Networks. J. Educ. Meas. 2007, 44, 341–359. [Google Scholar] [CrossRef]
- Almond, R.G.; Mislevy, R.J.; Steinberg, L.S.; Yan, D.; Williamson, D.M. Bayesian Networks in Educational Assessment; Springer: New York, NY, USA, 2015. [Google Scholar]
- Almond, R.G.; Mulder, J.; Hemat, L.A.; Yan, D. Bayesian Network Models for Local Dependence Among Observable Outcome Variables. J. Educ. Behav. Stat. 2009, 34, 491–521. [Google Scholar] [CrossRef] [Green Version]
- Almond, R.; Yan, D.; Hemat, L. Parameter Recovery Studies With a Diagnostic Bayesian Network Model. Behaviormetrika 2008, 35, 159–185. [Google Scholar] [CrossRef]
- Jensen, F.V.; Olesen, K.G.; Andersen, S.K. An algebra of bayesian belief universes for knowledge-based systems. Networks 1990, 20, 637–659. [Google Scholar] [CrossRef]
- Murphy, K.P. Dynamic Bayesian Neyworks: Representation, Inference and Learning. Ph.D. Thesis, University of California, Berkeley, CA, USA, 2002. [Google Scholar]
- Reye, J. A Belief Net Backbone for Student Modelling. In Intelligent Tutoring Systems; Ikeda, M., Ashley, K.D., Chan, T.W., Eds.; Springer: Berlin/Heidelberg, Germany, 1996; pp. 596–604. [Google Scholar]
- Chang, K.; Beck, J.; Mostow, J.; Corbett, A. A Bayes Net Toolkit for Student Modeling. In Intelligent Tutoring Systems; Ikeda, M., Ashley, K.D., Chan, T.W., Eds.; Springer: Berlin/Heidelberg, Germany, 2006; pp. 104–113. [Google Scholar]
- Briggs, D.C.; Alonzo, A.C. The Psychometric Modeling of Ordered Multiple-Choice Item Responses for Diagnostic Assessment with a Learning Progression. In Proceedings of the Learning Progressions in Science, Iowa City, IA, USA, 24–26 June 2012; pp. 293–316. [Google Scholar]
- Corcoran, T.; Mosher, F.; Rogat, A. Learning Progressions in Science: An. Evidence-Based Approach to Reform; Consortium for Policy Research in Education: Philadelphia, PA, USA, 2009; pp. 1–88. [Google Scholar]
- Corrigan, S.; Loper, S.; Barber, J.; Brown, N.; Kulikowich, J. The juncture of supply and demand for information: How and when can learning progressions meet the information demands of curriculum developers? In Proceedings of the Learning Progressions in Science, Iowa City, IA, USA, 24–26 June 2009. [Google Scholar]
- Yoon, S.; Goh, S.E.; Yang, Z. Toward a Learning Progress Iowa City ion of Complex Systems Understanding. Complicity: Int. J. Complex. Educ. 2019, 16, 1–19. [Google Scholar] [CrossRef]
- Attali, Y.; Arieli-Attali, M. Validating Classifications From Learning Progressions: Framework and Implementation. ETS Res. Rep. Ser. 2019, 2019, 1–20. [Google Scholar] [CrossRef] [Green Version]
- Rupp, A.; Choi, Y.; Gushta, M.; Mislevy, R.; Thies, M.C.; Bagley, E.; Nash, P.; Hatfield, D.; Svarovsky, G.; Shaffer, D.W. Modeling learning progressions in epistemic games with epistemic network analysis: Principles for data analysis and generation. In Proceedings of the Learning Progressions in Science Conference, Iowa City, IA, USA, 24–26 June 2009. [Google Scholar]
- Rupp, A.A.; Sweet, S.; Choi, Y. Modeling learning trajectories with epistemic network analysis: A simulation-based investigation of a novel analytic method for epistemic games. In Proceedings of the Educational Data Mining Conference, Pittsburgh, PA, USA, 11–13 June 2010. [Google Scholar]
Percent | Count | ||
---|---|---|---|
Educational Level | 1year | 43.2% | 108 |
2year | 25.6% | 64 | |
3year | 14.0% | 35 | |
4year | 17.2% | 43 | |
Age | 20 | 24.0% | 6 |
30 | 26.8% | 67 | |
40 | 28.0% | 70 | |
50 | 42.8% | 107 | |
Gender | Male | 35.2% | 88 |
Female | 65.8% | 162 | |
Job Status | Full-time | 25.6% | 64 |
Part-time | 39.2% | 98 | |
No | 36.2% | 88 |
Slice | S | K | I | V | E |
---|---|---|---|---|---|
1 | 1 | 1 | 1 | 0 | 0 |
2 | 0 | 1 | 0 | 1 | 0 |
3 | 1 | 0 | 1 | 0 | 1 |
4 | 1 | 1 | 0 | 1 | 1 |
N | 1 | 1 | 0 | 1 | 2 |
Slice | S | K | I | V | E |
---|---|---|---|---|---|
S | 0 | 1 | 1 | 0 | 0 |
K | 1 | 0 | 1 | 0 | 0 |
I | 1 | 1 | 0 | 0 | 0 |
V | 0 | 0 | 0 | 1 | 0 |
E | 0 | 0 | 0 | 0 | 0 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Choi, Y.; Cho, Y.I. Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System. Sustainability 2020, 12, 7950. https://doi.org/10.3390/su12197950
Choi Y, Cho YI. Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System. Sustainability. 2020; 12(19):7950. https://doi.org/10.3390/su12197950
Chicago/Turabian StyleChoi, Younyoung, and Young Il Cho. 2020. "Learning Analytics Using Social Network Analysis and Bayesian Network Analysis in Sustainable Computer-Based Formative Assessment System" Sustainability 12, no. 19: 7950. https://doi.org/10.3390/su12197950