Using Learning Analytics for Personalised, Data-Informed Feedback and Support: Studies of Impact, Challenges, and Future Directions

A special issue of Education Sciences (ISSN 2227-7102).

Deadline for manuscript submissions: closed (10 September 2023) | Viewed by 4165

Special Issue Editors

Faculty of Engineering and IT, University of Technology Sydney, Sydney 2007, Australia
Interests: learning analytics and educational data mining; technology enhanced teaching in higher education; student engagement and transition; student feedback literacy; collaborative learning; design thinking; technology acceptance/adoption of information systems

E-Mail Website
Guest Editor
Connected Intelligence Centre, University of Technology Sydney, Sydney 2007, Australia
Interests: learning analytics; feedback; self-regulated learning; learner emotions; student engagement; technology adoption; learning design

E-Mail Website
Guest Editor
The Center for Academic Innovation, University of Michigan, Ann Arbor, MI 48104, USA
Interests: learning analytics; gameful learning; educational technology; motivation theory; critical feedback; equity in education

Special Issue Information

Dear Colleagues,

With the maturity of learning analytics (LA) as a field, many tools and systems exist for data-informed feedback and support. The vast range of these interventions includes fully-automated learning analytics dashboards and recommender systems (Sahin & Ifenthaler, 2010), online tutoring systems (e.g., Heffernan & Heffernan, 2014), web-based portals for tailored support and feedback (e.g., Matz et al., 2021), and semi-automated instructor-in-the-loop systems (e.g., Liu et al., 2017; Pardo et al., 2018), and writing analytics feedback tools (e.g., Knight et al., 2020). However, in comparison with developmental work, research evaluating the effectiveness of learning analytics feedback interventions is lagging (Viberg et al., 2018). Although feedback generally remains a significant factor in improving student learning, its effects are not uniform (Wisniewski, Zierer & Hattie, 2020). Regarding feedback drawing on learning analytics, there is some evidence of the same effect (e.g., Lim et al., 2021), but this is insufficient. More evidence is needed to understand the nuanced impact of data-informed, automated feedback on students with differing motivations, educational backgrounds, prior knowledge, and other learner characteristics. Understanding differences in impact due to learner characteristics is important for designing effective personalised feedback and support systems based on individuals’ learner data.

Over the years, the LA field has made repeated calls for the alignment of learning design and learning analytics (Hernandez-Leo et al., 2019; Lockyer, Heathcote, & Dawson, 2013). Learning analytics tools that began as research projects are finding their way into actual teaching and learning contexts, from project to product (Buckingham Shum, 2022). Wielding such tools in the wild brings a host of challenges, not least of which is knowing how to embed the tool within the context of the teaching and learning environment. Given the importance of embedding learning analytics into learning design, more research is needed to demonstrate how educators can use learning analytics feedback tools in such a way as to promote students’ deep engagement with their personalised feedback.

This Special Issue aims to investigate the key elements of feedback, approaches to data-informed feedback, the importance of developing data-informed feedback literacy among students and teachers, and the impacts, associated challenges, practices, technologies, and future directions. We invite empirical contributions in the research area of personalised, data-informed feedback. These include (but are not limited to) the following:

  • Feedback nudges
  • Peer feedback 
  • Video feedback
  • Feedback rubrics
  • Feedback and learning design
  • Feedback and belonging
  • Feedback and student engagement
  • Feedback and self-regulated learning
  • Feedback literacy (emotional response to feedback) of student and teacher
  • Challenges in adopting data-informed feedback 
  • Dialogical feedback

We look forward to receiving your contributions. 

References

Buckingham Shum, S. (2022). Embedding learning analytics in a University: Boardroom, Staff Room, Server Room, Classroom. In O. Viberg & A. Gronlund (Eds.), Practicable Learning Analytics. SpringerNature.

Heffernan, N. T., & Heffernan, C. L. (2014). The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and Teaching. International Journal of Artificial Intelligence in Education, 24(4), 470-497. https://doi.org/10.1007/s40593-014-0024-x.

Hernandez‐Leo, D., Martinez‐Maldonado, R., Pardo, A., Munoz‐Cristobal, J. A., & Rodríguez‐Triana, M. J. (2019). Analytics for learning design: A layered framework and tools. British Journal of Educational Technology, 50(1), 139-152.

Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439-1459.

Knight, S., Shibani, A., Abel, S., Gibson, A., Ryan, P., Sutton, N., Wight, R., Lucas, C., Sandor, A., Kitto, K., Liu, M., Mogarka, R. V., & Buckingham Shum, S. (2020). AcaWriter A learning analytics tool for formative feedback on academic writing. Journal of Writing Research, 12(1), 141-186. https://doi.org/https://doi.org/10.17239/jowr-2020.12.01.06.

Lim, L.-A., Gentili, S., Pardo, A., Kovanovic, V., Whitelock-Wainwright, A., Gasevic, D., & Dawson, S. (2021). What changes, and for whom? A study of the impact of learning analytics-based process feedback in a large course. Learning and Instruction, 101202. https://doi.org/https://doi.org/10.1016/j.learninstruc.2019.04.003.

Liu, D. Y.-T., Bartimote-Aufflick, K., Pardo, A., & Bridgeman, A. J. (2017). Data-driven personalization of student learning support in higher education. In A. Peña-Ayala (Ed.), Learning Analytics: Fundaments, Applications, and Trends, Studies in Systems, Decision and Control, 94 (pp. 143-169). https://doi.org/10.1007/978-3-319-52977-6.

Matz, R. L., Schulz, K. W., Hanley, E. N., Derry, H. A., Hayward, B. T., Koester, B. P., Hayward, C., & McKay, T. (2021). Analyzing the efficacy of Ecoach in supporting gateway course success through tailored support. In LAK21: 11th International Learning Analytics and Knowledge Conference (LAK21), April 12–16, 2021, Irvine, CA, USA. (pp. 216-225). ACM. https://doi.org/https://doi.org/10.1145/3448139.3448160.

Pardo, A., Bartimote-Aufflick, K., Buckingham Shum, S., Dawson, S., Gao, J., Gašević, D., ..., & Vigentini, L. (2018). OnTask: Delivering Data-Informed Personalized Learning Support Actions. Journal of Learning Analytics, 5(3), 235-249. https://doi.org/http://dx.doi.org/10.18608/jla.2018.53.15.

Sahin, M., & Ifenthaler, D. (2021). Visualizations and Dashboards for Learning Analytics: A Systematic Literature Review. In M. Sahin & D. Ifenthaler (Eds.), Visualizations and Dashboards for Learning Analytics (pp. 3-22). Springer International Publishing. https://doi.org/10.1007/978-3-030-81222-5_1.

Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98-110. https://doi.org/https://doi.org/10.1016/j.chb.2018.07.027.

Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: A meta-analysis of educational feedback research. Frontiers in Psychology, 10, 3087. https://doi.org/10.3389/fpsyg.2019.03087.

Dr. Amara Atif
Dr. Lisa-Angelique Lim
Dr. Caitlin Hayward
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a double-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Education Sciences is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1800 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • learning analytics
  • personalized
  • data-informed feedback
  • student engagement
  • feedback interventions

Published Papers (2 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

21 pages, 3387 KiB  
Article
In Search of Alignment between Learning Analytics and Learning Design: A Multiple Case Study in a Higher Education Institution
by Lisa-Angelique Lim, Amara Atif, Keith Heggart and Nicole Sutton
Educ. Sci. 2023, 13(11), 1114; https://doi.org/10.3390/educsci13111114 - 6 Nov 2023
Viewed by 1878
Abstract
Learning design (LD) has increasingly been recognized as a significant contextual element for the interpretation and adoption of learning analytics (LA). Yet, few studies have explored how instructors integrate LA feedback into their learning designs, especially within open automated feedback (AF) systems. This [...] Read more.
Learning design (LD) has increasingly been recognized as a significant contextual element for the interpretation and adoption of learning analytics (LA). Yet, few studies have explored how instructors integrate LA feedback into their learning designs, especially within open automated feedback (AF) systems. This research presents a multiple-case study at one higher education institution to unveil instructors’ pilot efforts in using an open AF system to align LA and LD within their unique contexts, with the goal of delivering personalized feedback and tailored support. A notable finding from these cases is that instructors successfully aligned LA with LD for personalized feedback through checkpoint analytics in highly structured courses. Moreover, they relied on checkpoint analytics as an evaluation mechanism for evaluating impact. Importantly, students perceived a stronger sense of instructors’ support, reinforcing previous findings on the effectiveness of personalized feedback. This study contributes essential empirical insights to the intersection of learning analytics and learning design, shedding light on practical ways educators align LA and LD for personalized feedback and support. Full article
Show Figures

Figure 1

23 pages, 318 KiB  
Article
Content-Focused Formative Feedback Combining Achievement, Qualitative and Learning Analytics Data
by Cecilia Martinez, Ramiro Serra, Prem Sundaramoorthy, Thomas Booij, Cornelis Vertegaal, Zahra Bounik, Kevin van Hastenberg and Mark Bentum
Educ. Sci. 2023, 13(10), 1014; https://doi.org/10.3390/educsci13101014 - 7 Oct 2023
Viewed by 1006
Abstract
Research that integrates Learning Analytics (LA) with formative feedback has been shown to enhance student individual learning processes and performance. Debates on LA-based feedback highlight the need to further understand what data sources are appropriate for LA, how soon the feedback should be [...] Read more.
Research that integrates Learning Analytics (LA) with formative feedback has been shown to enhance student individual learning processes and performance. Debates on LA-based feedback highlight the need to further understand what data sources are appropriate for LA, how soon the feedback should be sent to students and how different types of feedback promote learning. This study describes an empirical case of LA-based feedback in higher education and analyzes how content-focused feedback promotes student achievement. The model combines quantitative achievement indicators with qualitative data about student learning challenges to develop feedback. Data sources include student pretest results, participation in practice exercises as well as midterm and final exam grades. In addition, in-depth interviews with high-, medium- and low-performing students are conducted to understand learning challenges. Based on their performance, students receive content-focused feedback every two weeks. The results show statistically significant improvements in final grades, in addition to a higher rate of problem-solving participation among students who receive feedback compared to their peers who opt out of the study. The contributions to the area of LA-based formative feedback are the following: (a) a model that combines quantitative with qualitative data sources to predict and understand student achievement challenges, (b) templates to design pedagogical and research-based formative feedback, (c) quantitative and qualitative positive results of the experience, (d) a documented case describing the practical implementation process. Full article
Show Figures

Figure 1

Back to TopTop