AI, Analytics and a New Assessment Model for Universities

Round 1

Reviewer 1 Report

Thank you for giving me the opportunity to review this article. It presents a general review on how to integrate AI and LA in higher education. One of the most prominent trent as reported in international reports today. 

 

However, I would like to recommend and question the authors:

 

- Firstly, what do you mean by "formative assessment"? I think this should be clarified in this document as it sometimes seems to be confused with other terms such as continuous assessment.  

 

- I think it is important to include a specific section on the limitations of the work and implications for practice or practical notes on the integration of LA and IE in the teaching-learning process based on their work. 

 

- Below are some references that I consider useful for the authors:

Stanja, J., Gritz, W., Krugel, J., Hoppe, A., & Dannemann, S. (2023). Formative assessment strategies for students' conceptions—The potential of learning analytics. British Journal of Educational Technology, 54, 58–75. https://doi.org/10.1111/bjet.13288

Gašević D, Greiff S, Shaffer DW (2022) Towards strengthening links between learning analytics and assessment: Challenges and potentials of a promising new bond. Comput Human Behav 134. https://doi.org/10.1016/j.chb.2022.107304

Tirado-Olivares, S.; Navío-Inglés, M.; O’Connor-Jiménez, P.; Cózar-Gutiérrez, R. From Human to Machine: Investigating the Effectiveness of the Conversational AI ChatGPT in Historical Thinking. Educ. Sci. 2023, 13, 803. https://doi.org/10.3390/educsci13080803

 

Author Response

Please see attachment

Author Response File: Author Response.pdf

Reviewer 2 Report

The article analyzes a timely and exciting topic. However, several remarks should be addressed before recommending publications.

 

The article's introduction should examine in a more comprehensive way existing literature on AI applied to education. The introduction is in fact not mentioning that the topic is at the moment largely debated in the sector and that recently several studies have identified possible future uses and limitations of the technology.

I suggest that these recently published articles should be discussed in the introduction:

Some of these articles are directly mentioning the problem of competitiveness and the introduction of AI.
- Nemorin, S., Vlachidis, A., Ayerakwa, H. M., & Andriotis, P. (2023). AI hyped? A horizon scan of discourse on artificial intelligence in education (AIED) and development. Learning, Media and Technology, 48(1), 38-51.

- Grassini, S. (2023). Shaping the future of education: exploring the potential and consequences of AI and ChatGPT in educational settings. Education Sciences, 13(7), 692.

- Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410.

The article would gain in impact with a clearer authorial standpoint in the discussion/conclusion.

no comments on the English. The article is readeable and only minor errors were detected

Author Response

Please see attachment

Author Response File: Author Response.pdf

Reviewer 3 Report

The paper education-2614110 whose title is "AI, analytics and a new assessment model for universities" makes an intense review of the educational model in higher education focusing on how artificial intelligence can bring great benefits to the educational model.

The article presented is very interesting, denoting a great topicality both in the data provided and in the debate raised about the educational model.

It is important to highlight the different aspects that are developed and analyzed such as "A: growth in knowledge-based graduate occupations, B: competitive pressures on the HE market, C: increasing qualification, unbundling and credit transfer, ..."

This comparative view from different perspectives makes the article have a more global vision and therefore more accurate in its conclusions.

 

The use of Artificial Intelligence in education is a topic of recent debate and controversy both at higher education levels and in basic training globally, therefore, I believe that the approach developed is completely accurate and very useful for the scientific and educational community.

 

It would be interesting if the article could cover some aspects in order to be published and clarify certain doubts that arise when reading it.

In the study on the impact of the pandemic on online education, more data or specific studies should be included to support the statements made.

With respect to the two functions of the evaluation, specific and concrete examples or case studies should be provided to illustrate the problems and limitations.

Regarding the use of artificial intelligence in higher education, it should be further addressed as to how it can be used in assessment (AFL) as well as provide concrete examples of how universities are implementing AI in their assessment practices.

Finally, it is recommended that the key points of the article be summarized more concisely.

Given that the article is mostly of high quality, I propose a minor revision for further publication inviting the authors to make appropriate improvements.

Author Response

Please see attachment

Author Response File: Author Response.pdf