Next Article in Journal
Artificial Neural Network Led Optimization of Oxyhydrogen Hybridized Diesel Operated Engine
Next Article in Special Issue
The Perceived Satisfaction in Utilizing Learning Management System among Engineering Students during the COVID-19 Pandemic: Integrating Task Technology Fit and Extended Technology Acceptance Model
Previous Article in Journal
Using Mobile Device Data to Track the Effects of the COVID-19 Pandemic on Spatiotemporal Patterns of National Park Visitation
Previous Article in Special Issue
Exploring the Factors Affecting Mobile Learning for Sustainability in Higher Education
Article

Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums

Department of Telematics Engineering, Universidad Carlos III de Madrid, E-28911 Leganés, Spain
*
Authors to whom correspondence should be addressed.
Academic Editors: Waleed Mugahed Al-Rahmi and Qusay Al-Maatouk
Sustainability 2021, 13(16), 9364; https://doi.org/10.3390/su13169364
Received: 29 July 2021 / Revised: 16 August 2021 / Accepted: 17 August 2021 / Published: 20 August 2021
Discussion forums are a valuable source of information in educational platforms such as Massive Open Online Courses (MOOCs), as users can exchange opinions or even help other students in an asynchronous way, contributing to the sustainability of MOOCs even with low interaction from the instructor. Therefore, the use of the forum messages to get insights about students’ performance in a course is interesting. This article presents an automatic grading approach that can be used to assess learners through their interactions in the forum. The approach is based on the combination of three dimensions: (1) the quality of the content of the interactions, (2) the impact of the interactions, and (3) the user’s activity in the forum. The evaluation of the approach compares the assessment by experts with the automatic assessment obtaining a high accuracy of 0.8068 and Normalized Root Mean Square Error (NRMSE) of 0.1799, which outperforms previous existing approaches. Future research work can try to improve the automatic grading by the training of the indicators of the approach depending on the MOOCs or the combination with text mining techniques. View Full-Text
Keywords: MOOC; discussion forum; automatic grading; evaluation; interactions; quality; impact MOOC; discussion forum; automatic grading; evaluation; interactions; quality; impact
Show Figures

Figure 1

MDPI and ACS Style

Pérez-Nicolás, R.L.; Alario-Hoyos, C.; Estévez-Ayres, I.; Moreno-Marcos, P.M.; Muñoz-Merino, P.J.; Delgado Kloos, C. Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums. Sustainability 2021, 13, 9364. https://doi.org/10.3390/su13169364

AMA Style

Pérez-Nicolás RL, Alario-Hoyos C, Estévez-Ayres I, Moreno-Marcos PM, Muñoz-Merino PJ, Delgado Kloos C. Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums. Sustainability. 2021; 13(16):9364. https://doi.org/10.3390/su13169364

Chicago/Turabian Style

Pérez-Nicolás, Raquel L., Carlos Alario-Hoyos, Iria Estévez-Ayres, Pedro M. Moreno-Marcos, Pedro J. Muñoz-Merino, and Carlos Delgado Kloos. 2021. "Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums" Sustainability 13, no. 16: 9364. https://doi.org/10.3390/su13169364

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop