Next Article in Journal
Motivating Factors for Implementing Apparel Certification Schemes—A Sustainable Supply Chain Management Perspective
Next Article in Special Issue
ICT Integration into Science Education and Its Relationship to the Digital Gender Gap
Previous Article in Journal
Effects of the Type of CSR Discourse for Utilitarian and Hedonic Services
Previous Article in Special Issue
School Climate and Peer Victimization. Involvement, Affiliation and Help Perceived in School Centers as Protective Factors against Violent Behavior in Adolescent Couples
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Gamification in Higher Education: Impact on Student Motivation and the Acquisition of Social and Civic Key Competencies

by
José-María Campillo-Ferrer
*,
Pedro Miralles-Martínez
and
Raquel Sánchez-Ibáñez
Department of Social Sciences Education, University of Murcia, 30100 Murcia, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(12), 4822; https://doi.org/10.3390/su12124822
Submission received: 1 May 2020 / Revised: 5 June 2020 / Accepted: 8 June 2020 / Published: 12 June 2020

Abstract

:
This study investigates to what extent the popular online gaming platform called Kahoot can be used as a creative and effective tool to promote motivation, engagement and meaningful learning. For this purpose, a quasi-experimental study was conducted with a sample of 101 undergraduate students of education who participated in online Kahoot quizzes by designing their own questions as part of the formative assessment. According to the results of the pre- and post-tests, the integration of this game-based student response system into the teaching process improved students’ perception of certain concepts in social science teaching, increased their active participation in the lesson, and motivated them towards learning in a more interactive and stimulating environment. Therefore, it is recommended to take gamification to a whole new level with attractive digital participation platforms to increase motivation and enhance students’ learning experience in higher education contexts.

1. Introduction

The promotion of game-based learning (GBL) has undoubtedly changed academic environments and traditional teaching styles by significantly modifying the roles of the teacher and the student [1]. In particular, with regard to students, GBL implies more active participation in these learning processes, which responds more effectively to their current interests while improving digital literacy and promoting quality and sustainable education [2,3]. To achieve these objectives, the emergence of new teaching and learning models has encouraged educators, as social actors, to adapt to the needs of learners in order to create conditions suitable for developing more motivating and innovative practices [4,5]. One of the reasons for this important change is the so-called “student response system”, which favors the collection of real-time information on students’ level of understanding of the contents covered in class [6]. The first individual response devices were used in the 1960s, although they were only widely implemented from the 1970s onwards [7]. Once these electronic tools were made available, classroom interaction was improved, particularly between teachers and students, making it easier to detect problems or shortcomings that arose during the learning process. Initially, the first tools, such as keyboards, required a terminal that received by infrared or radio frequency the signals sent by remote controls that had previously been distributed to students [8,9]. Today, remote controls are no longer necessary because smartphones, tablets or laptops favor the implementation of these systems due to wireless connections, applications and websites [10,11]. Therefore, due to the advancement and application of Information and Communication Technology (ICT), content knowledge and fun can be merged into daily lessons without the need for other intermediate devices. On the Internet, we can find a variety of high-quality online platforms that fully meet the above criteria, such as “Kahoot”, “Socrative”, “Quiz”, “Acadly” or “PollEverywhere”, inter alia [12]. There are small differences between these web tools depending on the main aim of the game, the technical expertise required, or the types of result obtained.
Of all the student response system platforms, our study focuses on an online gaming tool called Kahoot, which combines a ludic approach with an appealing design, helping to promote active participation and constructivist learning. In this web tool there are several options available for both teachers and students, such as quizzes, surveys and discussions. In the quizzes, the main objective is to appropriately answer the questions posed, trying to do this in the shortest time possible in order to beat the other participants. Unlike quizzes, discussions and surveys are not usually based on single-answer questions. In fact, discussions may be limited to an open-ended question to promote dialogue and the exchange of ideas among students, while surveys consist of a set of questions that are effective in getting students to talk about issues raised in class so that everyone has the opportunity to make their opinions heard. In their design and implementation, the questions can be created by the platform user or selected from pre-determined lists. At the end of each activity, students have the opportunity to review what they have learned so far.
Among the benefits of this online gaming platform, the following have been identified in different studies:
(1)
It encourages creativity and innovation. The active participation of students stimulates their imagination and their creative capacity to make their own tests and learn from those made by their teachers and classmates [13]. Curto Prieto, Orcos Palma, Blázquez Tobías and León [14] examined the use of Kahoot in students’ learning process for science and mathematics in secondary education and one conclusion this study highlighted is that students’ creativity improved dueto this online resource.
(2)
It increases students’ engagement and motivation to learn and their ambitions for success as it creates a stimulating and competitive environment in which students actively participate. The higher or lower number of points earned depends not only on the total number of correct answers but also on the time taken to answer them. Plump and LaRosa [15] analyzed undergraduate business law students’ answers regarding their level of engagement in the classroom when playing Kahoot. The results of that study concluded that this online platform promoted a higher level of engagement and competitiveness among students.
(3)
Teaching social studies through this online learning tool is associated with student achievement in social and civic skills, as it contributes to an understanding of social, economic and political concepts, as well as international development and sustainability. Candel [16] concluded that the use of Kahoot and other ICT resources through the teaching of social sciences in a cooperative learning environment improved the acquisition and development of social and civic skills and attitudes.
(4)
It has a user-friendly interface that requires a low level of technical expertise. In fact, both the students and the teacher can create a learning experience in a clear and understandable way using only pictures, video and questions to foster an intensely innovative social learning experience [17,18]. Medina and Hurtado [19] provided evidence that the use of Kahoot increased undergraduate students’ motivation because of its easy-to-use implementation.
(5)
It is easily accessible by any device with an Internet connection: smart phones, tablets or laptops. It is also free for all users after registration, it being understood that these games, nicknamed “Kahoots”, are used for teaching or learning and not for commercial purposes [20,21].
(6)
It promotes a type of synchronous interaction that encourages real-time collaboration and fosters a sense of community. Guardia, Del Olmo, Roa and Berlanga [22] verified the benefits of this digital platform in promoting participatory evaluation that favored the development of cross-disciplinary skills.
(7)
The use of these instructional games in the classroom is likely to minimize distractions, thereby improving attention and concentration and therefore the quality of learning beyond that developed by traditional teaching styles. Tan Ai Lin, Ganapath and Kaur [23] aimed at gauging the extent to which the use of Kahoot improved undergraduate students’ learning. Their results highlighted its effectiveness in fostering and reinforcing learning in both a theoretical and practical sense.
(8)
It provides opportunities to review and revise learning content, which promotes efficient and progressive learning. Thus, when students play on this platform, they have access to academic information that can help them clarify concepts and clear up doubts that may arise [24]. Licorish, Owen, Daniel and George [25] examined students’ experience using this ICT resource in a higher education context in New Zealand and concluded that it enriched the quality of student learning in the classroom.
(9)
It favors the achievement of better results in the groups in which this system of student response is implemented. In fact, several studies highlight the fact that students who play Kahoot often achieve better results in examinations [26]. Tóth, Lógó and Lógó [27] measured the long-term learning effect of Kahoot quizzes on 200 undergraduate students. The results showed that the students who took more Kahoot quizzes got better marks. In this line, Gómez-Carrasco, Monteagudo-Fernández, Moreno-Vera and Sainz-Gómez [28] examined the effects of a gamification program for teachers in training on the motivation and perception of learning. The results indicated an increase in motivation levels among the respondents and also showed significant differences according to the gender of the participants, which opens the door to further research on the causes and consequences of such findings.
However, other studies have described some disadvantages and negative implications with respect to the challenging changes involved in game-based teaching. In particular, some teachers may find the platform discouraging, as they have to do extra work to adjust the pace of the class to achieve a better understanding of the content. This requires a great deal of effort both inside and outside the classroom in order to integrate digital content into lesson plans. It also requires increasing the educational adaptations made in the classroom in order to promote content learning by all students in a comprehensive and meaningful way. Another disadvantage pointed out in some studies is linked to the negative attitude of some students to these digital challenges, since not all students prefer to play an active role in the classroom. In fact, some of them feel more comfortable taking notes and studying content after class without using their mobile phones for academic purposes because they fear making mistakes in public when using this digital resource or not feeling supported by their peers when asked about content previously worked on in class [29,30]. Further research and information on the application of these innovative proposals in higher education contexts is therefore needed to better understand and adapt these ludic strategies to the main interests and demands of students.

Objectives

The aim of this study is to examine the effect that the game-based student response system Kahoot had on students’ level of motivation and learning. To achieve this aim, the following research objectives were set:
RO1: To analyze the opinions of undergraduate students on the effect that the student response system called Kahoot had on their motivation level; in particular, to examine their opinions about the effects that this student response system had on their motivation level according to the gender of the participants.
RO2: To collect information from participants about their level of digital competence in the use of this web tool, and, in particular, to analyze their impressions about the level of digital competence required when using this online platform, following the basic instructions and creating a test with multiple choice questions. Further, to examine their opinions about the level of digital competence required when using this online platform, following the basic instructions and creating a test with multiple choice questions according to their previous digital expertise. Further, to analyze their views on the level of digital competence required when using this online platform, following the basic instructions and taking a test with multiple choice questions according to the gender of the participants.
RO3: To examine undergraduate students’ impressions on the learning achieved in the core unit through the use of gamification, and in particular: to analyze their views on learning social and civic skills in the core unit; to examine their impressions of the learning of social and civic skills in the core unit according to their level of motivation; and to analyze their opinions about the learning of social and civic skills in the core unit according to the gender of the participants.

2. Materials and Methods

A quasi-experimental study was designed with pre- and post-test questionnaires, which were designed ad hoc to compare the level of achievement of the objectives set out in this educational innovation.
A quantitative methodology was used to analyze the level and type of participation of university students in this online game platform. In order to carry out this process effectively, participants were monitored until they had finished the 4-month period and their answers were examined before and after implementing this methodological proposal in order to ascertain the existence of significant differences at the end of the academic period.

2.1. Participants

The gamification program was carried out in the core unit of “Teaching Social Sciences”, which is compulsory for all second-year students of the Primary Education degree of the University of Murcia, Spain. In this study, the convenience sample consisted of 101 students (25 men (24.7%) and 76 women (75.3%) who were chosen for their readily availability. Before the study started, they were asked to sign an informed consent form, following the recommendations of the Research Ethics Committee at the University of Murcia. The ages of the participants ranged from 19 to 22 years (M = 20.94 and SD = 2.77) although there was a minority of students above that age (4.73%). Almost 90% of the participants in the study were 19 or 20 years old and only 5% of the students in the sample had repeated the year.

2.2. Data Collection Tools

The quantitative data on the effects of this game-based student response system were collected through an ad hoc questionnaire, one of the most widely used techniques in data collection, the purpose of which is to study and obtain information in a systematic and orderly manner on the categories and variables needed to carry out the research. Among the advantages of this technique are the following: collecting a large amount of information from a large number of subjects on very diverse aspects, allowing for easy and cheap administration, being direct, being able to express opinions anonymously and freely, allowing the person surveyed to rationalize each question and facilitate the analysis of the results [31]. However, the questionnaire also has its limitations, some of which are related to the concept of “social desirability”. Among its main drawbacks are the complexity of its design, the lack of depth of responses, and the limited response rate [32]. It consisted of three sections and 21 items, the first of which consisted of four statements relating to participants’ perceptions of their technical expertise in using this online tool (See Appendix A, Table A1 and Table A2). The second section consisted of four statements on the level of motivation with this online platform. The third section comprised 13 items related to respondents’ perceptions of how this student response system can help them learn problem-solving skills and social and civic competencies. A five-point Likert scale was used—ranging from “1”: strongly disagree, to “5”: strongly agree—so that students could freely rate the statements in the three sections of the questionnaire according to their points of view.
This instrument was based on an earlier research questionnaire that was used in a previous study and was originally validated by external experts [28]. The questionnaire in this study was adapted from the original instrument and was validated by a focus group, in which the authors of the above-mentioned study participated together with three ICT experts.

2.3. Procedure and Data Analysis

This core unit was held in the first term of the 2019/2020 academic year (September–December). The sessions were held on Tuesdays and Thursdays from 4 until 6pm. The aim of this core unit was for students to develop their knowledge and teaching skills in social sciences in a way that fosters high quality academic and social learning. The content of the core unit included explanations, descriptions and reflections on the main concepts in the social sciences through readings, news, research articles and other sources of information. Most of the class activities were group work, i.e., the analysis of case studies, debating a controversial topic or discussing quotations, which aimed at creating multiple and frequent interactions in which students helped each other and cooperated with each other to make their learning more effective. Additionally, students had to design, apply, adapt and evaluate content that was specific to the teaching of social sciences in order to promote the development of key competencies in this discipline. To this end, students were required to design social science lesson plans, sequence teaching content and curriculum objectives, or analyze the application of social science curriculum standards, among other relevant activities.
Some of the activities were game-based and consisted of online quizzes designed to test their knowledge of the content previously worked on in class. The strategies used in the gamification were based on the Kahoot student response system as a teaching technique to increase motivation and the development of social skills. The teaching team prepared two weekly Kahoot tests on the academic content. The aim of these games was to answer questions about this content in the shortest time possible, resulting in the awarding of points to the fastest and most efficient students. Similarly, students also had to create and implement their own Kahoot quizzes in class for similar purposes. They used their mobile phones to take the quizzes and their laptops to make them. The quizzes were made in groups of four or five, although they were taken individually because they liked to play against each other. Discussions about the results were held after each quiz, which allowed for more active participation in the class and helped to strengthen the mutual learning process.
The data was carefully analyzed with the Statistical Package for Social Sciences (SPSS) v.26.0. In addition, non-parametric tests (Wilcoxon, U Mann–Whitney and Kruskal–Wallis) were implemented for the variables of sex, group, motivation level and the level of ICT competence. These tests were carried out after obtaining the results provided by the Kolmogorov–Smirnov tests, which were implemented to examine whether the variables were normally distributed. The mean values have been expressed numerically in the following section, as well as information on the standard deviation by gender, group and level of ICT competence in both the pre-tests and post-tests.

3. Results

In terms of the results related to the first objective, which focused on the level of student motivation, the perception of respondents improved from one test to another, as their average scores increased in both subgroups, as shown in Table 1.
The ratings of the male students are slightly higher than those of females, although there are no major differences between the subgroups. However, in general there are statistically significant differences between the pre- and post-test, as indicated in the Wilcoxon Signed Rank Test (Z =−3.031b, p = 0.02). According to these findings, it can be stated that the implementation of Kahoot in the core unit “Teaching Social Sciences” increased students’ motivation significantly. Table 2 shows the means and standard deviations of the answer options given by the participants according to their level of digital competence.
The results of the first subgroup are higher than those of the second and third subgroups, which is reinforced by similar findings from Kruskal–Wallis non-parametric tests regarding question formulation, as they indicate that the participants with a high level of ICT competence are more effective in formulating the test questions on this platform (H = 8.67; p < 0.05). In general, the participants’ rating is lower when they give their opinion on the steps they have to take to create a quiz from the beginning, i.e., accessing the platform, choosing questions, brainstorming with a list of possible answers, or adding pictures, among other steps. However, there is a significant difference in this variable between the average scores of the students before and after following the steps in the creation of the quizzes (p < 0.05), which shows that the application of Kahoot had promoted a change in attitude at the end of the term, as can be seen in Table 3.
There were no significant differences between men and women on the perception of the digital skills needed to effectively use this platform before and after the educational intervention.
With regard to the acquisition of skills and abilities linked to the development of social and civic competencies, the participants’ answers are also grouped in the highest values in both the pre-tests and the post-tests, as can be seen in Table 4.
The results obtained indicated a high satisfaction of Kahoot users in the development of their social and civic competencies. Most of the items obtained a score above 4 out of 5 in the post-tests, although there were four items that did not exceed the value of 4. The items best considered were those related to learning both social sciences and interdisciplinary content (4.31), while the lowest were related to the acquisition of attitudes of tolerance and mutual respect (3.61).
A Wilcoxon’s sign rank test was conducted to analyze the existence of statistically significant differences. All the mean differences found between the pre- and post-tests were not statistically significant, with the exception of one (encouraging critical social thinking, p < 0.5), as seen in Table 5.
In addition, a Kruskal–Wallis H test was conducted in which the independent variable was the level of motivation and the dependent variables were perceptions on the acquisition of skills and the development of social and civic competencies throughout the core unit. The results indicate that there were significant differences in all variables in this section between subgroups of participants with different levels of motivation, as shown in Table 6.
These results prove that the most motivated students placed a greater value on their learning of skills and the abilities linked to social and civic competencies in this discipline. The mean differences found between males and females were not statistically significant.

4. Discussion and Conclusions

Different studies carried out in higher education contexts highlight the impact of ludic platforms in improving motivation and promoting relevant learning experiences for students [33,34,35]. In particular, the use of Kahoot, which attracts students because of its attractive interface and its lively music [36], helps users to develop their work skills and interpersonal abilities [37]. Therefore, these innovations have been shown to improve students’ ability to grasp the meaning of new information, ask questions, make decisions, and draw conclusions that help to achieve learning goals and expected outcomes [38].
The results obtained in this research also confirm that students positively value the use of this digital platform, which can encourage the adoption of these motivating ICT proposals in similar contexts [39].
With regard to the data on the digital competence of the learners, it should be noted that the participants welcomed these online proposals and felt able to master this platform in terms of understanding game options, basic instructions and question formulations. As other research shows, no specific training or complex technical knowledge is required [25,40].
Furthermore, this platform covers a range of cooperative actions in which students have the opportunity to work together in group activities, respecting each other and accepting different points of view. Within this cooperative framework, educators should encourage strategies to place students in challenging tasks that address their interests and needs more appropriately than those developed through more traditional teaching styles [41].
In fact, as can be seen from the above, teachers and students must be inspired by their decisions and actions to communicate and work together through digital technologies, integrating information and content into their previous knowledge and favoring a more autonomous and independent learning process [42,43,44]. In particular, according to the students’ opinions, Kahoot allowed them to acquire knowledge in a different way and to develop a set of skills and abilities linked to social and civic competencies. For this reason, teachers and students should be encouraged to become digitally literate and master the use of a wide range of information and communication technologies, as the use of digital resources fosters creativity and critical thinking, while expanding their repertoire of teaching and learning skills. Since students learn in different ways, it is the task of educators to use the most motivating tools to better support students in the classroom and to ensure high-quality teaching that promotes higher student achievement through these digital innovations.
In this research, we have focused on analyzing students’ impressions of a number of variables related to motivation levels, digital competence and learning perceptions, but we have not analyzed the opinions of the teachers who have carried out this innovation in the classroom. The exchange of ideas between teachers and students is a good starting point for future research technology development. Furthermore, the analysis of teachers’ and students’ impressions over time would provide researchers with useful information on which type of learning is most valued during students’ university training. These findings would be effective for readjusting the teaching program of the core unit under study according to students’ needs and interests.
The limitations of this study are those related to sample size, demographic diversity, the generalizability of results and the validation of the research instrument. Due to the small sample size, it is difficult to determine to what extent the results can be generalized. The study participants were also limited in demographic terms due to the restricted age range. Consequently, statistical generalizability in this study has been difficult to achieve, which reduces its representativeness. Furthermore, the conclusions of this research are related to the perspectives of undergraduate students of education on the use of the Kahoot platform, which should not be equated with their actual performance levels achieved during the term. Regarding the validation of the research instrument, while face-to-face interactions between ICT experts and social science researchers were effective in collecting qualitative data to validate the questionnaire, other techniques to measure the internal consistency of the instrument could have complemented the research and more accurately establish the validity of this standard survey instrument.

Author Contributions

Conceptualization, J.-M.C.-F., P.M.-M. and R.S.-I.; Methodology, J.-M.C.-F., P.M.-M. and R.S.-I.; Software, J.-M.C.-F., P.M.-M. and R.S.-I.; Validation, J.-M.C.-F., P.M.-M. and R.S.-I.; Formal analysis, J.-M.C.-F., P.M.-M. and R.S.-I.; Investigation, J.-M.C.-F., P.M.-M. and R.S.-I.; Resources, J.-M.C.-F., P.M.-M. and R.S.-I.; Data curation, J.-M.C.-F., P.M.-M. and R.S.-I.; Writing—Original draft preparation, J.-M.C.-F., P.M.-M. and R.S.-I.; Writing—Review and editing, J.-M.C.-F., P.M.-M. and R.S.-I.; Visualization, J.-M.C.-F., P.M.-M. and R.S.-I.; Supervision, P.M.-M. and R.S.-I.; Project administration, P.M.-M. and R.S.-I.; Funding acquisition, P.M.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Spanish Ministry of Science, Innovation and Universities, grant number PGC2018-094491-B-C33. This study was also co-financed by the European Regional Development Fund (ERDF).

Acknowledgments

We would like to acknowledge the support given by Michael Palmer, who has very generously offered to proofread the text.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A. The questionnaire

A survey on the effectiveness of Kahoot.
Instructions: This survey will be used to improve our teaching and learning practices in the core unit Teaching Social Sciences of the Primary Education Degree at the University of Murcia, Spain. Please rate each statement as accurate as possible by crossing the box under the number that most closely describes your overall opinion for each item: (1) Strongly disagree; (2) Disagree; (3) Neither agree nor disagree; (4) Agree; (5) Strongly agree. If you do not understand a statement, raise your hand. Your views will be kept confidential and will not affect your status as a student teacher at this university. When you have completed the survey, please return it as soon as possible. Thank you.
  • Age: _______ Gender: _______ (M/F).
  • Level of motivation _____________ (High/medium/low).
  • Level of digital competence _______ (High/medium/low).
  • Have you ever created your own Kahoot before? __ (Yes/No).
  • Have you failed this subject before? ________ (Yes/No).
Table A1. Rating scale.
Table A1. Rating scale.
Previous knowledge in playing Kahoot.
1.
I can adjust the game settings in Kahoot.
12345
2.
I understand the basic instructions of this online platform
12345
3.
I can follow the steps to create a quiz
12345
4.
I can formulate questions in Kahoot, which gauges my understanding of short sections of a unit
12345
Motivation in playing Kahoot
5.
I would like to create Kahoot quizzes in this subject
12345
6.
I would like to take Kahoot quizzes in this subject
12345
7.
I feel motivated when using this online platform for educational purposes
12345
8.
I feel more motivated in class when I win points in Kahoot quizzes
12345
Acquisition of social and civic competences and problem-solving skills
9.
I think that Kahoot can help me to study the content of this core unit
12345
10.
I reckon that Kahoot can help me to acquire social science knowledge more effectively
12345
11.
I reckon that Kahoot can help me to learn interdisciplinary content from different subjects
12345
12.
I think that Kahoot can help me to plan, design and evaluate my learning processes
12345
13.
I consider that Kahoot can promote cooperative learning
12345
14.
I reckon that Kahoot can help me to improve my capacity to interpret relevant data
12345
15.
I think that Kahoot can help me to develop critical social thinking
12345
16.
I consider that Kahoot can help me to promote democratic values to achieve a peaceful multicultural society
12345
17.
I reckon that Kahoot can help me to develop problem-solving skills
12345
18.
I think that Kahoot can help me to develop collective social responsibility
12345
19.
I reckon that Kahoot can help me to increase my capacity for active and constructive participation in class through tolerant and respectful attitudes
12345
20.
I believe that Kahoot can foster a better understanding of social, economic, legal and political concepts and institutions
12345
21.
I believe that Kahoot can be useful in raising awareness of diversity
12345
Una encuesta sobre la eficacia de Kahoot
Instrucciones: Esta encuesta se utilizará para mejorar nuestras prácticas de enseñanza y aprendizaje en la asignatura de CienciasSociales y su Didáctica del Grado de Educación Primaria en la Universidad de Murcia, España. Por favor, califique cada afirmación lo más exacta possible marcando la casilla debajo del número que describa con mayor precision su opinión general sobre cada punto: (1) Totalmente en desacuerdo; (2) En desacuerdo; (3) Ni de acuerdoni en desacuerdo; (4) De acuerdo; (5) Totalmente de acuerdo. Si no entiende algún enunciado, levante la mano. Sus opiniones se mantendrán confidenciales y no afectarán a su condición de estudiante de magisterio en esta universidad. Cuando haya completado la encuesta, por favour devuélvala lo antes posible. Gracias.
  • Edad: _______ Sexo: _______ (H/M)
  • Nivel de motivación _____________(Alto/medio/bajo)
  • Nivel de competencia digital _______ (Alto/medio/bajo)
  • ¿Has creado antes tu propio kahoot? (Sí/No),
  • ¿Has suspendido esta asignatura antes? _______(Sí/No)
Table A2. Escala de valoración.
Table A2. Escala de valoración.
Conocimientos previos en el juego Kahoot
1.
Puedo ajustar la configuración del juego en Kahoot
12345
2.
Entiendo las instrucciones básicas de esta plataforma en línea
12345
3.
Puedo seguir los pasos para crear un test
12345
4.
Puedo formular preguntas en Kahoot, lo que mide mi comprensión de determinados contenidos de una unidad formativa
12345
La motivación en el juego de Kahoot
5.
Me gustaría crear un test Kahoot en esta asignatura
12345
6.
Me gustaría hacer un test Kahoot en esta asignatura
12345
7.
Me siento motivado/a al usar esta plataforma en línea con fines educativos
12345
8.
Me siento más motivado/a en clase cuando gano puntos en los tests Kahoot
12345
Adquisición de competencias socials y cívicas y habilidades en la resolución de problemas
9.
Pienso que Kahoot me puede ayudar a estudiar el contenido de esta asignatura
12345
10.
Considero que Kahoot puede ayudarme a incrementar la adquisición de conocimientos en ciencias sociales de manera más efectiva
12345
11.
Considero que Kahoot me ayuda a aprender contenido interdisciplinar de diferentes asignaturas
12345
12.
Creo que Kahoot puede ayudarme a planificar, diseñar y evaluar mis procesos de aprendizaje
12345
13.
Considero que Kahoot puede promover el aprendizaje cooperativo
12345
14.
Considero que Kahoot me puede ayudar a mejorar mi capacidad para interpreter datos relevantes
12345
15.
Creo que Kahoot me puede ayudar a desarrollar el pensamiento social crítico
12345
16.
Considero que Kahoot puede ayudarme a promover valores democráticos para lograr una sociedad multicultural pacífica
12345
17.
Considero que Kahoot me puede ayudar a desarrollar destrezas para la resolución de problemas
12345
18.
Creo que Kahoot me puede ayudar a desarrollar un sentimiento de responsabilidad social colectiva
12345
19.
Considero que Kahoot me puede ayudar a incrementar mi capacidad para participar de forma activa y constructiva en clase a través de la adopción de actitudes tolerantes y respetuosas
12345
20.
Pienso que Kahoot puede favorecer una major comprensión de los conceptos y las instituciones sociales, económicas, legales y políticas
12345
21.
Considero que Kahoot puede ser útil para aumentar mi nivel de conciencia sobre la diversidad
12345

References

  1. Miralles-Martínez, P.; Gómez-Carrasco, C.J.; Monteagudo-Fernández, J. Percepciones sobre el uso de recursos TIC y «Mass Media» para la enseñanza de la historia, unestudio comparativo en futuros docentes de España-Inglaterra. Educ. XXI 2019, 22, 187–211. [Google Scholar] [CrossRef]
  2. Yang, J.C.; Chien, K.H.; Liu, T.C. A Digital Game-Based Learning System for Energy Education: An Energy Conservation PET. TOJET 2012, 11, 27–37. [Google Scholar]
  3. Haruna, H.; Hu, X.; Chu, S.K.W.; Mellecker, R.R.; Gabriel, G.; Ndekao, P.S. Improving Sexual Health Education Programs for Adolescent Students through Game-Based Learning and Gamification. Int. J. Environ. Res. Public Health 2018, 15, 2027. [Google Scholar] [CrossRef] [Green Version]
  4. Andrioni, F. Cross-European Perspective in Social Work Education: A Good Blended Learning Model of Practice. Sustainability 2018, 10, 1539. [Google Scholar] [CrossRef] [Green Version]
  5. Moreno-Murcia, J.A.; Hernández, E.H.; Ruiz, L. Perceptions of Controlling Teaching Behaviors and the Effects on the Motivation and Behavior of High School Physical Education Students. Int. J. Environ. Res. Public Health 2018, 15, 2288. [Google Scholar] [CrossRef] [Green Version]
  6. Abramson, D.; Pietroszek, K.; Chinaei, L.; Lank, E.; Terry, M. Classroom response systems in higher education: Meeting user needs with NetClick. In Proceedings of the Global Engineering Education Conference (EDUCON), 2013 IEEE, Berlin, Germany, 13–15 March 2013; pp. 840–846. [Google Scholar]
  7. Judson, E.; Sawada, A.D. Learning from past and present: Electronic response systems in college lecture halls. J. Comput. Math. Sci. Teach. 2002, 21, 167–181. [Google Scholar]
  8. Johnson, K.; Lillis, C. Clickers in the laboratory: Student thoughts and views. Interdisc. J.Inf. Knowl. Manag. 2010, 5, 139–151. [Google Scholar] [CrossRef] [Green Version]
  9. Zhu, E. Teaching with clickers. C. Res. Learn. Teach. Occas. Pap. 2007, 22, 1–8. [Google Scholar]
  10. Holguín, E.P.; Madera, P.G.; Valdepeñas, B.H.R.; del Hierro Casado, M.L. Kahoot en docencia: Una alternative practica a los clickers. In Proceedings of the XI Jornadas Internacionales de Innovaciόn Universitaria Educar para Transformar, Universidad Europea de Madrid, Madrid, Spain, 7–8 July 2014. [Google Scholar]
  11. Wang, A.I. The wear out effect of a game-based student response system. Comput. Educ. 2015, 82, 217–227. [Google Scholar] [CrossRef] [Green Version]
  12. Vallet-Bellmunt, I.; Vallet-Bellmunt, T.; Zubiria-Ferriols, E.; Martínez-Fernández, T.; Bel-Oms, I. Un estudio comparativo entre dos herramientas de respuesta de audiencia en las aulas universitarias. Rev. Perspect. Empresarial 2019, 6, 61–73. [Google Scholar] [CrossRef]
  13. Cruz, Μ.; Orange, Ε. 21st Century skills in the teaching of foreign languages at primary and secondary schools. Turk. Online J. Educ. Technol. 2016, 15, 1–12. [Google Scholar]
  14. Prieto, M.C.; Palma, L.O.; Blázquez Tobías, P.J.; León, F.J.M. Student assessment of the use of Kahoot in the learning process of science and mathematics. Educ. Sci. 2019, 9, 55. [Google Scholar] [CrossRef] [Green Version]
  15. Plump, C.M.; LaRosa, J. Using Kahoot! In the classroom to create engagement and active learning: A game-based technology solution for eLearning novices. Manag. Teach. Rev. 2017, 2, 151–158. [Google Scholar] [CrossRef]
  16. Candel, E.C. El uso de la gamificación y los recursos digitales en el aprendizaje de las ciencias sociales en la educación superior. DIM 2018, 36, 1–14. [Google Scholar]
  17. Marín, D.; Esteve, M.I.V.; Peirats Chacón, J.; López Marí, M. Gamificación en la evaluación de l aprendizaje: Valoración del uso de Kahoot! In Innovate strategies for Higher Education in Spain; Redine, Ed.; Adaya Press: Eindhoven, The Netherlands, 2018; pp. 8–17. [Google Scholar]
  18. Zarzycka-Piskorz, E. Kahoot it or not? Can games be motivating in learning grammar? Teach. Engl. Technol. 2016, 16, 17–36. [Google Scholar]
  19. Medina, E.G.L.; Hurtado, C.P.R. Kahoot! A digital tool for learning vocabulary in a language classroom. Rev. Publicando 2017, 4, 441–449. [Google Scholar]
  20. Aljaloud, A.; Gromik, N.; Billingsley, W.; Kwan, P. Research trends in student response systems: A literature review. Int. J. Learn. Technol. 2015, 10, 313–325. [Google Scholar] [CrossRef]
  21. Hung, H.T. Clickers in the flipped classroom: Bring your own device (BYOD) to promote student learning. Interact. Learn. Environ. 2017, 25, 983–995. [Google Scholar] [CrossRef]
  22. Guardia, J.J.; Del Olmo, J.L.; Roa, I.; Berlanga, V. Innovation in the teaching-learning process: The case of Kahoot! Horizon 2019, 27, 35–45. [Google Scholar] [CrossRef]
  23. Lin, D.T.A.; Ganapathy, M.; Kaur, M. Kahoot! It: Gamification in Higher Education. Pertanika J. Soc. Sci. Hum. 2018, 26, 565–582. [Google Scholar]
  24. Lee, C.C.; Hao, Y.; Lee, K.S.; Sim, S.C.; Huang, C.C. Investigation of the effects of an online instant response system on students in a middle school of a rural area. Comput. Hum. Behav. 2019, 95, 217–223. [Google Scholar] [CrossRef]
  25. Licorish, S.A.; Owen, H.E.; Daniel, B.; George, J.L. Students’ perception of Kahoot!’s influence on teaching and learning. Res. Pract. Technol. Enhanc. Learn. 2018, 13, 9. [Google Scholar] [CrossRef] [Green Version]
  26. Ismail, M.A.A.; Mohammad, J.A.M. Kahoot: A promising tool for formative assessment in medical education. Educ. Med. J. 2017, 9, 19–26. [Google Scholar] [CrossRef]
  27. Tóth, Á.; Lógó, P.; Lógó, E. The The Effect of the Kahoot Quiz on the Student’s Results in the Exam. Period. Polytech. Soc. Manag. Sci. 2019, 27, 173–179. [Google Scholar] [CrossRef] [Green Version]
  28. Gómez-Carrasco, C.J.; Monteagudo-Fernández, J.; Moreno-Vera, J.R.; Sainz-Gómez, M. Effects of a Gamification and Flipped-Classroom Program for Teachers in Training on Motivation and Learning Perception. Educ. Sci. 2019, 9, 299. [Google Scholar] [CrossRef] [Green Version]
  29. Chiang, H.H. Kahoot! In an EFL Reading Class. J. Lang. Teach. Res. 2020, 11, 33–44. [Google Scholar] [CrossRef]
  30. Muhridza, N.H.M.; Rosli, N.A.M.; Sirri, A.; Samad, A.A. Using game-based technology, KAHOOT! For classroom engagement. LSP Int. J. 2018, 5, 37–48. [Google Scholar] [CrossRef]
  31. McMillan, J.H.; Schumacher, S. Research in Education: Evidence-Based Inquiry, 7th ed.; Pearson: Boston, MA, USA, 2008. [Google Scholar]
  32. Puche, S.M.; Martínez, P.M.; Molina, J.O. Concepciones de los futuros maestros de Educación Primaria sobre formación cívica y ciudadana. Educ. XXI 2013, 31, 105–126. [Google Scholar]
  33. Álvaro-Tordesillas, A.; Alonso-Rodríguez, M.; Poza-Casado, I.; Galván-Desvaux, N. Gamification experience in the subject of descriptive geometry for architecture. Educ. XX1 2020, 23, 373–408. [Google Scholar] [CrossRef]
  34. De Mingo-López, D.V.; Meliá, L.V. Actividades Kahoot en el aula y satisfacción del alumnado. 3C TIC 2019, 8, 96–115. [Google Scholar] [CrossRef]
  35. Resmayani, N.P.A.; Putra, I.N.T.D. Gamification: Using Kahoot! To Make Students Love the Class from the Very Beginning. Linguist. ELT J. 2020, 7, 10–18. [Google Scholar] [CrossRef]
  36. Boden, G.M.; Hart, L. Kahoot-Game Based Student Response System. Compass J. Learn. Teach. 2018, 11. [Google Scholar] [CrossRef]
  37. Sailer, M.; Hense, J.; Mandl, H.; Klevers, M. Fostering development of work competencies and motivation via gamification. In Competence-Based Vocational and Professional Education; Mulder, M., Ed.; Springer International: Cham, Switzerland, 2017; pp. 795–818. [Google Scholar] [CrossRef]
  38. Dellos, R. Kahoot! A digital game resource for learning. Int. J. Instr. Technol. Distance Learn. 2015, 12, 49–52. [Google Scholar]
  39. Esteves, M.D.; Pereira, A.; Veiga, N.; Vasco, R.; Veiga, A. The Use of New Learning Technologies in Higher Education Classroom: A Case Study. IJEP 2018, 8, 115–127. [Google Scholar] [CrossRef] [Green Version]
  40. Yürük, N. Edutainment: Using Kahoot! As A Review Activity in Foreign Language Classrooms. JETOL 2019, 2, 89–101. [Google Scholar] [CrossRef] [Green Version]
  41. Fotaris, P.; Mastoras, T.; Leinfellner, R.; Rosunally, Y. Climbing up the Leaderboard: An Empirical Study of Applying Gamification Techniques to a Computer Programming Class. EJEL 2016, 14, 94–110. [Google Scholar]
  42. Miralles-Martínez, P.; Gómez-Carrasco, C.J.; Arias, V.B.; Fontal-Merillas, O. Recursos digitales y metodología didáctica en la formación inicial de docentes de Historia. Comunicar Revista científica iberoamericana de Comun. Y Educ. 2019, 61, 45–56. [Google Scholar] [CrossRef]
  43. Vila, R.O. Kahoot: ¡un, dos, tres! Iber. Didáctica de Las Cienc. Soc. Geogr. eHist. 2017, 86, 51–56. [Google Scholar]
  44. Sharma, A.; Gandhar, K.; Sharma, S.; Seema, S. Role of ICT in the Process of Teaching and Learning. J. EP. 2011, 2, 1–6. [Google Scholar]
Table 1. Descriptive statistics of motivation by gender.
Table 1. Descriptive statistics of motivation by gender.
MotivationMenWomen
n = 14n = 47
MSDMSD
Pre-test4.010.993.821.07
Post-test4.310.874.260.91
Table 2. Descriptive statistics of the level of digital competence for using Kahoot.
Table 2. Descriptive statistics of the level of digital competence for using Kahoot.
Digital CompetenceHighMediumLow
Pre-TestPost-TestPre-TestPost-TestPre-TestPost-Test
MSDMSDMSDMSDMSDMSD
Game settings4.710.644.680.474.390.854.390.724.310.514.330.57
Basic instructions4.570.674.760.524.350.814.450.674.020.894.330.57
Steps in creating a quiz3.851.014.640.633.601.054.150.953.841.473.331.08
Formulating questions4.380.804.760.544.300.704.300.704.100.413.661.22
Table 3. Wilcoxon’s signed rank test in relation to the level of digital competence at Kahoot.
Table 3. Wilcoxon’s signed rank test in relation to the level of digital competence at Kahoot.
Digital CompetenceNegative RankPositive RankTest Statistics
nMean RankSum of RanksnMean RankSum of RanksTieszp
Game settings3333.8211163232.16102935−0.28b0.774
Basic instructions2429.44706.53530.391063.542−1.48b0.152
Steps in creating a quiz1537.675655635.55159130−4.12b0.000 *
Formulating questions2429.35704.53328.74948.544−1.042b0.294
* p < 0.05, Based on negative ranks.
Table 4. Descriptive statistics of students’ opinions on learning acquired through the use of Kahoot.
Table 4. Descriptive statistics of students’ opinions on learning acquired through the use of Kahoot.
ItemPre-TestPost-Test
MSDMSD
Increased access to social science knowledge4.340.684.270.87
Learning knowledge of interdisciplinary content4.230.714.310.73
Help to plan, design and evaluate learning processes4.150.754.210.84
Promoting cooperative learning4.290.744.170.76
Improve the capacity to interpret relevant data3.810.863.990.89
Encouraging critical social thinking3.520.983.840.94
Promoting democratic values3.710.953.860.88
Develop problem-solving skills3.840.884.010.91
Encouraging individual and collective responsibility3.7410.063.990.88
Increase their capacity for active and constructive participation3.950.844.080.89
Favoring a better understanding of social, economic, legal and political concepts and institutions3.650.973.860.99
Raising awareness of diversity3.900.884.010.89
Increases tolerance and mutual respect3.271.023.611.06
Table 5. Wilcoxon’s signed rank test with respect to learning acquired through the use of Kahoot.
Table 5. Wilcoxon’s signed rank test with respect to learning acquired through the use of Kahoot.
Learning Acquired in KahootNegative RankPositive RankTest Statistics
nMean RankSum of RanksnMean RankSum of RanksTieszp
Encouraging critical social thinking3136.5511334741.45194823−2.10b0.035 *
* p < 0.05.
Table 6. Results of the Kruskal–Wallis test in relation to the opinions of participants on the learning acquired and their levels of motivation.
Table 6. Results of the Kruskal–Wallis test in relation to the opinions of participants on the learning acquired and their levels of motivation.
Social and Civic CompetenciesHigh MotivationMedium MotivationLow MotivationTest Statistics
nMean RanknMean RanknMean RankHgLp
Increased access to social science knowledge5358.134444.19431.388.75820.013 *
Learning knowledge of interdisciplinary content5358.344443.24439.138.42620.015 *
Helping plan, design and evaluate learning processes5356.514446.66425.756.78420.034 *
Promoting cooperative learning5359.824442.18431.1312.45620.002 *
Improve the capacity to interpret relevant data5363.104437.75436.3821.76220.000 *
Encouraging critical social thinking5359.774442.36429.7512.25720.002 *
Promoting democratic values5364.184438.30416.1327.77220.000 *
Develop problem-solving skills5363.764437.09434.8823.62120.000 *
Encouraging individual and collective responsibility5359.794442.45428.5012.38320.002 *
Increase their capacity for active and constructive participation5361.184441.30422.8816.83120.000 *
Favoring a better understanding of social, economic, legal and political concepts and institutions5362.964438.63428.6321.07520.000 *
Raising awareness of diversity5361.974439.58431.2518.23020.000 *
Increases tolerance and mutual respect5361.564440.16430.3816.17720.000 *
* p < 0.05.

Share and Cite

MDPI and ACS Style

Campillo-Ferrer, J.-M.; Miralles-Martínez, P.; Sánchez-Ibáñez, R. Gamification in Higher Education: Impact on Student Motivation and the Acquisition of Social and Civic Key Competencies. Sustainability 2020, 12, 4822. https://doi.org/10.3390/su12124822

AMA Style

Campillo-Ferrer J-M, Miralles-Martínez P, Sánchez-Ibáñez R. Gamification in Higher Education: Impact on Student Motivation and the Acquisition of Social and Civic Key Competencies. Sustainability. 2020; 12(12):4822. https://doi.org/10.3390/su12124822

Chicago/Turabian Style

Campillo-Ferrer, José-María, Pedro Miralles-Martínez, and Raquel Sánchez-Ibáñez. 2020. "Gamification in Higher Education: Impact on Student Motivation and the Acquisition of Social and Civic Key Competencies" Sustainability 12, no. 12: 4822. https://doi.org/10.3390/su12124822

APA Style

Campillo-Ferrer, J. -M., Miralles-Martínez, P., & Sánchez-Ibáñez, R. (2020). Gamification in Higher Education: Impact on Student Motivation and the Acquisition of Social and Civic Key Competencies. Sustainability, 12(12), 4822. https://doi.org/10.3390/su12124822

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop