Next Article in Journal
Exhibiting Uncertainty: Visualizing Data Quality Indicators for Cultural Collections
Next Article in Special Issue
Video Games and Collaborative Learning in Education? A Scale for Measuring In-Service Teachers’ Attitudes towards Collaborative Learning with Video Games
Previous Article in Journal / Special Issue
FLIGBY—A Serious Game Tool to Enhance Motivation and Competencies in Entrepreneurship
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Enhancing Fun through Gamification to Improve Engagement in MOOC

by
Oriol Borrás-Gené
1,*,
Margarita Martínez-Núñez
2 and
Luis Martín-Fernández
2
1
Departamento Ciencias de la Computación, Arquitectura de Computadores, Lenguajes y Sistemas Informáticos y Estadística e Investigación Operativa, LITE Group—Universidad Rey Juan Carlos, 28933 Madrid, Spain
2
Departamento de Ingeniería de Organización, Administración de Empresas y Estadística, Universidad Politécnica de Madrid, 28031 Madrid, Spain
*
Author to whom correspondence should be addressed.
Informatics 2019, 6(3), 28; https://doi.org/10.3390/informatics6030028
Submission received: 2 July 2019 / Revised: 24 July 2019 / Accepted: 25 July 2019 / Published: 26 July 2019

Abstract

:
Massive Open Online Courses (MOOCs), regardless of their topic, are a perfect space to generate, through virtual learning communities associated with them, very valuable resources for their participants and, in general, anyone interested in the topic covered. If in the design of these learning spaces, elements specific to games are added to them, which is known as gamification, we can try to increase the engagement of the student towards the course and, therefore, towards the community. This paper presents an experience of a MOOC of Universidad Rey Juan Carlos (Spain) with a connectivist approach. Aspects such as fun and motivation have been worked on in the design, through the application of gamified activities and the use of elements from social networks, considered as gamification, with the aim of increasing participation and engagement within a Facebook group, used as a community to support the course. We have analyzed aspects such as enjoyment and motivation, the result of which has been active participation and high engagement within the MOOC community in the form of content and especially great interaction, highlighting the existence of continuous activity once the edition of the MOOC is finished, as a consequence of a habit generated in the student.

1. Introduction

The generalization of Internet access and globalization have led to a change in aspects such as communication, work, leisure or business [1], requiring every individual to constantly update their knowledge, which is known as lifelong learning. This continuous learning and the existence of Internet requires new models that explain the way in which one learns. Connectivism [2] tries to explain the learning that takes place in the digital age, which is outside of the person, in the Web and the most important aspect will be the ability to create connections with the content and between different individuals. Siemens [2] emphasizes “as knowledge continues to grow and evolve, access to what is needed is more important than what the learner currently possesses”.
To respond to these constant needs for training and new forms of learning, universities are opening their content through various initiatives such as the pioneering OpenCourseWare (OCW) [3] or more recently, the Massive Open Online Courses (MOOC) that are offering university educational level since 2008 to thousands of people, with the only requirement of having access to the Internet [4].
Two approaches stand out within the field of MOOC [5,6], on one hand the cMOOC, based on a connectivist approach, in which its pedagogy its pedagogy promotes the social part of the course, try to focus it around the contributions of the students; on the other hand there are the xMOOC, based on content and with features similar to those of a traditional online course, these are the most widely known. There is a trend towards hybrid solutions [7,8], which take advantage of the number of users of xMOOC platforms, with a space in which to manage users and content; and social spaces in which to develop the most connectivist part of cMOOC. The lack of control of information generated on the Web [2] favors the formation of specialized spaces or Virtual Learning Communities (VLC), and specifically in MOOC it is common to find them as spaces where their participants interact and generate conversation and resources. There are different options when choosing a VLC [8], being the most used digital social networks given their nature and which are used by the majority of MOOC participants, this makes them a convenient solution and with the possibility of having some participation.
New methodologies [6] are increasingly used to achieve better results in MOOC, in most cases focusing on one of the drawbacks of this course modality, the large number of dropouts. Gamification is one of the possibilities in which we work to improve these results, this consists [9] in applying elements of game design in contexts that are not games, in this case education. Although there are other interesting aspects in which it is possible to work using gamification, such as the VLC.
The aim of this research is to find out whether, through the application in one MOOC, with connectivism approach, of various gamification techniques, that increase motivation and fun, it is possible to achieve a greater engagement in terms of participation and generate a habit in the use of the VLC. With the purpose of increasing participation in the form of new content and conversations by the various members of the community associated with the MOOC. For the development of this work we have worked with a learning community on Facebook. As a first hypothesis, it has been considered that the very fact of participating in a digital social network such as Facebook and its elements are a way of gamification in itself. It has been analyzed which is the relation that the participants of the virtual community of learning have with the perception of the amusement and its engagement with it, relying on how they affect the characterization of participants according to these concepts, in order to obtain useful patterns of behavior to apply in future editions of the MOOC. This MOOC, from the Rey Juan Carlos University, lasted one month and was given during the month of September 2018, winning the First Award for Educational Innovation MiriadaX.
In the following sections the experience will be developed. In the “Background” section, a theoretical review is proposed about the main aspects of this work. In the following two sections, the design of the MOOC will be described and the main results obtained will be presented. Finally, this paper shows a discussion of the results obtained and ends with conclusions.

2. Background

2.1. Towards a Hybrid MOOC

MOOCs have appeared as a disruptive element in the field of education [10], within the higher education community, allowing thousands of people from all over the world to be trained in a diversity of contents [4,6,11] through Open Educational Resources (OER) and different pedagogical proposals. However, they also have some exceptions and dropout rates of between 60% and 90% of the students enrolled.
Within the philosophy of connectivism as a learning model, the first MOOC [12] appeared in 2008, known as cMOOC, in which it is the students themselves who construct the contents of the course. A new pedagogy that turns the student into the protagonist of the MOOC [8] where both the content and the discussion generated are totally distributed [4] as is the case with the Internet, where learning is produced by the fact of browsing and creates connections. It emphasizes the autonomy of the student, who uses his habitual digital tool to communicate. This supposes numerous tools and technologies associated to the MOOC and it will be necessary to dominate to be able to follow the course, reason why it is required of some advanced digital skills [4,8].
On the other hand, there are the xMOOC, which since its emergence in 2012 has grown rapidly [11] and are the best known and most common, with thousands of students and no limit on the number of enrolled. Their structure is similar to an online course [5], they are organized by modules, objectives, video lectures and have automatic evaluation tests (test) or between peers. Platforms such as Coursera, EdX, Udacity [4] or MiriadaX congregate the majority of users and are composed mainly of universities. It is common to find in these platforms a more traditional model in which the teacher is the expert and the student is simply a consumer of knowledge, as opposed to the cMOOC where roles are changed, and students are given greater protagonism.
Although connectivist MOOCs have an interesting pedagogical model, the main disadvantage is the distributed nature of the students’ contributions, it is complex to follow this type of courses due to the number of communication tools used and to bring together their management, compared to the ease of xMOOC models. At the same time, one of the main limitations of xMOOC is the social part [10,13], being relegated to internal and closed forums, not very useful. At the same time, one of the main limitations of the xMOOC is the social part [10,13], being relegated to internal and closed forums for people who are not part of the MOOC. It is usual that they cannot be accessed after the edition is finished, losing all the conversations generated in them. Sometimes it is difficult to follow the conversations in them because of the students’ lack of organization in writing their publications. For this reason, new tendencies appear that mix both types of MOOC [7,8], they are called hybrid MOOC or hMOOC, starting from the use of an xMOOC platform where the teaching team creates the structure of the course with the contents and manages the users. On the other hand, one or more external tools are used to complement the social deficiencies of these platforms, generally tools that favor the social part or that allow the application of new methodologies such as gamification [6] through different elements and mechanisms (badges, reputation, points, etc.).

2.2. Virtual Learning Communities

VLCs are spaces or groups of people with interests that focus on a common theme and that allow interaction and dialogue in digital spaces [14,15].
Advantages of VLCs include [6] synchronous and asynchronous communication; permanence of publications for later review; ease of communication between different geographical areas; connection with potential clients or people interested in other people’s publications; and unlimited interactivity. The added value of using social networks is that it makes it easier to share content and generate discussion forums [16] with the most organized content, its use being better known by most students. They are increasingly used in the field of education, such as Facebook groups [8,10] that allow the creation of discussion and interaction spaces in a synchronous and asynchronous way.

2.3. Gamification Principles

Games are an element that is increasingly present in today’s society, in part due to the rise and possibilities offered by new technologies that allow these games to be applied through numerous devices. There is a tendency to reuse design principles in other contexts that have nothing to do with games such as marketing, health or education. If one extracts those elements of design, key for the success of a game, and they are applied in these new contexts is when one will be able to speak of Gamification [17,18] and especially in education [19]. In the specific case of MOOCs there is a growth in the use of this methodology [20,21,22,23] applying gamification to achieve greater engagement of participants.
One of the current problems in education [24] is the lack of commitment and motivation of students, the application of gamification in education has great potential for improving performance, motivation, engagement or fun [22,23] of training activities. This will enable students to improve their skills and knowledge [24] by devoting more time to study and with greater involvement. It should not be forgotten that emotions and feelings [6,25] have a great impact on learning processes, generating greater engagement or on the contrary even reaching frustration within the course, it will be important to take them into account for proper management.
When talking about design it is complex to find a single framework that defines the different existing elements or dimensions [26] without finding a consensus when talking about terms such as mechanics, dynamics or components. Depending on the author, elements such as narrative, challenge, emotion, collaboration, badges, and dots will appear related to these terms.

2.4. Gamification and VLC

The use of digital social networks in education as VLC is becoming more widespread, given the impact it has on learning, with aspects such as motivation, engagement, satisfaction, and interaction [27] enabling online sharing and collaboration. Another aspect to study is the feelings generated when an interaction takes place, through discussions or comments in these networks, which is an important element when related to the activity of users in the MOOC [25].
If one analyzes the inherent elements of social network platforms such as Facebook or Twitter, which promote increased activity on them, one perceives a direct relationship with the gamification elements themselves. For example, the fact of receiving “likes” in a publication is related to aspects such as points and positive feelings related to status or even enjoyment, which Facebook allows to different degrees when indicating that we like a publication. The same happens with the phenomenon of being “followed” in a social network or when our publications are shared. On this aspect authors such as Hansch, Newman, and Schildhauer [26] propose a framework when talking about gamification design, in which they include another aspect that features prominently in online learning and knowledge sharing: the social/interactive dimension.
Using these elements of social networks in VLC, we are able to apply gamification without the need for other technologies, not only for the fact of working the social dimension, but also for the use of other dynamics. Specifically, the digital social network Facebook has a tool called “Groups” that allows creation of workspaces, with different privacy settings. This platform is committed to the educational use of these groups and within these, elements closely linked to gamification stand out, such as these:
  • Progress bar, associated with the additional functionality of the groups, “Units”, which serve to organize the collection and ordering of group publications, managing the chaos that often occurs with so much published information. Members of group are able to mark the publications of each unit seen, checking in the bar its level of progress.
  • Digital badges that Facebook itself automatically associates according to the degree or type of participation of members in the group. These, when obtained, are associated with the name of the member who has obtained it, appearing in all the publications made within group. Facebook Groups currently offers 10 different badges [28].
  • Different degrees of “likes” (I like it, I love it, it saddens me, etc.), comments and reshares. Although these options are not specific to groups, they are interesting as gamification elements.

3. Materials and Methods

3.1. MOOC

The MOOC analyzed, “Empower yourself with social networks” from Universidad Rey Juan Carlos, was offered in 2018 on the Spanish platform MiriadaX for one month (29 August to 25 September). It obtained First Award for Educational Innovation MiriadaX from the same platform in 2018 [29]. Over 4 weeks and 5 modules, the MOOC works on aspects such as personal branding on the Internet. Each module consists of a series of lessons that work on specific topics through video, text, links of interest, and exercises. The first week introduces the course learning guide (module 0) and contextualizes the course theme (module 1) emphasizing aspects such as professional digital identity. The next two weeks is where they see different social networks, from those more general as Facebook or Twitter (module 2) to others more specialized, such as LinkedIn (module 3). The fourth and final module works tools such as video, web analytics, and the concept of Personal Branding as the final result of the MOOC. All contents of the MOOC were accessible from the first day, except exams of each module which were opened one per week. In this way the students could review the material at their own pace, although through e-mail communications was set a rhythm and order, for those who needed a more guided modality.
The proposed design is based on a hybrid philosophy [7] called gcMOOC, already used in other works by the authors [21], which takes advantage of the infrastructure already created, such as the MiriadaX platform (xMOOC), and which has more than 6 million registered users [30], to offer a cMOOC approach through external elements [8]. The objective is to achieve greater student involvement and increased interaction in the MOOC in the form of new resources, thus following the connectivist principles, where priority is given to the content provided by those participating in the MOOC. For this, it was necessary to use a virtual learning community in which to generate a connectivist part. The key to the proposed model is the use of gamification, especially taking advantage of the social part of it, from a digital social network such as Facebook, and its own gamified elements that seek greater engagement.
Therefore, the MOOC is divided into two spaces, the platform where the course is, and the VLC where the activity is generated. In the following sections the proposed model will be analyzed: both the virtual learning community created and those gamification elements introduced.

3.2. Virtual Learning Community (Facebook Group)

In order to encourage participation, a virtual learning community was created on the Facebook platform, specifically a public group. The advantage of groups is that they organize publications on a wall where any member of the group can publish content appearing in the first place each publication, unlike Facebook pages, where only appear on the wall the publications of the administrators. Groups have very complete statistics for the teacher and also have interesting features for education: units, badges, publications with styles (bold, italics, numbering, etc.), hashtags, different roles of members and systems for approval of publications or searches within the community.
The VLC created for the MOOC is totally public and presents a set of rules of conduct previously defined in a corresponding section. In addition, in the MOOC, there is a lesson within module 0 that links to the community and explains how it works through a video tutorial. The link to the community is constantly quoted in e-mails sent to students and in various MOOC lessons.
The “Units” tool of the group has been used, which allows the teacher to organize those publications that he considers appropriate within the units. In the case of the MOOC they were used as tips or pieces of advice, to get the most profit from each module. Four units or tips were created, within which the teacher organized all the publications of the team, to avoid that these were lost in the time line of the group between so much publication of the participants. The units allow to make them obligatory, in such a way that they appear to the student as incomplete in a progress bar that as the reading seeing will be completed. Figure 1 shows on the left a unit, one can see the bar that indicates graphically and numerically the number of publications of the unit viewed and an example of publication, at the end the option can be seen “done” that the user can mark once viewed; to the right is the information message that appears to each user after finishing a unit and below the general bar that every user sees in the group, indicating the number of completed units.

3.3. Applied Gamification

The xMOOC models are the most massified and therefore generalized. In these courses most users choose to make use of content and individual learning; few go beyond and work a more social and connected part. Hybrid approaches, such as this model, with external communities where most MOOC activity takes place. The drawback is, on the part of MOOC students, ignorance of their existence, lack of interest or digital skills, this will mean that they do not access these spaces or do not make the most of them.
In this work, through gamification, we seek to motivate and generate new habits in the student to see the usefulness of the VLC and become accustomed to access and work in it. To this end, the two spaces have been worked on: the MOOC and the VLC.

3.3.1. MOOC and VLC gamification

In the first place, it has been decided to use challenges that involve the student through voluntary activities in which they can put into practice the theoretical concepts set out in the MOOC and, on the other hand, encourage participation in the VLC sharing the results. They were divided into two types:
  • Asynchronous activities: A total of 12 exercises distributed within the lessons, in which the student can put into practice what he has learned in the lesson at his own pace, and which encourage him to share the result in the form of a publication in the virtual learning community, thus seeking a flow of content from the MOOC to the VLC [8,31]. They were proposed activities such as creating a profile in the social networks explained and sharing it in the VLC, or looking for additional information about the contents, also sharing it.
  • Synchronous activities: 4 interactive live activities were proposed, in form of a broadcast via YouTube video platform, using “Hangouts on-air” [32] live videoconferencing option. Any student with the link could view the live event and participate in the chat on the right side of the video.
Within these synchronous activities, the novelty with respect to other initiatives of the team has been the design, seeking a very active participation and protagonism of the student within the activity and to feel part of this. This is the summary of the events:
  • “Building digital identity”: In this event, the professor proposed a collaborative analysis of what actions are carried out on the Internet that leave their mark on the digital identity of any person. We used the chat of the YouTube retransmission through which to participate live; the professor was working on the ideas he was reading written in the chat.
  • “What about us on Internet”: In this case was made use of the Kahoot! platform of questions, which allows to use it to apply gamification, given its format of a contest. It was used live, allowing anyone to participate who entered the platform, via web or mobile app, and wrote the specific code provided during the live event for the space created. Through a survey, the activity proposed to participants to make different Internet searches about their name and surname, and to see what information appeared from them, analyzing the results the teacher and contributing ideas.
  • “Interview with...”: The last two events had the same configuration, they were two interviews, one per week, to experts in the subject of each week module. The event was designed for maximum participation and protagonism of the students. Four days before the event, a link was sent to a space in the Sli.do questions and answers platform, where any MOOC student could write a question on his or her behalf or anonymously, leaving the question published for anyone to see and vote for. The most voted questions were those that were asked to each one of the interviewees.
On the other hand, the use of a digital social network as a support to the VLC and from the point of view of the applied gamification, not only allows the use of a more social and collaborative dimension, it also offers its own elements (likes, units, shares, and badges) that could be adopted within the gamified design of the MOOC, which tend to be unnoticed in the literature. These kinds of elements encourage dynamics such as socialization, participation, debate, status or progress. Figure 2 shows an example of how badges associated with a profile would look (admin and visual storyteller).

3.3.2. Gamified Model

After reviewing the different actions in the two main spaces of the MOOC, Figure 3 shows the resulting design. At the top is the hybrid MOOC model that uses a VLC to support the most connectivist and social part. In order to increase engagement, gamification is applied in this work, the result being checked in the lower part of the figure.
The most structured and organized part is associated with the MOOC (left) and is where both asynchronous activities are proposed, within the lessons, and synchronous activities, at different moments of the edition, which make use of external tools. The result seeks to generate an increase in publications and greater interaction within the virtual community of learning, on the right of the figure is shown this community and what gamified elements within it also encourage motivation to participate and interact within.
Table 1 summarizes the features, tools, and platforms used to apply the gamification in MOOC edition (Figure 3).

3.4. Data Collection

In order to obtain data, we used the statistics provided by the platforms on which MOOC was designed and all its activities:
  • MiriadaX allows you to know the number of students enrolled, how many have started and how many have finished.
  • Facebook Group offers very detailed statistics, showing information such as active members in the group, number of publications detailed by date, or visits and reactions to publications.
  • YouTube allows to know in a very complete way the visualizations of the videos and of the live broadcasts.
  • Sli.do and Kahoot! also provide statistics of participation, although they are very basic, for the purpose of the experience have been enough.
At the end of the MOOC, a satisfaction survey was sent to all enrolled, based on the validated SEEQ survey [33], already used in other experiences of the same team. Specific questions were added related to specific aspects to be measured on the MOOC the VLC, such as the tools used or the perception of learning and fun. A total of 63 Likert type questions with a range from 1 to 5 (Strongly disagree to Strongly agree) were posed. In some questions the option “I don’t know him” was added to make include this possibility for the specific case of tools used.

4. Results

The research presented in this article works with the data extracted from student activity in an MOOC designed and delivered by the teaching team over the 28 days, comparing them with a satisfaction survey sent after completion.
Table 2 reflects the overall results of the completion of MOOC and the virtual learning community on the last day of the edition (25/09/2018). The number of completions corresponds to students who passed at least 75% of the assessment activities and video lectures viewed. The percentages of finalization have been calculated in relation to those who registered and also to those who started the MOOC, this number is more significant, bearing in mind that the platform considers as initiated any user who has accessed at least once during the course period, as opposed to the 3980 registered users who did not enter even once during the edition, and therefore did not see any video or content.
As for the VLC, this table shows the total values after completing the course, highlighting a large interaction of users with respect to publications with comments and reactions. The latter refer to the Facebook “likes” of both publications and comments, taking into account the different likes options offered by the social network.
All events have been supported by Hangouts on air from YouTube, broadcast live. Table 3 shows a summary of the activity of these four events. This table shows, for each event, the Youtube information, in time ranges, from the day of the event, until the end of the edition and until the day before the second edition of the MOOC began. The values obtained are from the day of recording. The average duration was 30 min, and you can see the fall of users who saw them, and therefore engagement in the MOOC, as the edition progresses.

4.1. Live Events

Throughout the MOOC different types of activities were proposed, as seen above. The results of the synchronous gamification activities and the tools used to interact with the students will be analyzed below.
As for the interaction generated in the events, different elements were used to allow the participation of the spectators. For the first one we used YouTube’s own chat, with a total of 373 live conversations. Kahoot!, a very interesting application used in education to gamify, got a total of 88 participants, 10% of the viewers, who answered the 8 questions posed. The last two events asked for a previous participation through Sli.do. In the 4 days prior to each event MOOC students proposed 50 and 36 questions respectively for the interviewees, and these obtained 102 and 52 likes. Sli.do allows anonymous questions to be published or the name to be written, and only 36% were anonymous at both events.

4.2. Participation in the VLC

In this section the specific results obtained in the Facebook community will be analyzed. Figure 4 shows the generated activity in a graphical way. At the top of the graph you can see the evolution of the publications (red), this shows a downward trend as the end of MOOC edition approaches, versus the interaction (comments and reactions) between members that has been more constant. It emphasizes that the number of active users remains constant throughout the edition. The lower part of Figure 4 shows the evolution of community members, which has been growing even at the end of the edition. During the whole edition, both students who started at different times, even at the last minute, and new enrollees were incorporated into the community, as the platform allows registration until the end of the edition.
In order to check whether a compromise had really been achieved and to create a habit in the use of VLC, independently of MOOC, Facebook group was analyzed as soon as the edition of MOOC had been completed, without any kind of community dynamization or emails encouraging participation. Figure 5 shows the result of the activity between 26 September, 2018 and 1 April, 2019, the day before the start of the second edition of the MOOC. The result was an increase of 425 new members, 387 publications, 605 comments, and 2755 reactions. An average of 53.4 active members per day, albeit with a large deviation (196.4).

4.3. Satisfaction Survey

After completing MOOC, a survey was sent to find out the assessment of students, answered by a total of 480 individuals, that is, 10.5% of those who started the course. Although the survey had a total of 63 questions, the seven most representative questions in relation to this work, summarized in Table 4, have been selected.
Firstly, the students’ perception of three aspects related to the MOOC was analyzed: enjoyment and gamification; directly related to questions 1 and 2 respectively. Figure 6 shows each of the three aspects related to question 7 on whether the MOOC was completed at 100%, 75%, or not.
The aspect of enjoyment or fun again highlights that those who have had the most fun have been those who have finished at 100% with 61.6%, and 75% with 55.6%. In both cases, those students who have completed the MOOC consider that they have had fun, an aspect that was sought to be promoted. As for the applied gamification, they were asked if they had felt like in a game, in this case the value as expected decreases, since a complete gamification was not applied, for example to MiriadaX platform itself, even so more than 40% of those who finished the MOOC, have had this perception.
Continuing with these two aspects, Figure 7 shows the relationship, in this case, with respect to the age of the students.
For fun, the values are around 45.3% of the 30–39 age group and 48.3% of those under 30; and the maximum values of 59.5% for the 40–49 age group and 56.7% again for those over 60. The other aspect, most related to gamification, only the age range between 40–49 with 43.9% and over 60 with 45% have felt in a game. As expected, those under 30 were the most skeptical with 29.3%.
Secondly, the aspects related to the VLC on Facebook and the MOOC have been analyzed. On the one hand to check if the applied gamification has increased the participation and on the other hand to check if its elements have really achieved a real commitment of its members with the community and can be considered as motivating elements.
Figure 8 shows the answers given to the degree of participation in the Facebook group using its different elements.
In general, members of group have read the publications of others, drastically reducing the rest of participative actions, where almost 50% of those asked not shared publications, commented on others or published; although it stands out that between 20% and 24% have actively carried out these actions. The second most common interaction was the use of “likes”, with just over 41%.
The following graph (Figure 9) analyzes the results related to motivation in the VLC, from question 5, in order to know how it affects the interaction of others on the subject’s participation in the community when publishing.
Answers to this fifth question reveal that, in general, members of the group are motivated when someone comments on their publications with 48.3%, that they share with 47.9% and that they get “likes” only 37%.
In order to obtain an overview of the results of the previous graphs, Figure 10 proposes a more complete analysis of question 5 from the point of view of the ages of the participants. In this way, the aim is to understand in depth the motivation for a user that others interact with their publications.
After the results shown in the graph, it is the participants between 50 and 59 who are most motivated to share and comment on their publications around 51%, being in turn the least important and motivators seem to them the “likes” with only 36.5% interest in them, along with those over 60 who are even less interested with 30%. In general, the rest of ages are motivated with more than 41% to comment and share with them, being the age groups under 39 who have more attraction for “likes” with 40%.
Finally, fun has been studied as a key element to generate an engagement in the MOOC and, as a consequence, a greater participation in the learning community. Table 5 shows a comparison between the student’s perception of fun when performing the MOOC (Q1) and the questions that refer to the feeling of being in a game (Q2), being part of the community (Q6), and about participation in Facebook (Q3 and Q4 (d)). The most representative values of the results have been highlighted in bold, which will be reviewed below.
It is verified that those participants who have had more sensation of being in a game (Agree or Strongly agree in Q2) are those who have had more fun (Agree or Strongly agree in Q1), the same relation that exists with the feeling of being part of the community (Agree or Strongly agree in Q6). About sharing publications, the 86.96% that have not shared publications (Strongly disagree in Q3) are those that have less fun in the MOOC (Strongly disagree in Q1). The surveyed participants that more actively share their publications (Agree or Strongly agree in Q3) are those who have had more fun (Agree or Strongly agree in Q1). At last, those participants who have put more likes (Strongly agree in Q4), have also had fun (Strongly agree in Q1), being these close to 35%. Almost 74% of those who did not put likes (Strongly disagree in Q4) did not have a perception of fun with the MOOC (Strongly disagree in Q1).

5. Discussion and Conclusions

In general, MOOCs are known and criticized for the low student numbers that complete them. Although this value has not been demonstrated to be dependent on the quality of the contents [1], neither is the objective of this research to improve it, if it is true that it can be used to get an idea of the degree of commitment to the course on the part of the students. It is common in MOOCs to find a high drop-out, around 90%–95% [5], compared to the results obtained in this work with 19.4%, which double the most common values. Specifically, 15.9% saw all the contents and surpassed all the activities to 100%.
This research has analyzed the convenience of applying gamification actions in a hybrid MOOC model, where special importance has been given to the social part, promoting those characteristics of a cMOOC, to increase engagement, fun and create a habit when using the VLC, in order to generate new content and conversation.
Two types of activities were proposed in the design, giving rise to a particularly active community with almost 2000 publications during the 28 days of publication. There has been a great deal of interaction between community members with over 2500 comments and 13,000 interactions. Asynchronous activities, associated with content within the MOOC, in which the student was encouraged to publish the results in the community, as well as in other team initiatives in previous MOOCs [21,32]. Synchronous activities, through live events, were quite seen, although with the classic curve of fall in the participation of the MOOC [7] and in them the audience participated, even though they had to make use of different technologies like Kahoot! or Sli.do, we must not forget that the type of MOOC student is very heterogeneous and does not always have advanced digital competences [4,8]. Participation is remarkable in these activities, to a greater or lesser degree, with 1963 visitors who during the MOOC entered the first event, 43.1% of those who started the course, up to 9% of those who saw the last event, as shown in Table 3. This participation is quite high, bearing in mind also that these were voluntary activities and meant that the student had access to a space other than the MOOC platform. Participation has been quite high, bearing in mind that these were voluntary activities and meant that the student had access to a space other than the MOOC platform. Within these events, except the first where the interaction was simple, through the chat of the video itself on YouTube, the rest had mainly viewers in front of students who participated actively entering platforms where the activity was performed as Kahoot! or Sli.do. It should not be forgotten that these types of initiatives require some digital skills, and although its use was a novelty with respect to other MOOCs, its use was minority.
Figure 5 shows that there has been activity, once the edition of the MOOC is finished, both in publications and in interactions, therefore, it has been possible to create a habit and for the members to see the usefulness of participating in this type of communities. Gamification promotes socially desirable learning behaviors [27], in this case the use of the social network itself as a learning space in which to share content.
Based on the satisfaction survey, the students’ perception of the sensation of being in a game and having fun participating in the MOOC and the VLC has been analyzed. Figure 6 reveals that those who have had the most fun are those who have finished the MOOC at 100% with 61.6% and 75% with more than 50%, fun is an important element when promoting engagement [23] and to take into account when designing a gamified model [21]. Regardless of the ending, if we focus on age, and reviewing the two graphs globally, we can see that in general the groups that have had the most fun have been from the age of 40. And more specifically, only those over 40 have really had some perception of being in a game, as opposed to those under 30, which as expected have a different concept of game, familiar with mobile applications or real videogames.
From the point of view of motivation, another key element to achieve greater engagement in the model presented, participation in the Facebook group (Figure 8) reveals how students have worked within the community. Highlighting the reading and decreasing the rest of the actions within Facebook, being giving “likes” to others, over 41%, what has been used most, followed by commenting and sharing publications. But, if we change the focus and look at the motivation to receive this type of recognition in the publications or interactions that the student makes, the results change, (Figure 9) with almost 50% to those who do motivate the fact that they are commented or shared. These feelings generated by the interaction (comments, likes, etc.) have a relation with the activity of the students in the MOOC [25]. Within this point of view, it is interesting how the participants are predisposed to give “likes” but only 37% are motivated to receive them. Looking at the age analysis in Figure 10, as expected, the younger generations under 39 are the most motivated to receive likes (41%), to share their publications (40%–45%) and to comment (46%–48%) on generations more habituated to the use of social networks [34], as opposed to those over 60, of which only 30% were interested in receiving likes. The younger generations, who have shown a greater interest in these elements, are more susceptible to what is known as gameful experience also in contexts that are not games [35], having a predisposition to greater engagement when applying these proposals.
Analyzing this type of elements, typical of social networks such as likes, comments or the possibility of sharing other people’s publications, offer a “visible status” and a “social engagement” [36]. The ability to follow each other’s learning progress, upvoting other peers [26] can harness these motivational aspects of gamification to stimulate participation and engagement with learning contents and with other participants [27], as has been shown in this work. The use of VLC is more and more common in education [27], making use of social networks such as VLC it will be possible, in an indirect way, to take advantage of the use of these own gamification characteristics [26].
The findings shown in Table 5 reinforce this relationship between fun and social part, from feeling in a community where those participants who have had the most fun have also felt a greater degree of community with 67%. On the other hand, no direct relationship has been found between the degree of fun and the sharing of MOOC activities in the community. Finally, there is a certain relationship among the participants who have used “likes” the most and those who have had the most fun with 45%, seeming to them an attractive element, and we consider that it could be associated with the gamification points and the sensation of happiness that it produces, as other authors [26,27].
It is clear that those participants who have had the greatest feeling of being in a game (Q2) are those who have had the most fun, the same relationship that exists with the feeling of being part of the community. Of those surveyed, 23.13% took an active part in sharing their publications, of which around 30% thought it was fun, as opposed to those who did not share anything and did not perceive any fun in the MOOC. Finally, those participants who liked it the most also had fun, being close to 45%. Almost 74% of those who did not put likes did not have a perception of fun with the MOOC. Participants that agreed or strongly agreed with having fun with the MOOC shows higher levels of gamification (Q2), community feeling (Q6), and participation (Q4). However, there is no direct relation between having fun and sharing MOOC activities in Facebook. Therefore, the participation of students in sharing their own activities is not enhanced through having fun. Other actions to motivate sharing activities should be implemented.
As a main conclusion, through the use of gamification, by using two types of activities (synchronous and asynchronous) from a MOOC, and the elements of digital social networks themselves (Facebook), we have achieved greater engagement and generation of content for the VLC. It has been proven that users have had fun and active participation in the community, creating a habit beyond the edition of the MOOC. Fun can be key to achieving greater engagement both in the course, with a higher degree of completion, and in the community.
This increase in motivation to participate in a social network is thanks to attractive elements that can be used as gamification by their own nature, as opposed to more restrained spaces such as online course forums. It has been proposed that members of the community receive an incentive to publish, with this type of interest sample towards their contributions.
With respect to previous experiences, we have worked more on the interaction with the student, to make it more active, incorporating tools such as Kahoot! or Sli.do in live events, although with an extra difficulty for certain users due to lack of digital knowledge, as well as inconvenience when having to use more tools.
The next line of research will seek to deepen the students’ perception of the usefulness of the content generated, increase the number of interactive activities in which to apply gamification, incorporating new digital tools. We will also work on the design of activities that are more fun and attractive for students.

Author Contributions

Conceptualization, O.B.-G.; Methodology, O.B.-G.; Validation, O.B.-G., M.M.-N. and L.M.-F.; Formal Analysis, M.M.-N.; Investigation, O.B.-G., M.M.-N. and L.M.-F.; Resources, O.B.-G.; Data Curation, O.B.-G.; Writing—Original Draft Preparation, O.B.-G.; Writing—Review & Editing, O.B.-G. and L.M.-F.; Supervision, O.B.-G.; Project Administration, O.B.-G.

Funding

This work was supported by research grants iProg of MINECO (ref. TIN2015-66731-C2-1-R) and has funded by the Madrid Regional Government, through the project e-Madrid-CM (P2018/TCS-4307). The e-Madrid-CM been co- project is also co-financed by the Structural Funds (FSE and FEDER).

Acknowledgments

This work has counted on the collaboration of the URJC Online team for the design, recording of videos and the management of the MOOC; also, to thank the team of the LITE group.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Stracke, C.M. The Quality of MOOCs: How to improve the design of open education and online courses for learners? In Proceedings of the 4th International Conference on Learning and Collaboration Technologies, Vancouver, BC, Canada, 9–14 July 2017; Springer: Cham, Switzerland, 2017; pp. 285–293. [Google Scholar]
  2. Siemens, G. Connectivism: A learning theory for the digital age. Int. J. Instr. Technol. Dis. Learn. 2005, 2, 1–8. [Google Scholar]
  3. Martinez, S. OCW (OpenCourseWare) and MOOC (open course Where?). In Proceedings of the OpenCourseWare Consortium Global, Ljubljana, Slovenia, 23–25 April 2014. [Google Scholar]
  4. Siemens, G. Massive Open Online Courses: Innovation in Education? Available online: https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/pub_PS_OER-IRP_CH1.pdf (accessed on 2 July 2019).
  5. Sein-Echaluce, M.L.; Fidalgo-Blanco, Á.; García-Peñalvo, F.J. Adaptive and cooperative model of knowledge management in MOOCs. In Proceedings of the 4th International Conference on Learning and Collaboration Technologies, Vancouver, BC, Canada, 9–14 July 2017; Springer: Cham, Switzerland, 2017; pp. 273–284. [Google Scholar]
  6. Leony, D.; Merino, P.J.M.; Valiente, J.A.R.; Pardo, A.; Kloos, C.D. Detection and Evaluation of Emotions in Massive Open Online Courses. J. UCS 2015, 21, 638–655. [Google Scholar]
  7. Fidalgo-Blanco, Á.; Sein-Echaluce, M.L.; García-Peñalvo, F.J. From massive access to cooperation: Lessons learned and proven results of a hybrid xMOOC/cMOOC pedagogical approach to MOOCs. Int. J. Educ. Technol. High. Educ. 2016, 13, 24. [Google Scholar] [CrossRef]
  8. Borrás-Gené, O. Empowering MOOC Participants: Dynamic Content Adaptation Through External Tools. In Proceedings of the European MOOCs Stakeholders Summit 2019, Naples, Italy, 20–22 May 2019; Springer: Cham, Switzerland, 2019; pp. 121–130. [Google Scholar]
  9. Groh, F. Gamification: State of the Art Definition and Utilization. Available online: http://hubscher.org/roland/courses/hf765/readings/Groh_2012.pdf (accessed on 2 July 2019).
  10. Pelet, J.E.; Pratt, M.A.; Fauvy, S. MOOCs and the integration of social media and curation tools in e-learning. In Proceedings of the International Workshop on Learning Technology for Education in Cloud, Maribor, Slovenia, 24–28 August 2015; Springer: Cham, Switzerland, 2015; pp. 43–53. [Google Scholar]
  11. Daniel, J.; Cano, E.V.; Cervera, M.G. The future of MOOCs: Adaptive learning or business model? Int. J. Educ. Technol. High. Educ. 2015, 12, 64–73. [Google Scholar] [CrossRef]
  12. Rodriguez, O. The concept of openness behind c and x-MOOCs (Massive Open Online Courses). Open Praxis. 2013, 5, 67–73. [Google Scholar] [CrossRef]
  13. Ramírez-Donoso, L.; Pérez-Sanagustín, M.; Neyem, A.; Rojas-Riethmuller, J.S. Promoviendo la colaboración efectiva en MOOCs a través de aplicaciones móviles. In Proceedings of the 2015 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies, Santiago, Chile, 28–30 October 2015. [Google Scholar]
  14. Goldie, J.G.S. Connectivism: A knowledge learning theory for the digital age? Med. Teach. 2016, 38, 1064–1069. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Núñez-Martinez, M.; Borrás-Gené, O.; Fidalgo-Blanco, Á. Social community in MOOCs: Practical implications and outcomes. In Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM), Salamanca, Spain, 1–3 October 2014; pp. 147–154. [Google Scholar]
  16. García, M.I.; Díaz, C.G. Facebook como herramienta educativa en el contexto universitario. Historia y Comunicación Social. 2014, 19, 379–391. [Google Scholar]
  17. Deterding, S.; Sicart, M.; Nacke, L.; O’Hara, K.; Dixon, D. Gamification. Using game-design elements in non-gaming contexts. In Proceedings of the CHI’11 Extended Abstracts on Human Factors in Computing Systems, Vancouver, BC, Canada, 7–12 May 2011; ACM: New York, NY, USA, 2011; pp. 2425–2428. [Google Scholar]
  18. Werbach, K.; Hunter, D. The Gamification Toolkit: Dynamics, Mechanics, and Components for the Win; Wharton Digital Press: Philadelphia, PA, USA, 2015. [Google Scholar]
  19. Kapp, K.M. The Gamification of Learning and Instruction; Wiley: San Francisco, CA, USA, 2013. [Google Scholar]
  20. Vaibhav, A.; Gupta, P. Gamification of MOOCs for increasing user engagement. In Proceedings of the 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE), Patiala, India, 19–20 December 2014; pp. 290–295. [Google Scholar]
  21. Borrás-Gené, O.; Martínez-Núñez, M.; Fidalgo-Blanco, Á. New challenges for the motivation and learning in engineering education using gamification in MOOC. Int. J. Eng. Educ. 2016, 32, 501–512. [Google Scholar]
  22. Klemke, R.; Eradze, M.; Antonaci, A. The flipped MOOC: Using gamification and learning analytics in MOOC design—A conceptual approach. Educ. Sci. 2018, 8, 25. [Google Scholar] [CrossRef]
  23. Huang, W.H.Y.; Soman, D. Gamification of Education. Available online: https://inside.rotman.utoronto.ca/behaviouraleconomicsinaction/files/2013/09/GuideGamificationEducationDec2013.pdf (accessed on 2 July 2019).
  24. Kiryakova, G.; Angelova, N.; Yordanova, L. Gamification in education. In Proceedings of the 9th International Balkan Education and Science Conference, Edirne, Turkey, 16–18 October 2014. [Google Scholar]
  25. Wang, L.; Hu, G.; Zhou, T. Semantic analysis of learners’ emotional tendencies on online MOOC education. Sustainability 2018, 10, 1921. [Google Scholar] [CrossRef]
  26. Hansch, A.; Newman, C.; Schildhauer, T. Fostering Engagement with Gamification: Review of Current Practices on Online Learning Platforms. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2694736 (accessed on 2 July 2019).
  27. De-Marcos, L.; Domínguez, A.; Saenz-de-Navarrete, J.; Pagés, C. An empirical study comparing gamification and social networking on e-learning. Comput. Educ. 2014, 75, 82–91. [Google Scholar] [CrossRef]
  28. Discover New Badges to Recognize Admins and Outstanding Members. Available online: https://www.facebook.com/community/education/blog/badges/ (accessed on 4 June 2019).
  29. Telefónica Premia la Innovación Educativa de los MOOCs a Través de Míriadax. Available online: https://comunicacionmarketing.es/actualidad/24/01/2019/telefonica-premia-la-innovacion-educativa-de-los-moocs-a-traves-de-miriadax/5389.html (accessed on 4 June 2019).
  30. ¡Conoce los Objetivos de Desarrollo Sostenible a Través del Nuevo MOOC de Miríadax! Available online: https://blogthinkbig.com/desarrollo-sostenible-miriadax (accessed on 27 June 2019).
  31. García-Peñalvo, F.J.; Cruz-Benito, J.; Borrás-Gené, O.; Blanco, Á.F. Evolution of the Conversation and Knowledge Acquisition in Social Networks Related to a MOOC Course. In Learning and Collaboration Technologies; Zaphiris, P., Ioannou, A., Eds.; Springer: Berlin, German, 2015. [Google Scholar]
  32. Pérez, A.B.; Borrás-Gené, O. Uso de Hangouts como recurso educativo en abierto en MOOC. In Proceedings of the IV Congreso Internacional sobre Aprendizaje, Innovación y Competitividad (CINAIC), Zaragoza, Spain, 4–6 October 2017. [Google Scholar]
  33. Marsh, H.W. SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Students’ evaluations of University Teaching. Br. J. Educ. Psychol. 1982, 52, 77–95. [Google Scholar] [CrossRef]
  34. Schroer, W. Defining, Managing, and Marketing to Generations, X, Y, and Z. IAM 2008, 10, 9. [Google Scholar]
  35. Högberg, J.; Hamari, J.; Wästlund, E. Gameful Experience Questionnaire (GAMEFULQUEST): An instrument for measuring the perceived gamefulness of system use. User Model. User-Adapt. Interac. 2019, 3, 1–42. [Google Scholar] [CrossRef]
  36. Dicheva, D.; Dichev, C.; Agre, G.; Angelova, G. Gamification in education: A systematic mapping study. Educ. Technol. Soc. 2015, 18, 75–88. [Google Scholar]
Figure 1. Screenshots of units in Facebook Groups.
Figure 1. Screenshots of units in Facebook Groups.
Informatics 06 00028 g001
Figure 2. Digital badges in Facebook Groups.
Figure 2. Digital badges in Facebook Groups.
Informatics 06 00028 g002
Figure 3. Gamified model (Massive Open Online Courses (MOOC) and Virtual Learning Communities (VLC)).
Figure 3. Gamified model (Massive Open Online Courses (MOOC) and Virtual Learning Communities (VLC)).
Informatics 06 00028 g003
Figure 4. VLC publications (top) and members evolution (bottom).
Figure 4. VLC publications (top) and members evolution (bottom).
Informatics 06 00028 g004
Figure 5. VLC activity after MOOC edition.
Figure 5. VLC activity after MOOC edition.
Informatics 06 00028 g005
Figure 6. Relationship between learning, enjoyment, gamification and completion of MOOC.
Figure 6. Relationship between learning, enjoyment, gamification and completion of MOOC.
Informatics 06 00028 g006
Figure 7. Relationship between learning, enjoyment, gamification and age.
Figure 7. Relationship between learning, enjoyment, gamification and age.
Informatics 06 00028 g007
Figure 8. Participation in Facebook group: reading, publishing, commenting, likes, and sharing (Q4).
Figure 8. Participation in Facebook group: reading, publishing, commenting, likes, and sharing (Q4).
Informatics 06 00028 g008
Figure 9. Motivation in Facebook Group (Q5).
Figure 9. Motivation in Facebook Group (Q5).
Informatics 06 00028 g009
Figure 10. Motivation in Facebook Group (Q5) age analysis.
Figure 10. Motivation in Facebook Group (Q5) age analysis.
Informatics 06 00028 g010
Table 1. Relationship between gamification activities and technologies used.
Table 1. Relationship between gamification activities and technologies used.
Technologies
Asynchronous ActivitiesMiriadaX (MOOC platform)
Synchronous ActivitiesKahoot!
Sli.do
Virtual Learning CommunitiesFacebook GroupLikes
Shares
Units
Badges
Table 2. Results of MOOC’s participation in the MiriadaX platform and Facebook group.
Table 2. Results of MOOC’s participation in the MiriadaX platform and Facebook group.
MOOC (MiriadaX)
EnrolledStartedFinished (100%)% (Enrolled)% (Started)
85324552135915.9%29.8%
Finished (75%)% (Enrolled)% (Started)
165519.4%36.3%
VLC (Facebook Group)
MembersPublicationsCommentsReactions
25401980274613,333
Table 3. Live events summary.
Table 3. Live events summary.
Live Events (Synchronous Activities)
Building Digital IdentityWhat about Us on InternetInterview with... (1)Interview with... (2)
YouTube
Streaming duration (min:sec)32:2526:0533:0127:41
Event dayDay04/09/201811/09/201818/09/201825/08/2018
Views798803270381
Peak concurrents1821578378
Unique viewers599534214319
Likes71415948
Shares19867
Chat messages373---
Until end of MOOC (25/09/2018)Period22 days15 days7 days1 day
Views28341333608515
Unique viewers1963886444412
Likes110527053
Shares8312148
After finishing MOOC 26/09/2018 to 01/04/2019Views32901407672664
Likes112557057
Shares9612108
Comments463253
Kahoot!Participants-88--
Sli.doParticipants--4941
Questions--5036
Likes--10252
Table 4. Selected questions from the satisfaction survey for the study.
Table 4. Selected questions from the satisfaction survey for the study.
Q1. EnjoymentI had fun with the MOOC
Q2. GamificationI felt like I was in a game in the MOOC
Q3. ParticipationI have shared in the Facebook community the proposed activities of the course
Q4. Participation (a, b, c, d e)Participation in the Facebook group (a) reading, (b) publishing, (c) commenting to others, (d) likes and (e) sharing publications
Q5. Motivation (a, b, c)It encourages me, when I publish something, that my publications: (a) have comments, (b) are shared and (c) have likes
Q6. EngagementI have felt part of the community
Q7. CompletionI’ve passed the MOOC
Table 5. Relationship between gamification, community engagement and fun.
Table 5. Relationship between gamification, community engagement and fun.
Q1. I had Fun with the MOOC
Strongly DisagreeDisagreeNeither Agree nor DisagreeAgreeStrongly Agree
Q2. I felt like I was in a game in the MOOCStrongly Disagree16.82%39.19%10.53%4.72%2.26%
Disagree20.56%47.30%30.70%9.45%1.50%
Neither Agree nor Disagree25.23%12.16%50.88%36.22%12.03%
Agree17.76%1.35%7.02%48.03%31.58%
Strongly Agree18.69%0.00%0.88%1.57%50.38%
Q6. I have felt part of the communityStrongly Disagree73.91%14.86%1.75%0.00%0.75%
Disagree26.09%44.59%21.05%5.51%1.50%
Neither Agree nor Disagree0.00%37.84%56.14%23.62%1.50%
Agree0.00%1.35%16.67%47.24%24.06%
Strongly Agree0.00%1.35%4.39%22.05%67.67%
Q3. I have shared in the Facebook community the proposed activities of the courseStrongly Disagree86.96%51.35%34.21%36.22%22.56%
Disagree8.70%21.62%22.81%23.62%14.29%
Neither Agree nor Disagree0.00%17.57%24.56%21.26%22.56%
Agree4.35%6.76%13.16%10.24%20.30%
Strongly Agree0.00%2.70%5.26%8.66%20.30%
Q4 (d). Participation in the Facebook group [Likes]Strongly Disagree73.91%47.30%32.46%37.01%21.05%
Disagree13.04%22.97%21.05%19.69%12.03%
Neither Agree nor Disagree4.35%16.22%16.67%9.45%4.51%
Agree2.17%7.43%17.54%23.62%28.20%
Strongly Agree6.52%6.08%12.28%10.24%34.21%

Share and Cite

MDPI and ACS Style

Borrás-Gené, O.; Martínez-Núñez, M.; Martín-Fernández, L. Enhancing Fun through Gamification to Improve Engagement in MOOC. Informatics 2019, 6, 28. https://doi.org/10.3390/informatics6030028

AMA Style

Borrás-Gené O, Martínez-Núñez M, Martín-Fernández L. Enhancing Fun through Gamification to Improve Engagement in MOOC. Informatics. 2019; 6(3):28. https://doi.org/10.3390/informatics6030028

Chicago/Turabian Style

Borrás-Gené, Oriol, Margarita Martínez-Núñez, and Luis Martín-Fernández. 2019. "Enhancing Fun through Gamification to Improve Engagement in MOOC" Informatics 6, no. 3: 28. https://doi.org/10.3390/informatics6030028

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop