Adaptive Gamification in Science Education: An Analysis of the Impact of Implementation and Adapted Game Elements on Students’ Motivation

Abstract

In recent years, gamification has captured the attention of researchers and educators, particularly in science education, where students often express negative emotions. Gamification methods aim to motivate learners to participate in learning by incorporating intrinsic and extrinsic motivational factors. However, the effectiveness of gamification has yielded varying outcomes, prompting researchers to explore adaptive gamification as an alternative approach. Nevertheless, there needs to be more research on adaptive gamification approaches, particularly concerning motivation, which is the primary objective of gamification. In this study, we developed and tested an adaptive gamification environment based on specific motivational and psychological frameworks. This environment incorporated adaptive criteria, learning strategies, gaming elements, and all crucial aspects of science education for six classes of third-grade students in primary school. We employed a quantitative approach to gain insights into the motivational impact on students and their perception of the adaptive gamification application. We aimed to understand how each game element experienced by students influenced their motivation. Based on our findings, students were more motivated to learn science when using an adaptive gamification environment. Additionally, the adaptation process was largely successful, as students generally liked the game elements integrated into their lessons, indicating the effectiveness of the multidimensional framework employed in enhancing students’ experiences and engagement.

1. Introduction

Educators have consistently prioritized students’ active participation in the classroom as a fundamental aspect [1]. With the dynamic influence and continuous progress of technology, it is essential to develop innovative learning environments that cater to the requirements and interests of contemporary learners, thereby fostering an engaging and inspiring educational experience [2,3]. The attainment of high levels of student engagement and motivation is of great importance, as research has demonstrated its positive impact on academic achievement [4,5]. In recent years, there has been a notable increase in the utilization of digital games across various domains, including academia [6]. This trend has sparked the interest of researchers and practitioners, leading to the emergence of a novel approach known as gamification [7]. The COVID-19 pandemic has further highlighted an ongoing challenge wherein numerous students struggle to effectively regulate their motivation, particularly within digital learning settings [8,9].

Promoting science education is crucial for the progress of our society and the development of individuals who possess scientific literacy, enabling them to comprehend and appreciate the intricacies of the world [10]. Science education nurtures essential learning skills and fosters attitudes that emphasize the significance of evidence-based decision-making while nurturing social and environmental consciousness. These benefits extend to individuals regardless of their future involvement in the fields of science and technology [10,11]. Students at all educational levels have consistently encountered challenges when grasping scientific concepts [12,13]. The complexity associated with comprehending and understanding science-related concepts often leads to negative emotions, unfavourable experiences, and diminished motivation for learning among students [14,15]. However, other factors can influence science learning, such as teacher self-efficacy and motivation [16], geographical differences [16], gender differences [15], and school setting [15].

The increasing popularity of games in our society has sparked significant interest among educators and instructional developers in a concept known as gamification. Although the term “gamification” was initially introduced in 2008, it was not until 2010 that it gained broader acceptance [7]. Since then, its popularity has continued to grow steadily and remains a central concept today [17]. Gamification in education refers to “incorporating game mechanics, aesthetics, and the cognitive and behavioural aspects associated with games into non-game-related educational content” [18]. This approach aims to engage and motivate students, address challenging situations, and enhance the learning experience through digital materials.

Extensive research has solidified the understanding that gamification holds significant potential to influence and drive desired changes in behaviour [17,19]. Despite being applied for nearly a decade, the existing literature on gamification reveals varied outcomes concerning its effectiveness in enhancing learning and motivation [20]. These mixed results suggest that the commonly employed “one size fits all” approach to gamification, which assumes similar reactions from all users towards gamification elements, may be insufficient [21,22]. The lack of adaptation of game elements and the absence of an appropriate didactic approach tailored to the individual needs of each learner, combined with the frequent presentation of repetitive game elements, can contribute to higher levels of abandonment over time [23]. Furthermore, the absence of a well-defined and carefully planned design can also result in adverse outcomes [19,24,25]. It is essential to consider these parameters when designing a gamified app [26] and implementing it in a classroom setting [27].

Previous studies have powerfully shown that for gamification to be effective, it should be adapted to align with users’ expectations and individual preferences [3,28,29]. Indeed, adapting game elements to cater to individual preferences can be challenging, considering the diverse range of learners and their varying motivations for learning. However, it is essential to note that adaptive gamification, which involves tailoring game elements based on individual user actions, preferences, and characteristics [30], is still a relatively new concept. There are currently only a limited number of approaches described in the literature, and even fewer specifically designed to be content-specific and not generic [29,31].

The development of the adaptive gamification environment to teach scientific concepts related to the water cycle was based on a framework encompassing adaptive criteria, learning strategies, gaming elements, and all vital aspects of the learning process related to specific science education [31]. Our main objectives are to understand primary education students’ motivation and engagement when utilizing an adaptive gamified application specified for science-related content and the motivational impact game elements had on students. More specifically, our research questions are:

• What was the motivational impact of this adaptive gamification environment on the students regarding science education?
• How did the adaptive game elements motivate students?

2. Literature Review

2.1. Adaptable Gamification and Science Education

Overall, the interaction and correlation between students and science education in schools is often described as problematic. It is believed that there is a decline in motivation, attitudes, and interest, mainly as students grow up. Similar thoughts are derived when considering gender differences favouring boys. The motivation to learn science is seen as an influential factor in the development of scientific literacy among individuals [32]. Motivation is crucial in science education and acquiring scientific knowledge and skills [32]. Empirical studies have already established a connection between motivation to engage in science and academic performance [33,34]. Even though motivation towards science can impact the learning process [35], it is essential to note that various factors, like personal interests, personality traits, and cognitive style, can contribute to individual motivation [34,36].

In recent years, gamification has gained considerable attention as a concept that has been shown to enhance student engagement and motivation to learn, particularly in various fields and science education [17,20]. This aspect has become even more crucial as learners no longer seem as engaged with traditional teaching approaches as they once were [15]. The concept of gamification utilizes game elements and mechanics, known for their ability to motivate and engage players over extended periods, and applies them to nongame contexts. Its main goal is to replicate the same level of motivation and engagement for other purposes beyond gaming [37]. In addition, technological developments have facilitated the expansion of gamification into digital environments. This includes using applications or platforms that leverage digital devices such as computers, tablets, or smartphones [38]. As a result, science gamification applications have seen a noticeable increase [17]. Unlike other educational games, the primary objective of these applications is not solely focused on learning, although learning is an indirect outcome. The main goal is to modify learner behaviour or attitude within a specific context [39] (p. 759).

Nevertheless, it is essential to note that motivation varies among individuals, and different people can be motivated by various elements in specific ways. Consequently, in a gamified environment, interactions with the game can impact individuals differently based on their unique motivational factors [26]. Additionally, it is worth mentioning that gamification has its challenges, as several studies have raised concerns regarding its impact on learning outcomes and motivation [40,41], including science education [42,43]. As such, it has become apparent that gamification’s “one size fits all” approach is not enough [22,30]. The nonadaptation of game elements and the appropriate didactic approach to the needs of each trainee individually, as well as the frequent presentation of similar and repetitive game elements, can increase abandonment levels in the long run [23]. Users do not necessarily have the same style when playing and achieving their tasks and goals, and they are usually motivated by specific game elements and mechanics [44]. Consequently, researchers have focused on adapting gamified environments to meet students’ characteristics [45,46].

As per the Horizon Report 2021 [47], adaptive learning uses technologies that track students’ progress and modify instructional approaches by leveraging data and various information. Adaptive learning technologies “dynamically adapt the level or type of course content based on an individual’s abilities or skill acquisition. This process involves automated interventions and interventions from instructors, all aimed at accelerating the learner’s performance” [48]. Adaptive gamification enhances learner participation by adapting and integrating different game elements and mechanics according to the user’s characteristics [30]. It is designed to incorporate specific elements responsive to the learner. Including all elements relevant to different types of learners carries the risk of creating an excessive user interface overload [49]. However, adaptive gamification is still in its early stages [31].

Based on the available literature, adaptive gamification has yielded various outcomes. While there is evidence supporting the positive motivational impact of adaptive gamification, such as increased engagement [50], motivation [23,51], and retention [49], these effects may not apply to all player types [52,53]. Furthermore, there are instances where students using both adapted and nonadapted game elements have reported similar flow experiences [54]. In terms of learning performance, students have demonstrated higher task completion [22] and course completion rates [23], as well as improved learning outcomes [51]. However, studies investigating student motivation and learning outcomes still need to be expanded and cannot provide a clear overview. Additionally, according to Hallifax et al. [55], conflicting results raise concerns regarding user modelling and selecting relevant game elements.

As Seaborn and Fels [56] have highlighted, the challenges the adaptive gamification approach faces are the interplay between gamification elements, dynamics, and user characteristics. They noted the need for an ideal gamification system to integrate game elements seamlessly. Therefore, the main challenge lies in developing a feasible design and implementation of adaptive gamification that effectively tackles these concerns. This entails utilizing customised game elements to match the students’ characteristics and needs.

2.2. Gaming Elements

Game mechanics are a crucial component of gamification applications, and their significance becomes even more significant in adaptive gamification. According to Kapp [18], game application elements encompass various aspects, including challenges, badges, points, storytelling, etc. These mechanics are employed to enhance engagement and motivation within the gamified experience. Given their influence on students’ behaviour, engagement, and motivation, it is crucial to recognize, select, and apply game elements within gamification. Carefully considering and implementing these elements can significantly impact the overall effectiveness and success of the gamified experience [18,57]. Designing a successful gamification system is complex and contains several inherent difficulties. It is important to note that incorporating numerous game elements simultaneously only sometimes guarantees a practical gamification experience [58]. Indeed, within the literature, different terminologies are used to define what could be the same game element. This variation arises because some works employ definitions at different levels of abstraction. For example, “progression” and “level” may refer to the same game element, depending on how the gamification system is structured or conceptualized. This highlights the need for clarity and consensus in defining and categorizing game elements to ensure effective communication and understanding in gamification research and practice [59].

Furthermore, despite the growing utilization of gamification in education [60], the assessment of the impact of the various game elements in education needs to be supported by factual, empirical findings. More rigorous empirical studies and research in this area are necessary to understand better how specific game elements impact learning outcomes and student engagement. Following the call for a deeper understanding of incentives in such contexts [61], it is strongly suggested [62] that additional studies explore the degree to which game mechanics influence the overall motivations of participants in idea contests. This highlights how specific game mechanics impact individuals’ motivations and engagement in collaborative innovation processes such as idea contests.

2.3. Framework

The framework approach employed in the adaptive gamification environment aligns with the suggestions made by Zourmpakis et al. [31]. This framework revolves around two key factors. The first factor is the player model, which categorizes students’ preferences for playing modes and game elements into six categories based on the Hexad model [2,63]. The categories are [64]:

• Achievers: They are primarily driven by a sense of competence. They enjoy engaging in new experiences and taking on challenges to demonstrate their abilities and accomplishments.
• Players: They are primarily motivated by external rewards. The rewards the system provides highly influence them, significantly impacting their behaviour, even if unrelated to their main progress or objectives. The reward system is crucial in motivating and shaping their engagement within the gamification environment.
• Philanthropists: They are primarily motivated by a sense of purpose. They derive satisfaction from helping others and are willing to offer assistance without expecting anything in return. Their motivation is driven by the desire to contribute and positively impact others rather than seeking personal rewards or gains.
• Disruptors: They are primarily motivated by change. Disruptors tend to push the system’s boundaries, either in a negative manner, such as by spoiling the game for others, or in a positive manner, such as by identifying flaws and working towards improving the system. They desire to challenge and disrupt the status quo, seeking ways to bring change and innovation within the gamified environment.
• Socializers: They are primarily motivated by the need for relatedness. Socializers are intrinsically motivated by interactions with other players and establishing relationships with them (social relatedness). They find fulfilment and enjoyment in engaging with others, fostering social connections, and building community within the gamification context. Interpersonal interactions and social engagement are central to motivating and satisfying their gaming experience.
• Free spirits: They are mainly motivated by autonomy and self-expression. They have a strong desire to be in control of their actions and decisions, preferring to explore the system independently rather than being tightly regulated or controlled. They value the freedom to express themselves and engage with the gamified environment in ways that align with their preferences and interests. Autonomy and the opportunity for self-expression are critical drivers of motivation for free spirits.

The second factor in the proposed framework is learning strategies. Learning strategies significantly shape the learning process’s goals, objectives, paths, and stages. However, due to the potential burden of switching between learning strategies and the nature of science education, the framework focuses on only two preferred learning strategies. This approach aims to reduce the workload associated with adaptation and familiarize students with both learning strategies if adaptation is required. The chosen learning strategies also share common aspects, facilitating the transition between them if necessary. The proposed approach encompasses two adaptation processes: the adaptation of game elements and the adaptation of the learning process. Three main points are considered in adapting the game elements: user feedback, profiling, and adaptation. The system continuously updates the player’s profile throughout the course. This is achieved through in-app dialogues designed to gather the user’s feedback and opinions regarding the game elements. At the end of the lesson, the user is asked questions based on their updated profile. These questions help to customize the game elements and allow the user to select a game element from the second and third-player categories, based on their ranking, to be included.

The basic architecture of the proposed adaptive gamification is as follows:

• The user completes a questionnaire using the Hexad model to create the initial player profile.
• The system selects and applies game elements to the environment based on the player’s profile.
• The player’s profile is updated throughout the course through in-app dialogues to gather feedback and preferences.
• At the end of the lesson, the user is asked questions based on their updated profile to customize the game elements.
• The user selects a game element from the second and third player categories to be included according to the ranking.
• The system adjusts the gamified environment based on the selected game element and updates the player’s profile accordingly.

This basic architecture allows for the personalized adaptation of game elements based on the user’s preferences and feedback, enhancing the overall gamification experience. The framework utilized in the adaptive gamification environment aligns with and builds upon the work conducted by Zourmpakis et al. [31] (Figure 1). For a comprehensive understanding of the adaptive gamification framework, including additional details and explanations, we recommend referring to the research conducted by Zourmpakis et al. [31].

Based on the provided guidelines and methodology, an adaptive gamification environment called “Water Cycle” was developed using the Unity3D game engine. This gamification application focuses on teaching phenomena related to the water cycle, explicitly melting, freezing, boiling, and evaporation.

The “Water Cycle” application is designed as an open-world simulation environment incorporating avatars. After the user completes the questionnaire and creates a profile, they are presented with a text that describes the game’s story based on their profile and the chosen learning strategy.

In the case of exploratory learning, the user assumes the role of a friend of a policewoman, assisting her in investigating various natural phenomena. On the other hand, if problem-solving learning is selected, the user takes on the role of a police officer’s assistant and is assigned tasks to solve specific cases related to the water cycle.

Figure 2 illustrates the user’s freedom to navigate and explore the application. Users can interact with nonplayer characters, engage in conversations, collect materials, conduct experiments, and observe real-life phenomena and sounds. This immersive environment provides users a rich and interactive experience, allowing them to actively participate in and learn about the water cycle through various activities and interactions.

3. Methodology

This quantitative study was conducted in primary schools of Heraklion, Crete, Greece. This research was carried out with the main purpose of defining the motivational impact of primary students on the use of adaptive gamification environments in science education based on their views. The students’ views regarding the game elements they used were also examined.

Initially, it is essential to acknowledge that the examination of water cycle phenomena was selected due to its wide range of practical applications in daily life, as we believed it would captivate students’ interest. Additionally, the water cycle concept and its associated ideas have been incorporated into the recently developed Comprehensive Curriculum in Greece, with teacher training already underway. In this study, we utilized a semi-experimental design with a convenience sample. It occurred in 6 3rd-grade classes in 3 different schools in Heraklion. Students in all classes were taught similarly, using the adaptive gamification application, which ran exclusively on computers. The students that collectively took part were 80. Each class followed four lessons. The concepts taught were coagulation, melting, evaporation, and boiling. The research was implemented in 2 phases. In the first phase, the four teaching interventions were implemented. In the second phase, the students completed the questionnaire. Each class’s teachers conducted the lessons. The elementary teachers were trained beforehand using a theoretical framework centred on integrating technology into the educational process. The teacher training was therefore designed based on the TPASK (technological pedagogical science knowledge) model [65] as it enables the analysis and development of a multifaceted phenomenon such as technology integration while helping to formulate the kind of knowledge that teachers need in order to integrate technology while teaching science concepts into the actual classroom setting. During the research process, we systematically followed all national and international rules for ethics and ethics in research [66], and permission was obtained from the Ethics Committee of the PTPE of the University of Crete.

We initiated the process by considering the primary research inquiries when developing the questionnaire. We then proceeded by consulting the pertinent literature in the field, explicitly referring to Rajendran et al. [67], Halim et al. [68], and Melkersson and Lundin [69] for guidance, insights and designing the survey questionnaire. Furthermore, specific questions were appropriately revised for technological advancements and research on their content or context. Taggart et al. [70] suggested involving experts in developing a questionnaire can enhance its content validity. In creating the questionnaire for this particular study, we employed an iterative approach, which involved the research team in generating the items and sought input from educational technology experts at the University of Crete to review the questionnaire items. The development process encompassed multiple cycles of iteration until the final version was reached.

The Likert scale was used as a measurement for data collection. All categories of questions were scored from 1 to 5 (strongly disagree, disagree, neither agree nor disagree, agree, strongly agree). In total, the questionnaire provided included two categories of questions. In the first category, there were questions about students’ motivation and views on learning science using the adaptive gamification application and their motivation regarding game mechanisms and elements. Regarding the second category, there were questions about all the elements and mechanisms included in the application. However, before answering about a mechanism, students were asked to select whether they had encountered or used that particular element. Students answered only about game elements they had encountered and used in the app. Each item had the same six appropriately tailored questions. The questionnaire included nine questions for Category 1 and 66 questions (11 items) for Category 2.

It should be noted that in two out of the six classes, there were more students than there were computers, by a few. In order to avoid splitting the classes in half, some students were grouped the first time based on their profiling and, more accurately, their dominant type. This was performed to ensure that the grouped students would have, as much as possible, similar characteristics relative to each other. Though this ensured that most students had similar characteristics, not all students that were put together liked teamwork necessarily. As such, though the grouped students had roughly similar characteristics based on their primary player type, some had to cooperate even though they would not have wanted to. However, students in the free spirits category were not grouped, as this would have substantially affected their experience. The results were analyzed using the SPSS statistical package.

4. Results

The first category had nine items, graded on a Likert-type scale of 1 to 5, with the intent to examine students’ motivation and views about learning science using the adaptive gamification application. The information collected was organized into

Table 1. Students’ motivation and views about learning science using the adaptive gamification application.

Questions	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
I like to learn about natural phenomena using applications like the one with the water cycle application	0	0	7.5	32.5	60.0	4.53	0.636
2. I am interested in learning about natural phenomena in school.	0	3.8	7.5	37.5	51.3	4.36	0.783
3. I prefer to spend more time learning about natural phenomena from other subjects.	5	2.5	22.5	28.8	41.3	3.99	1.097
4. I can learn natural phenomena using applications such as the Water Cycle.	2.5	2.5	6.3	36.3	52.5	4.34	0.899
5. I feel more confident learning about natural phenomena in a fun way.	1.3	2.5	13.8	30.0	52.5	4.30	0.892
6. The classroom lesson on natural phenomena is boring.	26.3	11.3	17.5	12.5	32.5	3.14	1.613
7. Learning about natural phenomena such as the water cycle increases my interest in learning.	0	5.0	6.3	31.3	57.5	4.41	0.822
8. Using apps like the one with the water cycle makes me want to learn more about natural phenomena and be good at it.	7.5	1.3	6.3	30.0	55.0	4.24	1.139
9. Using applications like the Water Cycle to learn about natural phenomena makes me feel less nervous in class.	10.0	2.5	21.3	26.3	40.0	3.84	1.267

, as presented below, and was subjected to descriptive analysis.

Based on Table 1, students showed their substantially high-levelled fondness for learning science while using the adaptive gamification application (M= 4.53), with 92.5% agreeing or strongly agreeing (Q1). Though students seem to be highly interested in learning science concepts in the school setting (Q2) (M = 4.36) and even showed a preference for science education and would rather spend more time in it than other subjects (M = 3.99), nearly half of them (45%, agree or strongly agree) consider the traditional teaching that occurs in the classroom regarding science education to be dull (Q6). Furthermore, this impacted their level of confidence in learning, as students expressed feeling more assured in understanding natural phenomena through an enjoyable approach (M = 4.30) (Q5). A significant 52.5% of students strongly agreed with this notion. However, in contrast to traditional classroom teaching methods, students reported a significant increase in their interest in learning through the adaptive gamification environment (mean = 4.41) (Q7). Only a tiny percentage (5%) expressed disagreement with this statement.

Additionally, students displayed higher motivation and perceived the application as a valuable learning tool for studying science (mean = 4.34) (Q4). Moreover, 85.5% of students agreed or strongly agreed that the application fostered a greater desire to learn and excel (Q8). Finally, using the application positively affected students’ nervousness (mean = 3.84), with nearly two-thirds of students agreeing or strongly agreeing that they felt more relaxed and less nervous while engaging in the learning process (Q9).

The second category aimed to assess the impact of game elements and mechanisms students encountered in the adaptive gamification environment on their motivation. This category comprised 11 subcategories, each representing a distinct game element. Within each subcategory, six questions were modified to convey the same meaning. At the start of each subcategory, the initial question was to establish whether the student had encountered that specific element in their playthroughs. If the student had not encountered it, they would mark “NO” and move on to the following subcategory, skipping the current one. If the student answered affirmatively, they would respond to the following five questions within that subcategory. Like the first category, the descriptive analysis examined all the questions.

Table 2. Badges and currency.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Students’ motivation for badges	I liked the app because it had badges.	60	5	0	10	36.7	48.3	4.23	0.998
	I was actively trying to get badges.	60	0	3.3	11.7	33.3	51.7	4.33	0.816
	I collected the badges I wanted to collect.	60	3.3	10	15	23.3	48.3	4.03	1.164
	I loved collecting badges.	60	0	0	11.7	21.7	66.7	4.55	0.699
	I got nervous trying to collect badges (reversed question).	60	46.7	6.7	10	18.3	18.3	2.55	1.641
Students’ motivation for currency	I liked the app because it had currency/money.	61	6.6	9.8	19.7	26.2	37.7	3.79	1.24
	I was actively trying to earn money.	61	4.9	3.3	8.2	29.5	54.1	4.25	1.075
	I earned the money I wanted to raise.	61	13.1	11.5	24.6	19.7	31.1	3.44	1.385
	I liked to earn money.	61	0	1.6	19.7	24.6	54.1	4.31	0.847
	I was stressed trying to save money (reversed question).	61	36.1	19.7	9.8	18	16.4	2.59	1.532

presents the first two game elements: badges and currency. Among the 80 students, it was found that 60 students had encountered badges in at least one of their playthroughs, while 61 students had experienced the currency mechanism at some point during their learning process. In the case of the badges element, students admitted to being fond of the application since it contained badges (M = 4.23), with almost half of them strongly agreeing with the notion. Furthermore, the participants expressed their strong fondness for the badges (M = 4.55), with no one expressing disagreement or strong disagreement. They also demonstrated significant effort in actively seeking to obtain badges while using the app (M = 4.33). The majority of students were successful in acquiring the desired badges (M = 4.03). However, almost one out of three students (36.9%) agreed or strongly agreed that they experienced nervousness while attempting to collect badges.

Regarding the in-app currency, the students were highly interested in earning money (M = 4.31) and actively pursued it within the game (M = 4.25). However, their fondness for the application decreased slightly due to the currency mechanism (M = 3.79). This decline could be attributed to their inability to earn the desired amount of money, as only about half admitted to achieving this goal (50.8% agreed or strongly agreed). Additionally, over 34.4% of participants reported feeling stressed while trying to acquire money (agreed or strongly agreed).

As indicated in

Table 3. Cases/storytelling and points.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Students’ motivation for the cases/storytelling	I liked the game because it had cases.	77	1.3	1.3	7.8	28.6	61	4.47	0.804
	I was actively trying to solve the cases.	77	2.6	1.3	6.5	31.2	58.4	4.42	0.879
	I investigated and solved the cases to the best of my ability.	77	3.9	0	5.2	23.4	67.5	4.51	0.912
	I liked solving cases.	77	1.3	1.3	9.1	26	62.3	4.47	0.821
	I used to get nervous when solving cases (reversed questions).	77	40.3	13	16.9	13	16.9	2.53	1.535
Students’ motivation for points	I liked the app because it had points.	72	4.2	0	13.9	41.7	40.3	4.14	0.954
	I was actively trying to score points.	72	4.2	2.8	1.4	33.3	58.3	4.39	0.972
	I collected the points I wanted to collect.	72	5.6	9.7	16.7	22.2	45.8	3.93	1.237
	I liked to score points.	72	5.6	1.4	4.2	26.4	62.5	4.39	1.042
	I used to get nervous when I was trying to score points (reversed question).	72	41.7	20.8	8.3	11.1	18.1	2.43	1.555

, the following game elements include the storytelling/cases element and points. The data from Table 3 reveals that most students experienced these elements, with 72 students reporting the point element, while only 3 out of 80 individuals did not report encountering the storytelling/cases element. The cases/storytelling game element appears to be highly appreciated, as nearly 9 out of 10 students (88.3%) agreed or strongly agreed that they enjoyed solving cases (M = 4.47) and liked the application more because of the inclusion of this specific game element (89.6%) (M = 4.47). Furthermore, a similarly high percentage of participants expressed their active and enthusiastic engagement with this element (89.6% agree or strongly agree) (M = 4.42) and reported success in following the story and solving the cases (90.9% agree or absolutely agree) (M = 4.51). However, almost 3 out of 10 individuals (29.9% agree or absolutely agree) admitted feeling nervous while attempting to solve the cases.

Regarding the points element, the majority of participants expressed their fondness for it (M = 4.39), and nearly 8 out of 10 individuals (80%, agree or absolutely agree) appreciated the adaptive gamification environment more because it included this specific game element (M = 4.14). Most students were highly focused and made significant efforts to accumulate points (M = 4.39). However, not all students successfully attained the desired points, as approximately 2 out of 3 (67%) agreed or strongly agreed that they could collect the points they wanted (M = 3.93). Furthermore, almost 1 out of 3 participants (33%) reported feeling nervous (agree or strongly agree) while trying to earn points.

Table 4. Gifts and levels.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Students’ motivation for gifts	I liked the app because it had gifts.	24	0	0	4.2	37.5	58.3	4.54	0.588
	I was actively trying to get gifts.	24	8.3	0	8.3	29.2	54.2	4.21	1.179
	I collected the gifts I wanted to collect.	24	8.3	0	25	16.7	50	4	1.251
	I like collecting gifts.	24	0	0	12.5	25	62.5	4.5	0.722
	I used to get nervous when collecting gifts (reversed question).	24	41.7	12.5	16.7	16.7	12.5	2.46	1.503
Students’ motivation for levels	I liked the app because it had levels.	76	1.3	0	17.1	36.8	44.7	4.24	0.831
	I was actively trying to climb levels.	76	2.6	5.3	10.5	19.7	61.8	4.33	1.038
	I raised to the level I wanted to.	76	9.2	9.2	18.4	22.4	40.8	3.76	1.325
	I liked going up levels.	76	1.3	1.3	13.2	25	59.2	4.39	0.865
	I used to get nervous when trying to go up levels (reversed question).	76	47.4	21.1	9.2	3.9	18.4	2.25	1.533

presents the motivation levels related to the gift and levels of game elements. According to Table 4, a small number of students (24 participants) encountered or noticed the gift game element, whereas most students (76 out of 80) experienced the level mechanism. As indicated in Table 4, a few students (24 participants) encountered or noticed the gift game element. However, despite the limited exposure to this element, the students showed a strong affinity towards it (M = 4.50) and liked the application because of its inclusion (M = 4.54). Surprisingly, none of these students disagreed with the gift game element (disagree or absolutely disagree). Most students actively engaged with the gift game element and tried to acquire gifts (M = 4.21). Two out of three students (66.7% agree or absolutely agree) reported successfully collecting a significant number of the gifts they desired (M = 4.00). However, similar to previous findings, almost three out of ten individuals (29.2%) experienced significant stress (agreed or absolutely agreed) while engaging with the gift game element. The levels element was also well-received, with 84.2% of participants liking this specific game element (M = 4.39).

Additionally, 80.5% of students were fond of the application because it included the element of the level (M = 4.24) (agreed or absolutely agreed). Furthermore, a significant majority of students (81.5%) actively attempted to reach higher levels during their playthrough (M = 4.33), with nearly two out of three students (66.7%) successfully achieving this goal (agreed or absolutely agreed) (M = 3.76). The stress levels associated with levelling up were relatively low, as only about one out of five students (22.3%) absolutely agreed or agreed that they felt nervous while trying to progress to higher levels.

Based on the data in

Table 5. Promotion and cooperation.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Students’ motivation for promotion	I liked the app because I could get promoted.	61	1.6	0	14.8	34.4	49.2	4.3	0.843
	I was actively trying to get promoted.	61	3.3	6.6	13.1	27.9	49.2	4.13	1.087
	I got the promotions I wanted in the app.	61	6.6	6.6	14.8	24.6	47.5	4	1.225
	I liked getting promoted.	61	1.6	1.6	6.6	32.8	57.4	4.43	0.826
	I used to get nervous when trying to get promoted (reversed question).	61	42.6	16.4	9.8	9.8	21.3	2.51	1.619
Students’ motivation for cooperation	I liked the app because I could collaborate with/help other students.	57	5.3	5.3	3.5	22.8	63.2	4.33	1.123
	I actively tried to cooperate with/help other students.	57	7	5.3	7	33.3	47.4	4.09	1.184
	I cooperated/helped the other students I wanted to help.	57	1.8	7	10.5	26.3	54.4	4.25	1.023
	I liked working with/helping other students.	57	5.3	3.5	5.3	31.6	54.4	4.26	1.078
	I was stressed when trying to cooperate/help other students (reversed question).	57	38.6	14	5.3	14	28.1	2.79	1.719

, 61 students came across the promotion element, while 57 students cooperated with other peers and essentially used the cooperation element. The promotion element was highly regarded, as most students expressed their fondness for this element (M = 4.43) and approved of the adaptive gamification environment because of its inclusion (M = 4.30). Additionally, nearly three out of four individuals (77.1% agree or absolutely agree)) actively made an effort to get promoted during their gameplay (M = 4.13), and approximately seven out of ten students (72.1% agree or absolutely agree) successfully achieved their desired promotion (M = 4.00). However, it is worth noting that a fair number of students (31.1% agree or absolutely agree) reported feeling stressed concerning the promotion element. The cooperation element garnered significant appreciation, as many individuals expressed their fondness for working with other students (86% agree or absolutely agree) (M = 4.26).

Similarly, the same percentage of students liked the application specifically because it included the cooperation mechanism (86% agree or absolutely agree) (M = 4.36). However, it is worth noting that the negative responses for both questions were around 10%, one of the highest among all the other game elements. Furthermore, a substantial majority of students (80.7%) agreed or absolutely agreed that they actively tried to cooperate with their peers (M = 4.09), and the same percentage believed that they were successful in achieving cooperation based on their perspective (M = 4.25). Unfortunately, the stress levels reported by the students concerning the cooperation element were relatively high, with 42.1% agreeing or strongly agreeing that they felt stressed. This could be understood considering that a few students were not keen on working together, leading to higher stress levels than other game elements.

The following two game elements, as highlighted in

Table 6. Challenges and customization.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Student motivation for the challenges	I liked the app because it had challenges.	80	2.5	2.5	10	38.8	46.3	4.24	0.917
	I was actively trying to overcome challenges.	80	3.8	1.3	11.3	27.5	56.3	4.31	0.988
	I overcame the challenges I wanted to overcome.	80	6.3	7.5	13.8	22.5	50	4.03	1.232
	I like to overcome challenges.	80	2.5	5	3.8	28.8	60	4.39	0.961
	I used to get nervous when overcoming challenges (reversed question).	80	51.3	11.3	8.8	13.8	15	2.3	1.562
Student motivation for customization	I liked the game because of the change in appearance.	26	11.5	3.8	19.2	23.1	42.3	3.81	1.357
	I was actively trying to change my appearance.	26	0	11.5	15.4	30.8	42.3	4.04	1.038
	I managed to change my appearance as many times as I wanted.	26	42.3	15.4	19.2	7.7	15.4	2.38	1.499
	I like to change my appearance.	26	0	4	32	16	48	4.08	0.997
	I used to get anxious when I tried to change my appearance (reversed question).	26	50	7.7	19.2	15.4	7.7	2.23	1.423

, include challenges and customization. According to the methodology employed in the adaptive gamification environment, all profiles created by the dominant player type and the two higher player types lead to the inclusion of the challenges in all possible profiles. As depicted in Table 6, all participants noticed and experienced the element of the challenge, while only 25 individuals encountered the customization element. Students demonstrated a strong affinity for the element of the challenge, with 88.8% agreeing or agreeing that they enjoyed facing and overcoming challenges (M = 4.39). Furthermore, 85.1% of students agreed or absolutely agreed that including challenges in the application made them appreciate it more (M = 4.24). Most students actively worked to overcome the challenges they encountered (M = 4.31), and most expressed satisfaction in successfully overcoming the challenges they set out to do (M = 4.03). However, like other game elements, nearly 3 out of 10 students reported feeling nervous while attempting to resolve the challenges.

Regarding the customization element, students displayed a significant fondness for the ability to change their appearance (M = 4.08). However, they could have appreciated the adaptive gamification environment more due to the inclusion of this game mechanism (M = 3.81). A total of 15% of the students stated that they did not like or dislike the application because it contained this element, the highest among all other elements. This response is understandable, considering the data presented in Table 6. Although students actively tried to change their appearance (M = 4.04), only a few could do so to the extent they desired, as more than half of the students stated that they could not achieve their desired customization (57.7% absolutely disagree or disagree). Fortunately, the stress levels associated with the customization element were similar to some of the other game elements, with 23.1% of students reporting significant stress levels (agree or absolutely agree).

Table 7. Roles.

Subcategory	Questions	Participants Answered	Absolutely Disagree (%)	Disagree (%)	Neither Agree nor Disagree (%)	Agree (%)	Strongly Agree (%)	Mean Average	Std Deviation
Student motivation for the roles	I liked the game because I had a role.	78	1.3	5.1	5.1	32.1	61.5	4.53	0.716
	I was actively trying to “play” my role.	78	0	2.6	9	29.5	59	4.45	0.767
	I wanted to and succeeded in improving my role within the application.	78	9	2.6	7.7	19.2	61.5	4.22	1.255
	I liked having a role within the app.	78	0	2.6	6.4	32.1	59	4.47	0.734
	I was nervous when I had a role within the app (reversed question).	78	48.7	10.3	12.8	10.3	17.9	2.38	1.589

illustrates the last game element included in the application, the roles game element. According to the data, almost all participants (except for 2) noticed and experienced the roles game element. This element received highly positive feedback (M = 4.47), with 91.1% of participants (agree or absolutely agree) expressing their liking for having a role in the application. Additionally, an almost similar percentage (93.6%, agree or absolutely agree) expressed fondness for the application due to the inclusion of this element (M = 4.53). Students showed great interest and actively engaged in “playing” their roles (M = 4.45), with approximately 8 out of 10 students (80.7%, agree or absolutely agreeing) succeeding in improving their role during gameplay (M = 4.22). However, nearly 1 out of 4 individuals reported feeling nervous to a significant degree (agree or absolutely agree) while participating in their assigned roles.

5. Discussion

The current research study provides valuable insights into the field of adaptive gamification, particularly in the context of science education. While limited research exists on gamification in science education [17], and even fewer studies focus specifically on students’ motivation using adaptive gamification applications, most existing studies generally compare gamification and adaptive gamification in a general manner [71]. This study acknowledges that students’ motivational aspects can be influenced by their activities and the specific domain or content [59]. Therefore, drawing generalized conclusions about the affordances of adaptive gamification becomes challenging. The objective of this study is to offer an understanding of the motivational impact of a domain-specific adaptive gamification framework on students in the field of science education, as well as how the gaming elements they encountered influenced them.

In terms of motivational aspects, the findings of this study indicate that participants displayed a higher level of motivation towards learning science when using an adaptive gamification environment. Students strongly preferred the application as a means of learning science, with no students disagreeing or strongly disagreeing. They also reported an increased interest in learning through this approach, with only a tiny percentage (5%) expressing disagreement. These results demonstrate that students felt motivated and highly interested in learning science when incorporating the adaptive gamification environment. Additionally, a significant portion of students found traditional classroom lessons boring. However, the data suggests that it is not the content that discourages students from learning science, as they demonstrated a high interest in learning about natural phenomena and even preferred science over other subjects. Students associated their confidence with the “fun” aspect of learning, indicating that a more engaging and enjoyable learning approach can significantly impact their level of engagement and confidence. This is evident because students believed they could learn science concepts through the application and were willing to enhance their understanding of natural phenomena through its use. This finding aligns with previous studies indicating that gamification environments, which offer an enjoyable approach to learning, can enhance student engagement and foster a greater willingness to engage with similar applications in the future [72]. Furthermore, many students reported feeling less nervous during the learning process when using the adaptive gamification environment, which increased their attentiveness in the classroom and their readiness to improve their performance in science lessons.

In addition, we examined the impact of game elements on students’ motivation. It is important to note that the game elements and mechanisms were not implemented simultaneously in this adaptive gamification application. Our framework employed a multidimensional adaptive design, unlike most previous studies that followed a single-dimensional personalization approach [71]. This design allowed for runtime adaptation, resulting in a more comprehensive personalization [31]. Based on our findings, it became evident that at least some students experienced adaptation in their profiles, leading to variations in the game elements they encountered. This was reflected in the number of elements reported by students and the possible combinations they experienced. These insights highlight the dynamic and personalized nature of the adaptive gamification approach used in this study [31].

Based on these findings, the adaptation process was largely successful, as students generally liked the game elements integrated into their lessons. However, the meagre negative ratings regarding the likeness and appreciation of the application suggest that either the adaptation was applied to a small number of individuals or it was implemented on a limited scale, such as switching between closely related user types (e.g., player and achiever) or adjusting the secondary and tertiary dominant user types. Nevertheless, regardless of the specifics, the multidimensional framework, which considered more than just a single user type, effectively enhanced students’ experiences and engagement. A similar study also supports this conclusion [71].

Additionally, it was observed that badges, storytelling/cases, gifts, and roles received the most positive feedback from students and contributed to their appreciation of the application. This suggests that students’ motivation is greatly influenced by their immersion in the storytelling aspect, the role they assume within the application, and the rewards that symbolize their status and self-improvement. The connection between immersion in storytelling/narrative elements and its positive impact on student engagement aligns with findings from other studies [73]. Similarly, the positive relationship between badges and student motivation and engagement has been documented in previous research [19]. These findings further support that these game elements effectively enhance students’ motivation and engagement in the learning process.

What is more, the satisfaction of individuals with using game elements did not necessarily impact their level of active engagement or fondness for the application. Lower scores in satisfaction did not lead to a corresponding decrease in fondness of the application. However, user satisfaction was generally lower than active engagement and fondness, except for cases/storytelling, roles, and cooperation. This suggests that students were primarily satisfied by the immersive aspects of the application, which is consistent with the findings of Aldemir et al. [73], highlighting the importance of immersion for the storytelling element to affect motivation and engagement. The application has room for improvement concerning other game elements, particularly in customization, levels, and currency, which received lower satisfaction scores.

Regarding cooperation, it is not easy to draw confident conclusions about student satisfaction since it was also used by some students who may have yet to be inclined to use it. Students were less active in the cooperation element, but their satisfaction was higher. This indicates that even though some students did not put in their maximum effort to cooperate with others, possibly because they did not have a strong desire for it, the results were better than expected, resulting in higher satisfaction. We cannot make assumptions about the specific user types and their interactions with most of the game elements, as we need to have information about the profile of each user and the ability for user types to change during gameplay. However, all user profiles consistently utilized the challenges game element [31]. It was found that challenges received high approval rates among all user types, promoting high levels of active engagement and satisfaction [73]. This suggests that the intrinsic motivation for accomplishment has a noticeable effect on the achiever type [64] and all user types. However, it is impossible to determine to what extent each user type is affected by this game element.

Moreover, games are commonly associated with stress reduction for individuals [74]. Based on our findings, most game elements did not induce high-stress levels, as the percentage of individuals who agreed or mostly agreed that a game element or mechanism made them anxious was generally below 30%. However, this differed for the cooperation, badges, and currency elements. The higher level of anxiety reported for the cooperation element can be understood since some students were required to cooperate even if they did not want to. The previous literature has shown that badges can generate a certain level of anxiety [69], which aligns with our results. However, the same does not apply to the currency element. The anxiety associated with this element is likely a result of students being highly active and striving to earn money during their playthrough but ultimately failing to do so.

Consequently, not being able to accumulate enough money to make in-game purchases and acquire items they had set their minds on could contribute to their anxiety. Furthermore, the element of the challenge involved the use of timers, as difficulty and assistance were linked to time. However, students did not report higher stress levels than most other game elements, contrasting with findings from other research studies [75].

6. Limitations

The present study has certain limitations. Adaptive gamification was introduced to enhance the effectiveness of one-size-fits-all gamification. While we examined the motivational outcomes of students in the adapted gamification environment, we did not compare it to a one-size-fits-all gamification approach. As a result, this study cannot provide definitive results on whether this objective was achieved. Additionally, our findings are limited to the specific game elements incorporated in our adaptive gamification approach. We did not include every game element mentioned in gamification literature, such as leaderboards and team chats. Different outcomes may be observed by integrating these or other game elements.

Moreover, in this study, we did not consider other essential user characteristics regarding gamification, such as gender differences. In addition, each learning course was carried out by the teacher of that class. Though all teachers had been trained to use the adaptive gamification environment before teaching in the school setting, it is still possible to have affected students’ motivation from the learning experience. Furthermore, knowing students’ profiles would provide more insight into the accuracy of the Hexad typology, the frequency of profile changes, whether changes occurred collectively or individually, and the frequency of adjustments, particularly to the dominant profile. Additionally, it would offer a more detailed and precise understanding of how each game element affects each profile [3,76]. Finally, this study needs to be more extensive concerning our results’ context dependency and generalizability. Long-term studies could also ensure that the motivational outcomes are not due to the novelty effect. The framework used was specifically designed for the science education learning environment, and results may differ in other domains, as Hallifax et al. [3] suggested.

7. Conclusions

This article showcased the results of a quantitative semi-experimental investigation into the impact of adaptive gamification on learner motivation and perceptions in science education. The study was conducted in four primary schools located in Heraklion, Crete, Greece. The data collected and analyzed involved 80 students from six distinct classes who had completed four custom-designed learning modules focused on water cycle science concepts. These modules incorporated a specialized adaptive gamification framework tailored to the subject matter.

Our findings offer new perspectives and enhance the utilization of adaptive gamification. We discovered valuable insights into how to customize gamification, particularly by demonstrating that the Hexad user typology is one of the most relevant approaches for identifying user preferences regarding game elements. However, in this implementation, the adaptation of game elements and learning strategies was not solely based on a single user type. We recognized that motivations can be fluid and may change during gameplay. Therefore, the foundation for adaptation was the learner’s profile rather than a static adaptation that classifies individuals solely based on their user profiles after an initial selection, as proposed in the literature [2,55].

Nonetheless, since the appropriate game element is tailored to the specific learner profile, it still promotes self-determination. The results obtained by examining each game element emphasize that they have varying effects on learners’ motivation, as shown by previous research [75]. It is crucial to exercise caution when suggesting game elements to learners, as these elements may have conflicting impacts depending on their profiles [75].

According to Hallifax et al. [3], user motivation in tailored gamification is influenced by two significant factors: implementing a specific motivational strategy and selecting the user typology or profile. Both factors are considered in this case, with the results being extremely positive. However, it is essential to note that teachers also play a crucial role. Though the teachers in this study had volunteered and were trained in utilizing this application in class, the inability to effectively utilize digital content from a pedagogical standpoint has been shown to impact students negatively, such as increased discouragement and reduced learning motivation [77,78]. Thus, considering that the influence of teachers’ views and attitudes is essential when introducing new teaching methodologies into the learning process, it is crucial to maximize a learning tool’s positive benefits on students’ motivation to learn [27,79].

Moreover, future research is recommended to examine personalization’s effects in user studies conducted over an extended period. This would enable investigating whether the enhanced user experience translates into improved performance over time. Alternatively, offering users the option to decide whether they want to use the system regularly would provide further insights into potential effects on user behaviour, and this aspect could be explored in future studies as well.

Additional studies that address our research’s limitations and explore the effectiveness of similar adaptive gamification applications in science education would be beneficial. These studies could validate and generalize the results while providing valuable insights for future design modifications to enhance the learning experience. Additionally, it is crucial to investigate learning achievements. Measuring both learning outcomes and motivational aspects is equally important to comprehensively assess adaptive gamification’s effectiveness in education. By examining the impact on learning outcomes, such as knowledge retention and skill acquisition, alongside motivational factors, we can better understand the effectiveness and potential benefits of implementing adaptive gamification in the learning process [72,80]. Consequently, properly developing applications for science teaching concepts is crucial for motivating students to actively participate and engage with the material [17,81]. Moreover, the development of similar content-specific adaptive gamification environments holds the potential to benefit other subject areas beyond science education.