2. Study Scope, Research Question and Contribution
This study is inspired by the game Tic-Tac-Training [
24] to promote sustainable behavior concerning adult active transportation. Tic-Tac-Training is a variation of the classical game Tic-Tac-Toe; here, players collaborate in teams competing against other teams, instead of having two players as in the classical game. The gameboard in Tic-Tac-Training has several sizes, and all of them are much larger than the classical 3 × 3 tile game board. To claim tiles, users perform a task related to PA or healthy living that could be customized, thus allowing the system to be used in several contexts. Battleship-PA was inspired to allow hosts to customize tasks and players performing tasks before claiming a tile as well as the system architecture. Tic-Tac-Training was designed for competition among multiple teams and provided some drive to players to continue gameplay over multiple matches.
An earlier study showed that the competitive approach was not satisfactory or well-suited for children because they largely desire cooperation, teamwork, and collaboration over competition [
25]. Tic-Tac-Training was designed and developed for adults in workplaces, but children have distinct and peculiar viewpoints about games and what motivates them in interesting games. Therefore, it becomes important to reconsider the game development approaches and seek better ways to encourage children to be physically active. The novelty of this study is focused mainly on adapting an existing classical game, Battleship, to allow students and teachers to create tasks that suit their orientation of PA. Previous studies have shown the importance of the active involvement of end-users in the design and development of digital technologies—especially technologies that focus on behavior change [
24]. Moreover, the opportunity for teachers to create their own tasks in the game, e.g., from the curriculum, makes it more attractive to use the game in school contexts when aiming to increase child PA. There is also a need to consider other focus areas of the game and technology development to address the needs of society, such as health, wellbeing, and climate action by factoring in the expectation and needs of end-users.
The end-user’s experience should be applied in the creation of gamification experience and digital solutions for behavior change [
24]. As the first step in game adaptation, we created a digital version of the Battleship game to understand if it would be playable by the students. In a previous intervention in a school setting, we aimed to increase physical activity in the form of active school transportation. Assignments designed by teachers and connected to the curriculum were used as gamification elements to increase the children’s motivation for active school transport as well as increasing teachers’ engagement [
26,
27]. Therefore, in the design phase of the Battleship-PA, we wanted to create a game that allowed teachers to create assignments that integrate learning activities into the game while also increasing PA. To understand how PA can be promoted in formal, informal, and non-formal school settings through gamification, we applied here an iterative game development life cycle. This model transforms the classical strategy 2-player Battleship game into a multiplayer PA game, Battleship-PA, that features cooperative, teamwork, and collaboration elements. Using a mixed-method research approach, we evaluated the first prototype of the Battleship-PA to determine user experience and impact.
The specific research question guiding this study is, what is the user experience and impact of the Battleship-PA game to promote motivation for physical activity among school-aged children in an informal setting?
This study is part of a multidisciplinary project “Sustainable Innovations for Children Transporting Actively (SICTA).”. Among other things, the SICTA project aims to develop novel ideas and ways to apply gamification to increase children´s PA and to engage in active school transport.
2.1. Our Contributions: Initial Design, Development and Implementation of Multiplayer Cooperative Game, Battleship-PA, to Promote Active School Transport
2.1.1. Initiation
A low fidelity prototype of the Battleship game was developed using an iterative game development life cycle (GDLC) [
28] and inspired by the Tic-Tac-Training game [
24]. The GDLC presented in
Figure 1 consists of six stages: initiation, pre-production, production, testing, beta, and release.
The battleship game was chosen because of its closely related features with the Tic-Tac-Toe game used in the previous study and that inspired this study. Similar to the Tic-Tac-Toe game, Battleship is a two-player strategy game that supports cooperation, collaboration, teamwork, and competition. Both games can be tweaked and implemented as a multiplayer game. One unique feature of the Battleship game that makes it appealing for this intervention is the large size of the game board (10 × 10 grid). More tasks can be generated during gameplay with a higher number of grids. These tasks are PA-oriented and are meant to allow users to perform PA while playing the game. The Tic-Tac-Training game presented in [
24] was targeted at adults in workplaces.
Initiation describes the initial rough idea of the game, pre-production defines the idea, and production is the core development of the idea and testing consisting of users tested the developed version. After the testing stage evaluates the game, the process goes back to pre-production with insights gained from the testing stage. If the game is deemed to be sufficiently refined after the testing stage, then the development process proceeds into the beta testing stage, thus letting third party users or external testers play the game; the game is then released to the public.
2.1.2. Pre-Production
This study presents the iterative game development process of Battleship-PA followed by gameplay, testing, and formative evaluation in an informal school setting. Finally, we apply the Octalysis framework [
12] to analyze the implemented features of Battleship-PA, including how it connects to the eight core drives of gamification, to examine whether it has the potential to change children’s behavior around PA in the future. The lessons learned here synthesize the experiences acquired from the entire process and provide valuable information not only for game developers, but also for other stakeholders that use persuasive game technology for behavioral changes in children regarding their PA.
2.1.3. Production: Basic Gameplay of Battleship-PA
This game is a web-based variation of the classical game “Battleship.” The goal is to encourage schoolchildren´s PA. Battleship-PA gives the players a cooperative and competitive experience that extends the basic concepts from the classical version of Battleships. In the classical version, two players first place their ships on their own board and then take turns guessing where the opponent’s ships are placed on their board. They gain points by correctly guessing their opponent’s ship’s placements. The match ends when one player has found all the other player’s ships.
Battleship-PA uses a web-based version. It can have several players, and both teams’ ships are placed randomly on their board or may be adjacent to other ships.
Figure 2a shows the game board when newly created. Teams still score by correctly guessing the other team’s ships positions. The team must complete a physical task in order to guess. We consider the process of completing the physical task, following certain rules as gamification. The process of performing the physical activity (i.e., gamifying the activity) while playing the Battleship game is the primary source of gamification in the current version of the prototype application. The assignments that the teacher/instructor provided in the game during the physical activity is the idea for gamification, mixing learning experiences with physical activity in a gamification setting, for example, looking for traffic signs on their way to school, or counting the number of steps on their way. All of the current and future gamification elements are presented in the discussion section. We intend to use the evaluation results and feedback to add additional gamification features. Before deciding which tile to guess, teams can hover or click the tile to discover the task description, to understand how to perform the task.
Figure 2b presents the task popup example, and
Table 1 shows some examples of physical activity tasks that are gamified in the current version of Battleship-PA. Reading is crucial, as the board simply shows an icon that might not convey the task’s requirements. Other tasks might have the same icon; therefore, reading is important to differentiate tasks with the same icon. The teams do not have to take turns, which suggests that one team can guess several times before the other team can guess. Therefore, completing tasks faster than the other team is a valid strategy to win the match. The process is performed similarly to the classical version—correctly guessing all the other team’s ships. The ships are formed by guessing the correct tiles, which will be indicated with a green color.
Figure 2c shows the difference between ships, misses, and unclaimed tiles.
Figure 2d presents the winning message, e.g., a case where Team 1 has won.
2.1.4. Match and Task Creation
The welcoming screen presents an interface for users to log in (
Figure 3a) and have a view of the current state of the game (
Figure 3b). Creating a Battleships-ST match is simple: All users can create matches by choosing the create match option in the navigation bar (
Figure 3c) and taking the host role for that particular match. This will create a lobby with a six-character code for joining the game, which consists of capital letters and randomized numbers; the backend ensures that the code is unique. Users then enter the code in the join match option in the navbar and then join one of the two teams in the lobby. They can then switch teams before the match has begun (
Figure 3d). The host has an option to proceed from the team lobby to create tasks for the match while other users are still in the lobby. A task is made up of a description and an icon. The description is written by the host, and an icon is then chosen from a dropdown menu and then submitted. The icon should be linked to the description so that users can easily categorize tasks by simply observing the board. For example, for a task with the description “bike to school”, a bike icon would be most fitting since the task involves biking. Submitted tasks are placed in the task list and can be removed by the host if they wish by clicking the trashcan button (
Figure 3e). The host can proceed whenever they decide that enough tasks have been added. They can then start the match, and the board will then be populated with randomly selected tasks from the task list. Since the selection is completely random, some tasks might appear more frequently than other tasks, and there is a chance that some tasks do not appear at all.
2.1.5. Architecture and Implementation
Battleship follows a client–server architecture model that web-based clients can access with a web browser.
Figure 4 illustrates the game architecture implemented with Angular, NodeJS, Sequelize ORM, and MariaDB technologies. The frontend architecture splits features into several angular services that are accessed using the user interface (UI). The components are related to the gameboard, e.g., uses board (for general gameplay), team, and match services (for general game variables). Similarly, the match creation components utilize task, match, auth, and team creation services. The login components use the auth service to allow logins and creation of users. The Angular services then communicate with the backend managers using a REST API. The backend consists of several Sequelize managers that perform various database actions to handle data on users, boards, teams, matches, etc.
The UI client is only optimized and tested on Google Chrome. The game runs on other browsers and devices, but the game might not be as visually appealing, and some features might not operate properly on other browsers and devices. The frontend UI components are presented to the user with dynamic HTML templates, with data provided by the angular components. The visuals of HTML templates are styled using CSS style sheets.
2.1.6. Current State of the Game—Low Fidelity Prototype
The game currently has several features available from the UI for the users. Users can create accounts and log in to these accounts. The accounts are very simple and only have a username and an ID. The login component simply checks if the username exists in the database. If it does, then the user proceeds to the overview page. The overview page has a list of the matches that the user is in. There is also a navigation bar that has three options: home, create match, and join match. The home button takes the user back to the overview page if the user is not already on the overview page. The join match button opens a field with a six-character join code of numbers and capital letters. Submitting a valid code lets the user join an existing match and one of the two teams. The create match creates a match, a join code, and a lobby for the two teams. The user who created the match has the role of host for that match. A host can proceed from the team lobby and create tasks and then start the match.
When a match has started, all users who are in a team that is in that match will enter the game board if they are still in the lobby; otherwise, they can join from the overview page. The board has 8 × 8 tiles, where each tile has a task that should be performed before claiming that tile that could hide a ship. On the board, tiles can be claimed by clicking on an unclaimed tile that will open a popup window with a green button; when clicked, this will claim the tile. If the claimed tile hides a ship, then the tile will turn green and play an explosion sound. If not, the tile will turn red and play a splashing sound. The explosion sound will be different depending on if a part of a ship was found or if an entire ship has been found from claiming this tile. Hovering over a tile on the game board will also open a popup window but this cannot be clicked on because it closes on mouse movement.
3. Testing: Game Testing and Formative Evaluation Method
3.1. Playtest—Cool Teknik: Research Context and Participants
The event “Cool teknik” or in English “Cool tech”, is an event in the city of Skellefteå located in northern Sweden where children aged 9–13 years test and learn more about emerging technology. During this event, a group of 13 participants tested Battleships. The participants were 8–11 years and all males. This event had several stations. Due to time restraints, 18 simple physical tasks were prepared in advance with both individual and team tasks. Some examples are “spin around 5 times”, “move the door”, and “take a lap around the room”. Due to the time restraints, technical issues, and the fact that our station consisted of several tests, only one of the two planned groups could test the Battleship-PA game. The group that could not participate in testing at this time were a group of 8 females. The size of the testing group was not ideal according to the classic usability testing guideline: The optimal number for medium–large projects is at least 15, but still large enough for the ideal number of participants for small projects (n = 7) [
29]. It was impossible to set up more gameplay sessions with school classes, both because this study was conducted over the Swedish summer break and because of the COVID-19 pandemic.
3.2. Research Method and Data Collection Instruments
In this mixed-method study comprising of qualitative and quantitative approaches [
30], we evaluated the user experience and impact of the Battleship-PA game to promote motivation, cooperation, collaboration, and behavioral changes towards PA among school aged children in an informal setting.
To collect feedback about the game and its impact, a user experience questionnaire was developed comprising four sections on a five-point Likert scale with agreement questions: user experience, motivation, audiovisuals, and impact of physical activity. Questions in all sections were based on questions from studies researched previously [
24,
31,
32]. The user experience is divided into four subsections: general experience, feedback adequacy, presence, and social interaction. Each section also includes an open field question where participants can motivate their answers and freely comment their thoughts about the game. In addition, the user experience section consisted of questions about what the participants thought about playing the game and their interaction with their team. The motivation section assessed what the participants enjoyed about the game, if they did. The audiovisual section gauged what the participants thought about the looks and sounds of the game. The active school transport impact section measured their attitude towards active school transportation and if they learned more about active school transportation by playing the game.
3.3. Data Collection Procedure
The testing and data collection took place in August 2021. The participants were divided into four teams and selected one user per team and were helped to set up matches with the 18 prepared tasks. During the game, the participants were observed directly and provided some insights about the game and the playtest process. As we watched the participants, we wrote down each observation in a notebook to avoid missing any data. During direct observation, we were focused on how the participants were physically active during gameplay and observed motivational behaviors related to cooperation, collaboration, competition, and teamplay.
In addition, voice recordings from two of the teams were recorded and then transcribed. After the game had ended the participants anonymously answered a user experience and impact questionnaire using Google forms for additional insights about the game and the testing process. They completed a questionnaire on their thoughts about the Battleship-PA game using a Likert scale: 1—strongly disagree and 5—strongly agree. The questionnaire wording was too complex for some participants and needed an explanation to help them answer some questions. Their answers are shown in the next sections.
The user experience and impact questionnaire was presented according to the sections of the user experience constructs derived from [
24,
31,
32], motivation constructs derived from [
24], audiovisuals experience constructs derived from [
31], and impact on physical activity and active school transport concepts derived from [
24].
3.4. Reliability and Validity
The user experience and impact questionnaire were first prepared in the English language, administered in the Swedish language, and later translated back to the English language before performing statistical analysis. Since the respondents were children, we ensured that the questionnaire items were designed to be clear, concise, and simple to avoid any confusion. Interaction audio recordings were conducted in Swedish and were transcribed into the English language. Both the translation of questionnaire and transcription of audio recordings were completed by a Swedish native speaker and excellent English speaker based on the Common European Framework of Reference for Languages, often referred to as CEFR. Although open-ended options, such as “other” or “please specify”, were provided to the respondents, the reliability of the results could be affected by questions that might have placed a need to satisfy the researchers by respondents answering what is believed to be the accurate answer.
A measure of reliability, Cronbach’s alpha on subscales user experience (0.85), motivation (0.88) and perception about physical activity and active school transport (0.74), were relatively high in general [
33].
3.5. Data Analysis Procedure
The data obtained through the user experience and impact questionnaire were analyzed based on a quantitative research approach using descriptive statistics. The direct observation and audio recording data were analyzed using a qualitative data analysis approach. Working as a team, we collected our observational notes, grouped the observations that refer to common behavior exhibited by the participants, interpreted the observations, and prioritized our findings accordingly. For example, we noted cooperation when team members show signs of agreement to adopt to a particular game strategy.
3.6. Ethical Consideration
Conducting research with children requires paying special attention and following due diligence to research ethics. This study was largely guided by the Code of Ethics of the World Medical Association (Declaration of Helsinki), even though this study is not medically inclined and no personal health related data were collected. All data from the event were collected with informed consent from the children’s guardians during the event; the children also gave their informed consent to participate. The participants’ personal data were anonymized with only ages and genders of their demographic information recorded for research purposes. The study was approved by the regional ethical committee in Umeå (Dr 2018-10-31 M).
5. Discussion
There were several evaluations of the gameplay session: participants’ interaction audio recordings, the observations, and the questionnaire. The audio recordings revealed that the participants were highly competitive and invested in the result of the match. This highlights the importance of competition as a motivating factor [
9]. However, several participants were frustrated or unmotivated by the fact that several tasks had to be repeated multiple times. Repetition could be an issue that decreases users’ interest and investment in the game. Therefore, it is important to consider what aspects of the game felt repetitive and how to avoid/change them or add incentives to motivate the aspects that feel repetitive [
9] to keep users engaged in the game. Nevertheless, the game is intended to be used in a school setting, and the notion of fun and engagement could be negotiated. Prior work [
34] shows that student engagement is built on behavioral engagement, i.e., participation and involvement, emotional engagement in the form of positive and negative reactions, as well as cognitive engagement, i.e., level of investment in learning.
Others [
35] found that learning is fun when there are choices, relevance, active learning, and camaraderie. This was achieved here by developing the tasks of the game that challenged the children physically, emotionally, and cognitively, as well as inspiring collaborative aspects. This approach allows teachers to create the task in relation to the curriculum. This enhances the possibility that activity and learning will occur and could encourage schools to use the game.
Rutberg and Lindqvist [
26] found that teacher’s involvement in designing assignments during active school transport enhanced student engagement in using active transport as well as enhancing teachers’ engagement in participating in the intervention. The recordings also highlighted that the visuals were confusing, and the rules of the game were unclear to some participants. While there was not as much frustration as for the repetition problem, some participants clearly struggled to comprehend the visuals and felt somewhat unmotivated to keep playing. Therefore, having clear progression and rules of a game is essential for motivating users to keep user engagement and avoid frustrations when playing [
9]. From observing the participants during the event, in addition to participants being competitive, they seemed to enjoy the collaborative aspect of the game, which is also supported by the questionnaire. This signifies the importance of collaboration as a motivation for gamification [
9,
24], which is also important in behavioral change [
36]. In
Table 9, we used the eight core Octalysis framework to highlight the required improvement in the future version of the game.
The results of the user experience aspects were mostly positive, as the respondents mostly agreed with the general user experience constructs, such as the game being easy to understand, being happy with the game and would like to play the game again. These user experience results were similar to the outcome of an earlier study [
21], in which the students reported a highly positive experience using games as interventions for increased physical activity. In addition, most of the students responded to a positive impact from motivational statements that focused on competition, collaboration within their teams, and performing physical activity during gameplay, as reported in earlier studies [
15,
18,
20,
24].
While the game is playable, there are several features that would drastically improve the game. Several points of the Octalysis framework [
12] recommend adding features that are customizable for all users and are owned by a single user. We could provide users with their own customizable avatars and add purchasable items for those avatars. Studies have shown that player-avatar identification led to increased motivation, time spent in gameplay, and completed game levels [
37,
38]. These items were bought with game currency gained by playing the game. This increases motivations for playing the game. Another feature motivating continuous play could be to add a progression system and achievements. For example, adding individual levels for users that grow with experience points. This could change by interacting with the game. Certain levels or events would grant the user an achievement or milestone. There could also be extra things hidden under some of the tiles, e.g., extra experience points or a cosmetic item for avatars. This adds an element of surprise for users and might motivate users to perform tasks even if they think that they are repetitive [
9]. Moreover, adding these motivating features will minimize novelty effect, perceived enjoyment, and usefulness of gamification diminishing with use [
20].
Another feature that also would improve motivation would be to add a social system for users. Communication was not a problem during the game tests because all participants were in the same room; thus, it might become an issue when the users are separated. Since each board has 64 tiles, it might be challenging for hosts to come up with 64 unique tasks. Thus, adding a feature to add common tasks, such as “walking to school” or “biking to school”, would probably simplify the match creation process. To show hosts how the icons would look on the board when creating tasks, the current dropdown menu with text could be replaced with a menu showing the icons visually. More icons could also be added to divide tasks more easily into different categories; thus, users would more easily understand the task on each tile. The method to choose which tasks are selected could also be improved so that each task does not repeat before all created tasks have been selected. This makes the tasks feel less repetitive.
While users might simply enjoy doing tasks and playing the game, it currently does not teach them anything about the benefits of daily physical activity. Hence, tools to teach users about these benefits and keep track of their current progress and put that into perspective might motivate users to continue playing. For example, keeping track of how much energy a team or user has used while playing the game and comparing how long you could run with that energy or what environmental impact the user or team has had by not using motorized transport.
The audio and visuals of the game could also be improved. We noted several confusions regarding the visuals from the observations and the audio recordings. Two of the confusions were that users were unsure about their score and which of the two boards belonged to their team. It was also unclear when one team had won the match; some participants were unsure of the rules of the game. Therefore, the visuals could be updated to clarify these aspects and add a way to see how many ships there are left for both teams. Additionally, a tutorial for users unfamiliar with the classic game could be added so that all users can understand the rules of the game. Another way to clear some of these confusions could be to add feedback features that clearly communicate with the user when something is performed incorrectly, or something has gone wrong.
This study has significant value but also several limitations. First, the group size of 13 people is more than the recommended amount for small user tests [
29], but it is also too small to draw any general conclusions about the game. Second, the lack of gender diversity in the testing group makes the results of the study less generalizable. Third, all the participants are from Skellefteå in northern Sweden and around the same age—further testing with participants of different ages and from different countries or other parts of the country would be needed before any general conclusions can be made.
6. Conclusions and Future Work
In conclusion, the web-based game Battleships-PA was presented with its conceptual and technical details. The game was designed with inspiration from the game Tic-Tac-Training. The main purpose of this study was to present the entire game development process of a PA game within a non-school context and gain insights from the gameplay session on how the game could be improved. By analyzing the answers from the questionnaire, the audio recordings, and observing the participants during the session, we concluded that the users enjoyed the collaborative and competitive aspects of the game but were confused by the visuals of the game. The results indicated their opinion regarding the game to improve motivation to be physically active in non-school settings. Children enjoyed collaborating and competing with others as well as completing tasks. However, the Octalysis framework suggested several features that could improve the game with a focus on long-term user involvement and an increase in clarity of the game visuals. Moreover, it is important to have clear visuals and rules or a tutorial so that all users can understand the game and thereby reducing the possibility of the novelty effect. The results have potential to impact future gamified PA interventions or solutions. The school setting is overwhelmed with tasks, and we wanted to create a game that has the potential to facilitate learning linked to the curriculum that was easy to use. Therefore, this game might also be interesting to researchers or teachers who wish to implement learning through gamification and simultaneously encourage PA in school classrooms. The architecture of the game might also be useful to developers who want to create web-based cooperative multiplayer games.
Future work involves several features that would improve the game and that can be implemented as suggested in the discussion section. Additional testing would be required to gain more accurate data on the motivational aspects of the game and if it motivates PA. This version of the game is still a competition between two teams; therefore, the next developmental phase of the game would focus on tweaking the game board to accommodate and be played by only one team to encourage collaboration versus competition. Additionally, observing how different age groups and more diverse gender distributions would react to the game could help determine the best target groups of children and ages. Lastly, our future research can use the knowledge gained in this study to develop a framework that integrates gamification in persuasive technologies for active school transport. In order to improve physical activity for children and adolescents, promoting and motivating them to use active transportation daily has been shown to be an effective way to increase physical activity [
39]. While there are numerous benefits of AT as a tool to increase physical activity, only 57% of schoolchildren of the ages 6–15 use AT to school during spring and fall in Sweden. Only 47% use AT during the winter [
40]. Even globally, there is a decrease in AT for children and adolescents, which will likely continue unless interventions are made [
41,
42]. This future research would optimally focus on ways to increase AST among children in Sweden. Methods of travel between home and school using non-motorized means could be studied to determine if the game can motivate long-term usage of active school transport.