Next Article in Journal
Ocular Melanoma: Current Concepts
Previous Article in Journal
Comment on Maraveas, C. Concrete Silos: Failures, Design Issues and Repair/Strengthening Methods. Appl. Sci. 2020, 10, 3938
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Methodology for Designing Systems Based on Tangible User Interfaces and Gamification Techniques for Blind People

by
Luis Roberto Ramos Aguiar
* and
Francisco Javier Álvarez Rodríguez
*
Departamento de Ciencias de la Computación, Universidad Autónoma de Aguascalientes, Aguascalientes 20100, Mexico
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2021, 11(12), 5676; https://doi.org/10.3390/app11125676
Submission received: 25 May 2021 / Revised: 11 June 2021 / Accepted: 16 June 2021 / Published: 19 June 2021
(This article belongs to the Section Robotics and Automation)

Abstract

:
Having a disability does not mean being away from major technologies present today; even people with visual impairment or blindness use different options to access technological information. Recent studies have shown that using tangible user interfaces and gamification techniques brings considerable benefits to learning and the understanding of essential topics for these people. Therefore, METUIGA methodology has been developed to facilitate digital content creation that mixes both characteristics and seeks to take advantage of the primary means of knowledge that these people have as their sense of touch, enriched with techniques that encourage them to use applications more frequently. For this reason, novelties are shown within the requirements and the design stages to implement these techniques. This work shows prototypes that have been made following METUIGA methodology to help teach geometry and mathematical lessons for blind people. In addition, a third prototype focused on children with an autism spectrum disorder demonstrates how METUIGA methodology can be applied in a variety of subjects and for a number of disabilities. Finally, an analysis of the software methodology evaluation is presented to show the initial perceptions of software developers toward METUIGA methodology, where important results were obtained in relation to the software engineering process application.

1. Introduction

Throughout history, disability has been considered through different points of view and although the ways of approaching it have changed radically, in each historical stage there have been supportive or discriminatory attitudes towards people with disabilities [1]. According to the World Health Organization, a disability refers to persons who have one or more impairments, whether physical, mental, intellectual, or sensory, which, due to their interaction with different environments in the social setting, may impede their full and effective participation on equal terms [2,3].
It is estimated that more than 1 billion people live with some form of disability. This figure corresponds to approximately 15% of world’s population; in fact, up to 190 million (3.8%) of people aged 15 years and older have significant difficulties functioning and frequently require health care services [2]. Furthermore, technology’s involvement in all areas of daily life is unquestionable, the development of these resources is growing impressively and in this context the fields of disability and pedagogy have had a great impact. Therefore, it is of great importance to know the different alternatives provided using technology, as well as to redesign the teaching–learning systems in all educational spaces.
Technologies have evolved over the years to achieve greater familiarity and interactions with users, and different methods have gradually appeared that can improve their experience with the technology presented to them. For example, recommender systems have become essential to users for finding “what they need” [4] and in virtual reality, users can experience changes of position in space and respective perspectives that they cannot experience in the real environment [5]. We have also augmented reality, a variation of virtual reality that, in contrast to virtual reality, encourages users to observe the real world with virtual objects superimposed on or composited with the real world. Thus, augmented reality complements reality, rather than replacing it completely [6]. Likewise, we have tangible user interfaces that allow interactions with digital technology through physical environments, so that instead of looking at graphical interfaces, they are seamlessly integrated into the user’s physical environment [7]. Despite these great advances in terms of interactions with digital information, those who suffer from disability remain aside. Within this vulnerable group are those who suffer from low vision problems or blindness and those who have alterations in the vision organ that affects the main medium used to consume digital information. Moreover, low vision or blindness does not isolate blind people, but drives them to consume as much information as they can acquire to develop in the same way as sighted people. The most pressing need of people with low vision and blindness, in addition to society’s awareness of disability, are technological requirements. Technical and technological aids significantly favor people’s access to the mass media [8]. Therefore, it is of the utmost importance to propose technological elements that focus on the main senses of exploration based on the person to whom the system is addressed.
METUIGA is a software design methodology that aims to facilitate the design of technological educational systems to help support essential subjects for blind people, and here you can find a series of activities to implement tangible user interfaces. It is a technology that allows interactions with digital information through different physical objects, thus exploiting the main sense of blind people, which is through touch. It also implements gamification techniques to provide enriched systems with challenges, missions, mechanics, and dynamics to encourage blind people to interact with the application on a frequent basis. Once the stages and activities of the methodology are defined, to demonstrate the results that have been obtained in the implementation of this methodology, three prototypes are presented. The first one is aimed at teaching geometric topics to blind children and the second one is focused on teaching mathematical portions to blind children. Both prototypes were designed with the intention of contributing to children’s organizational skills, spatial orientation, and difficulty with rational numbers. The third prototype shows an experimentation of the METUIGA methodology with the creation of a software to teach emotions to children with an Autism Spectrum Disorder (ASD).
Considering that software development must comply with a quality process, it was decided to carry out an evaluation of the methodology by experts in software engineering who followed the development process by building applications oriented to blind people. Afterwards, an evaluation model for software development methodologies was applied, which has as its objective “quality assurance in the development of projects, reduction or mitigation of risks and the ease of defining project deliverables” [9].
The remainder of this paper is composed as follows: Section 2 presents the problems of developing applications for people with disabilities, Section 3 presents the background of tangible user interfaces and gamification, Section 4 presents the METUIGA methodology and gives a brief explanation about the activities performed in its stages, Section 5 shows the prototypes generated with the METUIGA methodology, Section 6 explains the model of the evaluation of the software development methodologies proposed by the authors in [9], Section 7 presents a discussion related to the data obtained in the applied evaluation model, and finally Section 8 shows the conclusions of this work.

2. Problem

The development of applications oriented to people with disability is a challenge not commonly faced by development teams. Because of this, they do not know the essential features to cover in building these applications. For example, applications aimed at people with visual impairments should consider the most intuitive means of interaction to present digital information. These means of interaction may change according to the capabilities of the end user; it is not the same as designing an application for people with hearing impairments or any other disability, although the subject to teach is the same.
To help with this problem, new methodologies have emerged in software development that focus on different disabilities with aim of helping in the construction of applications aimed at these people, thus facilitating an understanding of digital information, and taking advantage of the main means of interaction according to the disability to be treated.
An important aspect within the development process of these methodologies is the integration of the users with disabilities in all the stages and activities related to building the software. This characteristic has its origins in user-centered design (UCD). To explain the UCD concept, we show some of the authors’ definitions that can be found in the literature. For example, according to Domingo and Pera [10] UCD “is a way to plan, manage and carry out projects of creation, improvement and implementation of interactive products. At the same time, it is also considered a design philosophy or approach according to which any design activity must consider for whom it is designed, as well as the contexts of use”. On the other hand, Abras et al. [11] defines UCD as “a general term for a philosophy and methods that focus on designing for users and their participation in the design of computer systems. The forms of user participation can vary. At one end of the spectrum, participation can be relatively light: they are consulted about their needs, observed, and participate in usability testing”. If we look for a more pointed definition, we can also observe the definition of Fernandes and Healy [12] who describe UCD as “a methodological set in which it is assumed that the entire design process should be driven by the user, their needs, objectives and characteristics”.
Therefore, UCD can be defined as an essential approach in all methodologies that intends to build applications aimed at some type of disability. The importance of knowing for whom it is designed, the context of the digital information to be presented, the knowledge that is expected to be achieved, the best methods of interaction to achieve greater familiarity, and the avoidance of possible frustrations when individuals feel a system is not built for them, are fundamental characteristics when building this type of application.

3. Background

METUIGA is the first methodology that mixes tangible user interfaces and gamification techniques within its development process. Definitions of these characteristics are shown below.

3.1. Tangible User Interfaces

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users’ knowledge and skills of interaction with the real non-digital world, TUIs show potential to enhance the way in which people interact with and leverage digital information [13]. These interfaces were identified by Fitzmaurice, although he called them “manipulable user interfaces” [14]. His definition was that of a physical object that performs a virtual function in which the physical object serves as a manipulator of different virtual events. Furthermore, TUIs were defined as devices that shape digital information, using physical objects as representations and controls of computational data led by the Tangible Media Group of the MIT Media Lab [15].
The term tangible refers to physical elements that will be part of tangible interfaces with which the end user interacts. Its role is to represent digital information with which activities will be performed. Tangible user interfaces can give physical form to digital information, facilitating the manipulation of different elements related to educational or bone context. Designers of TUIs are always looking for the union of the physical with the virtual. TUIs can make accessible the input of information through physical surfaces (walls, desks, ceilings, windows), environmental media (building blocks, models, instruments) and environmental media (light, sound, air flow, water flow) within physical environments. TUIs support collaboration between different users, who can interact with the environment simultaneously, and physical models of TUIs provide the user with an intuitive understanding of complex structures. Potential users of TUIs can be people who are not always sitting in front of a computer and people who do things better with their hands and objects.
Talking specifically about tangible user interfaces for blind people, a study by Maria et al. [16] who created a system called “Touch&Learn” for teaching new Braille to blind children considered that these interfaces provide a new way to learn basic concepts. Furthermore, MICOO (Multimodal Interactive Cubes for Object Orientation) is a tangible interface for blind or visually impaired people to create, modify and interact with diagrams and graphics. Their creators consider that these interfaces reduce the need for manual intervention and allow independent discovery by the users (blind people) and provide dynamic behavior while interacting and providing feedback [17]. Likewise, the use of tangible interfaces can be extended to other areas, such as the work completed by Morrison et al. [18] whose study, “Torino: A Tangible programming languages inclusive of Children With Visual Disabilities” showed that that the use of physical objects to represent or interact with programming constructs may be a more obvious choice for children with visual disabilities. In addition, Sitdhisanguan et al. [19] in their work “Using tangible user interfaces in computer-based training systems for low-functioning autistic children” considered that in terms of learning efficiency, TUIs offer a greater improvement compared to traditional tactile training methods. Additionally, Francis et al. [20] in his work “Do Tangible User Interfaces promote social behaviour during free play? A comparison of autistic and typically-developing children playing with passive and digital construction toys” concludes that for children with ASD this type of interface may be beneficial as it has been designed with sensory aspects of embodiment in mind. Moreover, Al Mahmud and Soysa [21] considered that tangible interfaces can link real-world physical objects with the digital world, which has a lot of potential for children with ASD. Finally, Price et al. [22] in their work “Using ‘tangibles’ to promote novel forms of playful learning” the successful use of tangible arrangements for engendering playful learning in several ways was shown.

3.2. Gamification

Gamification is a concept that emerged in educational literature at the beginning of the 21st century and it is presented from multiple definitions and perspectives. Ramirez considers it as the utilization of strategies, thoughts and game mechanics in non-habitual contexts for the modification of the participants’ behavior [23]. According to Kapp, gamification is “the use of mechanics, aesthetics, and game thinking to engage people, motivate action, promote learning, and solve problems” [24]. On the other side, “gamification is the use of game thinking, approaches and game elements in a context other than games” [14].
Several definitions are intertwined with their terms about gamification, but it could be summarized as: gamification is the integration of game elements, activities, and challenges that are not necessarily games, but help keep the user hooked because of their interest in achieving the various challenges presented to them. Games use some elements that play an important role in gamified systems:
  • Activities and challenges that the user performs to increase their progress towards new defined objectives;
  • Points are accumulated as different activities or challenges are completed;
  • The user’s level increases as he/she overcomes the different defined objectives;
  • Rewards or badges that show you have passed or completed an activity;
  • Ranking in relation to other users to compare your progress.
With new game engines that have offered free availability to developers to build their projects, the implementation of gamification techniques has been influenced by virtual reality applications that seek to immerse users in digital environments [5,25]. To applications aimed especially at blind people that have been shown to improve interest and enthusiasm for learning and thus increase understanding of the presented topics, recent studies have shown that the inclusion of challenges and interaction with gamification elements in mobile applications motivates them to learn but generates some confusion when identifying the correct part of the screen when they must select the correct part of the screen [26,27].

4. METUIGA Methodology

METUIGA (MEthodology for the design of systems based on Tangible User Interfaces and GAmification techniques for blind people) is result of analysis and research, carried out with the aim of generating a methodology focused on developing interactive educational systems following user-centered design principles and the iterative cascading life cycle, to create applications that take advantage of tangible user interfaces and gamification techniques to improve learning and understanding in blind people. Some of the important aspects of the METUIGA methodology are as follows:
  • Activities defined to build a tangible interface, the classification of tangible objects and software used to track tangible objects.
  • It defines a process composed of five activities to define the gamification characteristics that the system will have to engage the target users.
  • It defines different evaluation activities to measure usability in blind people and to measure the fulfillment of the proposed objectives.
  • It defines a process focused on user-centered design to generate systems that adapt to the needs of end users.
METUIGA methodology is composed of four main stages (Requirements, Design, Implementation, Evaluation) nurtured with activities related to tangible user interfaces and gamification. Within them different prototypes can be made where the end user is included in each of them to achieve products closer to their needs. Below, Figure 1 shows the methodological process of the METUIGA methodology where the horizontal arrow shows the stages of requirements, design, implementation, and evaluation manifesting the possibility of interactions between each of them in a flexible manner. Moreover, vertical arrows indicate an interaction between each stage with the end user:
To compare the novelties within the METUIGA methodology, an analysis of different user-centered software development methodologies was carried out, to analyze if they included any disability, if gamification techniques and tangible interfaces were used within their development process, and if the disability type was addressed to blind people. Table 1 shows the analyzed methodologies and the evaluated criteria:
Below, you can see the steps that make up each of the METUIGA methodology stages, whose objective is to help build applications that implement tangible user interfaces and gamification techniques for blind people.

4.1. Requirements Stage

The requirements stage aims to define the needs of the system, the tangible interfaces, and the gamification. This stage is composed of five activities that allow us to first establish the characteristics of the software engineering, the gamification, and the tangible user interfaces for the future system to be developed. In relation to the gamification characteristics, we identified the most appropriate type of gamification to apply in the future system, to be developed with the objective of establishing mechanics and dynamics according to the target user in the design phase. For this we resorted to the types of gamification proposed by the authors in [32] (See Table 2). Likewise, one of the most important challenges when trying to develop applications that implement tangible user interfaces is identifying the necessary tools to create them. For this reason, to help accelerate this process, METUIGA methodology provides a tool where you can observe the existing works aimed at blind, visually impaired people, or people in general to identify the most appropriate tools according to the needs of the project (See Table 3).
Figure 2 shows the stages that make up the requirements stage:

4.2. Design Stage

The design stage consists of defining the graphical interfaces of the system considering the gamification features and the tangible user interfaces. This stage is composed of twelve activities, with which the system established in the requirements stage has designed in relation to the gamification techniques together with the integration of tangible user interfaces to the developed system. In the gamification part, we found the identification of challenges and missions to be implemented, the classification of missions into common, individual, and collective, the design of a gamification structure, the selection of mechanics and dynamics to be implemented in the gamified system, and the design of an avatar interface (See Table 4).
After defining the gamification features to be implemented, we proceeded to the software engineering stages, such as the design of class diagrams, flow charts, construction of static and dynamic designs of system interfaces, construction of a database and finally, we classified and designed the features of tangible objects that will interact within the developed system, establishing their behavior when interacting with tangible interfaces and the user. For this purpose, we used the TAC palette that allows developers to visually describe the behavior of tangible objects when in contact with the tangible interface, thus linking the graphical interfaces developed with the gamified elements with the tangible objects developed (see Figure 3).
Once the tangible object behaviors have been defined, it is necessary to build the tangible interfaces. To complete this, it is important to note that during the requirements stage, the development team must have already decided which tool best suits the needs of the project. In case of the team not having decided yet which tool to use, METUIGA methodology in its twelfth activity of the design stage recommends that Reactivision [42] and its diagram is used to build a tangible interface (See Figure 4).
Figure 5 shows the stages that make up the design stage, where the integration of gamification elements, software engineering and tangible user interfaces make the METUIGA methodology the first to establish a design process that considers these three characteristics. See Appendix A for the activities involved at this stage.

4.3. Implementation Stage

The implementation stage consists of programming what was established in the design stage. This stage consists of three activities starting with the identification of a programming standard, the programming of the software based on previously created designs and finally, the design of a developed system architecture. Figure 6 shows the stages that make up the implementation stage:

4.4. Evaluation Stage

The purpose of the evaluation stage is to determine the acceptance of the system by end users and the fulfillment of the objectives established in the requirements stage. This stage is composed of three activities, starting with a measurement of the usability of the system using a “System Usability scale” instrument [43], followed by an evaluation of the system objectives by means of a “Light MECPDS” instrument [44] and finally, a measurement of the usability through a “Thinking Out Loud” instrument [45]. This specific instrument helps to measure usability when making applications for blind people. Figure 7 shows the stages that make up the evaluation stage:
It is important to mention that although these instruments are proposed by the METUIGA methodology, the development team is free to use other types of tools to evaluate the developed systems. For example, Zaman et al. [46] in their work “Editorial: the evolving field of tangible interaction for children: the challenge of empirical validation” presented empirical articles reporting on studies that obtained complementary knowledge about children’s perceptions of tangible interaction. Moreover, the benefits of implementing tangible interfaces are detailed in the paper “Are Tangibles More Fun? Comparing Children’s Enjoyment and Engagement Using Physical, Graphical and Tangible User Interfaces” by Xie et al. [47] who present a qualitative analysis based on observational notes and audio responses to open interview questions to help contextualize the quantitative findings and provided key insights into interactional differences not apparent in the quantitative findings. Likewise, you can also analyze the work of Sapounidis et al. [48], “Latent Class Modeling of Children’s Preference Profiles on Tangible and Graphical Robot Programming” where an instrument that used eight variables to operationalize children’s preferences were observed: attractiveness, collaboration and usability factors, such as enjoyment, ease of use, convenience, understandability, explainability and ease of recall. Futhermore, in a paper titled “Tangible and Graphical Programming with Experienced Children: A Mixed Methods Analysis” you can observe a study that applied a mixed methods approach to analyze the usability, collaboration, and playfulness aspects in introductory programming activities with tangible and graphical user interfaces of two groups of students [49].

5. Developed Applications

Building a TUI is a complex process that encompasses multidisciplinary knowledge including engineering, art, and social sciences [50]. Therefore, to build prototypes focused on teaching educational topics aimed at blind children, cooperation between different areas of knowledge was necessary (see Figure 8). After defining the stages of the METUIGA methodology, educational experts who had previously worked with blind people were consulted to choose the educational topics that, in their view, with tangible user interfaces could enhance their learning and understanding using tangible objects. Likewise, due to the UCD approach followed by METUIGA methodology, tangible interfaces were designed in close collaboration with educators and blind people. One of the most important benefits of this multidisciplinary approach is that designers can move beyond the focus on computers to physicality, namely from screens and applications on smartphones to tangible interfaces [51,52]. Subsequently, programmers oversaw reflecting what was established by the designers.
The developed prototypes demonstrate that it is possible to generate applications that combine the characteristics of tangible user interfaces and gamification techniques to teach educational topics to blind people, providing a new interaction experience. This new experience focuses on providing a computer application enriched by gamification elements with which the user interacts through physical elements. On the other side, due to the lack of vision of the target users, we resorted to auditory feedback to indicate the different states of the gamified elements (see Figure 9).

5.1. Prototype One

According to Nuñez “geometry contributes strongly to development of organization and spatial orientation skills of the blind student” [53]. The first prototype developed is called GeoTang (Tangible Geometry), which aims to help blind elementary school children learn basic geometry concepts by recognizing geometric objects (triangle, rectangle, square, circle, pentagon, hexagon, rhombus, oval, rectangle) that are available in the application and have a tangible object to identify them.
The child interacts with the application using the tangible interface and receives auditory feedback. The application has two options. In the first one, objects are placed on acrylic, and they receive object audio feedback in the question. In the second option, the questions are asked in form of riddles to be answered by placing the correct figure on the acrylic of the tangible interface.
The system is enriched with a series of gamification elements such as a system of lives, challenges, mission, avatars, levels, coins, and rewards that are obtained according to performance. Due to the lack of visibility of the target users, sounds were added to indicate when a correct or incorrect answer is given, as well as to indicate gamification mechanics and dynamics suggested by the methodology. On the other hand, special rewards were provided for the use of different tangible objects. Likewise, one of the important aspects in developing this application was to promote the interaction between normal-visual and visually impaired or blind users. For this reason, it was decided to implement the delivery of virtual coins to complete the challenges posed in the application so that they can be exchanged in a virtual store for different avatars and thus promote interaction between both users. Moreover, some of these challenges and missions were related to different tangible objects to encourage exploration of these. Moreover, a specific audio was assigned at the time of completing a challenge to indicate that you have achieved an achievement. In addition, a voice describes the challenge or mission achieved. In this way, we managed to provide a better interaction with the system and the achievements to the blind children (see Table 5).
Figure 10a shows the graphical interfaces of the Geotag application showing the gamification elements as well as the placement of a tangible object on the tangible interface (see Figure 10b).

5.2. Prototype Two

The second prototype is called a tangible portion which aims to help in the learning of basic mathematical portions (an integer, a half, a quarter), due to the difficulty of understanding related to rational numbers. This difficulty is mainly because it is a subject that relies mainly on visual elements for their understanding.
The interaction with the system is quite simple: the application asks a question regarding a mathematical portion, then the child must take the object that represents the fraction that he considers to be the one we are referring to and place it on the acrylic of the tangible interface. Once the object is placed, the system recognizes it and evaluates if it is the correct answer. After this the evaluation feedback is given via audio related to their performance. Compared to prototype one, this prototype allows interaction with one or more tangible objects to represent multiple mathematical portions. For example, if a child wants to represent a 2/3 quantity, he can superimpose two objects representing 1/3 and automatically the system will detect the portion to which he wants to refer as shown in Figure 11b. The system is enriched with a series of gamification elements such as a system of lives, levels, challenges, missions, and rewards that are obtained according to performance. In comparison with prototype one, this provides less gamification features because it is specifically oriented to work with blind people. It must be considered that because of this reason, the gamification elements that are part of this application should be easily adapted to give feedback on them through audio. Likewise, some of these challenges and missions were related to different tangible objects to encourage an exploration of these. As well as prototype one, moreover, a specific audio was assigned at the time of achieving a challenge or challenge to indicate that you have achieved an achievement. In addition, a voice describes the challenge, or the mission achieved. In this way we managed to provide a better interaction with the system and the achievements to the blind children (See Table 6).
Figure 11a shows the graphical interfaces of the tangible portion’s application showing the gamification elements and Figure 11b shows the multiple tangible objects interacting with the interface and the application, and you can also observe the quality system:

5.3. Prototype Three

With the intention of testing the development process of the METUIGA methodology for another type of disability, it was decided to conduct an experiment to demonstrate that the generated software meets the characteristics of tangible user interfaces and gamification techniques in an application aimed at another type of target user; in this case, in people with Autism Spectrum Disorder (ASD).
“People with ASD have serious difficulties in communication and social interaction skills and behavioral flexibility” [56]. “These difficulties, which respond to variable expressions of severity, are related to the existence of barriers to learning mental states that hinder the understanding of reality from the perspective of another person. Therefore, it is important to develop teaching aimed at helping these people to acquire the relevant skills and abilities to achieve these competencies to provide them with the tools to enjoy a life as normal as possible” [57].
The third prototype is called Tangible Emotions, this application is designed to help in the recognition of basic emotions (surprise, anger, fear, sadness, happiness) for children with ASD. The application is composed of two main activities, the first activity consists of showing the main characteristics of each emotion. In the second activity the child receives a question related to a social event and with the support of an adult must deduce what emotion he/she would feel when that event occurs, once the emotion is decided the child must place the object that corresponds to that emotion on acrylic of tangible interface, then the system will evaluate his/her answer and gives the corresponding feedback.
The system is enriched with a series of gamification elements such as challenges, levels and rewards that are obtained according to performance. Furthermore, since this application is aimed at children with ASD, it was decided not to implement the system of lives so as not to generate a certain level of frustration. For this reason, it is possible to use as many tangible objects as necessary to answer each of the activities correctly.
Figure 12a shows the graphical interfaces of the tangible emotion’s application showing the gamification elements and Figure 12b shows the tangible elements available for this application as well as a fiducial marker attached to one of them:

5.4. Common Characteristics

All prototypes were created in Unity 3D, a multiplatform video game engine [58] working under C# language. The tangible interface is composed of a 30 cm × 40 cm acrylic, a TedGem HD camera and a 5v led light bar mounted on a 40 cm × 30 cm × 80 cm wooden structure. Moreover, an open-source tracking system for fiducial markers called ReactiVision [42] was used to track the tangible objects. Figure 13a shows the internal components of tangible interface as well as the tangible emotions application running on the tangible interface (See Figure 13b).
Due to the different characteristics that were desired to be implemented in developing applications, these had small variations in relation to different elements of gamification used, Table 7 shows a comparison between different elements used in applications presented here.

6. Evaluation of Software Development Methodologies

When a new software methodology is created, it is important to know the perceptions of the software engineering experts. For this reason here is a pre-analysis of the METUIGA methodology using an instrument called an “Evaluation model of methodologies for software development”. This model seeks quality assurance in project development, risk reduction or mitigation, and ease of defining project deliverables. The model proposed by Méndez and Garrido [9] consists of three stages (See Figure 14).

6.1. Identification Variables in the Evaluation of Methodologies to Be Udes in Software Development

The first stage consists of defining those variables that they consider the software development methodology evaluated must comply with.

6.2. Creation of Surveys Considering Variables Identified

After choosing the evaluation variables, a survey is carried out with those involved using the methodology that will allow to order or prioritize each one of them, giving it a weighting according to the importance that the different people involved in software development give to each one of these characteristics. The survey is designed so that people can select the degree of importance they give to each of the variables through the following scale: 1. Strongly disagree, 2. Disagree, 3. Undecided/neutral, 4. Agree, 5. Strongly agree.

6.3. Desing of Software Methodology Evaluation Matrix

Finally, the methodology evaluation matrix is made, the steps to follow for the use of the matrix proposed by [9] are the following:
  • Identify key success factors;
  • Assign weighting to each key success factor;
  • Assign strength or weakness to each factor per competitor (Severe weakness = 1, Minor weakness = 2, Minor strength = 3, Major strength = 4);
  • Calculate weighted score;
  • Add results.
According to steps described previously, information needed to complete the competitive profile matrix is a tool that helps companies evaluate themselves against their main competitors using critical success factors for that industry [59]. These matrices are composed of four key components, success factors, weighting, rating and score as shown in Table 8.
According to the results obtained from an application model of Méndez and Garrido [9] in several software development methodologies the three most important factors that must exist in a methodology are:
  • Methodology must integrate the different phases of the development cycle;
  • Methodology must cover the entire software development cycle;
  • Methodology must be able to be used in a wide software project environment.

7. Results

The results obtained from Méndez and Garrido’s [9] model to evaluate the METUIGA methodology are shown below.

7.1. Identification of Success Factors

The first activity, as specified on the model proposed by Méndez and Garrido [9], consists of identifying the variables that should be fulfilled by methodology. For this purpose, it is decided that the same 13 variables that they present in their work will be implemented, which are as follows: 1. Methodology must be adjusted to the objectives, 2. Methodology should cover the entire software development cycle, 3. Methodology must integrate the different phases of development cycle, 4. Methodology should include validation of the following, 5. Methodology must support the determination of system accuracy throughout the development cycle, 6. Methodology should be the basis for effective communication, 7. Methodology should work in a dynamic user-oriented environment, 8. Methodology should be specified in a broad software project environment, 9. Methodology must be teachable, 11. Methodology must be supported by CASE tools, 12. Methodology must support the eventual evolution of system, 13. Methodology must contain activities leading to improve the software development process.

7.2. Weighing Success Factors with Information Technology Experts

To weigh the success factors, we selected nine experts in information technology (IT) with extensive knowledge in software engineering and who had previously worked with METUIGA methodology. Once selected, a survey was sent to them to weigh from 1 to 5 each of desirable requirements according to their importance within software engineering process, this survey was designed in such a way that they could select degree of importance of each one of the success factors through the next scale: 1 = Strongly Disagree, 2 = Disagree, 3 = Undecided/Neutral, 4 = Agree, 5 = Strongly Agree. Then a table was filled in to calculate the variable weights in a spreadsheet. The scale was weighted so that the results could be obtained, where 5 was 100%, 4 was 80%, 3 was 60%, 2 was 40% and 1 was 10% as shown in Table 9.

7.3. METUIGA Methodology Evaluation Matrix

Once the weighted results were obtained, an evaluation matrix was designed using a competitive profile matrix used in strategic planning as a basis. Subsequently, the success factors of the METUIGA methodology were evaluated in two stages by IT experts who were part of the success factor weightings and who had previously worked with METUIGA methodology. These scores were multiplied by the obtained weights to obtain the results of METUIGA methodology as shown in Table 10.

8. Discussion

Analyzing the results obtained in relation to the desirable requirements for a software methodology, it can be observed that for respondents it is important that a methodology covers all the software development cycle, as well as integrates different phases of development process. They also consider that it is necessary that it can be used in different software project environments, that it fits objectives, that it specifies who is responsible for the results and finally that it is easy to teach. Table 11 shows six success factors that obtained higher weights.
However, it is important to note that these results leave out factors that, in a way, are of great importance for METUIGA methodology as a methodology that works in a dynamic user-oriented environment. Moreover, it is important to indicate that within these six success factors are found three success factors identified by Méndez and Garrido [9] as fundamental desirable requirements in a software methodology. Likewise, assessing the METUIGA methodology evaluation matrix where the results of desirable requirements were weighted, we can conclude that the success factors are satisfied with an evaluation of 3.822 and 3.263, respectively in a range of 1 to 4. Finally, it is important when mentioning the results obtained that when evaluating if working in a dynamic user-oriented environment with a score of 4 and 3, respectively, due to user-centered design approach that follows METUIGA methodology, these scores make us deduce that end users are being correctly included in each of METUIGA methodology stages.

9. Conclusions

“Tangible user interfaces have become a new field for innovation and entrepreneurship” [60]. This paper showed the METUIGA methodology development process, which aims to develop applications that use tangible interfaces and gamification techniques for blind people, a review of its stages and activities oriented to a correct implementation of gamification and tangible user interfaces, different methods to build tangible interfaces were demonstrated, as well as a review of gamification and tangible interface process implemented in requirements and design stages.
Currently, there are multiple works in the literature that implement the use of tangible interfaces focused on the education of children [61]. However, there are very few that consider educational topics for blind people using tangible user interfaces and gamification techniques. For this reason, the prototypes presented here are unique in mixing both the features following the development process proposed by the METUIGA methodology. Furthermore, all this research reports considerable advantages when improving learning in blind people so by combining both features can exponentiate learning and understanding in these specific users [15,16,20,21,62].
The first prototypes generated by the methodology were presented, which helped to improve the development process and demonstrated the capability to generate applications with tangible user interfaces and gamification features. In addition, the options for integrating the gamified elements with the tangible objects through challenges and missions were presented. Finally, a prototype oriented to children with ASD was presented, demonstrating how the METUIGA methodology can be used in different areas of interaction. The representative images of the interaction with the tangible interface were also shown.
The METUIGA methodology analysis was performed following the methodological evaluation model proposed by Méndez and Garrido [9]. The weighting of success factors was carried out with nine experts in software engineering, indicating that a methodology should cover the entire development cycle, integrate different development phases and be able to work in different software environments. These factors were identified as the three most important factors for a software methodology.
Based on the analysis of the results, it was concluded that the evaluators’ perceptions indicate that the METUIGA methodology meets the desirable requirements of a software methodology according to the model outlined by the authors in [9] with a score of 3.822 and 3.263 in a range of 1 to 4. Additionally, we must consider that these results are limited to observations of the behavior of the METUIGA methodology. The next activity will involve more software developers. “It is possible to improve the effectiveness of methods significantly by involving multiple evaluators” [63].
These results motivate us to continue making functional prototypes to improve each of the stages and activities of the methodology to help build more applications focused on blind, visually impaired or otherwise disabled people and finally apply new evaluation methods to the METUIGA methodology to continue discovering aspects in which it can be improved. Additionally, we intend to analyze how children learn using their hands, explore the benefits of embodied metaphors in hybrid physical digital environments, and compare the use of tangible and graphical objects with the prototypes presented here [64,65,66].

Author Contributions

All authors have contributed equally to this work. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Did not involve humans or animals.

Informed Consent Statement

Not applicable.

Data Availability Statement

In case you want to observe how these prototypes work, you can go to the following link: https://cutt.ly/anYHCAQ (accessed on 25 May 2021). In addition, to allow easy access to the third prototype, adaptations were made for its operation through tactile devices without the need to use tangible objects. Currently there are more than 500 downloads around the world. You can download this application at the following link for educational purposes: https://cutt.ly/ggELd4D (accessed on 25 May 2021).

Acknowledgments

We would like to acknowledge Engineers Uriel de Jesús Carbajal Morales and Leonardo Wenceslao Equihua Rodriguéz for their contribution to implement the assessment instruments for METUIGA methodology.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. Challenges and missions established at design stage for the implementation of tangible emotions.
Figure A1. Challenges and missions established at design stage for the implementation of tangible emotions.
Applsci 11 05676 g0a1
Figure A2. Gamification framework selected for the Geotag application at the time known as Geometria tangible.
Figure A2. Gamification framework selected for the Geotag application at the time known as Geometria tangible.
Applsci 11 05676 g0a2
Figure A3. Initial designs of tangible portions application considering end users.
Figure A3. Initial designs of tangible portions application considering end users.
Applsci 11 05676 g0a3

References

  1. Del, M.; Kano, R.L. Tecnología Y Discapacidad: Una Mirada Pedagógica. Rdu Rev. Digit. Univ. Unam 2013, 14. Available online: http://www.revista.unam.mx/vol.14/num12/art53/ (accessed on 23 March 2021).
  2. Organización Mundial de la Salud. Discapacidad y salud. Organización Mundial de la Salud. 2021. Available online: https://www.who.int/es/news-room/fact-sheets/detail/disability-and-health (accessed on 23 March 2021).
  3. Esparza-Maldonado, A.L.; Margain-Fuentes, L.Y.; Álvarez-Rodríguez, F.J.; Benítez-Guerrero, E.I. Desarrollo y evaluación de un sistema interactivo para personas con discapacidad visual. TecnoLógicas 2018, 21, 149–157. [Google Scholar] [CrossRef]
  4. Moscato, V.; Picariello, A.; Sperli, G. An emotional recommender system for music. In IEEE Intelligent Systems; IEEE: Piscataway, NJ, USA, 2020. [Google Scholar] [CrossRef]
  5. Edler, D.; Keil, J.; Wiedenlübbert, T.; Sossna, M.; Kühne, O.; Dickmann, F. Immersive VR Experience of Redeveloped Post-industrial Sites: The Example of “Zeche Holland” in Bochum-Wattenscheid. KN J. Cartogr. Geogr. Inf. 2019, 69, 267–284. [Google Scholar] [CrossRef] [Green Version]
  6. Azuma, R.T. A Survey of Augmented Reality. Presence Teleoperators Virtual Environ. 1997, 6, 355–385. [Google Scholar] [CrossRef]
  7. Ishii, H. The tangible user interface and its evolution. Commun. ACM 2008, 51, 32–36. [Google Scholar] [CrossRef]
  8. Manzaneda, F.; Mendoza, D. Accesibilidad A La Comunicación Para Personas Ciegas. In Proceedings of the 2o Congreso Internacional de Bibliotecología, Documentación y Archivística (CIBDA), La Paz, Bolivia, 3–5 September 2003. [Google Scholar]
  9. Méndez, E.; Garrido, R. Modelo de evaluación de metodologías para el desarrollo de software. Univ. Catol. Andres Bello 2006. [Google Scholar]
  10. Domingo, M.; Pera, E. Diseño centrado en el usuario; University Oberta Catalunya: Barcelona, Spain, 2010; pp. 9–12. [Google Scholar]
  11. Hardi, R.; Pee, A.N.C.; Herman, N.S. User-Centered Design BT Bainbridge. Bainbridge 2004, 9. [Google Scholar]
  12. Fernandes, S.H.A.A.; Healy, L. Inclusion of blind student in the mathematics classroom: Tactile exploration of area, perimeter and volume. Bolema Math. Educ. Bull. 2010, 23, 1111–1135. [Google Scholar]
  13. Shaer, O. Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends® Hum. Comput. Interact. 2009, 3, 1–137. [Google Scholar] [CrossRef] [Green Version]
  14. Fitzmaurice, G.W. Graspable user interfaces. Citeseer 1996. [Google Scholar]
  15. Ishii, H.; Ullmer, B. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97); ACM Press: Atlanta, GA, USA, 1997; pp. 234–241. [Google Scholar]
  16. Lozano, M.D.; Penichet, V.M.R.; Leporini, B.; Fernando, A. Tangible User Interfaces to Ease the Learning Process of Visually-Impaired Children. In Proceedings of the 32nd International BCS Human Computer Interaction Conference 32, Belfast, UK, 1–5 July 2018. [Google Scholar] [CrossRef] [Green Version]
  17. Manshad, E.P.; Manshad, S.J. MICOO (Multimodal Interactive Cubes for Object Orientation): A tangible user interface for the blind and visually impaired. In Proceedings of the ASSETS’11: 13th International ACM SIGACCESS Conference on Computers and Accessibility, Dundee, Scotland, UK, 24 October 2011. [Google Scholar] [CrossRef]
  18. Morrison, C.; Villar, N.; Thieme, A.; Ashktorab, Z.; Taysom, E.; Salandin, O.; Cletheroe, D.; Saul, G.; Blackwell, A.F.; Edge, D.; et al. Torino: A Tangible Programming Language Inclusive of Children with Visual Disabilities. Hum. Comput. Interact. 2020, 35, 191–239. [Google Scholar] [CrossRef] [Green Version]
  19. Sitdhisanguan, K.; Chotikakamthorn, N.; Dechaboon, A.; Out, P. Using tangible user interfaces in computer-based training systems for low-functioning autistic children. Pers. Ubiquitous Comput. 2012, 16, 143–155. [Google Scholar] [CrossRef]
  20. Francis, G.A.; Farr, W.; Mareva, S.; Gibson, J.L. Do Tangible User Interfaces promote social behaviour during free play? A comparison of autistic and typically-developing children playing with passive and digital construction toys. Res. Autism Spectr. Disord. 2019, 58, 68–82. [Google Scholar] [CrossRef] [Green Version]
  21. Al Mahmud, A.; Soysa, A.I. POMA: A tangible user interface to improve social and cognitive skills of Sri Lankan children with ASD. Int. J. Hum. Comput. Stud. 2020, 144, 102486. [Google Scholar] [CrossRef]
  22. Price, S.; Rogers, Y.; Scaife, M.; Stanton, D.; Neale, H. Using ‘tangibles’ to promote novel forms of playful learning. Interact. Comput. 2003, 15, 169–185. [Google Scholar] [CrossRef]
  23. Ramirez, J.L. Gamificación: Mecánicas De Juegos En Tu Vida Personal Y Profesional; RC Libros: Mexico, 2014. [Google Scholar]
  24. Kapp, K.M. Games, gamification, and the quest for learner engagement. ATD JUNE 2012, 66, 64–68. [Google Scholar]
  25. Medyńska-Gulij, B.; Zagata, K. Experts and Gamers on Immersion into Reconstructed Strongholds. ISPRS Int. J. Geo-Inf. 2020, 9, 655. [Google Scholar] [CrossRef]
  26. Sari, A.C.; Fadillah, A.M.; Jonathan, J.; Prabowo, M.R.D. Interactive Gamification Learning Media Application for Blind Children Using Android Smartphone in Indonesia. Procedia Comput. Sci. 2019, 157, 589–595. [Google Scholar] [CrossRef]
  27. Fi, Y.; Udjaja, Y.; Sari, A.C. A Gamification Interactive Typing for Primary School Visually Impaired Children in Indonesia. Procedia Comput. Sci. 2017, 116, 638–644. [Google Scholar] [CrossRef]
  28. Saltiveri, G.T.I. MPIu+a. Una metodología que integra la Ingeniería del Software, la Interacción Persona-Ordenador y la Accesibilidad en el contexto de equipos de desarrollo multidisciplinares. Univ. Lleida España 2004. [Google Scholar]
  29. Serna, V.V.; Rodriguez, F.J.A.; Arteaga, J.M.; Gallegos, J.C.P.; Robles, T.A. MICEE Methodology. In Proceedings of the 2019 International Conference on Inclusive Technologies and Education (CONTIE); Institute of Electrical and Electronics Engineers (IEEE), San Jose del Cabo, Mexico, 30 October 2019; pp. 79–795. [Google Scholar]
  30. Mazuera, S.P.C. Propuesta Metodológica para el Diseño de Juegos Serios para Niños con Implante Coclear. Univ. Cauca 2016. [Google Scholar]
  31. Massa, S.; de Giusti, A.; Pesado, P. MPOBA: Un Modelo de Proceso para el desarrollo de Objetos de Aprendizaje, XVII Congr. Argentino Ciencias Comput. 2011. [Google Scholar]
  32. Werbach, K.; Hunter, D. The Gamification Toolkit: Game Elements. Win How Game Think. Can Revolut. Your Bus. 2012. [Google Scholar]
  33. Jafri, R.; Aljuhani, A.M.; Ali, S.A. A tangible user interface-based application utilizing 3D-printed manipulatives for teaching tactual shape perception and spatial awareness sub-concepts to visually impaired children. Int. J. Child-Comput. Interact. 2017, 11, 3–11. [Google Scholar] [CrossRef]
  34. Antle, A.N. Designing tangibles for children: What designers need to know. In Proceedings of the CHI ’07 Extended Abstracts on Human Factors in Computing Systems, San Jose, CA, USA, 28 April–3 May 2007; pp. 2243–2248. [Google Scholar] [CrossRef]
  35. Wyeth, P.; Purchase, H.C. Using developmental theories to inform the design of technology for children. In Proceedings of the 2003 Conference; ACM, New York, NY, USA, 6–7 June 2003; p. 93. [Google Scholar]
  36. Sapounidis, T.; Demetriadis, S.; Stamelos, I. Evaluating children performance with graphical and tangible robot programming tools. Pers. Ubiquitous Comput. 2015, 19, 225–237. [Google Scholar] [CrossRef]
  37. Lazzaro, N. Why We Play Games: Four Keys to More Emotion without Story. 2004. Available online: https://ubm-twvideo01.s3.amazonaws.com/o1/vault/gdc04/slides/why_we_play_games.pdf (accessed on 1 May 2021).
  38. Oriol, G. Fundamentos de la Gamificación. 2015. Available online: http://oa.upm.es/35517/1/fundamentos%20de%20la%20gamificacion_v1_1.pdf (accessed on 1 May 2021).
  39. Gaitán, V. Gamificación: El Aprendizaje Divertido 2013. Available online: https://www.educativa.com/blog-articulos/gamificacion-el-aprendizaje-divertido/ (accessed on 1 May 2021).
  40. Zichermann, G.; Cunningham, C. Gamification by Design; O’Reilly Media: Newton, MA, USA, 2011. [Google Scholar]
  41. Underkoffler, J.; Ishii, H. Urp: A luminous-tangible workbench for urban planning and design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Pittsburgh, PA, USA, 15–20 May 1999; pp. 386–393. [Google Scholar]
  42. Reactivision. 2020. Available online: http://reactivision.sourceforge.net/ (accessed on 2 January 2021).
  43. Krantz, S.G. A Retrospective; Cambridge University Press (CUP): Cambridge, UK, 1999; pp. 313–314. [Google Scholar]
  44. Pino, F.J.; García, F.; Ruiz, F.; Piattini, M. Adaptation of the standards ISO/IEC 12207:2002 and ISO/IEC 15504:2003 for the assessment of the software processes in developing countries. IEEE Latin Am. Trans. 2006, 4, 85–92. [Google Scholar] [CrossRef]
  45. Álvarez, T.; Rodríguez, F.J.Á.; Benitez, E.I. Metodología Para La Evaluación De La Ex-Periencia Del Usuario De Sistemas De Software Interactivos Para Usuarios Ciegos. Univ. Veracruzana 2019. [Google Scholar]
  46. Zaman, B.; Abeele, V.V.; Markopoulos, P.; Marshall, P. Editorial: The evolving field of tangible interaction for children: The challenge of empirical validation. Pers. Ubiquitous Comput. 2011, 16, 367–378. [Google Scholar] [CrossRef] [Green Version]
  47. Xie, L.; Antle, A.N.; Motamedi, N. Are tangibles more fun? In Proceedings of the 2nd International Conference on Cryptography, Security and Privacy, ACM, New York, NY, USA, 6–10 October 2009; pp. 191–198. [Google Scholar]
  48. Sapounidis, T.; Stamovlasis, D.; Demetriadis, S. Latent Class Modeling of Children’s Preference Profiles on Tangible and Graphical Robot Programming. IEEE Trans. Educ. 2018, 62, 127–133. [Google Scholar] [CrossRef]
  49. Sapounidis, T.; Demetriadis, S.; Papadopoulos, P.M.; Stamovlasis, D. Tangible and graphical programming with experienced children: A mixed methods analysis. Int. J. Child-Comput. Interact. 2019, 19, 67–78. [Google Scholar] [CrossRef]
  50. Shaer, O.; Horn, M.S.; Jacob, R.J. Tangible user interface laboratory: Teaching tangible interaction design in practice. Artif. Intell. Eng. Des. Anal. Manuf. 2009, 23, 251–261. [Google Scholar] [CrossRef]
  51. Jensen, M.V.; Buur, J.; Djajadiningrat, T. Designing the user actions in tangible interaction. In Proceedings of the 4th Decennial Aarhus Conference on Critical Computing Between Sense and Sensibility, Aarhus, Denmark, 20 August 2005. [Google Scholar] [CrossRef]
  52. Carulli, M.; Bordegoni, M. Rapid prototyping products mapping live-data streams into tangible user interfaces. In Proceedings of the International Conference on Engineering Design, Vancouver, BC, Canada, 21–25 August 2017; Volume 9. no. DS87-9. [Google Scholar]
  53. Núñez, M. Matemáticas para alumnos con problemas visuales. Univ. Rioja 2017. [Google Scholar]
  54. Aguiar, L.R.R.; Rodríguez, F.J. Álvarez METUIGA Methodology for the Design of Systems Based on Tangible User Interfaces and Gamification Techniques. In Transactions on Petri Nets and Other Models of Concurrency XV; Springer Science and Business Media LLC: Berlin/Heidelberg, Germany, 2020; pp. 229–245. [Google Scholar]
  55. Aguiar, L.R.R.; Rodríguez, F.J.Á. Metuiga ‘Metodología Para El Diseño De Sistemas Basados En Interfaces Tangibles De Usuario Y Técnicas De Gamificación’ En La Enseñanza De Porciones Matemáticas Para Niños Ciegos. ReCIBE, Rev. Electrón. Comput. Inf. Bioméd. Electrón. 2020, 9, C4–C11. Available online: http://recibe.cucei.udg.mx/ojs/index.php/ReCIBE/article/view/167 (accessed on 2 May 2021).
  56. American Psychiatric Association. DSM-IV Manual Diagnóstico y Estadístico de Los Trastornos Mentales; Instituto Municipal de Investigación Médica, Departamento de Informática Médica: Barcelona, Spain, 2009. [Google Scholar]
  57. Martínez, J.L.; García, S.A.; Bernabeu, M. Competencias emocionales del alumnado con Trastornos del Espectro Autista en un Aula Abierta Específica de Educación Secundaria. Aula Abierta 2012. [Google Scholar]
  58. Unity Unity3D. 2020. Available online: https://unity.com (accessed on 25 August 2020).
  59. Scarborough, N.M. Essentials of Entrepreneurship and Small Business Management. Glob. Ed. 2016. [Google Scholar]
  60. Sapounidis, T.; Stamelos, I.; Demetriadis, S.; Papadopoulos, P.M.; Burger, R.; Faria, A. Tangible User Interfaces for Programming and Education: A New Field for Innovation and Entrepreneurship. Adv. Digit. Educ. Lifelong Learn. 2016, 2, 271–295. [Google Scholar] [CrossRef]
  61. Rodić, L.D.; Granić, A. Tangible interfaces in early years’ education: A systematic review. Pers. Ubiquitous Comput. 2021, 1–39. [Google Scholar] [CrossRef]
  62. Manshad, M.S.; Pontelli, E.; Manshad, S.J. Trackable Interactive Multimodal Manipulatives: Towards a Tangible User Environment for the Blind. Trans. Petri Nets Other Models Concurr. XV 2012, 664–671. [Google Scholar] [CrossRef]
  63. Nielsen, J. How to conduct a heuristic evaluation. Nielsen Norman Gr. 1995, 1, 1–8. [Google Scholar]
  64. Antle, A.N.; Corness, G.; Droumeva, M. What the body knows: Exploring the benefits of embodied metaphors in hybrid physical digital environments. Interact. Comput. 2009, 21, 66–75. [Google Scholar] [CrossRef]
  65. Antle, A.N. Exploring how children use their hands to think: An embodied interactional analysis. Behav. Inf. Technol. 2013, 32, 938–954. [Google Scholar] [CrossRef]
  66. Horn, M.S.; Solovey, E.T.; Crouser, R.J.; Jacob, R.J.K. Comparing the use of tangible and graphical programming languages for informal science education. In Proceedings of the Conference on Human Factors in Computing Systems-Proceedings, Boston, MA, USA, 4 April 2009. [Google Scholar] [CrossRef] [Green Version]
Figure 1. METUIGA methodology.
Figure 1. METUIGA methodology.
Applsci 11 05676 g001
Figure 2. METUIGA methodology requirements stages.
Figure 2. METUIGA methodology requirements stages.
Applsci 11 05676 g002
Figure 3. TAC palette to describe behavior of tangible objects when interacting with a tangible interface. Source: [41].
Figure 3. TAC palette to describe behavior of tangible objects when interacting with a tangible interface. Source: [41].
Applsci 11 05676 g003
Figure 4. Diagram to build a tangible interface proposed by Reactivision. Source: [42].
Figure 4. Diagram to build a tangible interface proposed by Reactivision. Source: [42].
Applsci 11 05676 g004
Figure 5. METUIGA methodology design stages.
Figure 5. METUIGA methodology design stages.
Applsci 11 05676 g005
Figure 6. METUIGA methodology implementation stages.
Figure 6. METUIGA methodology implementation stages.
Applsci 11 05676 g006
Figure 7. METUIGA methodology evaluation stages.
Figure 7. METUIGA methodology evaluation stages.
Applsci 11 05676 g007
Figure 8. Multidisciplinary areas working together to create prototypes.
Figure 8. Multidisciplinary areas working together to create prototypes.
Applsci 11 05676 g008
Figure 9. Interaction between the gamification elements, the developed application, and the tangible user interfaces.
Figure 9. Interaction between the gamification elements, the developed application, and the tangible user interfaces.
Applsci 11 05676 g009
Figure 10. (a) Graphical interfaces of the Geotag application; (b) Interaction with the tangible interface by overlaying an element. Source: [54].
Figure 10. (a) Graphical interfaces of the Geotag application; (b) Interaction with the tangible interface by overlaying an element. Source: [54].
Applsci 11 05676 g010
Figure 11. (a) Graphical interfaces of tangible portion’s application; (b) Interaction with tangible interface by superimposing two elements to represent a composite portion. Source: [55].
Figure 11. (a) Graphical interfaces of tangible portion’s application; (b) Interaction with tangible interface by superimposing two elements to represent a composite portion. Source: [55].
Applsci 11 05676 g011
Figure 12. (a) Graphical interfaces of Tangible Emotions application; (b) Tangible elements of tangible emotions application and their fiducial marker.
Figure 12. (a) Graphical interfaces of Tangible Emotions application; (b) Tangible elements of tangible emotions application and their fiducial marker.
Applsci 11 05676 g012
Figure 13. (a) Internal components of tangible interface; (b) Tangible emotions application running on tangible interface.
Figure 13. (a) Internal components of tangible interface; (b) Tangible emotions application running on tangible interface.
Applsci 11 05676 g013
Figure 14. Evaluation model of a methodology. Source: Own creation, based on Méndez and Garrido [9].
Figure 14. Evaluation model of a methodology. Source: Own creation, based on Méndez and Garrido [9].
Applsci 11 05676 g014
Table 1. Software methodologies analysis.
Table 1. Software methodologies analysis.
Software MethodologyDisabilityGamificationTUIBlind People
Mpiu + a [28].NONONONO
MICEE [29].YESNONONO
MECONESIS [30].YESYESNONO
MPOBA [31].NONONONO
METUIGA.YESYESYESYES
Table 2. Categories or types of gamifications in requirements stage. Source: [32].
Table 2. Categories or types of gamifications in requirements stage. Source: [32].
Type of GamificationDescription
InternalTo improve motivation within an organization
ExternalWhen seeking to involve customers by improving the relationship between them and the company.
Behavioral changeIt seeks to generate new habits in the population, from encouraging them to choose healthier options to redesigning the classroom and encouraging them to learn more while enjoying themselves.
Table 3. Suggested projects to identify tools using tangible user interfaces in requirements stage.
Table 3. Suggested projects to identify tools using tangible user interfaces in requirements stage.
NameDescription
Tangible User Interfaces to Ease the Learning Process of Visually-Impaired Children [33].NFC technology is used to enable users to interact with physical objects using the tangible interface. Objects are identified with NFC tags placed inside them transparently to the user. The application is deployed on a mobile device with an NFC reader to recognize the objects and react accordingly.
MICOO (Multimodal Interactive Cubes for Object Orientation): A tangible user interface for the blind and visually impaired [17]. MICOO has been developed from scratch, using affordable and readily available hardware components. The system enables natural interaction using MICOO on a multi-touch surface. The tangible interface is controlled via multiple infrared cameras to track MICOO’s movement.
A tangible user interface-based application utilizing 3D-printed manipulatives for teaching tactual shape perception and spatial awareness sub-concepts to visually impaired children [16].For object tracking at tangible interface, they use Trackmate, an open-source tangible tracking system based on computer vision, introduced by the Tangible Media Group at the MIT Medioa Lab.
Using tangible user interfaces in computer-based training systems for low-functioning autistic children [19].A web camera placed underneath the tabletop to detect and identify the chosen tangible object. Infrared LED tubes were embedded on each tangible object. Each wood block or toy contains a unique number of tubes. Thus, from the picture taken by a web camera, the number of bright spots can be used to identify the selected and placed object.
Designing tangibles for children: What designers need to know [34].Introduces four areas of cognitive development which may be relevant for the design of tangible systems.
Using Developmental Theories to Inform the Design of Technology for Children [35].Concerns the development of a new educational resource for early childhood technology education. The
development has involved a detailed analysis of the target audience, the formulation of appropriate design criteria, the construction of the resource and its subsequent evaluation.
Evaluating children performance with graphical and tangible robot programming tools [36].Presented a comparison study of children’s performance using the two isomorphic subsystems (TUI vs. GUI).
Table 4. Gamification activities to be followed within METUIGA methodology in design stage.
Table 4. Gamification activities to be followed within METUIGA methodology in design stage.
Type of GamificationDescription
Challenge and misiónWithin a gamified system it is important to include challenges and missions to keep the users’ attention. Strong fun is associated with challenges, based on the pleasure of overcoming the challenge [37,38].
Mission classificationA mission is composed of one or more challenges, in this section we classify the challenges that will be part of each mission.
Gamification structureFollowing a gamification structure is important to achieve a good end-user satisfaction. For this reason, a structure composed of six components (Challenges, Conditional Wins, Leaderboards, Medals, Social Networks, Status) is provided to choose the most appropriate structure to develop the project.
Choice of game mechanis and game dynamicsMechanical techniques are ways of rewarding users according to objectives achieved (accumulation of points, level status, obtaining prizes, rewards, rankings, challenges, missions or challenges), while dynamic techniques refer to users’ own motivation to play and move forward in achieving their objectives (rewards, status, achievement, compensation) [39].
System avatarPersonalization is an important aspect in gamification implementation, for this reason an avatar creation is proposed in case that development team considers it appropriate to encourage interaction between normal-visual people and blind people. Even a simple player headshot and screen name can be considered an avatar, providing player with an opportunity for customization [40].
Table 5. Some challenges and integrated missions to encourage tangible object use in GeoTang application.
Table 5. Some challenges and integrated missions to encourage tangible object use in GeoTang application.
TypeDescriptionRewards
ChallengesUses object representing a triangle50 coins and a medal
ChallengesUses object representing a rectangle50 coins and a medal
MissionUses all tangible objects150 coins and a medal
ChallengesDiscover which object represents a circle100 coins and a medal
MissionRelates 50% of questions correctly with their tangible object.200 coins and a medal
Table 6. Some integrated challenges and missions to encourage tangible objects use in Tangible portions application.
Table 6. Some integrated challenges and missions to encourage tangible objects use in Tangible portions application.
TypeDescriptionRewards
ChallengesUses an object to represent 1/3Medal
ChallengesUses an object to represent 1/4Medal
MissionUses multiple objects to represent one fractionMedal
ChallengesUses all tangible objectsMedal
Table 7. Comparison of the gamification elements and the tangible features between the prototypes presented.
Table 7. Comparison of the gamification elements and the tangible features between the prototypes presented.
ApplicationLivesRewardsAvatarLevelsProgressMulti-ObjectsFeedbackStoreVirtual Money
Geotag application***** ***
Tangible portion’s** ****
Tangible emotions * ** *
* This scale was weighted to obtain results where 5 was 100%, 4 was 80%, 3 was 60%, 2 was 40% and 1 was 10%.
Table 8. Competitive profile matrix.
Table 8. Competitive profile matrix.
Success FactorsWeightingStage #Stage #
ScoreWeighted ResultScoreWeighted Result
Total score:
Table 9. Table to calculate variable weightings. Source: Own creation, based on Méndez and Garrido [9].
Table 9. Table to calculate variable weightings. Source: Own creation, based on Méndez and Garrido [9].
Success FactorsAchieved ScoreWeighted 1Total
123450.20.40.60.81
12345
Methodology must be adjusted to the objectives001440.0000.0000.1110.4440.4440.867
Methodology should cover the entire software development cycle001260.0000.0000.1110.2220.6670.911
Methodology must integrate the different phases of development cycle000540.0000.0000.0000.5560.4440.889
Methodology should include validation of the following002430.0000.0000.2220.4440.3330.822
Methodology must support the determination of system accuracy throughout the development cycle003420.0000.0000.3330.4440.2220.778
Methodology must be the basis for effective communication011340.0000.1110.1110.3330.4440.822
Methodology must work in a dynamic user-oriented environment022140.0000.2220.2220.1110.4440.756
Methodology should clearly specify who is responsible for results010440.0000.1110.0000.4440.4440.844
Methodology must be able to be used in a wide software project environment.000540.0000.0000.0000.5560.4440.889
Methodology should be teachable001530.0000.0000.1110.5560.3330.844
Methodology must be supported by CASE tools003510.0000.0000.3330.5560.1110.756
Methodology must support the eventual evolution of system011430.0000.1110.1110.4440.3330.800
Methodology must contain activities leading to improve the software development process003330.0000.0000.3330.3330.3330.800
1 This scale was weighted to obtain results where 5 was 100%, 4 was 80%, 3 was 60%, 2 was 40% and 1 was 10%.
Table 10. METUIGA methodology evaluation matrix.
Table 10. METUIGA methodology evaluation matrix.
Success FactorsWeightingStage 1Stage 2
ScoreWeighted ResultScoreWeighted Result
Methodology must be adjusted to the objectives0.08220.16330.245
Methodology should cover the entire software development cycle0.08630.25840.344
Methodology must integrate the different phases of development cycle0.08430.25240.336
Methodology should include validation of the following0.07720.15430.232
Methodology must support the determination of system accuracy throughout the development cycle0.07330.21840.291
Methodology must be the basis for effective communication0.07730.23240.309
Methodology must work in a dynamic user-oriented environment0.07140.28230.212
Methodology should clearly specify who is responsible for results0.07930.23840.318
Methodology must be able to be used in a wide software project environment.0.08440.33640.336
Methodology should be teachable0.07940.31840.318
Methodology must be supported by CASE tools0.07130.21240.282
Methodology must support the eventual evolution of the system0.07540.340.300
Methodology should contain activities leading to improve the software development process0.07540.340.300
Total score: 3.263 3.822
Table 11. Top six success factors obtained in the surveys.
Table 11. Top six success factors obtained in the surveys.
Success FactorScore
Methodology should cover the entire software development cycle0.911
Methodology must integrate the different phases of the development cycle0.889
Methodology must be able to be used in a wide software project environment0.889
Methodology must be adjusted to the objectives0.867
Methodology must clearly specify those responsible for results.0.844
Methodology should be teachable0.844
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ramos Aguiar, L.R.; Álvarez Rodríguez, F.J. Methodology for Designing Systems Based on Tangible User Interfaces and Gamification Techniques for Blind People. Appl. Sci. 2021, 11, 5676. https://doi.org/10.3390/app11125676

AMA Style

Ramos Aguiar LR, Álvarez Rodríguez FJ. Methodology for Designing Systems Based on Tangible User Interfaces and Gamification Techniques for Blind People. Applied Sciences. 2021; 11(12):5676. https://doi.org/10.3390/app11125676

Chicago/Turabian Style

Ramos Aguiar, Luis Roberto, and Francisco Javier Álvarez Rodríguez. 2021. "Methodology for Designing Systems Based on Tangible User Interfaces and Gamification Techniques for Blind People" Applied Sciences 11, no. 12: 5676. https://doi.org/10.3390/app11125676

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop