Abstract
In Ecuador, 30% of the population does not consume drinking water of good quality. One of the causes is related to the deficiency in the technical skills of water operators because some have not had access to elementary, high school or higher education due to factors of extreme vulnerability. The Massive Open Online Courses (MOOCs), having an inclusive and accessible typology with attention to people at risk of social exclusion are an option to strengthen the skills of operators. Therefore, the goal of this study is to create an instructional design in MOOCs that responds to the characteristics and learning needs of a sample of 286 operators of the drinking water system. The instructional design is based on the information systems success model of DeLone and McLean and the quality principles of Merrill, Margaryan, Locke, Latham and Seijts. The results present an instructional design including quality content with objectives and learning strategies that respond to the learning characteristics of the operators as well as activities and resources with a cognitive, emotional, and behavioral didactic approach oriented at changing attitudes to learning. Finally, we can conclude that the developed instructional design promotes a more inclusive, equitable and quality education.
1. Introduction
The Constitution of the Republic of Ecuador [1] declares water as a vital and inalienable human right, and articles 55, 134 and 137 of the Organic Code of Autonomy and Decentralization Territorial Organization (COOTAD) [2] established that the provision of drinking water service is an exclusive competence of the Autonomous Decentralized Municipal Governments (GADM). Therefore, water management should be public- or community–based. However, the GADMs may delegate participation in strategic sectors and public services to joint companies.
According to the National Secretariat of Water (SENAGUA), community management is the most predominant form of water service provision in rural areas, so the GADPs coordinate this service with 7000 Drinking Water and Sanitation Administrative Boards (JAAPS) that are responsible for providing drinking water [3].
The 2016 National Employment, Unemployment and Under-Employment Survey (ENEMDU) indicated that 70.1% of the population at the national level has access to drinking water (79.1% in urban areas and 51.4% in rural zones). It’s important to highlight that 49% of the rural area in our country lacks access to drinking water and the JAAPS present financial sustainability and water quality problems [3]. In Figure 1, it is observed that the provinces of Guayas, Los Rios, and Tungurahua have the lowest percentage representation (60%–78%) in the water treatment system, unlike the rest of the provinces [4].
Figure 1.
Percentage representation of provinces that have a drinking water treatment system.
On the other hand, according to the Water Balance carried out by the Water Regulation and Control Agency (ARCA) (SENAGUA, 2017), the demarcations of Jubones, Manabí, and Puyango-Catamayo have deficits in water availability, and instead the provinces of Pastaza and Napo have a greater availability of this resource [3].
In Ecuador, the Ecuadorian Standardization Service (INEN) is the body that issues, applies and evaluates compliance with the INEN 1108 Water Standard for Human Consumption [5]. The 1108 standard is based on international standards recognized by the United States Environmental Protection Agency (EPA), World Health Organization (WHO), American Public Health Associations (APHA), among other standards [6,7]. Only 4 out of 221 municipalities in Ecuador have received the quality seal for drinking water consumption by the Ecuadorian Standardization Service [8]. Some municipalities cannot meet these standards because they lack the knowledge or the technologies for drinking water treatment. One of the causes is related to the deficiencies in the technical ability of the operators due to their level of education, technical training, and experience, among other aspects. In addition, the academic offer of Higher Education Institutions (IES) does not respond to the number of operators, technicians, or engineers that the water sector demands in all regions of the country; for example, in Ecuador there are only three undergraduate programs in hydrology and three postgraduate programs related to water drinking treatment. So, there is no formal training program for water operators [9]. These problems are even worse in small cities, or rural areas. These difficulties also occur globally; for example, in a study carried out in 2015 by IWA [10] in 15 countries, such as Mali, Bangladesh, South Africa, Zambia, Tanzania, Mozambique, Burkina Faso, Niger, Senegal, and the Philippines. In addition, some deficiencies are related to the training and retention of human talent. These are:
- The educational offer does not adjust to the needs of the market.
- Lack of financial resources to recruit and retain staff.
- The number of existing technicians or engineers is insufficient for market need.
- Most human resources have elementary and high school instruction only.
From our point of view, one of the greatest problems in the training of operators is related to access to inclusive, equitable, and quality education. In Latin America and the Caribbean, 11,970 children, adolescents, and young people do not go to school because many of them may have special needs, are disabled or may be poor, refugees or may live in rural areas, among other types of vulnerabilities. However, speaking of inclusive education is usually associated with the needs of people with disabilities, when it really should be associated with diversity factors, such as: gender, age, location, poverty, disability, ethnicity, language, religion, migration or displacement situation, imprisonment, beliefs, attitudes, etc. Therefore, inclusive education is a process that contributes to achieving the goal of social inclusion where educational institutions, government, and industry are key actors for fair, responsible, and inclusive training [11].
We from the academy believe that the creation of Massive Open Online Courses (MOOC) could help bridge social gaps in relation to access to quality, inclusive, and equitable education for those groups that have historically been excluded but are interested in sustainable engineering practices, specifically related to the drinking water system in Ecuador. In this sense, the MOOCs have a disruptive approach because they are easily accessible, free of charge, and can be massified, allowing for the participation of a large number of students, contributing to social inclusion, the distribution of knowledge and educational innovation [12].
Indeed, since the New York Times [13] named 2012 as “the year of MOOCs” the participation of people in massive online courses has been exponential. It is the case that the platform with the largest number of MOOCs -Coursera- offers approximately 3000 courses with more than 97 million students, followed by edX with more than 3000 courses and approximately 42 million students [14]. However, access to inclusive education should not be summed up as free access or in the potential of MOOCs to involve a large number of participants, but rather in creating content with quality resources and activities that respond to student characteristics and learning needs in order to have a positive impact on student learning [15]. This context generates a challenge due to the high heterogeneity of the students. However, this could be improved to the extent that the MOOCs respond to the learning characteristics of social groups or communities [12]. However, MOOCs still have problems, such as: The high dropout rate, the design of activities for engineering careers, the type of evaluation, communication, feedback, sustainability, among other aspects [16]. These problems have led to studies [17] that analyze factors which can influence the quality of the design and content of MOOCs, drop out as well as personalized learning in response to learning needs and preferences, prior knowledge, context of participation and diversity of functionalities on online platforms, such as: videos, readings, forums, wiki, quizzes, and exercises with options like multiple answers, fill-in-the-blank, and text, among other functions [18,19,20]. Personalization plays an important role in responding to personal, social, emotional, cognitive, and academic characteristics in a learning environment [21]. Cooper and Mehran in their paper “Education Reflections on Stanford’s MOOCs” mention the need to create personalized courses with learning environments that respond to the unique learning needs of students [22]. Likewise, in 2015, Zapata Ros stated that: “In personalized education, the instructional design is individualized as a whole, or as far as possible, to adapt it to the learning characteristics detected in the student’s personal environment” [23].
The most common way to carry out personalized MOOCs is through adaptive learning, which uses learning analysis and data mining techniques in order to identify characteristics, learning styles or interaction similarities, and then incorporating learning activities with the aim of promoting a significant impact on student performance [24,25,26,27]. There are also studies that consider the learning characteristics of the participants as a reference to offer a certain course, but the results have not been satisfactory due to the high heterogeneity of the participants [28]. Finally, another type of personalized learning in MOOCs is gamification, which mainly considers the social aspect of learning characteristics [21]. For us, a personalized MOOC is based on the creation of an instructional design that takes into account the characteristics, needs and learning preferences of the students, as well as the quality criteria and principles for designing a quality MOOC [29,30]. For now, in the reviewed literature it has not been possible to find studies that have described how the characteristics, needs, and learning preferences are considered in the instructional design of a personalized MOOC that is relevant, inclusive, equitable, and of quality. However, two different pedagogical forms of MOOC are discussed in the literature: The conventional massive open online course (xMOOC) and the connectivist massive open online course (cMOOC). Some researchers believe that these two approaches have a reductionist view [31], leading other researchers to present a MOOC taxonomy with eight different pedagogical perspectives, such as: transfer MOOCs, made MOOCs, synch MOOCs, async MOOCs, adaptive MOOCs, group MOOCs, connectivism MOOCs, and mini-MOOCs [32]. Added to these pedagogical perspectives are the transfer courses, the massive open online courses (tMOOC) and sMOOCs [33]. The sMOOC was developed in 2014 as part of a European Elearning project “https://project.eco-learning.eu” (accessed on 5 October 2022) based on connectivism, situated learning, and the social constructivist perspective that has characterized online learning [34].
The characteristic of the sMOOC model includes being open, inclusive, and accessible to a wide variety of people, paying attention to those at risk of social exclusion [35]. Likewise, the model aims to promote the relationship between learning and the life experience of users through the contextualization of content and supporting adaptive learning strategies [36]. Indeed, there is research that points to sMOOCs and tMOOCs C, as the most relevant and disruptive social learning phenomena and methods in emerging countries [37].
In summary, we can say that depending on the characteristics and approach to the type of MOOC, it could bring you closer to a more inclusive education. However, for learning to be transformative, personalization of learning must include activities that allow the student to activate, demonstrate, apply, and integrate knowledge together with the incorporation of authentic resources based on real activities [38,39]. According to Merizow’s theory, education is a process of critical reflection that leads the student to a transformation of thought [40]. For transformative learning to occur, the student must have opportunities within the learning environment to allow them to act [40]. Therefore, the design of a MOOC must have activities and resources with an effective approach in order to generate an affective dissonance which motivates students to act both in the course activities and in their work, professional or personal activities [41,42].
In this paper our objective is to create an instructional design that takes as a reference the design approach of the sMOOCs model characterized by inclusion, equity, and access to a wide variety of people with diverse learning characteristics. In this sense, the application of criteria and principles such as: problem-centered, activation, demonstration, application, integration, collective knowledge, collaboration, differentiation, and authentic resources, will allow the creation of learning strategies that respond to the characteristics and learning needs of the water system operators. In summary, in this study we present a detailed description of the instructional design, including: (1) characteristics and learning needs of the operators of the Ecuadorian water system, (2) the application of principles and quality criteria for the instructional design and development of MOOCs, and (3) the use of the didactic concept; attitudinal change.
Finally, we want to mention that from May to October 2021, a survey was applied with the aim of identifying and assessing the characteristics and learning needs of the operators of the drinking water system, as well as to identify what type of activities or resources are preferred when taking an online course. The selected sample included cities from the population quintels Q25, Q50, and Q75 in order to understand the heterogeneity or diversity of learning characteristics. Twelve cities were selected, and eight cities confirmed their participation (67%) such as: Guayaquil (Q > 75), Portoviejo (Q50), El Empalme (Q25), La Libertad (Q25), Santa Elena (Q25), Salinas (Q25), Villamil Playas (Q25), and Gualaquiza (Q25). In the case of Guayaquil, the Posorja parish, and Puna Island were also included. Applying a stratified sampling by city, we determined a total sample size of 286 workers, which corresponds to the cities which participated in the project, and 100% of the sample was surveyed. With the collected data, an analysis of principal components and cluster analysis was carried out and the following profile was obtained [43].
Target Learners Profile: Operators have quality internet access at home, as well as access to computers and smartphones. They hold a high school degree and have between 1 and 5 years of experience as operators. They prefer the course to be online and face-to-face, containing mainly videos, practical exercises, hands-on activities, and readings focused on real situations as well as daily work activities. They would like to be trained in topics such as: Valves/Pump Types/Reservoirs/Power Generators/In-Line Sensors/Surface Water/Chemical feeders/Wells/Health risk assessment/Economic aspects. They prefer the MOOC to be a 4-week course with 2 h of weekly work. They would like to register for the course with friends/colleagues and prefer to take the course at home. Finally, the main motivation to take the course would be to obtain a certification and improve their performance at work.
Specifying the RQ.
With the objective in mind and the identification of the profile target learners, the following research question was developed:
What are the learning strategies that meet the principles and quality criteria of an instructional design as well as the characteristics and learning needs of water operators?
2. Materials and Methods
The main scenario that this study considers is the instructional design of a MOOC for operators of the drinking water system in Ecuador, which contemplates three perspectives: personalization, education, and technology.
Personalization perspective includes: (a) Identifying learning characteristics that have been widely described in the literature and can be synthesized into five categories: (1) personal; (2) academic; (3) social; (4) emotional; and (5) cognitive.
Education perspective includes: (b) Quality content through learning strategies and activities that considers generally accepted quality principles and criteria and that responds to unique learning needs to promote (c) attitudinal change in student behavior.
Technological perspective: Is the (d) quality of the online platform understood as easy to teach, use, and learn. Figure 2 presents an information model [44] adapted to the MOOC personalization context, where the three perspectives are displayed in components (a), (b), (c), and (d), influencing the design, development, implementation, and realization of the online course. Likewise, the degree of use or performance of the activities hypothetically supposes an increase in engagement, resulting in a positive influence on the performance of the student (water operator). Finally, with the results obtained in performance, improvements can be incorporated into each of the components.
Figure 2.
DeLone and McLean information model adapted to the context of personalized MOOCs.
It is important to mention that the perspectives of personalization, education, and technology are approaches that are deployed in the components described in the information model, and which in turn are executed systematically through the application of the criteria and principles of quality as well as the use of the didactic concept—Attitude Change—to create an inclusive, equitable, and quality instructional design. Figure 3 presents the relationship between perspectives and components, and how they are deployed through the application of the criteria and quality principles obtained as a result of the instructional design.
Figure 3.
Relationship between perspectives, components and quality criteria, and principles.
2.1. Application of Criteria to Design Quality
For the elaboration of the instructional design, it was necessary to use the criteria of the analysis and design phases to develop a quality MOOC [29]. The criteria of the analysis phase requires the creation of a team to plan the development of the MOOC, as well as to identify the stakeholders. In addition, the criteria indicate that an analysis of the needs and demands must be carried out to obtain a profile of the student. On the other hand, the criteria also recommend carrying out an analysis of the external context to learn about similar MOOCs in order to identify teaching opportunities through the activities and resources to be developed. Likewise, the criteria recommend knowing the training needs or requirements, as well as the information technology required for the development of the MOOC. Table 1 describes the criteria used in the analysis phase and their application to create the instructional design.
Table 1.
Quality Criteria-Analysis Phase.
With regard to the criteria for the design phase, these establish requirements to form a team that is responsible for the didactic concept, the development of course content, the visual realization, and to ensure the correct alignment between the course content, the learning objectives, and the student outcomes to respond to training needs. Likewise, the team is established to define the concepts for learning activities, communication and interaction, feedback, and evaluation. Table 2 describes the criteria used in the design phase and the application for the creation of the instructional design.
Table 2.
Quality Criteria-Design Phase.
2.2. Principles for Quality Instructional Design
The 11 principles to elaborate a quality instructional design were used in the design with the purpose that the content of the course and the learning activities consider the real problems that the operators have in their daily activities, in such a way that the existing knowledge is activated as a foundation for the acquisition of new knowledge and, at the same time, can be demonstrated, applied, and integrated in the real context of their work. In this sense, activities such as exercises or practical assignments activate prior knowledge with a problem focused on daily work activities, but later, through a practical assignment, the operator can demonstrate, apply, and integrate the new knowledge in the reality of their work. Similarly, the practical activities promote collaborative work to achieve the objective of the task, and through the experience and skills of the operators can contribute collectively to the integration of knowledge. On the other hand, the conceptualization of resources such as videos, interviews, testimonials, and readings are focused on showing real situations typical of the daily activities carried out by operators and considering their learning needs and characteristics. Regarding feedback, all the activities to be carried out must have automatic feedback given by the expert, which in our case is the content provider. In this way, we apply the 11 principles in a practical way in the elaboration of the instructional design and, in turn, we reduce the risk of desertion when the MOOC is implemented because we know the factors that most influence dropout is related to the design of the MOOC course and with previous experience because they are net factors or causes of the rest of the factors that generate dropout.
2.3. Didactic Concept: Attitude Change
The didactic concept for the instructional design of the MOOC—Attitude Change—is related to engagement in three aspects: cognitive, affective, and behavioral, allowing us to introduce dissonance as an instructional strategy [42]. For example, a student/operator has cognitive knowledge about how poorly treated water could cause health problems for a person and, therefore, is able to recognize the intense pain or dehydration of a person who has consumed contaminated water. Therefore, he/she experiences feelings of sadness for that person (and perhaps anger, frustration, or guilt). If he/she does not take action to stop a bad water treatment practice, his/her behavior will be inconsistent with his/her knowledge (cognition), and his/her emotions; therefore, she/he will experience unpleasant dissonance. Acting to find a solution will allow him/her to align his/her behavior with his/her emotions and knowledge, eliminating the dissonance which it creates. In this way, it is proposed that the learning activities have a sequential order in the advancement of a module, for example: A cognitive video is shown that addresses a concept, a methodology, statistics or exercises about water treatment, and then a second video where a person appears who suffered an illness due to the consumption of poorly treated water, with this, an emotional dissonance could be created to motivate the operator to carry out the activities of the course correctly and in turn he/she can identify specific activities that can be applied in the work, making the operator aware of the impact his/her work has on peoples’ health. Among the cognitive resources that were selected were: videos and readings, while in the affective aspect testimonies, interviews, and documentaries were selected and in the behavioral aspect they were practical assignments.
3. Results
3.1. Student Outcome, Leaning Objective and Content
In total, the course would have six modules that contribute to the formation of five learning objectives based on Bloom and Anderson’s taxonomy [48,49]. Likewise, these learning objectives are aligned to student outcomes that are evaluated and accredited in certification processes for operators in drinking water treatment in other countries [50]. It is important to mention that 12 heads belonging to treatment plants considered for this study participated in the definition of training problems, learning outcomes, and learning objectives. In general, we can say that the skills to be trained are related to problems of optimal dosage of chemicals in the processes of water intake and treatment of drinking water. Finally, the duration of the course would be 6 weeks with a dedication time of 2 h per week, thus responding to the requirements or preferences of the operators and the quality criteria. Table 3 shows the result of the alignment of the training problems with the student outcomes and the learning objectives.
Table 3.
Alignment between the content, learning objectives, student outcomes and the identified problems.
3.2. Quality Learning Strategies and Activities
Generally, the principles of Application, authentic resources, problem-centeredness, and goal setting are applied in many MOOCs, unlike the principles of activation, collective knowledge, differentiation, and demonstration, which are only applied in less than half of the courses. The principles of integration, collaboration, and expert feedback are present in less than 15% of the courses [30]. In this study, learning strategies that meet the 11 quality principles have been described. However, for now, an application that is embedded in the Edx platform and which is capable of identifying and validating the percentage of participation of the members during the development of a group activity has not been identified. This could be considered a limitation that affects one of the components of the principle of collaboration. Table A1. defines the learning strategies for instructional design based on the 11 quality principles.
Conceptually, 32 activities were planned, including 41 videos, 23 formative quizzes, 7 forums, 6 summative quizzes, 5 practical assignments, and 1 course assessment. Each related to cognitive, affective, and behavioral aspects (Didactic concept: Attitude Change). Approximately 50% of the activities are related to videos because the positive impact it has on online learning is known and it is also a good resource to generate cognitive and emotional dissonance [42,51]. Table A2 presents the types of activities and resources that have been considered for each aspect of attitudinal change. It has been prioritized that the videos be of short duration, recorded in locations of the world of work and conceptualized in daily work activities of the operators. Likewise, videos with an effective approach are represented in the form of testimonies, interviews, and documentaries in order to generate dissonance. In addition, Table A2 shows formative and summative activities that propose a real problem using the “drag and drop” type of question that, in addition to facilitating the conceptualization of the real problem, will also allow the student to observe through images the equipment and tools that are used in water treatment plants, to activate prior knowledge, and hypothetically increase engagement.
3.3. Instructional Design
The sequential order of the learning activities applied in the instructional design is related to the didactic concept -Attitude Change-, that is: The initial activities will always have a cognitive approach, followed by an effective approach to generate an emotional dissonance that motivates the student to perform practical tasks or incorporate specific actions into daily work activities. This approach in other studies has allowed students to feel more informed and confident in their opinion on a topic and, in turn, to have been able to identify specific activities that can be incorporated into their personal or working life [42]. Table 4 shows the architecture of the instructional design of Module 1: Monitoring of intake water, with the learning activities proposed for the creation of a quality instructional design.
Table 4.
Concept didactic-Learning activities.
One of the limitations of this study is not having been able to identify a measurement instrument that clearly shows the individual contribution of each student in a group assignment. In the instructional design, practical group assignments are proposed to contribute to the principle of “collaboration”, however, for now we have not been able to identify or embed a tool in the edX platform that can identify and value the individual contribution of each student in a group activity.
4. Conclusions
In short, an instructional design with learning strategies has been created that responds to the needs, preferences and learning characteristics of water operators belonging to both urban and rural sectors. These learning strategies are based on quality principles and criteria that respond to the demands and needs of a diverse group interested in accessing an inclusive, equitable, and fair education. In turn, the understanding and application of the criteria and principles should generate a space for reflection and thus propose quality content, with clear learning objectives consistent with the training needs and skills that operators are expected to acquire at the end of the course. Therefore, we have known that if it is possible to develop learning strategies that could generate an emotional dissonance that motivates the operator to act, either in the MOOC activities or in the application of specific activities at work, thus promoting awareness and sustainable management of water resources. Finally, we want to mention that the participation of expert professionals in the water sector, heads of water treatment in water companies, experts in education and technicians in the e-learning platform, has allowed the creation of an instructional design adapted to the working world of the operator/student. However, the challenge will be in the implementation of the personalized MOOC and how its execution positively impacts the performance of the operator.
5. Future Work
According to the findings, as future work, an inclusive, equitable and quality MOOC will be implemented considering the instructional design outlined in this paper. However, to assess the impact on student performance it will also be necessary to carry out an experimental study creating two MOOCs: The first is a personalized MOOC that responds to the strategies, activities, and learning resources identified in this study, and the second is a traditional MOOC. The traditional MOOC will reference the structures, activities, and existing resources in drinking water MOOCs found on platforms such as Edx, Coursera, Miriadax.
Author Contributions
Conceptualization, M.B.-L., L.D.-G., and P.H.; methodology, T.S., M.V., M.B.-L. and O.A.; formal analysis, P.L.M.G., O.A., M.V., T.S., L.D.-G., and M.B.-L.; supervision, P.L.M.G., M.V., O.A., writing–original draft, M.B.-L.; writing–review & editing, P.L.M.G., T.S. and P.H. All authors have read and agreed to the published version of the manuscript.
Funding
This research corresponds to project FIEC-258-2020, developed by the Faculty of Electrical and Computer Engineering. It was co-funded by the VLIR-UOS Biodiversity Network Ecuador.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the Research Deanship of ESPOL (Approval code: FIEC-258-2020; Date: 21 August 2020).
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
We would like to thank everyone who helped us with the research, especially the participants and authorities from the water companies. We would also like to thank the anonymous reviewers whose comments helped us improve the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
Table A1.
Learning strategies for the development of a quality instructional design.
Table A2.
Types of resources and activities according to the aspects of attitude change.
References
- La Asamblea Nacional de la República del Ecuador. Constitucion de la Republica del Ecuador 2008; La Asamblea Nacional de la República del Ecuador: Quito, Ecuador, 2008; p. 115. [Google Scholar]
- Presidencia de la Republica Código Orgánico De Organización Territorial, COOTAD. Registro Oficial 2015, 55. Available online: https://www.defensa.gob.ec/wp-content/uploads/downloads/2016/01/dic15_CODIGO-ORGANICO-DE-ORGANIZACION-TERRITORIAL-COOTAD.pdf (accessed on 3 May 2022).
- Consejo Nacional de Competencia. Informe de la Competencia de Gestión de Agua Potable; Consejo Nacional de Competencia: Quito, Ecuador, 2019. [Google Scholar]
- INEC Boletín Técnico No 04-2020-GAD Municipales Económica en Gobiernos Autónomos Descentralizados Municipales Gestión de Agua Potable y Saneamiento. 2021. Available online: https://www.ecuadorencifras.gob.ec/documentos/web-inec/Encuestas_Ambientales/Municipios_2020/Agua_potable_alcantarillado_2020/Boletin_tecnico_APA_2020_VF.pdf (accessed on 13 October 2022).
- Servicio Ecuatoriano de Normalización INEN. Norma Técnica Ecuatoriana Nte Inen 1108:2020 Agua Para Consumo Humano, Requisitos; Servicio Ecuatoriano de Normalización INEN: Quito, Ecuador, 2020; p. 14. [Google Scholar]
- World Health Organization. Guidelines for Drinking-Water Quality; World Health Organization: Geneva, Switzerland, 2017; Volume 55, ISBN 9789241549950. [Google Scholar]
- U.S. Environmental Protection Agency (EPA) Water Quality Standards Handbook. Available online: https://www.epa.gov/sites/production/files/2014-10/documents/handbook-chapter3.pdf (accessed on 16 October 2021).
- Servicio Ecuatoriano de Normalización INEN Listado de Productos Con Convenio para la Utilización del Certificado de Conformidad Con Sello de Calidad INEN. Available online: https://drive.google.com/file/d/1XCotTNYWkWUMd0EVJf-N6ACHJ_fA4nKl/view (accessed on 14 September 2022).
- Consejo de Educación Superior Oferta Vigente Del Sistema de Educación Superior del Ecuador. Available online: http://appcmi.ces.gob.ec/oferta_vigente/ (accessed on 17 August 2021).
- International Water Association. Wash Human Resource Capacity Gaps in 15 Developing Economies an Avoidable Crisis; International Water Associatio: Seacourt, UK, 2014. [Google Scholar]
- UNESCO. Inclusion and Education: Sustainable Development Goals United Nations Educational; Scientific and Cultural Organization: London, UK, 2020; pp. 1–34. [Google Scholar]
- Teixeira, A.M.; Mota, J.; Morgado, L.; Do Carmo Teixeira Pinto, M. Can MOOCs close the opportunity gaps? the contribution of social inclusive pedagogical design. Rev. Fuentes 2019, 21, 239–252. [Google Scholar] [CrossRef] [Scilit]
- Pappano, L. The Year of the MOOC. Available online: https://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-courses-are-multiplying-at-a-rapid-pace.html (accessed on 11 December 2021).
- Shah, D. By The Numbers: MOOCs in 2021. Available online: https://www.classcentral.com/report/mooc-stats-2021/ (accessed on 15 February 2022).
- Ngubane-Mokiwa, S. Accessibility strategies for making MOOCs for people with visual impairments: A universal design for learning (UDL) Perspective; Pan-Commonwealth Forum Open Learn. March 2016, pp. 1–12. Available online: http://oasis.col.org/handle/11599/2561 (accessed on 14 September 2022).
- Ruipérez-Valiente, J.A.; Martin, S.; Reich, J.; Castro, M. The UnMOOCing process: Extending the impact of MOOC educational resources as oers. Sustainability 2020, 12, 7346. [Google Scholar] [CrossRef] [Scilit]
- Aldowah, H.; Al-Samarraie, H.; Alzahrani, A.I.; Alalwan, N. Factors affecting student dropout in MOOCs: A cause and effect decision-making model. J. Comput. High Educ. 2020, 32, 429–454. [Google Scholar] [CrossRef] [Scilit]
- Conache, M.; Dima, R.; Mutu, A. A comparative analysis of MOOC (massive open online course) platforms. Inform. Econ. 2016, 20, 4–14. [Google Scholar] [CrossRef] [Scilit]
- Pereira, J.; Sanz-santamaría, S.; Gutiérrez, J. Comparative Technical Analysis and Prospective of the Major Open Source MOOC Platforms; RED. Revista de Educación a Distancia: Marcia, Spain, 2014; Volume 44, pp. 73–87. [Google Scholar]
- Martín, J.L.; Amado-Salvatierra, H.R.; Hilera, J.R. MOOCs for all: Evaluating the accessibility of top MOOC platforms. Int. J. Eng. Educ. 2021, 32, 2274–2283. [Google Scholar]
- Antonaci, A.; Klemke, R.; Kreijns, K.; Specht, M. Get gamification of MOOC right! how to embed the Individual and social aspects of MOOCs in gamification design. Int. J. Serious Games 2018, 5, 61–78. [Google Scholar] [CrossRef] [Scilit]
- Cooper, S.; Sahami, M. Education reflections on stanford’s MOOCs. Commun ACM 2013, 56, 28–30. [Google Scholar] [CrossRef] [Scilit]
- Zapata-Ros, M. El Diseño instruccional de los MOOC y el de los nuevos cursos online abiertos personalizados. Rev. De Educ. A Distancia (RED) 2015, 45, 1–35. [Google Scholar] [CrossRef] [Scilit]
- Daniel, S.J.; Cano, E.V.; Cervera, M.G. The future of MOOCs: Adaptive learning or business model? RUSC. Univ. Knowl. Soc. J. 2015, 12, 64–73. [Google Scholar] [CrossRef] [Scilit]
- Marosan, Z.; Savic, N.; Klasnja-Milicevic, A.; Ivanovic, M.; Vesin, B. Students’ perceptions of ils as a learning-style-identification tool in e-learning environments. Sustainability 2022, 14, 4426. [Google Scholar] [CrossRef] [Scilit]
- Lerís, D.; Sein-Echaluce, M.L.; Hernández, M.; Bueno, C. Validation of indicators for implementing an adaptive platform for MOOCs. Comput. Hum. Behav. 2017, 72, 783–795. [Google Scholar] [CrossRef] [Scilit]
- Hone, K.S.; el Said, G.R. Exploring the factors affecting mooc retention: A survey study. Comput. Educ 2016, 98, 157–168. [Google Scholar] [CrossRef] [Scilit]
- Teixeira, A.; Garcia-Cabot, A.; Garcia-Lopez, E.; Mota, J.; De-Marcos, L. A new competence-based approach for personalizing moocs in a mobile collaborative and networked environment. RIED Rev. Iberoam. De Educ. A Distancia 2015, 19, 143–160. [Google Scholar] [CrossRef] [Scilit]
- Stracke, C.M. Quality Reference Framework (QRF) for the Quality of MOOCs. Quality Reference Framework (QRF) for the Quality of MOOCs Developed by MOOQ in Close Collaboration with All Interested Parties Worldwide. Available online: http://www.mooc-quality.eu (accessed on 8 May 2020).
- Hendriks, R.A.; de Jong, P.G.M.; Admiraal, W.F.; Reinders, M.E.J. Instructional design quality in medical massive open online courses for integration into campus education. Med Teach. 2020, 42, 156–163. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hayes, S. MOOCs and Quality: A Review of the Recent Literature. QAA MOOCs Network. July 2015. Available online: https://pure.aston.ac.uk/ws/files/18622357/MOOCs_and_quality_a_review_of_the_recent_literature.pdf (accessed on 1 March 2022).
- Clark, D. MOOCs: Taxonomy of 8 Types of MOOC. Available online: http://donaldclarkplanb.blogspot.com/2013/04/moocs-taxonomy-of-8-types-of-mooc.html (accessed on 23 August 2022).
- Hueso-Romero, J.J.; Gil-Quintana, J.; Hasbun, H.; Osuna-Acedo, S. The social and transfer massive open online course: Post-digital learning. Future Internet 2021, 13, 119. [Google Scholar] [CrossRef] [Scilit]
- Jansen, D.; Schuwer, R. Institutional MOOC Strategies in Europe: Status Report Based on a Mapping Survey Conducted in October-December 2014; EADTU: Maastricht, The Netherlands, 2015; ISBN 9789079730155. [Google Scholar]
- Brouns, F.; Teixeira, A.; Morgado, L.; Fano, S.; Fueyo, A.; Jansen, D. Designing massive open online learning processes: The SMOOC pedagogical framework. Lect. Notes Educ. Technol. 2016, 16, 315–336. [Google Scholar] [CrossRef] [Scilit]
- Brouns, F.; Mota, J.; Morgado, L.; Jansen, D.; Fano, S.; Silva, A.; Teixeira, A. A Networked Learning Framework For Effective Mooc Design: The Eco Project Approach. In 8th EDEN Research Workshop. Challenges for Research into Open & Distance Learning: Doing Things Better: Doing Better Things; Teixeira, A.M., Szücs, A., Eds.; EDEN: Budapest, Hungary; Oxford, UK, 2014; pp. 161–171. [Google Scholar]
- García-González, S.; del Pozo, F.; Paredes, W.; del Pozo, H. Los MOOC: Tecnología y pedagogía emergente para la democratización del conocimiento. Rev. Perspect. 2018, 19, 215–224. [Google Scholar]
- Merrill, M.D. First Principles of Instruction. Educ. Technol. Res. Dev. 2002, 50, 43–59. [Google Scholar] [CrossRef] [Scilit]
- Margaryan, A.; Bianco, M.; Littlejohn, A. computers & education instructional quality of massive open online courses ( MOOCs ). Comput. Educ. 2015, 80, 77–83. [Google Scholar] [CrossRef] [Scilit]
- Mezirow, J. Transformative learning: Theory to practice. New Dir. Adult Contin. Educ. 1997, 1997, 5–12. [Google Scholar] [CrossRef] [Scilit]
- Hudson, L.; Wolff, A.; Gooch, D.; van der Linden, J.; Kortuem, G.; Petre, M.; ten Veen, R.; O’Connor-Gotra, S. Supporting urban change: Using a MOOC to facilitate attitudinal learning and participation in smart cities. Comput. Educ. 2019, 129, 37–47. [Google Scholar] [CrossRef] [Scilit]
- Watson, S.L.; Loizzo, J.; Watson, W.R.; Mueller, C.; Lim, J.; Ertmer, P.A. Instructional design, facilitation, and perceived learning outcomes: An exploratory case study of a human trafficking MOOC for attitudinal change. Educ. Technol. Res. Dev. 2016, 64, 1273–1300. [Google Scholar] [CrossRef] [Scilit]
- Bustamante-León, M.; Herrera, P.; Domínguez-Granda, L.; Schellens, T.; Goethals, P.L.M.; Alejandro, O.; Valcke, M. Toward a More Personalized MOOC: Data Analysis to Identify Drinking Water Production Operators’ Learning Characteristics—An Ecuador Case. Sustainability 2022, 14, 14206. [Google Scholar] [CrossRef] [Scilit]
- el Said, G.R. Understanding how learners use massive open online courses and why they drop out. J. Educ. Comput. Res. 2017, 55, 724–752. [Google Scholar] [CrossRef] [Scilit]
- Drachsler, H.; Kirschner, P.; Nederland, O.U. Learner Characteristics. In Encyclopedia of the Sciences of Learning; Springer: Berlin/Heidelberg, Germany, 2012. [Google Scholar] [CrossRef] [Scilit]
- Albelbisi, N.A. Development and validation of the MOOC success scale (MOOC-SS). Educ. Inf. Technol. (Dordr) 2020, 25, 4535–4555. [Google Scholar] [CrossRef] [Scilit]
- Albelbisi, N.; Yusop, F.D.; Salleh, U.K.M. Mapping the factors influencing success of massive open online courses (MOOC) in higher education. Eurasia J. Math. Sci. Technol. Educ. 2018, 14, 2995–3012. [Google Scholar] [CrossRef] [Scilit]
- Anderson, L.W.; Krathwohl Peter, W.; Airasian, D.R.; Cruikshank, K.A.; Mayer, R.E.; Pintrich, P.R.; Raths, J.; Wittrock, M.C. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. 2001. Available online: https://www.uky.edu/~rsand1/china2018/texts/Anderson-Krathwohl%20-%20A%20taxonomy%20for%20learning%20teaching%20and%20assessing.pdf (accessed on 14 September 2022).
- Barari, N.; RezaeiZadeh, M.; Khorasani, A.; Alami, F. Designing and validating educational standards for e-teaching in virtual learning environments (VLEs), based on revised bloom’s taxonomy. Interact. Learn. Environ. 2020, 30, 1640–1652. [Google Scholar] [CrossRef] [Scilit]
- California Water Boards. Water Treatment Minimum Qualifications for Examination/Certification; California Water Boards: Sacramento, CA, USA, 2016. [Google Scholar]
- Fuller, J.S.; Brantley-Dias, L.; Lokey-Vega, A.; Woodham Langub, L. Learner perceptions: Gauging the effectiveness of instructional strategies implemented in one university’s inaugural MOOC. Open Learn. J. Open Distance e-Learn 2021. [Google Scholar] [CrossRef] [Scilit]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).


