MOOCs Design: A Conceptual Framework for Continuous Teacher Training in Portugal

Abstract

This paper aims to present a conceptual framework for Massive Open Online Courses (MOOCs) design with regard to continuous teacher training, where a mixed methodology research approach was used. This methodology was structured in two consecutive phases: The first phase adopted a sequential exploratory strategy, where a scoping literature review approach was applied, and analysis content techniques were used to map and analyze the key dimensions in the design of MOOCs. The second phase was based on the concurrent triangulation strategy, where the quantitative data were extracted from 103 questionnaires and the qualitative data were obtained from two mini focus group interviews, which contributed to the development of the framework. Based on the data collected in phase 2, we proposed a framework which is structured in three main dimensions and ten subdimensions: (i) Resources—Human and Technological infrastructure; (ii) Design—Course overview, Target learners, Pedagogical approaches, Goals, Learning materials, content and activities and Assessment activities; and (iii) Organization and monitoring—Accreditation and Data monitoring and evaluation. This paper contributes to the actual state of the art in MOOCs design given the inexistence of frameworks for such courses in the specific case of continuous teacher training, and it shows the importance of accreditation recognition by the Portuguese entities.

1. Introduction

In the last decade, teachers have been facing several challenges due to technological innovations, students’ multiculturalism, and the growth of education digitization. Given these and other challenges, teachers have been forced to innovate in their teaching practices, and they therefore require a continuous training process. The continuous professional development of the teachers is crucial to help overcome such changes and challenges.

The Massive Open Online Courses (MOOCs) can offer new training modalities, provided that the necessary infrastructure conditions are available (e.g., quality internet access), as they are considered a promising tool that facilitates teachers’ lifelong learning [1,2]. Due to their inherent flexibility, MOOCs have the potential to mitigate geographic and time constraints. Teachers benefit from the flexibility of schedules by attending sessions at their own pace, without additional costs and travel inconveniences. In addition, they have access to a wide selection of training courses (offered by regional, national, or international suppliers), which are in general free of charge, regardless of their geographic location and without small group restrictions [3].

Although the advantages brought by MOOCs are recognized, if we considered that teachers represent a significant portion of MOOCs learners [4], the effectiveness of these courses on teachers or other education professionals is not yet evident [4,5,6]. Therefore, it is necessary to investigate the impact that the MOOCs can produce on the teachers’ professional development.

Considering those challenges, it is important to understand how online learning opportunities can help teachers’ professional development, defining standards and practices that allows us to measure and analyze their quality. To achieve that, it is necessary to have a better understanding of the possibilities and effectiveness of MOOCs, particularly associated with the teachers’ learning experiences. Therefore, several pedagogical and design issues for a MOOCs should be explored.

Given the aforementioned, in this study we propose a conceptual framework for the design of MOOCs targeted for continuous teacher training. For this, the following objectives were defined: (i) carry out a scoping literature review of existing works on the areas under study (MOOCs and continuous teacher training) and, subsequently, analyze frameworks for the MOOCs design (phase 1); and (ii) build a framework for the MOOCs design, establishing a set of dimensions, subdimensions and guidelines (phase 2). Thus, the results and discussion on this paper will focus on the data from the second phase of data collection and analysis.

2. Literature Review

MOOCs are online learning environments designed for large numbers of participants and tend to be free, open, and flexible. This type of course stands out from conventional online courses due to its massive and open dimensions, allowing teachers to connect with anyone around the world with an internet connection [7]. MOOCs are generally based on well-known and established pedagogical models and learning theories.

There are two main pedagogical terms: the connectivist-inspired approach, cMOOC, and the constructivism-inspired approach, xMOOC. cMOOCs are those that include collaboration and focus on participants building content and connections with other participants. Learning is student-centered and what is considered important are discussions and interactions between participants. On the other hand, xMOOCs are similar to the classic pedagogical model used in traditional university (online) courses, that aim to offer content delivery for the participants [7].

In recent years, several studies have highlighted the potential of MOOCs as a relevant opportunity for teachers’ professional development, especially for promoting new skills and professional improvement. Hernández, López and Barrera [8], developed a study where they analyze the MOOCs value assigned by master’s students of Teacher Training. This exploratory study used case studies, where an online questionnaire was presented to 37 pre-service teachers at the University of Alcalá (public institution based on on-site teaching) and at the Open University of Madrid (private institution based on distance learning). The results revealed differences between the two groups, face-to-face and distance students, in terms of the knowledge and attitudes towards MOOCs, but both groups agreed on its potential for teacher training (initial and continuing). In general, the Open University students showed a greater knowledge on these online environments, as well as a more positive and open attitude. The authors recommend that the participating universities need to develop and disseminate massive courses as a pedagogical resource both for the initial and continuous teacher training.

The study by Bonafini [9] showed how the participants’ professional experience, as well as their involvement in videos and in discussion forums help to predict a MOOCs conclusion for professional development of statistics teachers. The results showed that the number of watched videos is not enough to predict the probability of completion of a MOOC. On the other hand, the involvement in discussion forums is essential to promote learning, networking, and interaction between participants. The results also showed that the professional experience influences the conclusion of the course. Therefore, participation in forums and professional experience are factors that allow us to understand the engagement of participants in a MOOC.

Pedro and Baeta [10] analyze a MOOC developed for Portuguese primary and secondary education teachers, seeking to reflect on the impact that this type of training can have on continuous teacher training. The data showed a positive perception by the participating teachers in the various dimensions analyzed such as course organization, methodology and learning environment, resources and activities and digital tools used. Completion rates were high compared to other international studies. Thus, the authors concluded that MOOCs can be a viable and suitable alternative to continuous teacher training.

In 2019, the authors [6] developed a study that provided evidence on the effectiveness of MOOCs for teachers’ training in the safe and responsible use of ICT. The results also showed that these courses allow for the development of teachers’ digital competence in the creation of digital content.

Silva and Vergara [11] presented a literature review, the aim of which was to compile and analyze the state of the art regarding MOOC educational experiences in university teachers training. The results revealed several proposals where two types of MOOCs were identified—xMOOCs and cMOOCs, with a predominance of the former. It was also observed that most courses are open and free. However, the results showed that virtual learning communities are difficult to implement, specifically when there is a reduced communication between teachers and participants. Regarding the proposed activities and the methodological design, the results showed that the courses offered a model based on audiovisual presentations and the participants’ competence was based on memorization.

One of the weaknesses often highlighted in the articles was the reduced number of learning communities and the lack of diversity of activities in the courses, as they focuses on the content assimilation and subsequent evaluation. Finally, the courses pedagogical quality is perceived as poor, due to the teaching processes simplification instigated by the limited understanding of the teacher’s role and its role in promoting learning.

A quantitative study developed by Herranen, Aksela, Kaul, and Lehto [12] aimed to investigate the MOOCs relevance (individual, societal and vocational) for their current and prospective teaching from the teachers’ point of view. Individual relevance focuses on aspects such as satisfying curiosity and interest and skills for personal life in the future. Societal relevance is defined by aspects related to the person’s behavior in the society, responsibly and through their own interests. Vocational relevance consists of orienting towards, qualifying for, and getting a job, thereby contributing to socioeconomic growth. The research focused on the analysis of teachers’ expectations of the MOOCs relevance before the courses and their perceptions after attending (ten) courses, using an online prequestionnaire and postquestionnaire that was developed based on the relevance theory. The results of this study indicated that MOOCs can significantly contribute to the teacher’s professional development in areas such as science, mathematics, and technology education. The teachers showed high expectations in the courses in terms of prospective teaching method (vocational relevance) usefulness, and their future (individual and vocational relevance) usefulness. Likewise, expectations regarding collaboration and science, mathematics, and technology teaching were positively met. Finally, the authors mentioned that the investment and effort applied by the teachers were related to the level of interest throughout the course (individual relevance), and to their experiences, meaning that the most experienced teachers considered the courses to be more relevant.

In conclusion, the analyzed studies highlight how MOOCs can be considered as a viable, adequate, and effective strategy for continuous teacher training and professional development, since attending these courses allows for the developing of several skills, digital skills especially. However, investigations have shown how teachers’ professional experience and their (dis)interest in the course may be factors that influence their learning process, as well as course completion rates. Other evidence shows that teachers have high expectations regarding the MOOCs usefulness for their practices and for their professional future. In the various activities carried out in MOOCs courses, the importance is shown by the role of discussion forums, which are seen as an essential element for teachers’ learning, allowing them to create networks and promoting interaction among them. However, it was found that there is a predominance of the more traditional MOOCs model, based on the dissemination of information and memorization.

This state-of-the art shows an evolving trend of research in the scientific areas under study, as well as the importance of MOOCs in the continuous teachers’ training and in their professional development.

3. Methodology

This study was based on two mixed methodological approaches: (i) sequential exploratory strategy and (ii) concurrent triangulation strategy [13,14], in which data collection, analysis and discussion involved a set of processes and instruments of both a qualitative and quantitative nature. Bellow we describe each of the different methodologies used in this study, and Table 1 represents and clarifies the methodology adopted. Note that, the study was carried out in Portugal and, therefore, in the Portuguese language, including all the items of the instrument presented in Appendix A, Table A1.

Table 1. Mixed study design.

Study Design	Phase 1—Exploratory Sequential	Phase 2—Concurrent Triangulation
Purpose	Identify and analyze the dimensions and subdimensions for the design of Massive Open Online Courses (MOOCs), considering the continuous teacher training	Validate the framework from the perception of teachers, trainers, and MOOC participants
Participants	nine participants Stakeholders whose labor entity is involved in continuous teacher training	103 participants Trainers from Teachers’ Training Centers of the Association of Schools	seven participants Teachers, trainers, and MOOC participants
Data Collection	Scoping literature review Face-to-face and online interviews	Survey by questionnaire (LimeSurvey)	Focus group interviews Online interviews
Data Analysis	Content analysis NVIVO	Descriptive frequency analysis SPSS	Content analysis

The ethical guidelines of the American Educational Research Association (AERA) and British Educational Research Association (BERA) for educational research were respected, as well as the recommendations of the ethical commission of the Institute of Education of the University of Lisbon. All the participants were informed about the study goals and gave their informed consent to participate in the study.

3.1. Phase 1—Exploratory Sequential

3.1.1. Data Collection and Analysis Process

In the first phase—the sequential exploratory approach [14]—a scoping literature review based on Arksey and O’Malley’s proposal [15] was carried out and published [16]. This scoping review process was based on five stages: identifying the research question, identifying relevant studies, study selection, charting the data, and collation, summary, and results reporting. In addition, this can be complemented by an optional sixth stage, a consultation exercise.

The five stages allowed us to identify the existing literature and map key concepts about MOOCs and continuous teacher training through a survey of existing evidence in these areas. They also allowed us to analyze multiple frameworks for MOOCs design and to identify possible dimensions and connections in order to consider them for our work. The optional step aimed to validate the results collected in the previous stages. To do so, semi-structured interviews were carried out, where content analysis techniques were used to analyze the obtained results.

Considering the scoping literature review process adopted and its results, a research instrument was built. The dimensions and subdimensions identified in the theoretical and empirical field to be included in our framework, are shown in Figure 1. For the initial version of the framework, it was proposed that it be divided into three dimensions and respective subdimensions: resources—humans and technological infrastructure; design—course overview, target learners, pedagogical approach, goals, learning materials and content and, assessment activities; and external organization—accreditation and data monitoring and evaluation.

Figure 1. Initial version of the conceptual framework for MOOCs design for continuous teacher training.

Based on the results of the qualitative data collection and analysis (scoping literature review) and seeking to validate the built framework, a research instrument was developed, specifically, a questionnaire survey. Consisting of 121 items, the instrument was aimed at measuring the level of agreement based on a five-point scale (1—“totally disagree”; 2—“disagree”; 3—“do not agree nor disagree”; 4—“agree”; 5—“totally agree”), with the option “I don’t know/does not apply”. High internal consistency was found with Cronbach’s α reliability coefficient of 0.99 and content validity [17] was carried out with five experts, resulting in different suggestions.

The final version of the questionnaire was structured in 119 questions, three dimensions and eleven subdimensions (see Appendix A).

Participants

The data collection, from the sixth stage of the scoping literature review, involved nine participants with knowledge and responsibility on the area of continuous teacher training in Portugal, and who were aware of the problems under study. To guarantee these characteristics, a convenience sampling was chosen [12,18]. We chose to interview experts from six different stakeholders in Portugal: the Ministry of Education (n = 2), the Scientific and Pedagogical Council for Continuous Teachers’ Training (n = 1), the Higher Education Schools (n = 1), the Teachers’ Training Centers of the Association of Schools (n = 1), the Foundation for Science and Technology (FCT) specifically the NAU Project (n = 2) and the distance learning units in higher education contexts (n = 2).

In the characterization of the participants, it was found that six of the nine had experience in distance training or education, with different types of contact or roles (attendance, design and/or implementation). However, only seven of the experts had attended MOOCs for their professional development.

3.2. Phase 2—Concurrent Triangulation

3.2.1. Quantitative Data Collection and Analysis Process

The second phase aimed to validate the proposed framework, identifying its dimensions, subdimensions and guidelines. For this, the online questionnaire was applied to Portuguese teachers’ trainers, with the answers being exported to SPSS version 27.

The questionnaire consisted of three major dimensions and eleven subdimensions, with a total of 119 items (see Appendix A). The first dimension (‘resources’), structured by 15 items, integrated the ‘human resources’ (6 items) and ‘technological infrastructure’ subdimensions (9 items).

The second dimension (‘design’), organized by 56 items, integrated six subdimensions: course overview (12 items); target learners (3 items); pedagogical approach (9 items); goals (5 items); learning materials, content, and activities (17 items) and assessment activities (10 items).

The third dimension of the questionnaire had 48 items: the subdimensions ‘accreditation’ and ‘data monitoring and evaluation’ with 9 items each and the subdimension ‘assessment indicators for the accreditation process’ with 30 items.

The data analysis focused on the descriptive frequency analysis, with the inclusion of items in the framework being considered based on the percentage sum of options 4 (agree) and 5 (completely agree) of the scale (see Appendix B, Table A2). The items with values equal to or greater than 75% were considered for the development of the framework.

Participants

Involving a random sampling process, the questionnaire was applied to all the Portuguese teachers’ trainers (from Portuguese schools’ association and from all Portuguese professional teachers’ groups). 103 trainers participated in this study, of which 61 (59.2%) were female and 42 male (40.8%), distributed over the five regions of the country (“Norte”, “Centro”, “Lisboa and Vale do Tejo”, “Alentejo” and “Algarve”). In this sense, “Lisboa and Vale do Tejo” had the highest number of responses (38.8%), followed by the “Norte” (25.2%) and “Centro” (22.3%) regions. The regions of “Alentejo” (6.8%) and “Algarve” (6.8%) had a lower representation. The group of participants has academic qualifications in master’s (54.4%), bachelor’s (23.3%) and doctoral (22.3%) degrees.

3.2.2. Qualitative Data Collection and Analysis Process

In the qualitative phase, data was collected from the experts through two mini focus groups [19]; one of the groups consisted of four elements and the other of three. After data collection, a content analysis was carried out following Coutinho’s model [17]. The data collection was carried out in a synchronous online environment using the Zoom videoconference system.

Participants

The focus group, based on a convenience sampling [13,19], included seven experts and professionals with experience as teachers, trainers, and participants in MOOCs. The group homogeneity [20] was achieved by the level of knowledge and/or experience of the participants in the MOOCs and in the continuous teacher training in Portugal.

4. Results and Discussion

In this section we present and discuss the results of qualitative and quantitative data concomitantly, with the aim of systematizing and building the final version of the framework.

In the first dimension (resources) and respective subdimensions (humans and technological infrastructure) analyses (item 1 to item 15), we include all items in the framework, since the results showed a general quantitative agreement ≥75%. Likewise, the qualitative data (focus group) were in accordance with the statistical data. We highlight items with agreement values higher than 95%, such as item 6 (The team involved in MOOCs design should conceive and have a plan for support and assistance to trainees), item 7 (The technological infrastructure must ensure quality access to trainees, guarantee access to all essential features and universal and permanent access to the platform) and item 15 (The technological infrastructure must have functionalities that guarantee quality standards of accessibility and usability for the trainees).

In the interviews, both groups warned about the need to expand the team, depending on the characteristics of the course, such as its complexity, size, theme, content, and structure, among others. Some experts recommended a support and assistance plan for trainees that was as automated as possible, so that teachers would get immediate answers: “I wish that as a MOOC participant I had a support plan that allowed me to get answers quickly” (Participant G).

Comments were also made about the paradox of the (in)existence of tutors. The second group emphasized the importance of the human component in MOOCs for teachers, but on the other hand they considered it to be an arduous task due to the massive factor of these courses. However, some authors [21] consider that this difficulty can be overcome by implementing peer assessment and automated solutions to detect students with difficulties and provide them with useful and timely feedback. Other authors [22] defend the adaptation of assistance by tutors, as well as the use of automated tools to complement the lack of human feedback.

The discussion also emphasized the importance of the platform having simple accessibility, with a clear understanding of the structure and sequence of the MOOCs contents. In addition, the adequacy of a responsive and adaptive design to different devices was discussed. Evidence brought by Salamah and Helmi [23], shows that platforms influence students’ learning experience; they state that the best MOOC platforms are those that bring innovation to a learning environment.

In the second dimension (design) and its subdimensions (course overview; target learners; pedagogical approach; goals; learning materials, content, and activities; and assessment activities) we observed that, in general, higher degrees of agreement were achieved (item 16 to item 71). However, four items showed values below 75%, namely: item 34 (MOOCs should favor the use of individual work methodologies) with a degree of agreement of 62.2%, item 61 (MOOCs should promote the use of non-digital materials according to the theme and objectives of the course) with 72.8% of agreement, item 64 (MOOCs should promote peer assessment methodologies (during and/or between activities) with percentage values of 74.8%, and item 70 (MOOCs should promote the use of blogs or e-portfolios for the collection, annotation and sharing of critical learning outcomes and reflections by the trainees) with a degree of agreement of 73.8%. However, only item 61 will be excluded since it was the only case where the qualitative results converge for the same degree of agreement. The option to keep the remaining items is justified by the focus group results.

The results showed the importance of a clear and detailed course description. In this sense, Minea-Pic [4] refers to the need for and importance of a design that aims to support teachers in these massive environments, especially inexperienced teachers: The collected data also showed the prerequisites’ importance, since online course experience, skills, knowledge, and teachers’ needs influence their engagement in MOOC [4] and their perception of the course’s relevance [24].

In addition to teacher training, MOOCs content should be aligned with the curriculum and resources should stimulate teacher motivation [4].

The flexibility principle is considered by some experts, a key element in MOOCs. Hertz, Clemson, Hansen, Laurillard, Murray, Fernandes, Gilleran, Ruiz and Rutkauskiene [25] have defined for the Teacher Academy a set of pedagogical principles for teachers’ continuous professional development and flexibility is one of them. This principle refers to free access, deadline flexibility and teachers’ learning pace.

Regarding the work dynamics, the first group discussed the collaborative and interactive work methodologies. This group considered that collaborative methodologies do not fit in massive courses: “It is not intended that collaborative work methodologies are adopted in the MOOC realization”. (Participant A); and “I also agree, I don’t think that’s the MOOC spirit”. (Participant C).

The literature shows divergent evidence from the empirical field. MOOCs for teachers should focus on the exchange of ideas among peers [26], on a culture of sharing, and on supporting the review, reflection and discussion of their beliefs and practices [27]. Moreover, it is important to develop a social approach and a sense of community, integrating activities that promote an environment of trust and support among teachers: “online communities provide teachers with enhanced opportunities for exchanging, sharing resources and learning collaboratively” [4] (p. 13).

Finally, a study [12] showed that teachers have high expectations about peer collaboration and that component contributed significantly to the MOOCs success. Through MOOCs, teachers can reflect on their learning and adapt it as needed for use in their own context.

With regard to materials, content and learning activities, Minea-Pic [4] emphasizes that MOOCs for teachers should consider teachers’ background (experience, skills, and needs), be aligned with the curriculum and include resources that stimulate teacher motivation. Hertz and his colleagues [25] also refer to watching videos of projects and lessons, as well as interviews with teachers and experts.

In the evaluation subdimension, the experts interviewed mentioned peer assessment as an enriching methodology for teachers, but with clear evaluation rubrics. According to Hertz, Clemson, Hansen, Laurillard, Murray, Fernandes, Gilleran, Ruiz and Rutkauskiene [25], learning evaluation and validation in MOOCs for European teachers involves the implementation of peer review activities. Peer reviews promote communication and interaction among participants and foster active and critical reflections on course topics [28,29]. Additionally, this type of evaluation promotes skills development in formative feedback practice, communication, time, and participant self-management [29].

To develop a successful peer assessment, Balfour [29] claims that it must be proportionally scalable to the MOOC and needs to be (a) simple, easy, and quick for students to understand, (b) an efficient approach in execution and without taking too much time, and (c) limited in the assignments given to each student.

Another topic discussed in both groups was summative assessment. Some experts believe that the accreditation and/or certification process may become complex without a summative aspect, regardless of the rating type (qualitative or quantitative). This uncertainty arises due to the criteria and procedures inherent to the MOOCs accreditation process in continuous teacher training in Portugal. Xiong and Suen [30] argue that the best MOOCs assessment approach involves a balanced combination between formative and summative evaluation.

As in the first dimension, the last dimension (organization and monitoring) and respective subdimensions (accreditation and data monitoring and evaluation) had all the items (item 72 to item 119) included in the framework. Again, the inclusion decision is justified by the high degrees of agreement and concordant opinions observed in the content analysis of the focus group interviews.

Regarding accreditation, all experts were in favor of the recognition of MOOCs among teachers and institutions with responsibility and involvement in the context of continuous teacher training. They also considered that accreditation can stimulate or reinforce interest in this type of training and boost their participation, contributing to the advancement of the teaching career: “I think it’s great that MOOCs become recognized for teaching career progression” (Participant F).

Considering the absence of a regulation aimed at accrediting massive courses in continuous teacher training in Portugal, they are seen as a non-formal training modality, since the only way to prove participation in a course is through a certificate. Exceptionally, some MOOCs of the European Schoolnet Academy grant formal recognition as continuing professional development through the submission of the participation certificate by teachers to the Scientific and Pedagogical Council of Continuous Teachers’ Training (Conselho Científico-Pedagógico da Formação Contínua).

Mine-Pic [4] argues that informal recognition may be insufficient to motivate, engage, and retain teachers in MOOCs: “While open badges or MOOC certificates may stimulate teachers’ motivation to begin engaging in such forms, they may not be sufficient for maintaining sustained and effective teacher participation in online professional learning if teachers do not acquire a more formal recognition of their invested time and efforts” (p. 33).

The experts discussed offering certification at no-cost to teachers, whose opinions diverged. Some interviewees advocated free and open access to certification, although there is concern about the teacher’s commitment without payment, as well as for the hours and costs underlying the development of MOOCs: “There seems to me to be less commitment from participants when it is totally free. However, I think it should be free. I think it should be, I like it to be, but it seems to me that sometimes the token cost factor can sometimes be relevant” (Participant G).

Jobe et al. [31] state that it is crucial to offer certificates and/or digital badges so that teachers can demonstrate the results achieved to educational institutions: “a mandatory design principle for a MOOC to be successful as a form of professional teacher development is that it offers a certificate/digital badge that clearly recognizes and validates the accomplishments of a learner” (p. 4).

Other experts revealed resistance to free certification, on the one hand due to the inherent costs in MOOCs producing, and on the other hand because of the payment normalization for training, whether in a national or international context: “(…) my experience is sometimes to take courses outside Portugal and at the end if I want the certificate, I pay. That is, I can do the whole course and not have a certificate at the end” (Participant A). These opinions refer to the business models that have emerged in recent years, in which the fee payment for certification is increasingly an option for institutions or MOOC providers [32].

The qualitative data also showed a concern for analyzing and understanding completion and dropout rates. The second group focused the discussion on mechanisms that can contribute to the prevention of high dropout rates, namely sending automatic messages to MOOC participants. On the other hand, the first group considers that it is essential to know and analyze the completion and dropout rates, allowing for the understanding of the reasons for dropouts and/or at what times they occurred.

These results are in line with those presented by Clark [32] and Hood and Littlejohn [33], who indicate that only using indicators such as dropout and completion rates is inadequate to measure the success of MOOCs or the quality of learning, since completion or certification is not always the goal of students. Several authors [34,35,36,37,38] identify a set of factors that contribute to the high dropout rate that are related to course and student characteristics. Thus, understanding the reasons that influence dropout rates as well as identifying areas that can be improved is critical to their decrease and to MOOCs development [36,38].

Considering the methodological perspective used in our study, (sequential exploration and concomitant triangulation), it’s important to describe the framework developed. Given theoretical and empirical field results, three dimensions and ten subdimensions were established:

  i.

Resources

R1. Human resources—This subdimension considers the structure, organization and quality of the team involved in the MOOCs design in the scientific, pedagogical, and technical domains.

R2. Technological infrastructure—It considers guidelines to ensure basic conditions on the MOOCs development and implementation, such as guaranteeing participants quality universal access, as well as scalability and data recording. Another guideline aims to support the addition of different features and tools (including external tools) that would ensure content dissemination, communication and the interaction between participants and the use of different assessment strategies. This subdimension also addresses issues related to accessibility quality and platform usability.

 ii.

Design

D1. Course overview—It considers the MOOCs informative elements for the teachers, such as the title, authors, training context, course structure, as well as the application, assessment, accreditation and/or certification processes.

D2. Target learners—This subdimension illustrates the requirements needed by the target audience to enter the course, such as training and professional experience, the level of digital literacy and the training environment.

D3. Pedagogical approach—This subdimension considers guidelines on the pedagogical strategy and the learning methodologies to adopt, seeking to maximize the learning experience and to promote relevant activities to the teachers. Furthermore, the teachers’ knowledge acquisition will be dependent on diversified learning methodologies which promote individual and collaborative work practices, as well as the capacity for the daily resolution of professional situations.

D4. Goals—This focuses on the suitability of the learning objectives of each training module.

D5. Learning material, content, and activities—This dimension is related to the organization, relevance and content and learning material update. It refers to the courses content and learning material, as well as the activities that encourage reflection and critical thinking. It also considers the control and quality of multimedia resources and intellectual property (copyright and creative commons licenses).

D6. Assessment activities—These guidelines focus on potential assessment activities to be included in courses, allowing trainees to be supported in the learning process, as well as verifying whether the expected results have been achieved.

iii.

Organization and monitoring

OM1. Accreditation—This dimension establishes guidelines for the certification and/or accreditation of continuous teacher training in MOOCs. It also considers evaluation criteria that analyze and guarantee the MOOCs design quality by the responsible entities.

OM2. Data monitoring and evaluation—This subdimension is intended to guide the MOOCs quality assurance throughout the construction process, as well as to support the improvement of future editions.

In Figure 2, the organization of the framework is schematically represented, in which the above described (sub) dimensions are shown.

Figure 2. Conceptual framework for MOOCs design for continuous teacher training.

The first dimension (resources) appears at the top of the framework due to the need to gather and guarantee the basic conditions for the creation of MOOCs courses. Underlying this, a set of decisions must be made before design decisions and the organization and monitoring.

The second dimension that refers to options regarding the MOOCs design, and the third dimension that considers the quality criteria for the MOOCs accreditation, monitoring, and evaluation processes, encompass decisions that must be deliberated on after the choice of the resources. Besides that, the third dimension (organization and monitoring) encompasses quality criteria to be considered throughout the course design, and also data analysis to help reflect on the decisions made throughout its development.

Thus, the framework has a sequential logic and, simultaneously, a bidirectional perspective, since all dimensions are interconnected due to the dynamic, iterative, and collaborative process that is required in the MOOCs production and development.

5. Conclusions

In this paper, we aimed to contribute to the inclusion process of the MOOCs in the continuous teacher training, considering the possible benefits brought by these courses to the teachers’ professional development. Thus, we developed a conceptual framework for the MOOCs design for this specific audience, therefore contributing to adoption of new effective training strategies in continuous teacher training in the Portuguese context.

Research has shown an evolutionary trend and an increased interest in teacher professional development and MOOCs, highlighting the numerous benefits and challenges associated with the massive courses in the teaching profession. However, empirical evidence that corroborates the impact and efficiency of such courses on teacher training and professional development is still missing [1,4,5,6,39,40].

The first phase objective was to analyze the existing literature and identify key concepts, and to build an initial framework based on the review and interview results. The second phase focused on the validation of the framework through both quantitative and qualitative data collection and analysis. In this phase, the analysis of responses from 103 trainers and two mini focus groups revealed convergent results between quantitative and qualitative data.

The results achieved highlight the relevance of this study, since it was verified through the scoping literature review approach, that there is a lack of frameworks for massive open online courses in continuous teacher training. Additionally, the theoretical and empirical fields sustain the importance of MOOCs as a low-cost solution for teacher training, considering its characteristics (massive, free and instructional design distinct from conventional online courses) and potentialities brought to teacher’s professional development (neither spatial nor temporal barriers, creation of broader learning communities, sharing of ideas, experiences and practices, flexibility in the learning pace, acquisition and/or updating of knowledge and skills).

Last year, teachers were forced to implement emergency remote teaching modalities due to the COVID-19 pandemic. This quick adaptation to new pedagogical concepts took place with little or no support, guidance, or training and without sufficient quality resources. In this sense, the face-to-face activities for professional teacher development have shown numerous challenges due to the changes caused by the pandemic, redirecting attention to strategies that support teachers in adapting to remote teaching (2,4).

According to Minea-Pic [4] (p. 36), “the COVID-19 disruption has brought renewed attention to the provision of online professional learning for teachers, acting as a catalyst for policy reforms in this area as well as regarding the development of teachers’ digital literacy”. Thus, the emerging need for remote learning during the pandemic sparked a new interest in systematically and effectively providing online teacher training strategies, measures, and initiatives. For this, it is essential to promote the involvement of teachers in professional learning, and, consequently, to recognize and certify the skills and knowledge acquired from digital technologies and online formats.

For this reason, it is essential to develop a guiding document for the development and implementation of a MOOC, namely for the continuous teacher training. In addition, we seek to contribute to the promotion of MOOCs as a viable training system, with a level of quality which would be recognized by entities responsible for continuous teacher training.