Next Article in Journal
Spider Webs and Lichens as Bioindicators of Heavy Metals: A Comparison Study in the Vicinity of a Copper Smelter (Poland)
Next Article in Special Issue
Teacher Digital Literacy: The Indisputable Challenge after COVID-19
Previous Article in Journal
A Theoretical Framework Development for Hotel Employee Turnover: Linking Trust in Supports, Emotional Exhaustion, Depersonalization, and Reduced Personal Accomplishment at Workplace
Previous Article in Special Issue
A Comparison between Collaborative and Individual Writings in Promoting Motivation and Language Acquisition
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

What Factors Determine the Value of an Online Teacher Education Experience from a Teacher’s Perspective?

by
Moussa Boumadan
1,*,
Roberto Soto-Varela
1,
Myriam Ortiz-Padilla
2 and
César Poyatos-Dorado
3
1
Faculty of Language and Education, Universidad Antonio de Nebrija, 28015 Madrid, Spain
2
Faculty of Legal and Social Sciences, Universidad Simón Bolívar, Barranquilla 080005, Colombia
3
Faculty of Teacher Training and Education, Universidad Autónoma de Madrid, 28049 Madrid, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(19), 8064; https://doi.org/10.3390/su12198064
Submission received: 3 September 2020 / Revised: 23 September 2020 / Accepted: 23 September 2020 / Published: 30 September 2020
(This article belongs to the Special Issue Sustainability Pedagogies for Training with Technologies)

Abstract

:
E-learning is currently at the center of interest in the educational community, in a situation of global pandemics that forces us to reduce attendance in all aspects of our lives. Online courses have had a bad reputation due to the distance between the tutor and the apprentice and the high dropout rates. The main purpose is to analyze the evaluations made by teachers on different features of a course, by examining variables like content, technology, activities, final work, and format. The analysis covers the 50 online courses that form part of the continuous training offer of the Regional Ministry of Education of the Community of Madrid in courses 17–18 and 18–19 in which 7501 teachers have participated. The opinion of each participant is collected from a questionnaire at the end of the training activity. This has been validated by a group of experts from the Regional Centre for Innovation and Training, belonging to the Community of Madrid, using the Delphi method. To develop the methodology, a linear multivariate model was calculated on the independent variables and the dependent variable Net Promoter Score (NPS). Most of the findings are related to two central variables in the educational approaches that occur in digital scenarios. What the group of teachers’ values most is the content of the proposal, while the factor that they consider least important is the technology that supports the development of the course. The rest of the variables analyzed have little impact on the recommendation of the courses. Nevertheless, conclusions suggest that combining factors such as content, technology, and pedagogy are essential in experiences like these.

1. Introduction

Continuous or ongoing teacher training is a response to the need posed both by changes and advances in society and by challenges in understanding educational processes and curricula that question teachers’ practices in dealing with new educational realities and their stakeholders. In this sense, it is necessary that the practice be reflected upon and fed back into a commitment that favors a better intervention in the educational environment, with new proposals and new pedagogical methods, based on the development of new competencies and skills pertinent to its action [1]. This ongoing training includes all the formative actions developed by the teacher in order to advance and seek, on a permanent basis, to get closer to pedagogical and disciplinary knowledge. This constant updating obeys both their personal needs and the processes and interests of educational institutions and external agencies. Teacher training is a “social and cultural process” that as a human possibility allows the transformation and development of the subject in interaction with society, through which knowledge, behavior, being, and typology of relationships and actions are changed [2].
It is important to note that the continuous training of teachers is part of their initial training and their daily practice. They learn, unlearn, and relearn in direct relation to the different scenarios they face, thus emanating new contextualized knowledge to give meaning to the role they play [3]. In this scenario of permanent updating, Cabero, Marín, and Castaño [4] place him as an “adult subject” who creates and recreates his teaching and learning scenarios by facing an indeterminate variety of problem situations of great diversity. In view of the importance of systematic and continuous teacher training in the qualification of their practice, institutions and government agencies are committed to this objective, ranging from classroom training, mostly, to distance learning and its combinations.
Mora-Valentín and Ortiz-De-Urbina [5], state that distance education refers to forms of teaching in which there is no student presence. Within this practice, they distinguish among which online teaching stands out as the scenario where distance teaching is carried out supported by Information and Communication Technologies (ICTs) and virtual spaces.
Until this historical moment that has forced teachers and students to integrate into remote learning spaces, online training was hardly chosen. In spite of this, online training had not been the preference choice for the continuous training of teachers. There are experiences in this sense and they are based on the advantages that underlie it, among which the author points out: (1) The possibility of accessing teachers in different places due to the elimination of physical distance, (2) participation of a greater number of participants in the course or training, since there is no concern regarding the formation of groups as in the case of presential education, (3) the management of the schedule and its flexibility according to the availability and rhythm of learning of each one, (4) it allows the asynchronous relationship between students and teachers, (5) the use of ICTs and Web 2.0 and its new pedagogical possibilities to favor the processes of teaching and learning, (6) independent and collaborative learning, and (7) cost reduction, among other aspects.
Likewise, the discussion about the disadvantages of this training modality, identifying aspects such as: (1) As the number of participants in these courses increases, there are also different interests, learning styles, and motivations that make each participant have a different possibility of having a real learning experience; (2) a very high dropout rate in relation to the attendance courses, associated in great part with the feeling of loneliness experienced by the learner who is observed alone, facing tasks, obligations, and resources in his own context, which does not guarantee learning, and (3) the problem of assessment and certification, as it is very difficult to have evidence of the learner’s authenticity of authorship [6,7].
According to [8], online collaborative activities, depending on the perception of the participants, improve not only cognitive development but also encourage the acquisition of skills such as teamwork, collaborative attitude, and enrich the vision of the students thanks to the different points of view. This research also highlights the importance of integrating collaborative ICT tools such as wikis into online learning processes. The evaluation processes are highlighted as an aspect of improvement. In turn, it proposes to develop more discussion activities and self-reflective tasks that enhance metacognitive skills.
Studies that analyze the aspects to be taken into account in this training modality and in particular in the bet of the online training courses are varied. Some advances developed by the authors are proposed here, identifying substantial elements to be taken into account in their scenario, their planning, development, quality, and effectiveness [7,9].
A first element of analysis is the activities and tasks; in this sense, Raposo -Rivas et al. [7], indicate that from the pedagogical point of view, these play a very important role. They define the implication of the student in the learning process. The authors distinguish different modalities in them that can go from the obligatory requirement to pass the course, to optional so that with autonomy and their commitment to learning, the student develops them in function of being able to reach the expected level of competence. It also indicates that they can be developed individually or collectively. García [10] points out that one of the factors that can influence the effectiveness of teacher training processes is the possibility of communicating with each other. In this way, they can reflect on their experiences and changes and be able to negotiate meanings with other peers facing similar contexts and situations. All this seems to be related to a positive effect on their practice and the effectiveness of the course. In online training, this interactivity is encouraged through debates, collaborative work, asynchronous communication, forums, wiki, and others. As for the tasks, different typologies are available such as questionnaires, tests, projects, among others.
A second feature of analysis is the content of the course says that teachers tend to better evaluate the training processes whose contents they emphasize in their experience. In the same way, they value the possibility of improving skills that interest and motivate him and in which the development of a certain skill that he can experience is declared (empirical and inductive learning) [10]. When referring to the materials used to develop these contents, it is important that all of them have been prepared for the objective of the course. These can bring teachers with increasing complexity closer to the concepts and knowledge required [9]. The author draws attention to the use of scientific documents or articles that often, because they are at a very high level, are not understood at an initial stage of the process and must be gradually integrated.
In reference to the means and resources used for online training, these must be consistent with the proposed objectives. It is noteworthy the fact that they must arouse the interest and motivation of the student and achieve their involvement in learning. At the same time, the need to reach all the students through them is pointed out, taking into account, for example, their learning styles. Here, resources that target each of the sensorial channels that can include simulated experiences, animations, audiovisuals, graphics, demonstrations, forums, blogs, wikis, and a large number of other resources that make ICTs possible are positively valued [11].
Another aspect to consider is the format in which online training is offered, which will depend largely on the technological software used and its design and architecture. This is an aspect that can greatly influence the motivation of the learner [9]. Thus, in studies carried out on the format, it is possible to identify common elements that obey to a pedagogical bet of them: Title, introductory video, presentation of the objectives, presentation of the teaching team, weekly dedication, duration of the course, functioning of the system, modules with their activities, and ways of relating and evaluation [7].
It is necessary to emphasize the importance of generating online learning communities that are capable of generating networked learning. To do this, there must be interaction between the participants of e-learning experiences using tools and spaces that encourage the exchange of impressions, resources, and knowledge. To produce a connective learning, it is necessary to design activities that favor the interaction between peers through workflows that empower the learners in the creation and participation. We also offer a wide diversity of content in different media and formats (videos, blogs, wikis, interactive activities, etc.) [12].
In the current situation of the Covid-19 pandemic, in which attendance has been limited due to its characteristics, distance education becomes an important opportunity for the continuity of teacher training. Therefore, it is necessary to advance studies that can shed light from the same teachers on their possibilities, advantages, and disadvantages.
In the case of Spain, teacher training is offered in different formats: Face-to-face, mixed, or distance. However, it is basically face-to-face. Therefore, it is considered a strategic priority to develop online courses that facilitate access to and monitoring of training programs for active teachers, providing both geographical and time flexibility. For this purpose, the Ministry of Education of the Community of Madrid offers annually various online distance training courses through its digital platform. The Community of Madrid has 6.5 million inhabitants and almost 51,000 teachers of non-university education. Between 2017 and 2018, around 50 tutored courses were offered in the online modality, plus classroom courses and mass online courses (MOOC), modalities that we will not address in this article. Each course follows a common structure designed by the Regional Centre for Innovation and Training (CRIF) and is assisted by tutors who have also been trained at the same Centre. All activities are carried out online and communication is also through the Internet. At the end of the course, a questionnaire is offered to evaluate the different aspects of the course and the reasons for accessing the training process. The online courses are offered from the digital teaching platform of the Regional Ministry of Education. The participants have access to different course modules and communication tools in a unique environment. In addition, the courses are optionally accompanied by external tools to the platform, such as social networks or forums.
It is precisely the objective of this study to analyze the evaluations made by teachers on the different aspects of a course, as are the contents that make up these courses, the technology through which these online experiences have been carried out, the activities that have had to be solved to achieve the resolution of the course, the final work that allows to demonstrate that the skills have been acquired and successfully overcome the training development, and finally, the format that configures the structuring of the different elements that make up the sequence. Also, this evaluation takes as a reference a predictive factor of satisfaction that is the NPS (Net Promoter Score). This analysis offers elements that can be useful in the implementation of relevant training actions with a better impact on educational quality.

2. Method

2.1. Participants

The participants in this research are teachers who registered and developed the online training courses offered by the Ministry of Education of the Community of Madrid in the academic years 2017–2018 and 2018–2019. Therefore, this is a non-probabilistic sample. The teachers sign up voluntarily for the training courses offered by the Community of Madrid. If there are more registrations than places available, scales based on merit and seniority are applied to award them.
These courses are sequential and are developed throughout the corresponding academic year, through the Moodle platform of the Community of Madrid. These training programs have a modular character, having to overcome a block to be able to access the next one. The dynamics follows the basic principles of an e-learning and collaborative learning proposal [13]. The student advances through the course autonomously, under the guidance of a tutor. The tutor’s functions consist of acting as a guide during the entire teaching and learning process, resolving individual or collective doubts, and correcting tasks by providing feedback to each of them. In addition, it makes common spaces for collaboration more dynamic. The experiences are characterized by being ubiquitous and connected [14], allowing the learner to access the experience from any place and time, being in constant contact with the course learning community. Specifically, the virtual classroom has general and specific forums where questions are resolved by the teacher or any student. Online activities or file attachments are also available, and in addition, some courses use external applications and services such as Padlet, Twitter, among others, in order to enrich the digital competence of the teachers.
The questionnaire they solve is at the end of the training experience, contained within the same platform where the course takes place. The total number of teachers who participated was 7810, however, as a criterion for the inclusion of the research, only those teachers who were able to fill in the questionnaire, for a total of 7501 participants in this study. They were distributed as shown in Table 1. For the subsequent analyses, as well as for the following tables and figures, only the course number will be used. This will facilitate reading. The high response rate is due to the fact that the questionnaire is located within the same space in which the training itinerary is developed, and furthermore, it is an essential requirement in order to successfully complete the course.
The following, table describes the number of students in each of the courses analyzed in this paper.

2.2. Research Instrument

Data collection was carried out through an online questionnaire located in the last module of each course. This survey was designed by a discussion group made up of professionals from the Regional Centre for Innovation and Training, which met during several sessions. The first session defined the type of survey (areas of interest, number of items, writing style, rating scale, and presentation format). The survey was passed on to a pilot group of people who had taken one of the online courses. Then, a session was held in which the items were written and placed inside the questionnaire’s skeleton. These items contemplated different types of questions, such as open and closed questions as well as multiple choice questions. The evaluation questions were constructed using a 6-point Likert scale. Using the Delphi method, an expert consultation was carried out to validate the final product. This step culminated in the final construction of the tool, allowing a high degree of validity for the purpose of the instrument. Once validated, it was digitized using the Google Drive forms tool. The final product would end up collecting information about the teachers who participate in the training experiences, the perception they have about these courses, their origin, the information needed to solve it, and one last point that questions whether they would recommend this type of training to other fellow teachers. The reliability of the instrument was checked using Cronbach’s Alpha coefficient. The score was 0.961, which allowed us to establish the internal consistency of the instrument.

2.3. Data Analysis

This research works with data on the evaluation of different aspects of the course, as well as the degree of recommendation of the same. Therefore, these data were used as variables, resulting in three types: Dependent, independent, and categorical:
  • Dependent variables: NPS and would you recommend this course to another teacher.
  • Independent variables: ICT Evaluation (the valuation made of the ICT tools used during the course), Content Evaluation (the evaluation made of the contents addressed in the course), Activity Evaluation (the assessment made of the activities developed throughout the course), Final Work Evaluation (the evaluation made of the final work proposed in the course), and Format Evaluation (the valuation made of the format in which the course has been presented).
  • Categorical variable: Course.
  • The NPS variable is numerical, and is the result of calculating through the question Would you recommend this course to another teacher? where their answers are classified into 3 categories:
  • Promoters: People who have answered 9 or 10.
  • Neutral: People who have responded 7 or 8.
  • Detractors: People who have responded between 0 and 6.
Once the answers are classified, the NPS is calculated as the percentage of Promoters minus the percentage of Detractors, that is to say:
NPS = P / n D / n
where
#P: Number of promoters
#N: Number of neutrals
#D: Number of detractors
n: Number of clients responding to the questionnaire, i.e., #P+#N+#D.
The result of this calculation can range from −100% to +100%. The central value, therefore, is zero. An NPS greater than zero is favorable and a NPS less than zero is unfavorable.
The variable Would you recommend this course to another teacher? measured on a scale of 0 to 10.
In order to prepare the independent variables (measured on a 6-degree Likert scale), the items in the questionnaire have been framed within each of the variables, according to their subject matter, and then an average score has been calculated for subsequent analysis.
To develop the methodology, a linear multivariate model was calculated on the independent variables and the dependent variable NPS. Each one of them was compared with the course variable, in order to establish an analysis of variance between them.
Initially, the data offered by CRIF are checked for normality for the variables content, technology, activities, final work, and format, applying the Kolmogorov–Smirnov test, since we have a sample more than n > 50. It can be observed in Table 2 that p-value for all variables analyzed in this study is 0.000. Therefore, we can say that with a 95% confidence for the variables, there is no evidence to prove that it follows a normal distribution. Next, the normality statistic is presented, which will indicate if the sample will be treated in a parametric way or not.

3. Results

The following are the results of the statistical analysis of the data, which begin with a Spearman correlation because the sample does not follow a normal distribution.
Table 3 shows high correlations between:
  • Content Evaluation with Activity Evaluation and The Final Work.
  • Activity Evaluation with Final Work Evaluation.
  • Moderate correlations between:
  • Would you recommend this course to another teacher? With Evaluation of the Contents, Activities, Final Work, and Format.
  • Evaluation of the ICT with Evaluation of the Content, Activities, Final Work, and Format.
  • Evaluation of the Format with Content, Activities, and Final Work.
  • Low or very low correlations between:
  • NPS with ICT assessment, Contents, Activities, Final Work, Format, and Would you recommend this course to another teacher? Would you recommend this course to another teacher.
Our next step is to look at the average reputation of each course (NPS), such as its recommendation, as described in Table 4 and Table 5. This allows us to place ourselves from a general perspective on each of the variables, before analyzing in detail the variance of each of the independent variables in relation to the course.
Then, since the sample cannot be said to follow a normal distribution, non-parametric measurements are applied. Specifically, the Kruskal–Wallis test, to confirm the existence of significant differences between the independent variables and the dependent variable NPS for each of the courses taken by the teachers.

3.1. Evaluation of ICTs

When the sample is paired, significant elements emerge. This allows you to check and mark differences between courses. In them, it can be seen that the course that better valued the use of ICT was No 1. Course number 5 had a worse valuation of the same section (Figure 1). The average evaluation of the use of ICT is 4.53.

3.2. Evaluation of the Contents

Analyzing the variable Contents Evaluation, it is possible to verify differences between the courses. In them, it can be seen that the one that had better evaluations of the Content was No. 32. Course number 5 had a worse evaluation of the same section (Figure 2). In the variable in question, the average rating was 5.16.

3.3. Evaluation of Activities

By focusing on the Activity Evaluation, we can see discrepancies across the different courses. We can see that the course No. 33 was the one with the best evaluation of the activities. The course No. 7 was the one with the worst evaluation in the same section (Figure 3). In this case, the average value of the activities was 5.10.

3.4. Evaluation of the Final Work

If we focus on the evaluation of the Final Work of the different courses, significant differences between them can be observed. This allows us to appreciate that the course in which the Final Work was best evaluated was No 14. Course number 5 had a worse evaluation of the same section (Figure 4). This time, the average value of the Final Project was 5.35.

3.5. Evaluation of the Format

In the verification of the sample by pairs referring to the Format Evaluation, significant elements are identified. This allows us to check and mark differences between courses. In them, it is possible to appreciate that the course in which the Format was better valued was No 14. Course number 5 had a worse valuation concerning the same section (Figure 5). Here, the average rating of the Format was 4.85.

3.6. NPS

Finally, when valuing the reputation of the course, as it happened with the previous variables, we can also confirm significant differences between them. The course that obtained the best NPS was No 34 and the worst valuation of the same section was No 5 (Figure 6). The average NPS score was 38.75, a value that is considered within a positive reputation range.

4. Discussion

At least for the next decade, training in ICT skills will be a burning challenge in all educational systems around the world [15]. For an educational system to be able to meet the demands of the knowledge society, it must have teachers who design, experiment, and evaluate learning experiences enriched with ICT [16].
Furthermore, there is no doubt that teacher training must become one of the challenges to be faced in order to ensure that citizens, especially children, adolescents, and young people who are still in the teaching–learning process, receive correct media literacy from [17]. Having a good system for valuing this formation is a fundamental requirement for a good evaluation [18].
The main conclusion of this study reveals that, for a good recommendation of an online teacher training course, the most important factor is the content that constitutes it, as Table 3 shows. There are other important factors in the evaluation of a course, such as the use of ICT or methodology, but the one that has more consideration is the content itself, giving a positive correlation of 0.646. This infers that the better the evaluation of the course content, the more recommended it is among teachers. At the same time, and reinforcing this conclusion, Table 5 indicates that there is a difference of 2.71 points on average in the evaluation of content between the best rated course (Cedar) in this section, and the worst rated (Technology, Programming, and Robotics). Similarly, Rivero and Mur [19] discover that methodology, content, and a good pedagogical foundation forms the basis for innovative approaches in the future.
It is possible that questions such as those discovered by Roig-Vila, Mengual-Andrés, and Quinto-Medrano [20] may influence the primary school teachers’ disciplinary and pedagogical knowledge rather than their technological knowledge. From the opposite perspective, there are tendencies linked to training actions that address the area of content creation of digital teaching competence. In addition to teaching teachers how to use authoring tools, they should pay special attention to technical aspects such as accessibility and reusability of content, as well as go in-depth into the creation of adaptive resources and providing feedback [21].
Although the lack of good technological training constitutes one of the key elements for the difficulties of implementing new technologies [22], in this case, as observed in Table 3, the teachers do not consider the ICT variable as an influential factor when recommending a training experience. All this is evident with a low positive correlation (0.403), assuming the lowest value of all the factors that influence teacher satisfaction with the training proposal. This conclusion is reinforced by observing Figure 1, from which it can be extracted that the average evaluation of the use of ICT within all the training courses is the one that has obtained the lowest score, exactly 4.53. This definitely shows that ICT is the factor of those taken into account that has the least influence on teacher satisfaction with the course. This is a premise that coincides with the Cabero and Marín [23] proposal, in which the training and improvement of teachers in ICT must be done from different approaches to how it has been done, which has focused too much on instrumental and technological aspects.
Furthermore, these formative actions for the virtual training of teachers should not focus so much on the instrumental component, that is, the functioning of the platform or LMS, but rather on didactic aspects, referring to the design of materials for the network, or the strategies and e-activities to be applied on that network [24]. Technology needs to be infused as a systemic and systematic process throughout the teacher training program [25]. On the contrary, placing ourselves in the position of the trends that give great value to technical aspects in teacher training processes is one of the fundamental premises for the incorporation of ICTs into the educational world is the technical knowledge to handle and apply digital tools. Without these skills, it will be difficult to implement experiences mediated by the technology in education [26].
At this same level, Erdogan and Sahin [27] found that, by obtaining poor results in technological knowledge, lower results are also obtained at the intersections of these with the rest of the basic knowledge (pedagogical and content knowledge). This implies low results in the technological and pedagogical knowledge of content, necessary for a good integration of ICT in the teaching work according to the TPACK model [28]. However, it should be noted that in order to effectively use ICTs in teaching, teachers must be trained in technological, content, and pedagogical skills. Therefore, education, teacher development, and professional development programs should provide learning opportunities for teachers to develop the three areas addressed in the TPACK model [29]. The continuous training of teachers has to be redirected towards other paths, not teaching a teacher how to handle a tool like Twitter but presenting them. Thanks to that, they will be able to get in touch with other teachers and share experiences and learning. In other words, the challenge lies in fostering relationships between education professionals and the media, not only as application technologies, but as cultural forms. We must change the culture of continuous training by generating a network in which professionals with more knowledge and experience with the media take on a mentoring role towards the newest ones, until they acquire sufficient mastery and security in their use [30].
Of the courses taken, the scores vary in terms of the evaluation of the sections measured in the questionnaire. Although it is true that a pattern is observed here (Figure 2, Figure 4 and Figure 6), it can be concluded that in general terms, course No 33 is the best valued in most of the factors, and even when it is not the best valued, it tends to be classified in high positions. In a similar way, but on the opposite side, the same happens with course No 5. This is usually the worst valued in most of the variables, and in those that are not, it is usually among the worst ranked.
With regard to the reputation of the course (NPS), the variables taken (contents, ICT, activities, final work, and format) have little influence on it, as can be seen in Table 3. Therefore, it is convenient to pose as prospective and future lines of development, to continue studying which variables can influence (evaluation systems, feedback tools, course methodology, gender of the participants, age of the teachers, etc.) for this purpose. Along these lines, we can progress in accordance with Felini [31] who offers a series of parameters that can guide the way forward and highlights, among other issues, the need to incorporate co-teaching processes in which more than one teacher participates, the configuration of effective working groups, and the originality of the training activity on media literacy. Furthermore, these training processes must necessarily be linked to good teaching practices that serve as a reference model [30].
What is clear is that a competence training proposal cannot be addressed through an approach based on the mere transmission of knowledge [32], it requires applied practical experience to develop the professional competence of teachers in the educational use of ICT [33], and the use of didactic resources and continuous and effective feedback [34].
Teachers involved in ICT professional development definitely tend to use computers more often, place more emphasis on teaching ICT skills, and have a stronger sense of ICT self-efficacy than their skeptical colleagues [35].
Regarding the rest of the variables, the activities of the training proposals analyzed do not seem to determine too much the decisions that teachers make in relation to their preference for continuous training. If we look at the final work of the courses, we discover that, as in the case of the activities, it is a factor that does not exert a high influence on the teachers’ decision making about the training opportunities they intend to access. Finally, regarding the format of the courses we can point out that it follows the pattern of the two previous factors, it cannot be considered a variable that influences the teachers’ preferences in a decisive way when facing the selection of a training opportunity.

5. Conclusions

To close, the objective of the study is to analyze the assessments made by teachers on different aspects of a course, identifying the factors (content, technology, activities, final work, and format) that predict the selection of a training experience by this profile. In this sense, it has been discovered that the content is what attracts most attention, while the technology used for its development turns out to be the least attractive for the teaching profile. The NPS of the courses analyzed reinforces these conclusions, since the courses that have obtained the best valuation are those in which the contents stand out, while the less valued are those directly linked to technology.
Therefore, we can conclude that a positive recommendation of a training opportunity by the teacher will be given in those courses that emphasize the design of their contents aligning them with the needs of the target population. On the other hand, we can emphasize that the factor that will have the least influence on this decision is the technology that is proposed as a means to carry out the different practices and dynamics that make up the training experience.
It can be clearly seen in the course No 33 (Digital Collaborative Art) that has a very marked focus on content arrangement, while course No 5 focuses mainly on technological instrumental content (Technology, programming, and robotics).
Table 5 represents the average course recommendation to support this idea. In it, it can be seen that, as in the case of Course Evaluation, numbers 33 and 34 are the most recommended, while numbers 5 and 7 are the least recommended. This reasserts the importance of the content, since the central proposal of the training experiences of numbers 33 and 34 has a component directly linked to this variable, while numbers 5 and 7 are more focused on technological aspects.
For teachers to design new learning environments and incorporate technologies, it is essential to experience a variety of modalities and initiatives in their own training, even more so in the pandemic situation in which we find ourselves The skills and competencies that teachers will have to develop in order to be able to teach how to learn in the new society are not acquired in training contexts that do not promote these skills and competencies. New training contexts are demanded in a digital environment that is rapidly changing. In short, new training scenarios must be considered in order to respond to new forms of learning [36], and to be successful in these scenarios, teachers need to have a good techno-pedagogical training that enables them to have control over the use of technological resources in their teaching practice, and in parallel, access to technical training on the use of different digital tools that give them security in the implementation of the sessions; all this at the service of an innovative pedagogical experience [37,38]. This is a necessity that has been magnified in the current situation with the Covid-19 pandemic, which has forced teachers to move their learning proposal to a digital environment in order to ensure continuity in the learning of their students.

6. Limitations and Further Developments of the Research

Finally, in relation to the limitations of the study, we can highlight the absence of control over variables such as the specific area of work of teachers, which could directly influence the preferences on the different aspects that make up the training courses. In addition, no information has been collected on sociodemographic variables that segment the sample by gender and age. These are two aspects that could emerge as elements that directly influence the opinions that teachers have about the training opportunities they face in their continuous professional development.
As future lines of research, it is proposed to develop this construct from the national proposal for teacher training. The sample would be extended to the other communities that make up the Spanish geography, seeking to consolidate the findings of this work from a broader perspective. In addition, a hypothesis will be raised that facilitates delving into the perceptions of the group of teachers, addressing the research from different methods. It will allow to identify the factors that most influence the decision making of the teachers about their ongoing training, providing concrete recommendations that allow the improvement of a training experience of this nature. At the same time, it is necessary to check whether the effects of the Covid-19 pandemic have modified the preferences of teachers in relation to the factors of the training they attend.

Author Contributions

The following is the distribution of the different tasks among the research team: Conceptualization, M.O.-P. and M.B.; methodology, R.S.-V. and C.P.-D.; validation, M.O.-P. and C.P.-D.; formal analysis, R.S.-V.; investigation, M.O.-P., R.S.-V., M.B. and C.P.-D.; formal analysis, R.S.-V.; resources, M.O.-P. and C.P.-D.; data curation, R.S.-V.; writing—original draft preparation, M.B.; writing—review and editing, M.O.-P. and M.B.; visualization, C.P.-D.; supervision, M.B.; project administration, R.S.-V. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ortiz Padilla, M. Diseño Aplicación Y Evaluación de un Programa de Formación Docente Para la Enseñanza de la Matemática Infantil. Ph.D. Thesis, Universidad Autónoma de Madrid, Madrid, Spain, 2016. Available online: http://purl.org/dc/dcmitype/Text (accessed on 14 July 2020).
  2. Vargas, L. La formación docente. Congreso Iberoamericano de Educación, Metas 2021. Buenos Aires, República de Argentina. 13, 14 y 15 septembre, 2010. Available online: http://www.chubut.edu.ar/descargas/secundaria/congreso/DOCENTES/R0103_Magyoly.pdf (accessed on 14 July 2020).
  3. León de Hernández, Z.M. Modelo pedagógico de formación permanente de los docentes en el proceso docente-educativo-productivo y de servicio en los Institutos Universitarios de Tecnología. Didasc. Didáct. Educ. 2012, 3, 59–84. [Google Scholar]
  4. Cabero Almenara, J.; Marín Díaz, V.; Castaño Garrido, C.M. Validación de la aplicación del modelo TPACK para la formación del profesorado en TIC. Attic Rev. Innov. Educ. 2015, 14, 13–22. [Google Scholar]
  5. Mora-Valentín, E.M.; Ortiz-De-Urbina-Criado, M. ¿Cómo fomentar el desarrollo de competencias en la formación on-line? Una experiencia en la asignatura de dirección estratégica. Educ. Knowl. Soc. 2015, 16, 90–108. [Google Scholar] [CrossRef] [Green Version]
  6. Vinader Segura, R.; Abuín Vences, N. Nuevos modelos educativos: Los MOOCs como paradigma de la formación online. Hist. Comun. Soc. 2013, 18, 801–814. [Google Scholar] [CrossRef] [Green Version]
  7. Raposo Rivas, M.; Martínez Figueira, M.E.; Sarmiento Campos, J.A. Un estudio sobre los componentes pedagógicos de los cursos online masivos. Comun. Rev. Cient. Iberoam. Comun. Educ. 2015, 44, 27–35. [Google Scholar]
  8. Biasutti, M. The student experience of a collaborative e-learning university module. Comput. Educ. 2011, 57, 1865–1875. [Google Scholar] [CrossRef]
  9. Chaparro Matamoros, P. La enseñanza online en los estudios universitarios. Actual. Juríd. Iberoam. 2016, 4, 9–26. [Google Scholar]
  10. García, C.M. La formación docente en la sociedad del conocimiento y la información: Avances y temas pendientes. Comun. Pedagog. Nuevas Tecnol. Recur. Didact. 2007, 10, 52–62. [Google Scholar]
  11. Sarmiento Santana, M. La Enseñanza de las Matemáticas y las Ntic: Una Estrategia de Formación Permanente; Universitat Rovira i Virgili: Tarragona, Spain, 2007; Available online: https://www.tdx.cat/handle/10803/8927#page=1 (accessed on 19 July 2020).
  12. Downes, S. Learning networks and connective knowledge. In Collective Intelligence and E-Learning 2.0: Implications of Web-Based Communities and Networking; Yang, H.H., Yuen, S.C.-Y., Eds.; IGI Global: Hershey, PA, USA, 2010; pp. 1–26. ISBN 978-1-60566-729-4. [Google Scholar]
  13. Biasutti, M. A comparative analysis of forums and wikis as tools for online collaborative learning. Comput. Educ. 2017, 111, 158–171. [Google Scholar] [CrossRef]
  14. Siemens, G. Conociendo el Conocimiento; Quintana, E., Vidal, D., Torres, L., Castrillejo, V.A., Santamaría, F., Alonso, N., Eds.; Lulu.com: Manitoba, Canada, 2010; ISBN 978-90-815937-1-7. [Google Scholar]
  15. Pérez-Tornero, J.-M.; Tayie, S. La formación de profesores en educación en medios: Currículo y experiencias internacionales. Comun. Rev. Cient. Comun. Educ. 2012, 20, 10–14. [Google Scholar] [CrossRef]
  16. García-Valcárcel Muñoz-Repiso, A.; Basilotta Gómez-Pablos, V.; Cabezas González, M.; Casillas Martín, S.; González Rodero, L.; Hernández Martín, A.; Mena Marcos, J.J. La formación del profesorado universitario en Tecnologías de la Información y la Comunicación en la Universidad de Salamanca. Rev. Latinoam. Tecnol. Educ. 2015, 14, 75–88. [Google Scholar] [CrossRef]
  17. López-Romero, L.; Aguaded-Gómez, M.-C. La docencia sobre alfabetización mediática en las facultades de educación y comunicación. Comun. Rev. Cient. Comun. Educ. 2015, 22, 187–195. [Google Scholar] [CrossRef] [Green Version]
  18. Gómez-García, M.; Matosas-López, L.; Ruiz-Palmero, J. Social networks use patterns among university youth: The validity and reliability of an updated measurement instrument. Sustainability 2020, 12, 3503. [Google Scholar] [CrossRef]
  19. Rivero Gracia, M.P.; Mur Sangrá, L. Aprender ciencias sociales en la web 2.0. Iber Didáct. Cienc. Soc. Geogr. Hist. 2015, 80, 30–37. [Google Scholar]
  20. Roig-Vila, R.; Mengual-Andrés, S.; Quinto-Medrano, P. Conocimientos tecnológicos, pedagógicos y disciplinares del profesorado de Primaria. Comun. Rev. Cient. Comun. Educ. 2015, 23, 151–159. [Google Scholar] [CrossRef] [Green Version]
  21. Gordillo, A.G.; López-Pernas, S.L.-P.; Barra, E.B.; Gordillo, A.; López-Pernas, S.; Barra, E. Effectiveness of MOOCs for teachers in safe ICT use training. Comun. Media Educ. Res. J. 2019, 27, 96–105. [Google Scholar] [CrossRef]
  22. Coronado Cabrera, E.; Cantú Valadez, M.; Rodríguez Pichardo, C. Diagnóstico universitario sobre el uso de la TIC en el proceso de enseñanza-aprendizaje bajo la modalidad educativa presencial en Santo Domingo. Edutec Rev. Electrón. Tecnol. Educ. 2014, 50, a289. [Google Scholar]
  23. Cabero Almenara, J.; Marín Díaz, V. Miradas sobre la formación del profesorado en tecnologías de información y comunicación (TIC). Enl@ce Rev. Venez. Inf., Tecnol. Conoc. 2014, 11, 3. [Google Scholar]
  24. Cabero Almenara, J.; Gallego Pérez, Ó.; Puentes Puente, Á.; Jiménez Rosa, T. La “Aceptación de la Tecnología de la Formación Virtual” y su relación con la Capacitación Docente en Formación Virtual. EDMETIC 2018, 1, 225–241. [Google Scholar] [CrossRef] [Green Version]
  25. Tondeur, J.; Scherer, R.; Siddiq, F.; Baran, E. A comprehensive investigation of TPACK within pre-service teachers’ ICT profiles: Mind the gap! Australas. J. Educ. Technol. 2017, 33. [Google Scholar] [CrossRef] [Green Version]
  26. Fernández-Cruz, F.-J.; Fernández-Díaz, M.-J. Los docentes de la generación Z y sus competencias digitales. Comun. Rev. Cient. Comun. Educ. 2016, 24, 97–105. [Google Scholar] [CrossRef] [Green Version]
  27. Erdogan, A.; Sahin, I. Relationship between math teacher candidates’ Technological pedagogical and content knowledge (TPACK) and achievement levels. Procedia Soc. Behav. Sci. 2010, 2, 2707–2711. [Google Scholar] [CrossRef] [Green Version]
  28. Mishra, P.; Koehler, M.J. Technological pedagogical content knowledge: A framework for teacher knowledge. Teach. Coll. Rec. 2006, 108, 1017–1054. [Google Scholar] [CrossRef]
  29. Cabero, J.; Barroso, J. ICT teacher training: A view of the TPACK model. Cult. Educ. 2016, 28, 633–663. [Google Scholar] [CrossRef]
  30. Ramírez-García, A.; González-Fernández, N. Competencia mediática del profesorado y del alumnado de educación obligatoria en España. Comun. Rev. Cient. Comun. Educ. 2016, 24, 49–58. [Google Scholar] [CrossRef] [Green Version]
  31. Felini, D. Quality media literacy education: A tool for teachers and teacher educators of italian elementary schools. J. Media Lit. Educ. 2014, 6, 28–43. [Google Scholar]
  32. Gutiérrez Martín, A.; Palacios Picos, A.; Torrego Egido, L. La formación de los futuros maestros y la integración de las TIC en la educación: Anatomía de un desencuentro. Rev. Educ. 2010, 352, 267–293. [Google Scholar]
  33. Li, S.; Yamaguchi, S.; Sukhbaatar, J.; Takada, J. The influence of teachers’ professional development activities on the factors promoting ICT integration in primary schools in Mongolia. Educ. Sci. 2019, 9, 78. [Google Scholar] [CrossRef] [Green Version]
  34. Torrance, H. Formative assessment at the crossroads: Conformative, deformative and transformative assessment. Oxf. Rev. Educ. 2012, 38, 323–342. [Google Scholar] [CrossRef]
  35. Drossel, K.; Eickelmann, B. Teachers’ participation in professional development concerning the implementation of new technologies in class: A latent class analysis of teachers and the relationship with the use of computers, ICT self-efficacy and emphasis on teaching ICT skills. Large-Scale Assess. Educ. 2017, 5, 19. [Google Scholar] [CrossRef] [Green Version]
  36. Vaillant, D. Formación de profesores en escenarios TIC. Rev. e-Curric. 2014, 12, 1128–1142. [Google Scholar]
  37. Gómez, M.; Boumadan, M.; Poyatos, C.; Soto-Varela, R. Formación docente en línea a distancia. Un análisis de los perfiles y la opinión de los profesores. Rev. Electrón. Interuniv. Form. Profr. 2020, 23. [Google Scholar] [CrossRef]
  38. Martínez-Garcés, J.; Burbano-Vallejo, M.; Burbano-Vallejo, E. Obstáculos y perspectivas al emplear tecnologías de información para enseñar contabilidad. Educ. Humanismo 2019, 21, 104–119. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Kruskal–Wallis test for Information and Communication Technology (ICT) Evaluation variable.
Figure 1. Kruskal–Wallis test for Information and Communication Technology (ICT) Evaluation variable.
Sustainability 12 08064 g001
Figure 2. Kruskal–Wallis test for Content Evaluation variable.
Figure 2. Kruskal–Wallis test for Content Evaluation variable.
Sustainability 12 08064 g002
Figure 3. Kruskal–Wallis test for Activity Evaluation variable.
Figure 3. Kruskal–Wallis test for Activity Evaluation variable.
Sustainability 12 08064 g003
Figure 4. Kruskal–Wallis test for Final Work Evaluation variable.
Figure 4. Kruskal–Wallis test for Final Work Evaluation variable.
Sustainability 12 08064 g004
Figure 5. Kruskal–Wallis test for Format Evaluation variable.
Figure 5. Kruskal–Wallis test for Format Evaluation variable.
Sustainability 12 08064 g005
Figure 6. Kruskal–Wallis test for NPS variable.
Figure 6. Kruskal–Wallis test for NPS variable.
Sustainability 12 08064 g006
Table 1. Frequency of course participants.
Table 1. Frequency of course participants.
Course
FrequencyPercent
1. From paper to the cloud3304.4
2. Moodle120216.0
4. Teaching website5387.2
5. Technology, Programming and Robotics420.6
6. Learning to Search550.7
7. Digital Transformation430.6
11. Assess to learn74710.0
12. Learning Designs340.5
13. Service-Learning1351.8
14. Cooperative Learning1291.7
21. Flipped Classroom101213.5
22. Learning Landscapes5877.8
23. Project-Based Learning133317.8
31. National Statistics Institute1051.4
32. Cedro2403.2
33. Digital collaborative art240.3
34. Trainee Public-Worker310.4
41. Tutorial function4425.9
42. Coexistence4726.3
Total7501100.0
Table 2. Reliability statistics.
Table 2. Reliability statistics.
Cronbach’s AlphaN of Items
0.96126
Table 3. Kolmogorov–Smirnov test for a sample.
Table 3. Kolmogorov–Smirnov test for a sample.
ICT EvaluationContent EvaluationActivity EvaluationFinal Work EvaluationFormat EvaluationWould You Recommend This Course to Another Teacher?NPS
Test Statistic0.0800.1930.1760.2330.1180.1990.142
Asymp. Sig. (2-tailed)0.000 a0.000 a0.000 a0.000 a0.000 a0.000 a0.000 a
Test distribution is Normal. Calculated from data. a Lilliefors Significance Correction.
Table 4. Correlations.
Table 4. Correlations.
ICT EvaluationContent EvaluationActivity EvaluationFinal Work EvaluationFormat EvaluationWould You Recommend this Course to Another Teacher?NPS
Spearman’s rhoICT EvaluationCorrelation Coefficient1.0000.482 **0.474 **0.440 **0.545 **0.403 **0.142 **
Sig. (2-tailed) 0.0000.000.0000.0000.0000.000
Content EvaluationCorrelation Coefficient0.482 **1.0000.742 **0.708 **0.678 **0.646 **0.24 5**
Sig. (2-tailed)0.000 0.0000.0000.0000.0000.000
Activity EvaluationCorrelation Coefficient0.474 **0.742 **1.0000.718 **0.678 **0.613 **0.249 **
Sig. (2-tailed)0.0000.000 0.0000.0000.0000.000
Final Work EvaluationCorrelation Coefficient0.440 **0.708 **0.718 **1.0000.634 **0.552 **0.199 **
Sig. (2-tailed)0.0000.0000.000 0.0000.0000.000
Format EvaluationCorrelation Coefficient0.545 **0.678 **0.678 **0.634 **1.0000.597 **0.147 **
Sig. (2-tailed)0.0000.0000.0000.000 0.0000.000
Would you recommend this course to another teacher?Correlation Coefficient0.403 **0.646 **0.613 **0.552 **0.597**1.0000.272 **
Sig. (2-tailed)0.0000.0000.0000.0000.000 0.000
NPSCorrelation Coefficient0.142 **0.245 **0.249 **0.199 **0.147 **0.272 **1.000
Sig. (2-tailed)0.0000.0000.0000.0000.0000.000
** Correlation is significant at the 0.01 level (2-tailed).
Table 5. Net Promoter Score (NPS) and recommendation mean per course.
Table 5. Net Promoter Score (NPS) and recommendation mean per course.
CourseRecommendation MeanNPS Mean
18.6450.173
28.2841.156
48.7155.568
55.24−45.24
68.6960
76.49−31.43
118.1439.667
126.65−17.65
137.5021.05
148.8161.86
218.6252.495
228.7056.589
237.9133.421
317.5020.955
327.9530.348
33968
34984.38
418.3341.282
426.53−16.989

Share and Cite

MDPI and ACS Style

Boumadan, M.; Soto-Varela, R.; Ortiz-Padilla, M.; Poyatos-Dorado, C. What Factors Determine the Value of an Online Teacher Education Experience from a Teacher’s Perspective? Sustainability 2020, 12, 8064. https://doi.org/10.3390/su12198064

AMA Style

Boumadan M, Soto-Varela R, Ortiz-Padilla M, Poyatos-Dorado C. What Factors Determine the Value of an Online Teacher Education Experience from a Teacher’s Perspective? Sustainability. 2020; 12(19):8064. https://doi.org/10.3390/su12198064

Chicago/Turabian Style

Boumadan, Moussa, Roberto Soto-Varela, Myriam Ortiz-Padilla, and César Poyatos-Dorado. 2020. "What Factors Determine the Value of an Online Teacher Education Experience from a Teacher’s Perspective?" Sustainability 12, no. 19: 8064. https://doi.org/10.3390/su12198064

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop