3.2.2. Deep Look at the Academy Staff Pedagogical Digital Competences
A deeper look at the particular competences in each area and the qualitative reflection on their own practices presented during the interviews provides a clearer picture of how the participants associate their own digital pedagogical practices with their awareness of their own proficiency level according to the DigCompEdu.
Area 1. Professional Engagement
The study on educator-specific digital competences in
Area 1 (
Table 9) shows that the most consistent result is in competency
1.3. Professional Collaboration, while the highest level of dispersion is observed in competency
1.8. Professional learning (about digital technologies) and
1.9. Digital Continuous Professional Development (
Table 9,
Figure 4).
Despite the relatively high self-assessment in Area 1. Professional engagement, during the interviews, the teachers hardly commented on the individual competences from this group and how they manifest them in their practice. There were no comments on the competences 1.5. Reflective practice and 1.9. Computational thinking.
Implicitly, the level of competences 1.1. Organizational communication could be verified by the fact that the faculty has modern digital infrastructure and all the administrative communication is implemented in an electronic environment—the digital information system SUSI—with internal communication via institutional emails and the learning management system (LMS) Moodle, as well as local institutional certificates for signing documents and accessing the internal digital platforms.
With regard to 1.3. Professional cooperation, some teachers share that they participate in classes simultaneously and even collaborate in the field. In general, this is limited to participation in seminars and scientific forums, including in a digital environment, for example, in an online or hybrid format.
All the academicians teaching ICT-related courses demonstrate a high level of competences 1.7 and 1.8. Professional learning (through and about tech), consistent with their self-assessment score at levels C1–C2. For the other teachers, these competences do not seem to be necessary in the context of the subjects they teach.
Speaking about the competences to work in an online learning environment, the teachers comment on the need for flexibility to shift from one software to another in order to be able to support students: “I wanted to show an example with a tectonic processing program. It turned out that I have a much more powerful version than the students, and they cannot reproduce what I am showing them. For my part, I couldn’t quickly figure out how to solve the problem with their version of the software, and this took up a lot of teaching time and shifted the focus of the class.” (Senior assistant professor, ICT-based discipline, female).
The interviewees comment the competency 1.4. School technologies and infrastructure, mainly in terms of limitations. The computer labs are used for the specialized IT disciplines, while the others are conducted in the regular classroom, where, despite the good Wi-Fi connectivity to the Intranet and Internet, there are no electricity outlets for charging mobile devices. Similar is the experience with the interactive (smart) boards: “Although I teach a course related to the pedagogical functions of interactive whiteboards, I am unable to use one of the two classrooms equipped with such a device.” (Professor, ICT-based discipline, female).
According to 1.6. Digital life (ethics and safety), overall, the interviews reveal a positive attitude toward digitization. The main reasons are (1) the emergence of technology in everyday life and the transformation of digital skills into a requirement of the times (four people); (2) digital technologies are seen as a guarantee for high-quality and more effective learning (three people); (3) mastery of digital technologies is a criterion for competitiveness (three people): “Future teachers must be well prepared and familiar with modern technologies, able to apply them in their learning and teaching and to prepare their students so that they are ready to use these technologies in real life as an integral part of our lives.” (Associate professor, female).
On the other hand, there were also comments about technology overload (three people): “Another thing we are seeing is ‘digital fatigue’—a weariness with technology. We need to find the right balance and focus on meaning—where technology really adds value.” (Senior assist. prof., female).
Area 2. Digital Resources
Table 10 and
Figure 5 present the university teachers as
leaders in creating digital resources for education in the field of mathematics, informatics and ICT. It seems they feel more confident in creating than in modifying digital resources. The weakest point is the sharing of digital resources (
Table 10 and
Figure 5).
The competences in the area are commented on in interviews from the aspect of forming these competences in future teachers. Lecturers provide examples of teaching methods—problem-solving, project-based learning, in which they integrate and assess competences for researching and selecting digital resources (2.1.). They express the expectation that students have already developed such competences, given that they are defined as outcomes of general education curricula at school. Ethics of use of digital resources is also focused on: “In addition to searching for and selecting digital resources, we also pay close attention to licensing rights.” (assist. prof., male).
All of the lecturers in ICT-based disciplines (multimedia, programming, digital creativity, etc.) put an emphasis on 2.2. Creating digital resources competence, as they require the creation of an authentic digital product:
“The course has a specific focus, and that is creativity. Therefore, naturally, the competences related to creating digital content are leading.” (Senior assist., male).
“In my courses, I focus 100% on practical application. You sit down in front of a computer, program software, or create a database.” (Assoc. prof., male).
Competences for Modifying digital resources (2.3.) go hand in hand with skills for the creation of digital content: “The course covers topics related to the development and design of various digital learning materials. I give students complete freedom to develop something entirely new or adapt an existing resource.” (Prof., male).
2.4. Management and protection competences are mentioned briefly and in a general way. The faculty expressed the opinion that students do not need to be developed in this direction.
From the other side, the competences for Sharing resources (2.5.) are discussed from different points of view as a part of professional and civic responsibility and they are included in different educational activities: “Sharing resources and interacting are practically mandatory components in at least one of the assignments they work on as a team, and this is actually an element that is included in their assessment.” (Prof., female).
Area 3: Teaching and Learning
While the academic staff reflects as
experts on most of the competences, it feels mostly at integrator level in relation to digitally supported self-regulated learning (
Table 11 and
Figure 6).
Speaking about 3.1. Teaching and lesson planning, the academic staff share experience mostly on how they develop these students’ competences, but they did not provide examples on how they develop their lesson by the help of digital technologies.
The digital guidance (3.2.) is presented mostly in demonstrations and formulating problems/assignments in a digital environment: “I demonstrate an example of programming code that is part of the lecture. A student asks, “What would happen if …”. Instead of answering him, I directly change the program code on the screen and we discuss together what is happening and why. Sometimes I even deliberately do ‘bugs’ to create a problem situation for them to think about.” (Prof., male).
3.3. Collaborative learning is quite prominent in the practices shared during the interview.
“I constantly organize group work using Moodle tools. For example, I require students to publish their assignments in the Database object, where each group can then review the assignments of other groups and rate them.”
(Assist. prof., male)
“For example, at the beginning of a group project, students start with a group brainstorming session in a digital environment (e.g., Miro), and then at home they can review and further develop their ideas until they arrive at a clear formulation of the problem they will be working on.”
(Assoc. prof, female)
“During teaching practice, we require students to plan their lessons in pairs so that there is always feedback and continuity from one group to another.”
(Assoc. prof, female)
The competence 3.4. Self-regulated learning had litter representation in the discussion The examples relate to constantly changing technologies and students’ ability to adapt to them in the future.
“It is extremely important to consider when and why we use digital technologies. The task of analysing learners is very challenging because the technologies we have and use for teaching today are one set, but when our students enter the classroom as teachers, they will probably be different. Students who are future teachers must be prepared to flexibly master new teaching and learning tools and use them appropriately.”
(Senior assistant, female)
Discussing competences to adopt Emerging technologies (3.5.), the topic of artificial intelligence (AI) is frequently commented on. Concerns and fears arise—on the one hand, there is an awareness that they must be involved in training, but on the other hand, they clearly realize that this will lead to radical changes in assessment and teaching practice. Some of the lecturers express their willingness to experiment with AI and other innovative technologies together with their students.
“Our first encounter with good and not-so-good practices (in terms of AI) came as a result of cases that arose or were brought up by students. Whether it was to share something, or because they had used AI in preparing an assignment, or because they were interested and asked us to think, develop, and review something together. We talked about generative artificial intelligence and the hallucinations it creates, as well as about educational games that encourage students to be more critical towards the use of this type of technology.”
(Assoc. prof., female)
“Another problem is artificial intelligence. It is already in use, but at the same time there is no regulation at university level. Bans or restrictions cannot be enforced. Nor is there any way of knowing whether a student has used unregulated artificial intelligence or not. Therefore, in my opinion, we need to take a different approach, not a prohibitive one, but rather one that focuses on how it can be used in education.”
(Prof., male)
Area 4: Assessment
The academic staff assess themselves around (but a little bit under) level B2. Using LMS Moodle for many years, most of the lecturers are familiar with different digital assessment tools, but it seems this does not guarantee self-confidence in the area (
Table 12 and
Figure 7).
Competence 4.1 is demonstrated in the application of the following basic assessment strategies: (1) assessment through projects (three people) or didactical assignments (five people).
Most teachers also use digital quizzes, but only one relies mainly on them. One participant explicitly mentions that he assesses the technical skills of his students, while two others clearly state that the technical skills of students are not a subject of assessment.
“I don’t assess their digital skills, but rather the results of their work. They decide for themselves how they will complete their tasks.”
(Assoc. prof. female)
Three of them state that they use a criteria matrix for assessment: “We have an observation protocol, we have assessment criteria, and the assessment of pedagogical digital competence accompanies every component in practice. For example, we have a section for lesson planning, which includes components related to the design. Has the student analysed the classroom in terms of equipment, technology, and the selection of software to be used? The answers to these questions contribute to the assessment.” (Assoc. prof., female)
However, in six (6) of the interviews, unclear or hidden assessment criteria were observed, which is considered a prerequisite for educational inequalities (
Peter et al., 2024):
“My grading strategy is simple. I give five assignments, and each correctly completed assignment earns one point toward the grade, no further explanation necessary.”
(Assoc. prof., male)
“When assessing coursework, the way it is formatted also influences the grade, even though this is not part of the assessment criteria.”
Most of the lecturers shared practices demonstrating their Analyzing evidence (4.2.) competence: “Tests and assignments are done in Moodle. Students receive feedback from me on them.” (Senior assistant, female).
Some teachers use imitation as a model when teaching students how to prepare digital exam materials: “For example, before a test, I tell my students that I have solved all the problems in the test in advance and have assessed how long it takes me and where the pitfalls are. This way, I set a model for them so that in the future, as teachers, they will first test the exam materials on themselves.” (Prof., male).
The competence 4.3. Feedback and planning are expressed through communication and feedback via personal messages and forums, as well as through the tools available in the e-learning environment.
“We encourage students to send us drafts of their coursework and seek feedback from us before the final submission so that they can improve their work in advance.”
(Senior assistant, male)
Area 5: Empowering Learners
The teaching staff has
expertise in blended learning as it is a traditional form in many courses at the faculty, but it still does not feel expert in other competences in the area. At the faculty, the traditional style of teaching, oriented to the mass student, still prevails, and this fact also reflects on the digital pedagogical competences of the academicians (
Table 13 and
Figure 8).
The competence 5.1. Accessibility and inclusion is discussed mostly as a subject of student development, but rarely in terms of the faculty practices. Only one lecturer talks about using students’ textbooks and learning resources in English: “In my classes, we compare the educational content in different educational systems, using textbooks published in other countries. Even with those in English, students find it difficult because they are not familiar with the terminology in that language, despite being fluent in it at a conversational level.”
“With regard to accessibility and inclusive education, we are very keen to discuss this issue with our students, and we also discuss it in relation to the technologies that should or should not be used, so as not to make the content inaccessible when working with students.”
The competences 5.2. Differentiation and personalization are commented on by five participants. It is noted that adjustments are being made to the educational process and additional support is being provided through consultations, including in a digital environment, in accordance with the level of the group.
Approximately a third of the participants shared digitally supported practices that actively engage students—working in teams on projects, brainstorming sessions, collaborative content creation, digitally conducted workshops and peer reviews. At the same time, they expressed concerns that it is difficult to overcome students’ tendency to reproduce passive learning styles.
“The ASSURE model we use places special emphasis on actively engaging students. We value this highly. We are advocates of a more active style of working with learners. Sometimes it is difficult to change the mindset of the students we work with because, until now, most of them have observed and participated in a less active style of work directed by their teachers and, accordingly, tend to apply this passive style to their students.”
Competence 5.4. Blended learning for implementing blended learning were discussed throughout the interviews in the context of various other issues, as this form of learning is typical and traditional for the university. Teachers feel so comfortable with it that they do not even consider it to require special competences.
Area 6. Facilitating Learners’ Digital Competence
Acting as leaders in creating digital resources (Area 10), the faculty professors feel
experts in facilitating students’ competences in digital content creation. They are also perceived as
experts in relation to
Digital problem-solving and
Information and media literacy (
Table 14 and
Figure 9). However, they describe themselves as
integrators in supporting the development of students’ competences for responsible use of digital technologies and resources, as well as digital safety and wellbeing competences.
According to facilitating students’ digital competences (6.1. and 6.2.), they share the following: “We try to focus on seeking high levels of competence of our students and to include as many cases and examples as possible, to require them to complete specific tasks that will develop such competence. We look at issues related to the reliability of sources and their accuracy, and how to extract data. We also have similar topics and components related to communication and collaboration. In some of the topics and projects we give in the course, we also assess this component.” (Prof., female).
Discussing forming competence 6.2. Communication and collaboration, a common issue in all interviews, is the lack of teamwork skills among students; sometimes this is even seen as a deliberate unwillingness on their part. Respondents, in turn, try to compensate for this usually through group activities or projects, but there are also those who directly refuse to assign such tasks in order to avoid unpleasant situations.
“Even in secondary education, there is a significant gap—pupils do not work together or in groups, nor do they work on projects with interdisciplinary connections. The holistic approach is not well integrated—studying a problem in depth from the perspective of, say, mathematics, chemistry, and physics. It is as if each subject stands alone. As a step towards overcoming this problem, we require students to think across subjects and encourage them to create more complex experiences for their pupils. That is why in my course I ask them to develop ideas for Escape Room-type games, as well as various scenarios that can be used for active holistic learning.”
(Senior assistant, female)
“They work on their final project in pairs. This is intentional. On the one hand, it is to distribute the workload of the entire project, and on the other hand, it is to develop teamwork and cooperation skills. Cooperation within and between groups takes place in Moodle LMS.”
(Assistant, male)
The strong, conscious, and professional support provided to students with regard to 6.3. Digital content creation is clearly evident in almost every interview.
“We expect students to create educational content. In this sense, we try to support their thinking as teachers, i.e., not to create things just for the sake of form or specific technology, but to do so in a well-thought-out manner from an educational perspective.”
(Senior assist., male)
“Each of the topics in the course involves creating original content or using and integrating third-party digital content. That is why I pay attention to the types of copyright, popular and less popular free licenses, ways of citing and referencing. In general, these types of things are the focus of the course and a lot of attention is paid to them.”
(Senior assist., male)
In general, the topic of compliance with license agreements and building skills to protect one’s own digital products through appropriate licenses was present in most of the interviews.
Five of the interviews seriously addressed the issue of plagiarism and the improper use of Internet resources by students in connection with the creation of resources. The professors comment on the measures they take against unethical behavior.
“As a preventive measure, I show them that our electronic system (Moodle) keeps all logs, saves everything, and it is visible. The journals could be either group or individual, as well as by time and by activity.”
(Assist. prof., male)
Some challenges are also discussed:
“Somehow, content is generated with the expectation that it is factually accurate. In this sense, we have pointed out that this is not a good approach and that such things should be verified as information. On the other hand, we encourage the use of artificial intelligence from the perspective of digital creativity, for example, to generate ideas for approaches in different situations. Therefore, it is important to discuss when it is appropriate and when it is not appropriate to use AI.”
(Senior assist. prof., male)
“We also discuss digital inequality. Multimedia solutions and technologies can enable different types of access to content, such as including content in text and audio formats. Possibility to create subtitles.”
(Senior assist. prof., male)
With regard to 6.4. Safety and well-being, lecturers pay particular attention to personal privacy and data protection.
“I always explain how artificial intelligence works, why, and what documents exist. I try to present to them different tools and show them the pros and cons.”
(Senior assist., female)
“My course includes a topic focused on how technology can support and facilitate the work of teachers and students with special needs.”
(Prof., female)
“Regarding “Digital Identity Management”—what can be noticed about students is the competent use of all systems and platforms that require authentication and competent management of personal data.”
Facilitating 6.5. Responsible use of digital technologies is the focus of teachers’ education at the Faculty of Mathematics and Informatics.
“In all cases, critical use of information and responsible work with data is the focus. It is a mandatory requirement that they (the students) as teachers should be able to present reliable, relevant, up-to-date information, to check their sources, to refrain from making inaccurate statements, and to cultivate a similar attitude, including with regard to ethics.”
(Assoc. prof, female)
With regard to 6.6. Problem-solving, the interviews reveal a rather instrumental, practically oriented view; it is associated with solving specific problems rather than analyzing the situation and identifying the problem.
“In the context of digital competences, even gathering information is a form of problem solving. The first problem is how to find it or how to collect data. Another important thing is to be able to sift through the information, understand what part of it will be useful to us and what part is just filler…”