1. Introduction
This article examines the processes of feedback and assessment in online language courses in higher education institutions (HEI). While online learning gathers bigger groups, teachers and institutions are forced to pay attention to the effectiveness and quality of the processes of evaluation and feedback since they have a significant impact on learning. A course should be structured so that it allows the students and teachers to reflect on their performance and to compare it with the set goals and to utilize the feedback they receive during the course.
This article discusses how to maintain quality in the processes of feedback and assessment in online language courses. The discussion is a part of the Finnish project “Getting ready—A higher education preparatory program for immigrants” which aims to develop the national recommendations for online training courses for immigrants who wish to apply to study in higher education institutions. The project group has drawn up a proposal for the preparatory program qualifications, and the first implementation of the piloting preparatory course starts in April 2019.
The article also introduces the Finnish education system and the reasons why Finland’s educational system has aroused the interest of educational researchers worldwide. Teaching and learning with information and communication technologies (ICT) is one of the major methodologies in the present Finnish educational discourse. At the moment, Finnish HEIs are competing in many fields, and teaching and learning technologies are often mentioned in the institutions’ profiles. Due to geographical reasons, our institution, the South-Eastern Finland University of Applied Sciences (later Xamk), has developed into one of the leading HEIs for online teaching in Finland.
The concepts of quality and feedback in higher education (particularly quality) are defined from the viewpoint of online learning. This brief theoretical background is reflected in relation to the recent quality criteria for online implementations which were published for Finnish HEIs and other educational institutions in order to build high quality online courses.
Finally, the article presents our ongoing work in the project “Getting ready—A higher education preparatory program for immigrants”. We study some learning principles and quality criteria that should be taken into account when creating online implementations. Our article is not a traditional research article. Instead, we would like to open discussion on the efficiency and future development of the selected principles.
2. Online Learning in Finland
The term online learning is used interchangeably with several terms, like e-learning, digital learning, virtual learning, cyberlearning, or even distance learning in specific contexts. Network and communication technologies provide language learning solutions for delivering instructions to learners in remote locations. Online learning means that the learning process is instructed via computer networks. This provides opportunities to reach people in distant geographical locations, as well as globally. (
Lim et al. 2007.)
Lim et al. (
2007) bring together several studies in order to compare instructional outcomes and learner satisfaction in online learning processes. Several studies (e.g.,
Otte and Benke 2006;
Pardere 2012) suggest that online learning can offer more beneficial and flexible learning modes compared to traditional face-to-face mode. However, there are also certain obstacles which can endanger adequate learning results (see e.g.,
Fontaine 2002;
Oh and Lim 2005;
Hong and Samimy 2010). In order to achieve sufficient results in online learning, a learner is expected to be motivated and active and have a good command of learning skills. The learning outcomes are better and the development is deeper if a learner has strong engagement and self-motivation for the online learning process. A sense of belonging and a community have influence on learner satisfaction and learning effectiveness. Since online learning processes lack genuine face-to-face interaction between a teacher and a learner, it is important to create a sense of presence and a feeling of immediacy when using the resources of communication technologies. However, according to
Lim et al. (
2007), no significant differences were found in learning outcomes between online and blended delivery methods.
Pardere (
2019) presents varying definitions for the term Blended Learning (BL). BL refers to the blend of traditional face-to-face teaching environment and online learning environment together with ICT-mediated teaching or computer-assisted learning (CAL). The term blended learning has been used synonymously with hybrid learning, hybrid instruction, mixed mode learning and technology-mediated learning or technology enhanced learning (
Wang et al. 2015). In the context of Finnish education, BL often occurs when using the flipped classroom method.
In BL courses, online and other modalities are used side by side and are connected (
Staker and Horn 2012). According to
Wang et al. (
2015), BL is a very complex system which consists of six separate but interacting subsystems: the learner, the teacher, the technology, the content, the learning support, and the institution. In the case of language studies, we may give a definition that BL combines computer-assisted language learning (CALL) technologies and face-to-face interaction. L2 education can be used to support efficient learning. BL can be beneficial, e.g., in promoting learners’ motivation and empowering learner autonomy, but L2 researchers are not convinced that BL implementations always accomplish the intended benefits (
Hong and Samimy 2010;
Pardere 2012).
This article focuses on the Finnish preparatory online program for immigrants, and in this program, the courses are not implemented with BL methods, only the CALL mode (i.e., web-based teleconferencing and online instruction via web-based learning environments/platforms) is used, but the core of the problem is the same: We are trying to support the learners’ motivation and empowered attitude, but the teacher can’t be sure whether the learner reaches the intended outcomes. In online courses, the lack of real face-to-face interaction may blur the teacher’s ability to observe the learner’s actual level of competence and attitude.
Hong and Samimy’s (
2010) study shows that the learners’ attitudes towards CALL are influenced by the learners’ general computer skills, daily hours of internet use or daily hours of L2 studies on the internet, gender, age and prior language learning experiences. A positive attitude creates positive learning results and positive results improve attitudes.
With a population of 5.5 million and an area of 338,440 square kilometers, the population density in Finland is quite low, being 18.1 inhabitants per km
2. About 25% of the population lives in the Helsinki metropolitan area. (
Figure 1).
This geographical scattering, as well as the low population density, certainly has a major effect on the increasing use of online learning. Educational institutions are located in bigger towns and, in order to make it possible for more people to participate in education, versatile ways to implement online learning have been developed. Online learning possibilities also enable diverse combinations of work and study. Online learning can improve the motivation of students because studying can be self-paced. In other words, you can learn where and whenever you want. However, online learning demands a higher degree of autonomy, self-discipline and organizational skills.
Neumeier (
2005) found out that, in order to support the participation rate of the students, the course should be clearly structured, in relation to, for example, the sequencing and methodological choices. According to Official Statistics of Finland (
OSF 2018a), 98% of the population aged 16–64 use the Internet and 90% use the Internet many times a day.
Due to obtaining very good PISA results at the beginning of the 21st century, Finland and its education system have been a point of interest among the actors working in the field of education worldwide. PISA stands for the Programme for International Student Assessment, which administers the testing of 15-year-old students all over the world in key school subjects (
OECD 2018a). The program was established by the Organisation for Economic Co-operation and Development (OECD).
Burg (
2018) highlights some differences between Finland and the USA in relation to education and circumstances affecting the learning abilities of children. Two themes that undoubtedly have an impact on the realization of learning are the number of children living in poverty (Finland 5.3% and US 33%) and the number of non-native language speakers (Finland 10% and US 20%) (
Burg 2018). Education in Finland is free at all levels of education. Thus, studying is possible in all phases of life and lifelong learning has been an important principle for decades.
In Finland, there are two types of higher education institutions: universities and universities of applied sciences (also known as Vocational Universities or Polytechnic Universities). The Ministry of Education and Culture steers and finances the activities and promotes the quality of higher education institutions. In order to develop the quality of education, the Ministry has listed several themes to be considered, e.g., teaching methods, learning environments, competence of teachers, digitalization, cooperation between institutions, flexibility in studies and recognition of prior learning. One important target is to identify the competence and educational needs of immigrants and to improve their chances of getting into the labor market. (
Ministry of Education and Culture 2018).
A process to build a vision for the Finnish higher education and research in 2030 has been ongoing for one year. The target of the process is to create a future scenario for developing the Finnish higher education system. According to this vision, “flexible and personalized study paths and degrees will enable lifelong learning in different life situations. Digitalization and openness will renew teaching, learning, research and innovation activities as well as higher education institutions and will open up new channels for effectiveness.” (
Ministry of Education and Culture 2017).
The affiliation of the authors of this article is South-Eastern Finland University of Applied Sciences (Xamk). Xamk is the 5th largest university of applied sciences in Finland and it operates in four towns: Kotka, Kouvola, Mikkeli and Savonlinna. The distance between the farthest campuses (Kotka and Savonlinna) is 260 km (
Figure 2).
The vision of Xamk includes similar themes and targets to those of the national vision (see
Ministry of Education and Culture 2017). The Strategy 2018–2030 focuses on the following themes: education and research that are independent of time and place, identification of future professions and developing the education accordingly, development of digital learning environments and new technological means of teaching, individual learning paths and international competence of students and staff. (
Strategia 2018–2030 2017).
4. Feedback Creating Quality
Quality is a concept with many meanings. It is difficult to give an exact and universal definition of it. Fortunately, quality in higher education is a concept which has drawn attention in recent years. For example, the European Association of Institutions in Higher Educations EURASHE organizes conferences and publishes reports frequently (
Bollaert 2014).
Finnish HEIs are committed to quality work. For example, in our home organization Xamk, each member of the community is responsible for the development of his/her own activities and the quality culture arises from individual and collective development. Maintaining quality demands systematic work in data collecting, information sharing, clarifying responsibilities, standardizing practices, spreading good practices and ensuring transparency, reliability and confidentiality. These quality processes extend through the whole organization, management, research staff, teachers and students. (
Quality Management at Xamk 2018).
Xamk’s quality does not grow or stay without continuous development work. This ongoing and never-ending development can be simplified with the help of Deming’s PDCA cycle which is a continuous quality improvement model: the cycle starts from planning (P), continues with doing (D), checking (C) the results and acting (A) for the improvement based on the previous steps. After this, the Deming’s cycle starts again from the beginning. This model is widely used in the quality processes of HEIs. (
Moen and Norman 2010). When planning and piloting a course, the Deming’s cycle helps the teacher to maintain quality by following the steps:
Plan the course
Pilot the course
Check how the piloting succeeded
Do the necessary improvements
Implement the course again in an improved form.
The Getting ready project (see
Section 3) is about planning, doing and checking, i.e., Deming’s steps P, D and C. The last step A ‘act’ will take place after the project work has been completed. Hopefully, systematic development will continue after that as well.
Related to Deming’s step C, checking, Finnish HEIs have systematic procedures. If management or an individual teacher want to know how the course succeeded, it is possible to collect data via a feedback inquiry. Xamk has standardized, digital course feedback forms and quite a clear process for sending inquiries to students and for later analyzing the received feedback. The Xamk students are asked to give feedback on the courses systematically and frequently, which gives teachers an opportunity to have information which is valuable when improving the courses (
Quality Management at Xamk 2018). The feedback should be targeted correctly.
Patton (
2012,
2013) offers a U-FE check list which helps to target feedback questions and guarantee the feedback is as beneficial as possible. If students give feedback but notice later that their feedback is not used for the improvement of the course, students will easily lose their motivation. (
Leckey and Neill 2001;
Chadna and Frick 2011).
When students give feedback, teachers can use it for improving the course. If we change the direction of feedback, and the teacher is the one who gives feedback for a student, he/she gets the opportunity to improve his/her course performance. Giving feedback is also one form of evaluation or assessment. The evaluation process includes observing the learners’ existing strengths, as well as conclusions and recommendations for future development. Evaluation or assessment are not synonymous with criticism or judgement. Evaluation can take place before, during or after the course. (
Virtanen 2007).
5. Quality in Online Learning
Several current projects in Finland focus on online learning. One of them is the eAMK project, which is funded by the Ministry of Education and Culture for 2017–2020. Its most important target is to create a shared offering of digital courses that is available for all universities of applied sciences. In order to broaden the selection of online courses, a coaching program will be implemented to increase staff competence on digital pedagogy. (
eAMK Project 2018a).
With a similar viewpoint of online learning, the Getting ready! project (
Section 3) has utilized resources and outcomes of the eAMK project. First, the eAMK project provides coaching in digital course planning for the specialists from the Getting ready! project. Second, the quality criteria for online implementation of the courses that have been developed in the eAMK project will be utilized in the Getting Ready! project as well as in Finnish online course design generally.
In the quality criteria, creating a new online course has been discussed from the following viewpoints: (1) Target group and users, (2) Learning objectives, learning process and pedagogical solution, (3) Assignments, (4) Contents and materials, (5) Tools, (6) Interaction, (7) Guidance and feedback, (8) Evaluation, (9) Development, (10) Usability and visuals, (11) Support services. (
eAMK Project 2017).
Target group and users include considering the starting level requirements of the course and informing the students about them. In some cases, the starting level can be tested in order to choose the students with the adequate knowledge for completing the course. The teacher should also know the number of participants and take it into account in the course.
Learning objectives, learning process and pedagogical solution include defining the learning objectives related to field-specific and generic competences, working life orientation, and internationalization. The pedagogical solutions are chosen to help the students to reach the learning objectives.
Assignments should help the students to reach the learning objectives and to take real working life situations into consideration. The target, schedule and evaluation criteria of the assignments should be clear. The assignments should be suitable for online learning.
Contents and materials should provide the students the possibility to combine previous and new information and select the most appropriate material. The materials should be up-to-date, reliable and legally accessible.
Tools in the course have been chosen to support the achievement of the learning objectives. The tools should be free and secure and there should be clear instructions for using or downloading the tools. The course description includes the information about the equipment and application requirements.
Interaction during the course should be implemented using easy modes of interaction, e.g., Skype, Adobe connect. The purpose of interaction is to support the achievement of the learning objectives.
Guidance and feedback should be available in a timely manner and during the whole course. The implementation methods, timetable and responsible persons should be clearly presented on the online platform. The possibility for the students to ask questions and give feedback should be available. Analysis tools of the online platform can be used for monitoring the progress of the students.
Evaluation should be implemented using versatile methods, such as peer evaluation, self-evaluation and automatic tests. The evaluation subjects are related to the learning objectives. The evaluation process is presented in the course description.
Development of the course should be continuous. All aspects of the course (e.g., methods, contents, online tools, learning objectives) should be assessed and developed. Feedback is collected from the students and the teachers, and the course is developed on the basis of the received feedback.
Usability and visuals include considering at least the following themes: structure and progress of the course, naming of the files and folders, unified style, readability (font, colors), accessibility of text formats and visual elements (pictures, videos), overall accessibility (different types of terminal devices) and security.
Support services should be available for both the students and the teachers. Information about the services and their schedule is clearly presented on the online platform.
Similar criteria for designing online courses have been presented by
Vai and Sosulski (
2011). They have created a practical but theory-based application for designing an online course, especially for higher education purposes. Vai and Sosulski’s guidelines for successful online course design suggest that an online course meets the quality demands when the following principles have been taken into account: (1) The graphical design is clear, i.e., the lay-out supports readability and visual and auditive elements are used to improve clarity, (2) The language is clear, the writing style is brief and the tone is supportive, (3) The course offers real-world multimodal examples and multiple learning resources and 4) The course has a clear structure with chapters. When planning new online courses or updating old ones, it is useful to find and study guide books in this field. For example,
Meskill and Anthony (
2015) offer a pragmatic overview on teaching languages online.
In
Section 6, we choose for closer study some learning principles that should be taken into account in the joint online implementations. We examine these principles by utilizing the quality criteria introduced in
Section 5. This study is important for us because we need to decide how to follow the quality criteria while building courses for the preparatory program.
6. Ensuring Quality in the Preparatory Training Course
The project introduced above, “Getting ready—A higher education preparatory program for immigrants” implements the first online preparatory course in April–September 2019. The planning phase of the different courses included in the entity occurs at the end of the year 2018 and at the beginning of the year 2019.
As framed in
Section 2, quality in online learning has been an issue that has been considered in many recent research studies. We apply this theoretical framework in order to create an online implementation with high quality. However, our focus is on pragmatic features. On the basis of our earlier online teaching experiences, we chose three important online learning principles or challenges to be considered more carefully in the planning of our courses (Finnish and English). These principles are the teacher availability, students’ expectations and feedback and evaluation. We examined these principles using the quality criteria introduced in the previous section in order to solve and foresee the possible problems in the course implementation.
6.1. Teacher Availability
When comparing contact courses to online courses, one of the most significant differences is the form of communication. In contact courses, the students see the teacher in live meetings according to the course timetable but, in contrast, there are no live meetings for online courses. The teacher and the student don’t share the same physical space and teaching and learning are asynchronous (see
Vai and Sosulski 2011). This difference sets versatile challenges on the form and quality of interaction in online courses.
According to the quality criteria for online implementations, interaction during the course should be implemented using modes and tools that support learning and reaching the learning targets. In our preparatory course, the learning environment is Moodle and in weekly meetings with the students we will use Skype for Business. Quite often online courses consist of material and tasks and there are no live online sessions between the teacher and the students. In our implementations the weekly online meetings support the students in their learning and provide the ability to practice the learning objectives.
It is also important that the students know when and how they can contact the teacher. According to the quality criteria, the schedule of the course should be clearly presented on the online platform. This schedule should also include the information about the teacher availability and the teacher’s contact information.
In our preparatory courses we will create video lectures about important advice related to the course (e.g., schedule, assignments). The lectures will be available on the online platform and they allow the students to review the course information as many times as they need to in order to comprehend any essential matters.
6.2. Students’ Expectations
The individual learning objectives of students typically vary a great deal. One student wants to learn the basics of a new language while the other needs credits in order to ensure his or her study grant. Thus, the students’ expectations can be diverse. From the preparatory course students’ point of view, the learning objective for most of them is to develop the skills needed for applying to higher education. Presumably their motivation will be good and expectations will be high.
To meet the students’ expectations, all parts of the quality criteria for online implementations should be considered. However, different students appreciate different qualities of courses. In any case, on the basis of the long online teaching experience of the authors, the most important qualities are a clear structure and schedule. It is essential to know what to do and when. According to the quality criteria, the assignments of the course should be clearly introduced on the online platform in relation to their purpose, schedule and evaluation criteria.
In order to meet the course participants’ individual expectations, the course should be implemented so that all students get the possibility to use their strengths and to develop their weaknesses. At the end of the course all participants should feel that personal development has occurred and increased competence has been developed.
Meeting the individual expectations of the students is a problematic issue. While the group size grows, arranging time for meeting the students individually becomes challenging. In this project, we have a chance to teach rather small groups of about 20 students. However, one goal of online courses is to offer study possibilities for a massive audience. In order to enable learning for different kinds of learners and to maintain the quality, the use of versatile tools and endless imagination are needed.
6.3. Feedback and Evaluation
Feedback is a two-way dialogue between the teacher and the students of the course. The quality criteria for online implementations also supports this principle. This two-way interaction should be made possible on the online platform. In our preparatory courses there are many ways to carry out interaction, e.g., Skype-sessions and discussion areas.
Evaluation is usually one of the most challenging parts of course implementations. The different sections of the evaluation process in an online course should be clearly described on the online platform. These sections include the subjects, the method, the criteria and the schedule of the evaluation. The criteria should be based on the learning objectives of the course so that the students are able to reflect their learning themselves, too.
Feedback and evaluation are also matters of self-confidence. In order to support students to utilize their strengths in learning and to overcome their learning challenges, the ways to give feedback and to implement evaluation should be carefully considered. Creating an appreciative atmosphere in the course starting from the beginning plays a crucial role in relation to the learning results.