Next Article in Journal
Building Mathematics Learning through Inquiry Using Student-Generated Data: Lessons Learned from Plan-Do-Study-Act Cycles
Next Article in Special Issue
Impact of Universal Primary Education Policy on the Schooling of Girls and Children with Disabilities in Uganda
Previous Article in Journal
Teachers’ Agency in Technology for Education in Pre- and Post-COVID-19 Periods: A Systematic Literature Review
Previous Article in Special Issue
Inclusive Education Systems: The Struggle for Equity and the Promotion of Autonomy in Portugal
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing Teachers’ Practices in Providing Inclusive Online Education: Development and Validation of an Instrument Based on Inclusive Practices among Teachers in Malaysia

1
Department of Computer Science, Oslo Metropolitan University, 0166 Oslo, Norway
2
Department of Mathematics and Science Education, University of Malaya, Kuala Lumpur 50603, Malaysia
*
Author to whom correspondence should be addressed.
Educ. Sci. 2023, 13(9), 918; https://doi.org/10.3390/educsci13090918
Submission received: 3 July 2023 / Revised: 30 August 2023 / Accepted: 31 August 2023 / Published: 8 September 2023
(This article belongs to the Special Issue Inclusive Education: International Policy and Practice)

Abstract

:
All students should have equal opportunities to pursue education. When the COVID-19 pandemic began, almost all teaching activities had to be switched from the traditional face-to-face format to digital platforms. Although it is now the post-pandemic period, many online teaching and learning practices have been maintained. It is, therefore, crucial to ensure that teachers are doing their best to make online teaching inclusive, and an instrument assessing their practices is essential. This study aims to develop this instrument and validate it. Referring to relevant works and universal design for learning (UDL) guidelines, we developed an instrument that consists of five domains: affective, behavioural, cognitive, competence and awareness. Through expert assessment of face, content and construct validity, a pilot study, and data analysis of 505 respondents teaching in different educational levels from primary schools to higher institutions in Malaysia, using exploratory factor analysis (EFA) and correlational testing, the findings show that the instrument has high validity and reliability in assessing teachers’ practices in delivering inclusive online education. While the instrument has implications for policymakers and researchers, it needs further validation in the context of different countries. Necessary amendments might be required to make it more context specific.

1. Introduction

The importance of providing equal opportunities to all children in pursuing education is self-evident. Not only is education crucial for one’s personal growth and development but ensuring inclusiveness of education also plays an important role for the progress of society as a whole. According to the United Nations International Children’s Emergency Fund, “inclusive education means all children in the same classrooms, in the same schools. It means real learning opportunities for groups who have traditionally been excluded—not only children with disabilities, but speakers of minority languages too” [1]. When teaching moves to digital platforms, there are other groups of students who can be excluded, as happened even before the pandemic. Not having equal access to software [2], equipment [3], and a stable internet connection (especially among countries in Africa, Asia and the Middle East) [4] and having disparate computer literacy [5] are some factors identified as contributing to students not all being able to participate fully in online classes.
The COVID-19 pandemic has accelerated online teaching and learning. Due to COVID-19 restrictions, traditional face-to-face teaching had to be switched to online teaching. It has been a challenge for many teachers to ensure that all students attending classes on digital platforms receive the same and equal opportunities to learn, as they did before the pandemic, in physical classrooms [6,7,8,9]. On 5 May 2023, the World Health Organization announced that COVID-19 was no longer a public health emergency of international concern [10], and many schools had even returned to traditional face-to-face teaching when restrictions were lifted before this announcement. However, some online teaching and learning practices have remained (either partially or completely) due to their advantages, such as students being able to watch recorded videos [11], saving commute time [12], and providing flexibility to adults and non-traditional students [13], as well as to teachers if unexpected events occur [14]. Despite the pros that online education can offer, we would like to emphasise at the same time that it has its cons as well, such as increased stress and workload among teachers, dissatisfaction among students, and lower attendance [9].
It is crucial to ensure that online teaching and learning environments are inclusive for all students, and teachers play a very important role in ensuring inclusivity. Previous studies have shown that teachers who were more aware of students not having equal access to resources required to attend online classes such as internet, laptops and/or computers, and space at home, tended to do more to ensure that students were offered equal opportunity to learn [3,6,7,9]. Teachers in these studies demonstrated themselves willing to record videos (as compensation for those who faced difficulties in attending synchronous online teaching), offer private communication channels, and provide resources such as self-explanatory notes, PowerPoint materials, links to useful websites, and YouTube videos. These practices contributed to a more inclusive online teaching and learning environment. We argue that it is important to have these practices assessed so that the status of current practices and hence, areas for improvement, can be identified.
However, to the best of our knowledge, a commonly accepted instrument that can be used to assess practices among teachers with regard to providing inclusive online education has not hitherto been developed. Such an instrument is also essential as a standard tool that can be used to assess practices across schools and institutions, regionally, nationally, and internationally. The main objective of this study is, therefore, to develop an instrument serving this purpose and examine its reliability and validity.

1.1. Theoretical Frameworks

When developing the instrument, we first reviewed relevant works about providing digitally accessible [15] and inclusive education [16], emergency remote education [17] and universal design for learning (UDL) guidelines [18]. As online education requires teachers to deliver education on digital platforms, it is crucial that they are digitally competent. One of the main challenges reported about emergency remote teaching has been teachers lacking necessary digital skills [17,19]. Two frameworks describing what digital competence for teachers signifies, i.e., the European Framework for the Digital Competence of Educators [20] and the United Nations Educational, Scientific and Cultural Organisation Information and Communications Technology (ICT) Competency Framework for Teachers [21], were adopted by Gilligan [15] in his work describing a framework for digital accessibility competencies for teachers. In addition to highlighting the importance of teachers receiving adequate training and guidance to be digitally competent, these frameworks underscore the importance of them being aware of students’ digital competence so that they can design lessons based on that awareness. Gilligan [15] also noted the lack of UDL being extensively incorporated into the use of digital technologies in education.
Mahat [16] developed an instrument called Multimodal Attitudes toward Inclusive Education Scale (MATIES) that aims to assess teachers’ attitudes toward inclusive education based on the theory of planned behaviour [22,23]. The instrument comprises three dimensions of attitudes: affective, cognitive, and behavioural. According to Mahat, the multidimensional attitudes toward behaviour, subjective norms, and perceived ease or difficulty of performing the behaviour can influence one’s intention to make education inclusive. Although the developed statements in MATIES focus on students with disabilities and special needs, Mahat’s work emphasised that the context of inclusive education is not limited to these students alone. It also encompasses the idea of having no students excluded due to other learning differences, such as those that might derive from students’ sociodemographic backgrounds. A review on questionnaires assessing teachers’ attitudes towards inclusive education reported that MATIES can be a helpful instrument for examining how teachers intend to adapt their classroom and teaching practices to achieve inclusiveness [24]. Both MacFarlane and Woolfson [25] and Mudhar, Ertesvåg [26] adopted MATIES as part of their self-developed instruments when investigating teachers’ attitudes and behaviour towards students with special needs.
Previous studies have indicated that teaching digitally poses greater challenges for addressing diversity and/or inequality among students, as the teaching occurs remotely [3,19,27]. UDL can be an appropriate framework for helping teachers overcome this problem. UDL is a framework that utilises research findings about human learning to enhance and optimise teaching and learning for all individuals [18,28]. The guidelines highlight multiple means of engagement, representation, action, and expression, which can contribute to meeting diversity in a class.

1.2. The Instrument

Based on the above-mentioned theoretical frameworks, affective, behavioural, cognitive, competence, and awareness were listed as the five domains in our instrument. Affective refers to teachers’ attitudes, behavioural refers to how they feel, think and act, and cognitive refers to their mental processes and resulting actions regarding the practices that make online teaching and learning environments more inclusive for students. The terms competence and awareness refer to teachers’ proficiency and consciousness in providing an online teaching and learning environment that is inclusive, respectively.
We developed statements that would reflect teachers’ practices based on relevant works that referred to our theoretical framework [15,16,18,20,21] and the identified domains accordingly. A Likert scale was used to score each statement (1 = strongly disagree, 2 = disagree, 3 = somewhat disagree, 4 = neither agree or disagree, 5 = somewhat agree, 6 = agree, and 7 = strongly agree). In addition to the scale of 1 to 7, the option of n/a (not applicable) was offered. Table 1 lists the statements for each domain.

1.3. Hypothesis

Our hypothesis is that teachers who (1) have an emotional response to the objective that all students receive equal and quality education (affective), (2) conduct themselves in accordance with the aim of including all students (behavioural), and (3) can assess teaching situations based on understanding, experiences, and along the lines of good senses (cognitive) tend to have higher competence and awareness in providing inclusive online education to their students. To validate this hypothesis, it was necessary to undertake some assessments which include face, content and construct validity through expert, exploratory factor analysis (EFA) and to further them through correlational testing.

2. Materials and Methods

2.1. Pre-Data Collection

After developing the statements in the instrument, we distributed the instrument to an English-language expert with a PhD in Teaching English to Speakers of Other Languages (TESOL) and three content experts from higher education institutions to assess its face, content and construct validity. Face validity pertains to how clear and relevant the instrument statements appear, and it can be enhanced through a language expert review and a pilot study phase involving participant feedback [29]. Content and construct validity involve ensuring that the instrument statements align with the underlying domains being measured. This correspondence can be accomplished by engaging content experts, such as researchers in the respective field [29]. To further ensure the instrument’s reliability and validity, a pilot study was conducted with non-participating teachers. This pilot study enabled researchers to further evaluate the face validity and construct validity of the instrument. The data gathered during this phase were subsequently subjected to rigorous statistical measures (i.e., Cronbach’s alpha) to evaluate the internal consistency and reliability of the instrument.

2.2. Sample of the Study

To gain a comprehensive understanding of the five domains we identified in our instrument, we included teachers from primary schools to higher education institutions in Malaysia and utilised a convenience sampling strategy to reach potential respondents. By including teachers from all educational levels and demographic backgrounds, we hoped to gain valuable and broader insights concerning factors influencing their practices in delivering inclusive online teaching. The teachers included in this study are from Malaysia, as one of our authors is working in the Faculty of Education in a university in Malaysia. By focusing on these teachers, we aimed to collect data in a way that would result in highly reliable findings, given the author’s background in the pedagogical field in Malaysia. These teachers cover various subjects, including languages, social sciences, humanities, arts, commerce, science, and mathematics, and play a vital role in delivering online education. Table 2 shows the demographic data of respondents who participated in this study.

2.3. Data Collection

Due to the COVID-19 pandemic and the Malaysian government’s introduction of the Movement Control Order, we formulated a Google Forms questionnaire as the data collection medium instead of a traditional paper and pencil questionnaire. This data collection method not only reduced the risk of physical contact between respondents and researchers but also allowed reaching a larger geographical area and more diverse demographic backgrounds. The first data collection was conducted from 8 March 2021 to 29 April 2022, in conjunction with a study focusing on secondary science teachers delivering inclusive education. The second data collection was conducted from 21 October 2021 to 28 April 2022, and was open to all teachers from all educational levels. This approach aimed to capture a wider spectrum of practices among all types of teachers.
To maximise accessibility, we used social media platforms to distribute the questionnaire link to all possible respondents and encouraged further sharing. In addition, we sought the support of the top management of some schools and educational institutions to facilitate the distribution of the questionnaires to their teachers. Upon completion of the data collection process, a total of 505 individuals responded to the questionnaire. Subsequently, we performed a data screening and data cleaning process to eliminate any redundant or invalid data. This process aimed to ensure that the data analysis phase would be conducted using accurate and valid data, resulting in reliable findings that validate the developed instrument.

2.4. Data Analysis

The data collected from 505 respondents were analysed using IBM SPSS Statistics (Version 26). An EFA was conducted to identify underlying factors within a set of observed variables, ensuring that the developed statements fell under the previously determined domains [30]. An EFA provides insights into the interrelationships among variables and serves as a basis for constructing a more concise measurement model. After completing the EFA, the data underwent correlation analysis. The authors’ choice to perform a correlation analysis after the EFA served the purpose of hypothesis generation and context establishment. This approach aligns with an exploratory perspective, utilizing initial correlations to unveil patterns and connections among variables. Identifying correlations played a role in informing subsequent factor analysis, guiding the interpretation of derived factors. This method integrates correlations as a preliminary guide. By utilizing correlations for hypothesis generation, the authors enhanced the meaningfulness of their EFA outcomes. This strategic synergy between correlation analysis and EFA reflects a comprehensive research approach, strengthening the study’s credibility by constructing a better understanding of the dataset.
Since the data exhibited a normal distribution, a parametric testing approach was used. To examine the correlations between the research variables, a Pearson’s correlation test was performed. The study included five variables associated with providing inclusive education during remote teaching: affective, behavioural, cognitive, competence, and awareness. To evaluate the strength of the relationships among these variables, the criteria proposed by Zou and Tuncali [31] were adopted. A correlation value above 0.80 indicated a high strength of relationship, and a value above 0.50 and less than 0.80 indicated a moderate strength, while values below 0.50 indicated a weak correlation.

3. Results

3.1. Face, Content, and Construct Validity

The English language expert with a PhD in TESOL first ensured appropriate language usage in the instrument after reviewing the statements. The review encompassed areas such as grammar, vocabulary usage, and the clarity of the statements within the instrument. Amendments were made to enhance the readability and clarity of the statements. The final version of the instrument was pilot tested with 46 non-participating teachers to gather feedback on readability and comprehensibility. The feedback from participants was then used to revise and refine the instrument statements, addressing any ambiguities or issues identified during the pilot testing phase. Three content experts from the university then reviewed the instrument for its coverage, appropriateness, and representativeness. Their evaluation ensured that the statements aligned with the intended construct being measured. The feedback from the experts was invaluable in identifying any potential gaps, redundancies, or shortcomings in the instrument. The necessary revisions were undertaken based on the constructive feedback provided by the experts.

3.2. Pilot Study

Table 3 displays the Cronbach’s alpha values for each domain, as well as for the overall questionnaire completed by the 46 non-participating teachers. The obtained alpha values ranged from 0.70 to 0.90, indicating that the questionnaire was considered reliable and that the statements were deemed suitable for use [32].

3.3. Explotary Factor Analysis (EFA)

A total of 505 teachers in Malaysia completed the questionnaire. In order to examine the underlying structure of the questionnaire administered to this sample, an EFA was conducted using all 24 statements in the instrument. The analysis involved applying oblique rotation (oblimin) to the factors. The suitability of the data for factor analysis was assessed using the Kaiser–Meyer–Olkin measure, which yielded a value of 0.90, indicating that the sample was adequate for the analysis. Bartlett’s test of sphericity was also performed to assess the correlation structure of the data. The results of the test, χ² (180) = 6062.43, p < 0.001, indicated that the correlation structure was suitable for conducting factor analyses. This suggested that the domains in the instrument were sufficiently correlated to explore their underlying factors.
Using the maximum likelihood factor analysis method, a cut-off point of 0.40 and the Kaiser’s criterion of eigenvalues greater than 1 (as recommended by Field [33] and Stevens [34]), a five-factor solution emerged as the best fit for the data. These five factors accounted for a cumulative variance of 63.33%, indicating that they explained a significant portion of the variability in the responses to the questionnaire.
Table 4 shows the results of the EFA. The instrument’s structure can be categorised into five correlated factors, as indicated by the interrelationships among the statements. These factors represent distinct domains of measurement within the instrument. Notably, the eigenvalues of the first five factors exceeded the threshold value of 1.00. Eigenvalues indicate the amount of variance explained by each factor. By having eigenvalues greater than 1.00, these five factors accounted for a substantial proportion of the total variance in the data. The results of the analysis suggest that the instrument’s statements effectively captured and measured five correlated domains. This finding reinforces the validity and coherence of the instrument, as the identified domains correspond to the theoretical framework and constructs upon which it was built. Overall, the EFA provides empirical evidence supporting the instrument’s structure, indicating that it effectively captures and measures the intended domains of interest.

3.4. Correlational Testing

In this section, we present the results obtained from the analysis of correlations between the domains of the questionnaire. The statements in the questionnaire scored with a Likert scale were subjected to inferential statistical analysis to evaluate the teachers’ perspectives on various variables associated with online teaching. By applying Pearson correlation, the calculation of correlations among the five variables revealed positive and statistically significant relationships, as illustrated in Figure 1.
The first variable (i.e., teachers’ competence in providing inclusive online teaching) shows significant correlations with variables of affective (r = 0.39, p = 0.03), behavioural (r = 0.31, p = 0.04), and cognitive (r = 0.53, p = 0.02) with regards to providing inclusive education digitally. Although these variables exhibit statistical significance, the strength of the correlations was relatively weak, as the r values were below 0.5.
Upon examining the second variable (i.e., awareness in providing inclusive online teaching), it was observed that the teachers’ awareness exhibited a statistically significant moderate correlation with their competence (r = 0.41, p = 0.0001). Similarly, three other variables, namely, affective, behavioural, and cognitive, were also found to be significantly correlated with teachers’ awareness in delivering inclusive online teaching to students, with moderate correlation strengths indicated by the r values (r = 0.51, p = 0.0001), (r = 0.50, p = 0.0001), and (r = 0.58, p = 0.0001), respectively. Table 5 summarises the correlation value for each construct.

4. Discussion

The present study was designed to develop and validate an instrument that can be used to assess teachers’ practices in delivering inclusive online education. The instrument was first developed based on relevant studies on online teaching [15,17], inclusive education [16], and UDL guidelines [35,36], and five domains were identified to develop statements that comprise the instrument.

4.1. Testing of Theoretical Frameworks Adopted in the Instrument

In Mahat’s [16] work, the theory of planned behaviour by Ajzen [23] was referred to when designing MATIES. In this study, we adopted some items from MATIES as well as its three main dimensions of attitudes: affective, behavioural and cognitive. A medium positive correlation between the affective and cognitive variables, and high positive correlations between the affective and behavioural and the cognitive and behavioural variables were found in Mahat’s work. Our findings support Mahat’s work, demonstrating correlations between these three variables. We further discuss the correlations between all our domains in the next section.
As the theory of planned behaviour expresses essential individual values, it has been used in research studies in inclusive education [37]. A scoping review synthesizing studies on inclusive education using the theory of planned behaviour concluded that the link between the predictors and actual behaviours was unclear [37]. We argue that by incorporating the domains of competence and awareness with the domains of the three attitudes suggested by Mahat [16], it is possible to assess both the predictors and actual behaviours with increased depth. Through the findings, we managed to see the link between predictors and actual behaviours better. In this study, the cognitive, affective, and awareness domains reflect more on predictors, while the behavioural and competence domains focus more on actual actions.
Previous studies have shown success in incorporating UDL guidelines to ensure the education delivered is inclusive [28]. Espada-Chavarria and González-Montesino’s [28] study investigated whether teaching strategies in line with UDL could contribute to learner motivation. Their results showed that UDL guidelines highlighting multiple means of engagement, representation, action, and expression were correctly implemented in their teaching strategies and could contribute to students feeling included and welcomed in their learning environment, and hence more motivated as well. Although this study only focused on students enrolled in a degree program for Spanish sign language and deaf communities, which is studied by a large number of deaf students, the sample size is considered very diverse since it considers gender, age, year of study, academic qualifications (some students have sign language as a mother tongue, while others have no prior knowledge of Spanish sign language), abilities, disabilities (such as attention deficit hyperactivity disorder and dyslexia), and varied needs when attending classes.

4.2. Collarations between Domains

The findings demonstrate correlations between all five domains, which provide further support for the hypothesis that teachers who (1) have an emotional response to the objective that all students receive equal and quality education (affective), (2) conduct themselves in accordance with the aim of including all students (behaviour), and (3) can assess teaching situations based on understanding, experiences, and along the lines of good senses (cognitive) tend to have higher competence and awareness in providing an inclusive online education to their students.
The affective domain. Previous studies investigating online teaching have revealed that teachers who possessed a higher level of affection were more likely to be aware of the unique challenges faced by students in an online teaching and learning environment [6,7,8,19,38,39,40]. Some teachers in these studies were willing to learn more so that they could make necessary changes to adapt to the diversity among their students and address inequality by providing, for example, an asynchronous mode of teaching and learning and various digital contents that helped students to understand better, and so forth. By attuning themselves to their students’ emotions, teachers can identify individual needs, concerns, and barriers to learning on digital platforms. This awareness can enable them to proactively address these issues and implement strategies that promote inclusivity. Our findings support these previous studies by demonstrating correlations between affective, awareness and competence domains.
The behavioural domain. In this study, the behavioural domain refers to how teachers feel, think, and act. It focuses more on actual action, as compared with predictors, which is our attempt to address the knowledge gap of the significant links between predictors and actual action [37] when adopting Ajzen’s [23] theory of planned behaviour and Mahat’s [16] MATIES in our work. Our findings demonstrate a stronger correlation between the behavioural and awareness domains than between the behavioural and competence domains. This indicates that when teachers in our study became aware that some students were excluded from receiving quality education when teaching was switched to online platforms (awareness—predictor), they attempted to compensate for that exclusion (behavioural—actual action). However, they might not have received sufficient training to utilise digital tools to achieve this goal (competence—actual action). Studies have shown that many teachers struggled to adopt online teaching when emergency remote teaching occurred as they were not competent and familiar with that kind of teaching [9,17,41,42]. Despite not being competent, because they had an awareness of the importance of including all students and the intention to do so, just as they had in their traditional physical classrooms, they were willing to do more, from learning to produce educational videos and producing them, to providing alternative ways for students to reach them outside typical schooling hours.
The cognitive domain. One of the highest correlations found in this study was between the domains of cognition and awareness, with an r value of 0.58 and p < 0.01. Mahat [16] provided evidence that the cognitive domain plays a crucial role in enhancing teachers’ awareness of student diversity, which increases their ability to create an inclusive online teaching and learning environment. Previous studies have demonstrated that a strong cognitive foundation enables teachers to comprehend the distinctive needs and challenges that students encounter in an online setting [43,44]. Teachers with extensive knowledge and understanding can identify and address the barriers to learning faced by students from diverse backgrounds. Teachers’ expertise in instructional design and technology integration can empower them to implement strategies that cater to various learning styles on digital platforms and ensure equitable access to online education for all students. By being mindful of their students’ challenges and requirements, teachers can proactively design instructional approaches that accommodate individual differences and foster equal learning opportunities.
In this study, correlation between the competence and cognitive domains provides some evidence demonstrating the high correlation coefficients, with an r value of 0.53. Our findings support the findings from a study [45] that also demonstrated a correlation between these domains. One possible explanation for this is that teachers’ cognitive abilities, such as critical thinking and problem-solving, contribute to effective planning and delivering teaching that meets the diverse needs of their students. These cognitive abilities make them better equipped to identify and address barriers to online teaching and provide necessary support to students who are struggling with online learning. Teachers with a solid understanding of inclusive pedagogical approaches can effectively utilise various digital tools, instructional resources, and communication channels to create an inclusive online teaching environment. By leveraging their cognitive skills, teachers can tailor instruction, provide scaffolding, and support the learning process of every student, including those with limited resources and/or disabilities that may hinder their ability to access quality, inclusive online education.

5. Conclusions

This study set out to develop and validate an instrument that can assess teachers’ practice in providing inclusive online education. The developed instrument consists of five domains: affective, behavioural, cognitive, competence, and awareness. Statements were formulated to reflect on practices for each domain, and a Likert scale from 1 to 7 was used to score each statement. Based on the data analysis of 505 respondents, it is evident that the identified domains are correlated with one another, although some correlations are less significant. The presence of inclusive affective, behavioural and cognitive abilities enhances teachers’ awareness toward student diversity and equips them with the competence and necessary skills to create an inclusive online teaching and learning environment. By recognizing the importance of these domains, educational institutions can provide teachers with the necessary training and resources.
This study has its limitations. First, the validation of the instrument was only conducted among experts and teachers in Malaysia. Teaching practices and culture vary from country to country. Therefore, not all the statements can be applicable to teachers from other countries. Second, as the questionnaire invited teachers from different educational levels to answer, the practices considered when developing this instrument were general. The extent of using ICT in teaching and learning and the adoption of online educational platforms can be very different when, for instance comparing education practices at primary schools and higher education institutions. In addition, while inclusive education very often refers to including students with special needs, such as students with disabilities and having learning differences (language barriers, culture differences, etc.), this study did not particularly focus on any of them. Our approach emphasised the inequality that was caused by the transition from traditional face-to-face education to online education. However, we could have included questions asking about the types of students the respondents had (i.e., if their students had a disability or were from a minority group). This might have provided us with more insights and richer data related to the types of students and teachers’ practices involved in inclusive online education.
Therefore, future studies could include further validation in the context of different countries and at different educational levels. Amendments might be required to make the instrument more context specific. Additional questions asking about the experiences of teaching and students’ sociodemographic background could be included in future studies when studying the associations between teaching experience and their practices for ensuring that online education is inclusive.
The instrument has implications for policymakers and researchers, as it provides a useful framework for understanding the role of these domains in the development of teaching practices for making online teaching more inclusive. By further exploring these domains, policymakers and researchers can help inform the development of policies and practices that promote inclusive online education and, hence, support the growth and success of all students to the greatest extent possible. By enhancing their affective, behavioural and cognitive attitudes, teachers can become more aware of students’ special needs in using ICT and learning on digital platforms. In addition to providing teacher training on the use of digital technologies in teaching to enhance their competencies, digital accessibility should be emphasised as part of teachers’ digital literacy. At the same time, their awareness of students’ diversity and needs should be raised via pedagogical training and/or professional development programs.
In addition to identifying the domains of affective, behavioural, cognitive, competence, and awareness in this instrument and the associations between them, our study can hopefully inspire researchers within inclusive education to further investigate these domains and how both the instrument and the domains can contribute to better inclusive education research. Lastly, we also hope that this study can raise awareness among teachers, parents, policymakers, and researchers concerning other student groups who might be excluded from online education as digitalisation takes place.

Author Contributions

Conceptualization, W.K.B. and K.H.C.; methodology, W.K.B. and K.H.C.; validation, W.K.B. and K.H.C.; formal analysis, W.K.B. and K.H.C.; investigation, W.K.B. and K.H.C.; resources, W.K.B. and K.H.C.; data curation, W.K.B. and K.H.C. writing—original draft preparation, W.K.B. and K.H.C.; writing—review and editing, W.K.B.; visualization, W.K.B. and K.H.C.; project administration, W.K.B. All authors have read and agreed to the published version of the manuscript.

Funding

This study received no funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all participants completing the questionnaire.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

We would like to thank all participants for their effort and time in answering the questionnaire, despite facing many challenges during emergency online teaching.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. UNICEF. Inclusive Education. 2023. Available online: https://www.unicef.org/education/inclusive-education (accessed on 20 May 2023).
  2. Owens, K.; Suskin, M.; Wiesemann, C. Bringing Campus Experience to Online Classes. In Proceedings of the 2019 ACM SIGUCCS Annual Conference, New Orleans, LA, USA, 3–6 November 2019. [Google Scholar]
  3. Yilmaz Ince, E.; Kabul, N.; Kabul, A. Inequality of Opportunity in Distance Education during the Pandemic Process. Turk. Online J. Educ. Technol. 2022, 21, 68–79. [Google Scholar]
  4. Palvia, S.; Aeron, P.; Gupta, P.; Mahapatra, D.; Parida, R.; Rosner, R.; Sindhi, S. Online Education: Worldwide Status, Challenges, Trends, and Implications. J. Glob. Inf. Technol. Manag. 2018, 21, 233–241. [Google Scholar] [CrossRef]
  5. Stankous, N.; Buibas, M. Math Online: Student’s Perspective Based on Survey. Eur. Sci. J. ESJ 2018, 14, 336–351. [Google Scholar] [CrossRef]
  6. Chua, K.H.; Bong, W.K. Providing inclusive education through virtual classrooms: A study of the experiences of secondary science teachers in Malaysia during the pandemic. Int. J. Incl. Educ. 2022, 1–18. [Google Scholar] [CrossRef]
  7. Phua, C.Y.; Chua, K.H.; Bong, W.K. Experiences of Parents and Teachers with Virtual Classrooms during the COVID-19 Restrictions: A Study Focusing on Inclusive Education in Malaysia. Educ. Sci. 2022, 12, 884. [Google Scholar] [CrossRef]
  8. Yan, L.; Whitelock-Wainwright, A.; Guan, Q.; Wen, G.; Gašević, D.; Chen, G. Students’ Experience of Online Learning during the COVID-19 Pandemic: A Province-Wide Survey Study. Br. J. Educ. Technol. 2021, 52, 2038–2057. [Google Scholar] [CrossRef] [PubMed]
  9. Gupta, R.; Aggarwal, A.; Sable, D.; Chahar, P.; Sharma, A.; Kumari, A.; Maji, R. COVID-19 Pandemic and Online Education: Impact on Students, Parents and Teachers. J. Hum. Behav. Soc. Environ. 2022, 32, 426–449. [Google Scholar] [CrossRef]
  10. Lenharo, M. WHO declares end to COVID-19′s emergency phase. Nature 2023, 882. [Google Scholar] [CrossRef]
  11. Lemke, T. How Much Zoom is Too Much? Making Asynchronous Learning Work. In Pandemic Pedagogy: Teaching International Relations amid COVID-19; Springer: Berlin/Heidelberg, Germany, 2022; pp. 73–96. [Google Scholar]
  12. Munir, H. Reshaping Sustainable University Education in Post-Pandemic World: Lessons Learned from an Empirical Study. Educ. Sci. 2022, 12, 524. [Google Scholar] [CrossRef]
  13. Singh, J.; Singh, L.; Matthees, B. Establishing Social, Cognitive, and Teaching Presence in Online Learning—A panacea in COVID-19 Pandemic, Post Vaccine and Post Pandemic Times. J. Educ. Technol. Syst. 2022, 51, 28–45. [Google Scholar] [CrossRef]
  14. Singh, J.; Evans, E.; Reed, A.; Karch, L.; Qualey, K.; Singh, L.; Wiersma, H. Online, Hybrid, and Face-to-Face Learning Through the Eyes of Faculty, Students, Administrators, and Instructional Designers: Lessons Learned and Directions for the Post-Vaccine and Post-Pandemic/COVID-19 World. J. Educ. Technol. Syst. 2022, 50, 301–326. [Google Scholar] [CrossRef]
  15. Gilligan, J. Competencies for Educators in Delivering Digital Accessibility in Higher Education. In Universal Access in Human-Computer Interaction. Applications and Practice: 14th International Conference, UAHCI 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19–24 July 2020; Part II 22; Springer: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
  16. Mahat, M. The Development of a Psychometrically-Sound Instrument to Measure Teachers’ Multidimensional Attitudes toward Inclusive Education. Int. J. Spec. Educ. 2008, 23, 82–92. [Google Scholar]
  17. Green, J.K.; Burrow, M.S.; Carvalho, L. Designing for Transition: Supporting Teachers and Students Cope with Emergency Remote Education. Postdigital Sci. Educ. 2020, 2, 906–922. [Google Scholar] [CrossRef]
  18. CAST. CAST: About Universal Design for Learning. 2023. Available online: https://www.cast.org/impact/universal-design-for-learning-udl (accessed on 23 May 2023).
  19. Van de Werfhorst, H.; Kessenich, E.; Geven, S. The Digital Divide in Online Education. Inequality in Digital Preparedness of Students and Schools before the Start of the COVID-19 Pandemic. Comput. Educ. Open 2020, 3, 100100. [Google Scholar] [CrossRef]
  20. European Commission. European Framework for the Digital Competence of Educators: DigCompEdu; Punie, Y., Ed.; Publications Office: Luxembourg, 2017. [Google Scholar]
  21. United Nations Educational, Scientific and Cultural Organization. UNESCO ICT Competency Framework for Teachers; UNESCO: Paris, France, 2011; 92p. [Google Scholar]
  22. Ajzen, I. Attitudes, Traits, and Actions: Dispositional Prediction of Behavior in Personality and Social Psychology. Adv. Exp. Soc. Psychol. 1987, 20, 1–63. [Google Scholar]
  23. Ajzen, I. From Intentions to Actions: A Theory of Planned Behavior. In Action Control: From Cognition to Behavior; Springer: Berlin/Heidelberg, Germany, 1985; pp. 11–39. [Google Scholar]
  24. Ewing, D.L.; Monsen, J.J.; Kielblock, S. Teachers’ attitudes towards inclusive education: A critical review of published questionnaires. Educ. Psychol. Pract. 2018, 34, 150–165. [Google Scholar] [CrossRef]
  25. MacFarlane, K.; Woolfson, L.M. Teacher attitudes and behavior toward the inclusion of children with social, emotional and behavioral difficulties in mainstream schools: An application of the theory of planned behavior. Teach. Teach. Educ. 2013, 29, 46–52. [Google Scholar] [CrossRef]
  26. Mudhar, G.; Ertesvåg, S.K.; Pakarinen, E. Patterns of teachers’ self-efficacy and attitudes toward inclusive education associated with teacher emotional support, collective teacher efficacy, and collegial collaboration. Eur. J. Spec. Needs Educ. 2023, 1–17. [Google Scholar] [CrossRef]
  27. Czerniewicz, L. Inequality as Higher Education Goes Online. In Networked Learning: Reflections and Challenges; Bonderup Dohn, N., Cranmer, S., Sime, J., de Laat, M., Ryberg, T., Eds.; Springer: New York, NY, USA, 2018; pp. 95–106. [Google Scholar]
  28. Espada-Chavarria, R.; González-Montesino, R.H.; López-Bastías, J.L.; Díaz-Vega, M. Universal Design for Learning and Instruction: Effective Strategies for Inclusive Higher Education. Educ. Sci. 2023, 13, 620. [Google Scholar] [CrossRef]
  29. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis; Prentice Hall: Upper Saddle River, NJ, USA, 2009. [Google Scholar]
  30. Streiner, D.L.; Norman, G.R.; Cairney, J. Health Measurement Scales: A Practical Guide to Their Development and Use; Oxford University Press: New York, NY, USA, 2015. [Google Scholar]
  31. Zou, K.H.; Tuncali, K.; Silverman, S.G. Correlation and Simple Linear Regression. Radiology 2003, 227, 617–628. [Google Scholar] [CrossRef]
  32. Nunnally, J.C. Assessment of Reliability. Psychometric Theory; McGraw-Hill Education: New York, NY, USA, 1967; pp. 206–235. [Google Scholar]
  33. Field, A. Discovering Statistics Using SPSS: Book Plus Code for E Version of Text; SAGE Publications Limited: London, UK, 2009; Volume 896. [Google Scholar]
  34. Stevens, J. Applied Multivariate Statistics for the Social Sciences; Eribaum: Hillsdale, NJ, USA, 1992. [Google Scholar]
  35. Chambers, D.; Coffey, A. Guidelines for designing middle-school transition using universal design for learning principles. Improv. Sch. 2019, 22, 29–42. [Google Scholar] [CrossRef]
  36. Trust, T.; Pektas, E. Using the ADDIE Model and Universal Design for Learning Principles to Develop an Open Online Course for Teacher Professional Development. J. Digit. Learn. Teach. Educ. 2018, 34, 219–233. [Google Scholar] [CrossRef]
  37. Opoku, M.P.; Cuskelly, M.; Pedersen, S.J.; Rayner, C.S. Applying the theory of planned behaviour in assessments of teachers’ intentions towards practicing inclusive education: A scoping review. Eur. J. Spec. Needs Educ. 2021, 36, 577–592. [Google Scholar] [CrossRef]
  38. Draxler-Weber, N.; Packmohr, S.; Brink, H. Barriers to Digital Higher Education Teaching and How to Overcome Them—Lessons Learned during the COVID-19 Pandemic. Educ. Sci. 2022, 12, 870. [Google Scholar] [CrossRef]
  39. Irawan, A.W.; Dwisona, D.; Lestari, M. Psychological Impacts of Students on Online Learning during the Pandemic COVID-19. KONSELI J. Bimbing. dan Konseling 2020, 7, 53–60. [Google Scholar] [CrossRef]
  40. Peimani, N.; Kamalipour, H. Online Education and the COVID-19 Outbreak: A Case Study of Online Teaching during Lockdown. Educ. Sci. 2021, 11, 72. [Google Scholar] [CrossRef]
  41. Abdulkareem, T.A.; Eidan, S.M. Online Learning for Higher Education Continuity (during COVID-19 Pandemic). Int. J. Youth Econ. 2020, 4, 125–134. [Google Scholar]
  42. Hassan, M. Online Teaching Challenges during COVID-19 Pandemic. Int. J. Inf. Educ. Technol. 2021, 11, 41–46. [Google Scholar] [CrossRef]
  43. Anthonysamy, L. The use of metacognitive strategies for undisrupted online learning: Preparing university students in the age of pandemic. Educ. Inf. Technol. 2021, 26, 6881–6899. [Google Scholar] [CrossRef]
  44. Asaph, A.; Raja, B. Efficient E-Learning by Dint of Cognitive Abilities. J. Educ. Technol. 2016, 13, 7–10. [Google Scholar]
  45. Skagerlund, K.; Forsblad, M.; Tinghög, G.; Västfjäll, D. Decision-Making Competence and Cognitive Abilities: Which Abilities Matter? J. Behav. Decis. Mak. 2022, 35, e2242. [Google Scholar] [CrossRef]
Figure 1. Correlation between the domains of the questionnaire.
Figure 1. Correlation between the domains of the questionnaire.
Education 13 00918 g001
Table 1. Lists of statements for each domain.
Table 1. Lists of statements for each domain.
DomainStatements
AffectiveA1: I have experienced students having difficulty communicating with me in the virtual classroom.
A2: My students in the virtual classroom cannot keep up with the day-to-day curriculum.
A3: My students are having difficulties understanding my teaching in the virtual classroom.
A4: I face challenges adapting the virtual classroom to meet the individual needs of all students.
A5: My students’ participation in the virtual classroom is low compared with their participation in the physical classroom.
A6: My students are willing to speak when they are in the virtual classroom.
BehaviouralB1: I am willing to encourage my students to participate in all activities in the virtual classroom.
B2: I am willing to adapt the curriculum to meet the individual needs of all students in the virtual classroom.
B3: I am willing to modify the virtual learning environment to adapt to the needs of my students.
B4: I am willing to adapt my communication techniques to ensure that all students in the virtual classroom can participate in the learning process.
B5: I am willing to adapt the assessment of individual students in the virtual classroom to achieve the learning objectives.
CognitiveC1: I believe that students have a similar learning experience whether they learn in the virtual classroom or physical classroom.
C2: I believe that all students can learn the regular curriculum in the virtual classroom.
C3: I believe that the virtual classroom provides appropriate learning experiences to all students.
C4: I believe that students should be taught in the physical classroom to obtain the best learning outcomes.
CompetenceD1: I am able to use ICT tools and/or apps to provide quality education via the virtual classroom (such as Google classroom).
D2: I have received the necessary training and assistance from my school to teach in the virtual classroom.
D3: I attend courses to increase my knowledge of the use of ICT tools and/or apps.
D4: My colleagues help me when I face challenges in using ICT tools and/or apps.
D5: I explore available resources to equip myself to conduct the virtual classroom.
AwarenessE1: I have been informed by students regarding their difficulties in attending the virtual classroom.
E2: I have been informed by parents regarding student difficulties in attending the virtual classroom.
E3: I am aware that not all students have equal access to attend virtual classrooms.
E4: My school has attempted to ensure that all students have equal access to attend virtual classrooms.
Table 2. Respondents’ demographic data.
Table 2. Respondents’ demographic data.
VariableTotal Sample (n = 505)
Gender
Male179
Female322
Prefer not to say4
Age
Below 3055
31–40225
41–50 150
51–60 72
Above 603
Years of Teaching
Less than 10 168
11–20 201
21–30 102
31–40 31
More than 403
School Location
Urban298
Suburban151
Rural56
Highest Academic Qualification
Certificate/Diploma54
Degree289
Master’s or higher161
Prefer not to say1
Main Subject Thought
Science189
Mathematics71
Language105
Other (art, social science, humanities, etc.)140
Table 3. The Cronbach’s alpha value for each domain and overall questionnaire.
Table 3. The Cronbach’s alpha value for each domain and overall questionnaire.
DomainCronbach’s Alpha Value
Affective0.76
Behavioural0.72
Cognitive0.77
Competence0.84
Awareness0.81
Overall0.76
Table 4. Exploratory factor analysis (EFA) of the statements.
Table 4. Exploratory factor analysis (EFA) of the statements.
StatementDomainFactor
12345
A2Affective0.77
A30.68
A50.65
A40.61
A10.58
A60.55
B3Behavioural 0.81
B4 0.74
B5 0.68
B1 0.66
B2 0.57
C2Cognitive 0.80
C3 0.77
C1 0.63
C4 0.59
D1Competence 0.83
D3 0.76
D4 0.71
D5 0.65
D2 0.59
E1Awareness 0.70
E3 0.68
E2 0.65
E4 0.60
Table 5. Pearson correlation among the domains.
Table 5. Pearson correlation among the domains.
AffectiveBehaviouralCognitiveCompetenceAwareness
Affective
Behavioural0.53 **
Cognitive0.34 **0.42 **
Competence0.39 *0.31 *0.53 *
Awareness0.51 **0.50 **0.58 **0.41 **
* indicates that p < 0.05; ** indicates that p < 0.01.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bong, W.K.; Chua, K.H. Assessing Teachers’ Practices in Providing Inclusive Online Education: Development and Validation of an Instrument Based on Inclusive Practices among Teachers in Malaysia. Educ. Sci. 2023, 13, 918. https://doi.org/10.3390/educsci13090918

AMA Style

Bong WK, Chua KH. Assessing Teachers’ Practices in Providing Inclusive Online Education: Development and Validation of an Instrument Based on Inclusive Practices among Teachers in Malaysia. Education Sciences. 2023; 13(9):918. https://doi.org/10.3390/educsci13090918

Chicago/Turabian Style

Bong, Way Kiat, and Kah Heng Chua. 2023. "Assessing Teachers’ Practices in Providing Inclusive Online Education: Development and Validation of an Instrument Based on Inclusive Practices among Teachers in Malaysia" Education Sciences 13, no. 9: 918. https://doi.org/10.3390/educsci13090918

APA Style

Bong, W. K., & Chua, K. H. (2023). Assessing Teachers’ Practices in Providing Inclusive Online Education: Development and Validation of an Instrument Based on Inclusive Practices among Teachers in Malaysia. Education Sciences, 13(9), 918. https://doi.org/10.3390/educsci13090918

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop