Next Article in Journal
Retraction: Wu, S. The Temporal-Spatial Distribution and Information-Diffusion-Based Risk Assessment of Forest Fires in China. Sustainability 2021, 13, 13859
Next Article in Special Issue
Authoritative Parenting Style and Proactive Behaviors: Evidence from China?
Previous Article in Journal
Does the Government’s Environmental Attention Affect Ambient Pollution? Empirical Research on Chinese Cities
Previous Article in Special Issue
Work Values Predict Job Satisfaction among Chinese Teachers during COVID-19: The Mediation Role of Work Engagement
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Perceptions of Inclusion Questionnaire including PE Teachers’ Opinion as Part of an Innovative Use of the Tool

by
Anna Zwierzchowska
1,
Karolina Kostorz
1,*,
Barbara Rosołek
1 and
Edyta Tomińska-Conte
2
1
Institute of Sport Science, The Jerzy Kukuczka Academy of Physical Education in Katowice, 40-065 Katowice, Poland
2
Faculty of Psychology and Education Sciences, University of Geneva, 1205 Geneva, Switzerland
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(6), 3241; https://doi.org/10.3390/su14063241
Submission received: 22 January 2022 / Revised: 4 March 2022 / Accepted: 7 March 2022 / Published: 10 March 2022

Abstract

:
The aim of the study was to validate the Polish version of the Perceptions of Inclusion Questionnaire (PIQ) for the first time. The analysis included not only pupils, parents/legal guardians, and teachers but also physical education teachers, which is an innovative solution proposed by the authors. The sample consisted of 448 respondents. Confirmatory factor analysis showed that the tested model corresponding to the construct proposed by the PIQ authors did not have good fit indicators (χ2/df = 7.73; CFI = 0.855; SRMR = 0.103; RMSEA = 0.123). The three-factor structure of the questionnaire was confirmed by the eigenvalues obtained for each extracted factor based on the Kaiser criterion and the scree plot based on the Cattella criterion. All three factors showed satisfactory levels of reliability (Cronbach’s alpha > 0.7). The conditions of convergent and discriminant validity for the construct were confirmed. However, Horn’s parallel analysis showed that the optimal number of factors is 4. Therefore, the research presented here should constitute a starting point for further analyses. It is recommended that research teams should conduct further scientific exploration of the PIQ tool in four perspectives, i.e., including PE teachers’ opinions.

1. Introduction

It is emphasized that the main task of school should be to include each pupil, regardless of gender, age, place of residence, race, poverty, degree of disability, ethnicity, indigeneity, language, religion, migration or displacement status, sexual orientation or gender identity and expression, incarceration, beliefs, and attitudes in the education process [1,2,3,4]. Many publications have indicated that the issues of inclusion are not only an interesting social problem, but above all, they are significant for the proper social and emotional development of pupils [5,6,7,8]. There is no doubt that for pupils, the class is an important, if not the most important, group to which they belong, in which interpersonal bonds of a special nature are established [7,8]. Ganotz et al. [9] emphasized that to have friends in the class seems to be important to defend negative threats and pursue a positive development. These authors noticed that peer relations in class are important not only for resilience, self-esteem, and well-being but also for other skills. It was shown that social inclusion in the classroom was statistically significant to promote resilience [9], and that pupils who feel personally accepted and integrated reported higher satisfaction in life [10,11]. Furthermore, Schwab and Rossmann [12] examined well-being in class in relation to their psychical health and found that positive school well-being is related to fewer psychosomatic complaints and higher subjective health and linked the teacher–pupil relationship and peer relations to depressive symptoms. It is also suggested that social competences, social withdrawal, aggressiveness, and cognitive abilities are important factors for social inclusion in school classes [13,14]. It should be emphasized that the phenomenon of loneliness or rejection is common, universal, and concerns all pupils, regardless of their nationality or social status. The sense of alienation does not only affect pupils with disabilities and sensory-motor deficits but also those who coexist with them. DeVries, Voß, and Gebhardt [15] underlined that although school inclusion is an important right of pupils in school systems around the world, many pupils, not only those with special education needs (SEN), have lower perceptions of inclusion.
Schwab et al. [3] underlined that within schools, teachers are primarily responsible for the evaluation of their pupil’s current levels of functioning as doing so allows teachers to adapt their daily decisions to the pupil’s individual needs—for instance, offering additional support lessons. This is one of the reasons why the assessment of the perception of inclusion in the education process is extremely important. It seems that the lack of homogeneous tools and groups of participants that take into consideration the multitude of disturbing factors does not allow for unequivocal interpretation of the sense of being included in the process of school education.
The development of the tool which could provide an easy-to-use screening instrument for school practice and support the early identification of the lack of school inclusion was a very important issue. It is indicated that emotional inclusion, social inclusion, and academic self-concept can be noted as central key issues of inclusion [8]. In response to the above challenge, a European team [8,16] developed and implemented a tool for the assessment of inclusion termed the Perceptions of Inclusion Questionnaire (PIQ). Furthermore, DeVries, Voß, and Gebhardt [15] and Schwab, Zurbriggen, and Venetz [3] also recommend the continued use of the Perception of Inclusion Questionnaire for collecting information about school inclusion and learners.
Although the PIQ is currently available in 24 languages, and in different countries studies are under way or have been published [8,16,17,18,19], the validation studies mentioned concern only the German and French versions of the PIQ. Its psychometric properties were demonstrated in a study of 823 German-speaking Swiss pupils (mean age 12 years), including 190 pupils with SEN [8]. The PIQ proved to be a reliable tool, particularly at the lower levels of the scales indicating limited inclusion.
The PIQ has been extended for use with pupils in grades 3 to 9 [16]. Subsequently, the teacher version (PIQ-T) was tested and the consistency between teachers and pupils was evaluated [16,20]. More recently, the parent version (PIQ-P) showed good psychometric qualities [3].
Guillemot and Hessels [18] indicated that since the PIQ’s psychometric properties cannot be considered universally valid, it is important to scrutinize the instrument’s characteristics in other cultural and linguistic zones in which it is applied. The lack of any publications in the literature concerning the factorial validity, internal consistency, and test-retest reliability of the Polish version of the PIQ inspired us to investigate this problem. Therefore, the aim of this paper was to investigate some psychometric properties of the Polish version of the PIQ, such as its factor structure and convergent validity. An innovative solution used by our team of researchers is to address the PIQ questionnaire to PE teachers, i.e., to introduce an additional fourth perspective in the assessment of the pupil’s sense of inclusion in school education.
The additional assessment form for PE teachers is intended to collect and verify the information about their role in developing the sense of school inclusion juxtaposed with the opinions of the teachers, parents, and pupils. There is no doubt that the role of a physical education teacher is to support the social, emotional, and cognitive inclusion of pupils in the educational process. The measures used are motivating, appropriately selected forms of physical activity and counteracting barriers to taking up physical activity [21]. This is especially important in the context of the integration of pupils with special educational needs [22,23,24,25]. The special preparation of PE teachers for inclusive education is crucial [22,23,26,27]. The PE teacher can be perceived as an initiator of involving pupils in the educational process, regardless of their diversity. There is empirical evidence of various attitudes of teachers towards pupils (including PE teachers) determined by the type of disability [22,26,28,29]. It is also indicated that physical education at school is one of the elements that affect the perception of inclusion in the school environment by the pupils. It is through sporting activity that the pupils’ emotional potential to break down barriers is developed while PE classes undoubtedly represent a source of learning new motor skills and raising the level of physical fitness. The pupil acquires movement skills and social competences through cooperation and competition, which significantly contributes to the development of his or her emotional stability [30]. Today, the overriding principle of education is to take into account diversity, and even more, to nurture and support diversity so that every pupil feels included in school education. At the same time, the problems of physical activity at school are not often presented from the perspective of pupil inclusion. Therefore, it seems that identification of the phenomenon of exclusion in mass, inclusive, and special schools in relation to the level of physical activity of their pupils may allow for the development of effective pedagogical strategies. It seems that for the assessment of inclusion in various Polish education systems (mass, inclusive, or segregating system), the use of feedback in four perspectives may have a significant contribution to the science in the field of the theory of adapted physical activity and thus the health sciences, especially taking into account the aspect of the pupil’s mental health.
Furthermore, given the importance of PE classes for the child’s biological development, it seems to be critical to examine the PE lesson environment as one of the major weaknesses or strengths of inclusion. This is because the physical education classes stimulate and trigger various types of pupils’ behavior affecting the class environment. To support the above thesis of extending the PIQ tool with the fourth dimension, it is worth quoting a study by Lindsay [31], who argues that the lack or incomplete diagnosis of inclusion leads to the poor effectiveness of school operations.
Taking into account all issues mentioned above, the aim of the study was to investigate whether the Polish version of the PIQ can be effectively used in further research. This paper presents the validation of the PIQ tool for four perspectives, i.e., pupils, parents/legal guardians, teachers, and PE teachers, which is an innovative solution proposed by the authors.

2. Material and Methods

2.1. Participants and Measures

The research was conducted in 2018–2019 in the Silesia Voivodeship (Tychy and Zabrze). Non-probability consecutive sampling was applied in the analysis. The following exclusion criteria were adopted in the study: no consent of the participant and/or legal guardian, no normal intellectual functioning, medical contraindications (behavioral dysfunctions, psychoses), contraindications by a psychologist and/or pedagogue, multiple intellectual disabilities of the motor organ, vision, or other problems that make it impossible to understand the PIQ questionnaire. With the above-mentioned exclusion criteria, 448 respondents underwent final analysis. The sample consisted of 112 pupils aged 10–16 years attending mass, integrated, and segregated schools, 112 parents or legal guardians, 112 teachers, and 112 PE teachers. The study involved both healthy pupils without any sensory-motor dysfunctions and deficits and children and adolescents with slight disorders that did not exclude them from completing the questionnaire. According to the instructions, pupils with intellectual disabilities were excluded from the survey. All individuals gave written consent to voluntarily participate in the research. In the case of minors, consent was obtained from the parents or legal guardians.
The PIQ is based on the German self-report Questionnaire for Assessing Dimensions of Integration of Students (FDI 4–6; Haeberlin, Moser, Bless, and Klaghofer [32]. The tool is dedicated to people directly involved in the school inclusion process, i.e., (1) pupils in the situation of school inclusion, (2) parents, and (3) teachers. All the above-mentioned individuals fill in the questionnaire, which contains 12 statements. It is worth adding that the items are short and use accessible wording. The Perceptions of Inclusion Questionnaire (PIQ) [8] addresses three relevant issues in this regard, namely the pupil’s perception of (1) emotional inclusion (item 1, 4, 7, 10), (2) social inclusion (item 2, 5, 8, 11), and (3) academic self-concept (item 3, 6, 9, 12). The development of the short PIQ scales included evaluation of the construct validity of the scales [16]. Respondents needed approximately 5 min to complete the PIQ. The task of the respondent is to rank the particular statements using a 4-point Likert scale, where 1 meant ‘not at all true’, 2—‘somewhat not true’, 3—‘somewhat true’, and 4 stood for ‘certainly true’. Reverse coding was used for the negatively formulated items, i.e., items 4, 8, and 12. Subscale scores were obtained by summing the ratings of the four items in each scale. The Perceptions of Inclusion Questionnaire (PIQ) has been translated into different languages. The examinations of psychometric properties of the German and English versions of the PIQ revealed that the tools meet high psychometric standards.
The lack of any publications in the literature concerning the factorial validity, internal consistency, and test-retest reliability of the Polish version of the PIQ inspired us to investigate these issues. The tool was downloaded from the website http://piqinfo.ch/wp-content/uploads/2021/01/PIQ-Polski_2021.pdf (accessed on 12 January 2022).
Approval was obtained from the Bioethics Committee of the Academy of Physical Education in Katowice (Resolution No. 2/2018 as of 21 June 2018). This paper presents the validation of the PIQ tool for four dimensions including PE teachers’ opinions. The present study was conducted according to the guidelines of the Declaration of Helsinki (Act No 9/2012 of 8 March 2012).

2.2. Statistical Analysis

The distribution of the results for the whole sample differs from the normal distribution for all the variables studied (Shapiro–Wilk W > 0.81; p < 0.001). The study revealed cases of asymmetric (skewed) distributions. However, all variables fell within the range of <−1, 1>, both for the whole sample and irrespective of the pupils, parents/legal guardians, teachers, and PE teachers. Therefore, it was assumed that the distribution of the variable studied was moderately asymmetric. The kurtosis (Ku) for all variables in each group fell within the range of <−2, 2>, indicating that the concentration around the mean value was satisfactory. The analysis was performed using Microsoft Office Excel 2010 and StatSoft Statistica v. 12 software. The purpose of the study was to examine the factorial validity, internal consistency, and reliability of the Polish version of the PIQ.

3. Results

The descriptive statistics are presented in Table 1.
In the first step, confirmatory factor analysis (CFA) was performed to confirm the 3-factor structure of the PIQ questionnaire proposed by the authors of the PIQ. Items 1, 4(-), 7, and 10 belong to the Factor 1—‘emotional inclusion’, items 2, 5, 8(-). and 11 to the Factor 2—‘social inclusion’, and items 3, 6, 9 and 12(-) to the Factor 3—‘academic self-concept’. CFA is based on a strong theoretical foundation that allows the researcher to specify an exact model in advance [33]. The maximum likelihood (ML) method was used to estimate the parameters. The model is shown in Figure 1.
The analysis revealed a lack of fit of the model to the data as the normalized chi-square index (χ2/df) was 7.73, the comparative fit index (CFI) was 0.855, the standardized root mean square residual (SRMR) was 0.103, and the Steiger–Lindt root mean square error of approximation (RMSEA) was 0.123. CFA was then performed by dividing into the four groups analyzed (Table 2).
As can be seen from the data in the table above, the analysis showed that the model was not well fitted to the data in any group. As the assumed PIQ structure was not confirmed, exploratory factor analysis using the principal component method with orthogonal Varimax rotation was conducted. Exploratory factor analysis and principal component analysis are two data analysis methods that are commonly used in psychological research [34]. When applying these techniques, it is important to determine how many factors to retain. This decision is sometimes based on a visual inspection of the scree plot [34]. The scree plot is one of the most common methods used for determining the number of components to extract [33]. Taking into account the above-mentioned issues, the scree plot was made in the first step (Figure 2).
As seen in the scree plot, the three-factor structure of the questionnaire was confirmed based on the Cattella criterion. The scree plot is a line graph showing the eigenvalues, the rate at which they decline, or the percentage of variance explained. Determining the number of principal components left is done by identifying the point of the smallest slope, and then, from that point rightwards, the eigenvalues are rejected as they represent a negligible portion of the variance. However, it should be emphasized that a major weakness of this procedure is that it relies on visual interpretation of the graph. Because of this, the scree plot has been accused of being subjective [33]. It is indicated that the scree plot not be used as a stand-alone procedure in determining the number of components to retain [33]. According to Kanyongo [33], researchers should therefore use it with other procedures, for example, the parallel analysis.
It is indicated that the concept of an eigenvalue is important in determining the number of components retained in principal component analysis [33]. This is why, in the next step, the eigenvalues were estimated based on the Kaiser criterion related to correlation matrix analysis (Table 3). Kaiser criterion considers only the components whose eigenvalue exceeds or is close to 1.
The three-factor structure of the questionnaire was confirmed by the eigenvalues obtained for each extracted factor based on the Kaiser criterion (Table 3). The presented data imply that the cumulative percentage of explained variance of the three analyzed factors in total explains over 65% of the variance. Taking into account the scree plot and the eigenvalues, it was assumed that the most significant issue concerning the perception of inclusion is Factor 1, i.e., ‘emotional inclusion’.
In the next step, Horn’s parallel analysis was used (Figure 3) based on Kanyongo’s [33] suggestions.
As can be seen in the chart above, the analysis showed that the optimal number of factors is 4.
Since the original version of the questionnaire consists of three factors, the 3-factor solution was adopted. The values of the factor loadings are presented in Table 4.
All three factors showed satisfactory levels of reliability (Cronbach’s alpha > 0.7). In the original version of the questionnaire, items 4 and 10 belonged to the ‘emotional inclusion’ factor. In the current version, item 4 belongs to ‘academic self-concept’ and item 10 to ‘social inclusion’.
Cronbach’s alpha coefficient was calculated to test the reliability of all three factors in each of the four study groups (Table 5).
The results of the analysis indicate that for Factor 2 in the groups of parents, the reliability was found to be poor (0.5 ≤ α < 0.6), whereas other factors in each group showed at least satisfactory levels of reliability (α > 0.7).
Convergent and discriminant validity for PIQ was estimated using the procedure proposed by Fornell and Larcker [35] (Table 6).
As can be seen from the data in the table above, discriminant validity was confirmed for all factors as AVE (average variance extracted) > MSV (maximum shared variance). Furthermore, convergent validity for Factor 1 and Factor 3 was also confirmed. The AVE value was higher than 0.5 and at the same time lower than composite reliability (CR). For Factor 2, the AVE value was less than 0.5, as it was 0.45. According to the theory proposed by Fornell and Larcker [35], this AVE value is acceptable if the CR value is greater than 0.6. Therefore, it can be assumed that the conditions of convergent and discriminant validity for the construct were confirmed.

4. Discussion

Most countries now have policies and/or legislation suggesting the need to include all learners (e.g., United Nations [4]. However, Schwab, Sharma, and Loreman [7] indicated that it remains unclear if schools truly include all learners and provide them with best developmental possibilities instead of simply physically placing different pupils in the same classrooms. There is no doubt that asking pupils to report how they feel about being included provides a new and innovative way to examine how well the inclusive education policies are implemented. Equally important is the information from people who are directly involved in the school inclusion process i.e., parents and teachers [36]. Therefore, the popularization of a tool such as PIQ (https://piqinfo.ch/) (accessed on 12 January 2022) allows for a unified assessment of the perceptions of inclusion in the school education. The development of the tool which could provide an easy-to-use screening instrument for school practice and support the early identification of insufficient school inclusion is a very important issue. In order for this to be possible, it is necessary to validate the tool by taking into account a country’s systemic conditions and the cultural and linguistic context [8,18,37,38]. In response to the above challenge, our research team made the first attempt to validate the Polish version of the PIQ. An innovative solution used by our team of researchers was to address the PIQ questionnaire to PE teachers, i.e., to introduce an additional fourth perspective of the assessment of the pupils’ perception of inclusion in school education. The additional assessment form for PE teachers is intended to collect and verify the information about their role in developing the perception of school inclusion juxtaposed with the opinions of the teachers, parents, and pupils [21,22,23,39,40].
The confirmatory factor analysis performed in the present study showed the lack of fit of the data to the model proposed by the authors of the PIQ both for the entire sample and with the inclusion of specific groups, i.e., pupils, parents, teachers, and PE teachers. The results partly correspond to those presented in a study by Guillemot and Hessels [18], but are not consistent with the results of other authors [8,41]. Therefore, we used the exploratory factor analysis using the principal component method with orthogonal Varimax rotation. In our research, the three-factor structure of the PIQ proposed by the authors of the PIQ [8] was confirmed based on both the Cattella and Kaiser criteria. At the same time, it turned out that factor loadings for item 4, item 8, item 10, item 12 were insignificant because p > 0.05. Furthermore, in the original version of the PIQ questionnaire, items 4 and 10 belonged to the ‘emotional inclusion’ factor [8]. In our study, item 4 belonged to ‘academic self-concept’ and item 10 to ‘social inclusion’. The results clearly support the observations of the tool’s authors regarding the need for linguistic verification of the PIQ’s statements, which should be culturally consistent [8,16,17,18,19].
In the present study, based on the theory of Fornell and Larcker (1981), the conditions of convergent and discriminant validity for the construct analyzed were confirmed. At the same time, all three identified factors, i.e., ‘emotional inclusion’, ‘social inclusion’, and ‘academic self-concept’, had satisfactory levels of reliability (Cronbach’s alpha > 0.7). It should be emphasized that in our study, the reliability analysis taking into account the division into groups showed that in the case of PE teachers, Cronbach’s alpha had the highest values both for Factor 1 (‘emotional inclusion’) and Factor 2 (‘social inclusion’), and very high for Factor 3 (‘academic self-concept’) compared to the results obtained by pupils, parents/legal guardians, and teachers. It seems that for the assessment of inclusion in various Polish education systems (mass, inclusive, or segregating system), the use of feedback from four perspectives, i.e., pupils, parents/legal guardians, teachers, and PE teachers, may contribute significantly to the science in the field of the theory of adapted physical activity and thus the health sciences, especially taking into account the aspect of the pupils’ mental health. This thesis corresponds with findings from research on the effectiveness of integrative and inclusive activities of PE teachers in the teaching process [21,23,39].

5. The Limitations of the Study

There is no doubt that the results presented in the study have several limitations. It should be noted that the perceptions of inclusion are not constant but characterized by certain dynamics and changeability over a lifetime. The awareness of these phenomena makes one approach any results obtained in a given moment with considerable caution. The findings of the present study cannot be considered fully conclusive. Moreover, because of the sample size, the research presented here should be viewed as a starting point for further analyses. Among the possible areas of expanding this research project, longitudinal studies with the application of a cross-sectional and sequential analysis design seem justified. This would allow the stability of the tool to be assessed. It also seems that it is advisable to perform parallel analyses in other areas of Poland. Furthermore, taking into account the respondents’ education and place of residence (by city and country) would contribute to a more expanded analysis. In this way, the exploration of the subject area and the conclusions could become more comprehensive and more valuable. The conclusions from the study show that despite social, civilizational, and legislative evolution oriented towards inclusion, the problem remains to be worth exploring in order to find the means of effective integration of pupils in school education based on PIQ results.

6. Conclusions

In light of the extension of inclusive practices in education, evaluating the usefulness of the PIQ for pupils is of special interest. It should be underlined that the PIQ provides an economical screening instrument for three central dimensions of school inclusion and can be used in both research and practice. The combined linguistic simplicity and shortness make it an attractive tool for school inclusion studies. With only 12 items, it can also be used in studies in which pupils’ self-perceptions of inclusion are not the central object, but considered in conjunction with other variables, such as self-esteem, positive orientation, and emotional intelligence.
Based on the findings of other authors and our analyses, it can be stated that the PIQ’s psychometric properties cannot be considered universally valid. This is why it is very important to scrutinize the instrument’s characteristics in other cultural and linguistic zones in which it is applied. In our study, all three factors, i.e., ‘emotional inclusion’, ‘social inclusion’, and ‘academic self-concept’ were characterized by a satisfactory level of reliability (Cronbach’s alpha > 0.7). Our study showed that factor loadings for item 4, item 8, item 10, and item 12 should be corrected. It seems that making the required corrections and putting the new Polish version of the PIQ on https://piqinfo.ch/ (accessed on 12 January 2022) will allow for further research on inclusion in school education. It should be added that a team of researchers undertook extensive discussions, and consequently, semantic changes resulting directly from the cultural and Polish understanding of the language were proposed.
Furthermore, it must be underlined that the reliability analysis for PE teachers was the highest for ‘emotional inclusion’ and ‘social inclusion’ and very high for ‘academic self-concept’ when compared to pupils’, parents’, and teachers’ scores, which justifies the introduction of PE teachers’ opinions to the assessment of pupils’ inclusion. Therefore, we recommend that research teams should conduct further scientific exploration of the PIQ tool in four perspectives, i.e., taking into account the opinions of PE teachers.

Author Contributions

Conceptualization, A.Z., B.R. and E.T.-C.; methodology, A.Z. and K.K.; formal analysis, B.R. and E.T.-C.; resources, A.Z. and K.K.; data curation, B.R. and E.T.-C.; writing—original draft preparation, A.Z. and K.K.; writing—review and editing, A.Z., K.K. and B.R.; supervision, A.Z. and K.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The Jerzy Kukuczka Academy of Physical Education in Katowice, grant number AWF/INS/ZB2/2022.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. Approval was obtained from the Bioethics Committee of the Academy of Physical Education in Katowice (Resolution No. 2/2018 as of 21 June 2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to they are collected, processed and calculated by the author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Messiou, K. Collaborative action research: Facilitating inclusion in schools. Educ. Action Res. 2019, 27, 197–209. [Google Scholar] [CrossRef]
  2. Messiou, K.; Ainscow, M. Inclusive Inquiry: Student–teacher dialogue as a means of promoting inclusion in schools. Br. Educ. Res. J. 2020, 46, 670–687. [Google Scholar] [CrossRef] [Green Version]
  3. Schwab, S.; Zurbriggen, C.L.; Venetz, M. Agreement among student, parent and teacher ratings of school inclusion: A multitrait-multimethod analysis. J. Sch. Psychol. 2020, 82, 1–16. [Google Scholar] [CrossRef] [PubMed]
  4. United Nations. Convention on the Rights of Persons with Disabilities. Eur. J. Health Law 2009, 14, 281–289. [Google Scholar] [CrossRef]
  5. Antoninis, M.; April, D.; Barakat, B.; Bella, N.; D’Addio, A.C.; Eck, M.; Endrizzi, F.; Joshi, P.; Kubacka, K.; McWilliam, A.; et al. All means all: An introduction to the 2020 Global Education Monitoring Report on inclusion. Prospects 2020, 49, 103–109. [Google Scholar] [CrossRef]
  6. Fernández-Archilla, J.A.; Álvarez, J.F.; Aguilar-Parra, J.M.; Trigueros, R.; Alonso-López, I.D.; Echeita, G. Validation of the Index for Inclusion Questionnaire for Compulsory Secondary Education Students. Sustainability 2020, 12, 2169. [Google Scholar] [CrossRef] [Green Version]
  7. Schwab, S.; Sharma, U.; Loreman, T. Are we included? Secondary students’ perception of inclusion climate in their schools. Teach. Teach. Educ. 2018, 75, 31–39. [Google Scholar] [CrossRef]
  8. Zurbriggen, C.L.A.; Venetz, M.; Schwab, S.; Hessels, M.G.P. A Psychometric Analysis of the Student Version of the Perceptions of Inclusion Questionnaire (PIQ). Eur. J. Psychol. Assess. 2019, 35, 641–649. [Google Scholar] [CrossRef]
  9. Ganotz, T.; Schwab, S.; Lehofer, M. Bullying among primary school-aged students: Which factors could strengthen their tendency towards resilience? Int. J. Incl. Educ. 2021, 1, 1–14. [Google Scholar] [CrossRef]
  10. Cruz-Ortiz, M.; Pérez-Rodríguez, M.C.; Jenaro-Río, C.; Sevilla-Santo, D.-E.; Cruz-Ortiz, S. When differences do not matter: Inclusion in a Mexican primary school/Cuando las diferencias no importan: La inclusión en una escuela primaria mexicana. Cult. Educ. 2016, 28, 72–98. [Google Scholar] [CrossRef]
  11. Moffa, K.; Dowdy, E.; Furlong, M.J. Exploring the Contributions of School Belonging to Complete Mental Health Screening. Educ. Dev. Psychol. 2016, 33, 16–32. [Google Scholar] [CrossRef] [Green Version]
  12. Schwab, S.; Rossmann, P. Peer integration, teacher-student relationships and the associations with depressive symptoms in secondary school students with and without special needs. Educ. Stud. 2019, 46, 302–315. [Google Scholar] [CrossRef] [Green Version]
  13. Schwab, S.; Gebhardt, M.; Krammer, M.; Gasteiger-Klicpera, B. Linking self-rated social inclusion to social behaviour. An empirical study of students with and without special education needs in secondary schools. Eur. J. Spéc. Needs Educ. 2014, 30, 1–14. [Google Scholar] [CrossRef]
  14. Schwab, S.; Gebhardt, M.; Gasteiger-Klicpera, B. Predictors of Social Inclusion of Students with and without SEN in Integrated Settings. Croat. Rev. Rehabil. Res. 2013, 49, 106–114. [Google Scholar]
  15. De Vries, J.M.; Voß, S.; Gebhardt, M. Do learners with special education needs really feel included? Evidence from the Perception of Inclusion Questionnaire and Strengths and Difficulties Questionnaire. Res. Dev. Disabil. 2018, 83, 28–36. [Google Scholar] [CrossRef]
  16. Venetz, M.; Zurbriggen, C.; Eckhart, M. Entwicklung und erste Validierung einer Kurzversion des „Fragebogens zur Erfassung von Dimensionen der Integration von Schülern (FDI)“ von Haeberlin, Moser, Bless und Klaghofer [Development and first validation of a short version of the Questionnaire for measuring dimensions of integration of students (FDI 4–6) by Haeberlin, Moser, Bless, and Klaghofer]. Empir. Sonderpädag 2014, 6, 99–113. [Google Scholar]
  17. Alnahdi, G.H.; Schwab, S. Inclusive education in Saudi Arabia and Germany: Students’ perception of school well-being, social inclusion, and academic self-concept. Eur. J. Spéc. Needs Educ. 2020, 36, 773–786. [Google Scholar] [CrossRef]
  18. Guillemot, F.; Hessels, M.G.P. Validation of the student version of the Perceptions of Inclusion Questionnaire on a sample of French students. Eur. J. Spéc. Needs Educ. 2021, 1–16. [Google Scholar] [CrossRef]
  19. Trygger, M. Do I Feel Included? A Study of Secondary Pupils’ Perception of Inclusion in a Compulsory School in Sweden. 2019. Available online: http://liu.diva-portal.org/smash/get/diva2:1355452/FULLTEXT02.pdf (accessed on 12 January 2022).
  20. Schwab, S.; Alnahdi, G.H. Teachers’ Judgments of Students’ School-Wellbeing, Social Inclusion, and Academic Self-Concept: A Multi-Trait-Multimethod Analysis Using the Perception of Inclusion Questionnaire. Front. Psychol. 2020, 11, 1498. [Google Scholar] [CrossRef]
  21. Wilhelmsen, T.; Sørensen, M. Inclusion of Children With Disabilities in Physical Education: A Systematic Review of Literature From 2009 to 2015. Adapt. Phys. Act. Q. 2017, 34, 311–337. [Google Scholar] [CrossRef]
  22. Block, M.; Obrusnikova, I. Inclusion in Physical Education: A Review of the Literature from 1995–2005. Adapt. Phys. Act. Q. 2007, 24, 103–124. [Google Scholar] [CrossRef] [PubMed]
  23. Reina, R.; Ferriz, R.; Roldan, A. Validation of a Physical Education Teachers’ Self-Efficacy Instrument Toward Inclusion of Students With Disabilities. Front. Psychol. 2019, 10, 2169. [Google Scholar] [CrossRef] [PubMed]
  24. Bentzen, M.; Malmquist, L.K. Differences in participation across physical activity contexts between adolescents with and without disability over three years: A self-determination theory perspective. Disabil. Rehabil. 2021, 1–9. [Google Scholar] [CrossRef] [PubMed]
  25. Haegele, J.A.; Maher, A.J. A creative non-fiction account of autistic youth integrated physical education experiences. Disabil. Soc. 2021, 1–20. [Google Scholar] [CrossRef]
  26. Hutzler, Y.; Barak, S. Self-efficacy of physical education teachers in including students with cerebral palsy in their classes. Res. Dev. Disabil. 2017, 68, 52–65. [Google Scholar] [CrossRef]
  27. Marconnot, R.; Pérez-Corrales, J.; Cuenca-Zaldívar, J.N.; Güeita-Rodríguez, J.; Carrasco-Garrido, P.; García-Bravo, C.; Solera-Hernández, E.; Gómez-Calcerrada, S.G.; Palacios-Ceña, D. The Perspective of Physical Education Teachers in Spain Regarding Barriers to the Practice of Physical Activity among Immigrant Children and Adolescents: A Qualitative Study. Int. J. Environ. Res. Public Health 2021, 18, 5598. [Google Scholar] [CrossRef]
  28. Vaz, S.; Wilson, N.; Falkmer, M.; Sim, A.; Scott, M.; Cordier, R.; Falkmer, T. Factors Associated with Primary School Teachers’ Attitudes Towards the Inclusion of Students with Disabilities. PLoS ONE 2015, 10, e0137002. [Google Scholar] [CrossRef]
  29. Wang, L. Perspectives of Students With Special Needs on Inclusion in General Physical Education: A Social-Relational Model of Disability. Adapt. Phys. Act. Q. 2019, 36, 242–263. [Google Scholar] [CrossRef]
  30. Okyere, C.; Aldersey, H.M.; Lysaght, R.; Sulaiman, S.K. Implementation of inclusive education for children with intellectual and developmental disabilities in African countries: A scoping review. Disabil. Rehabil. 2019, 41, 2578–2595. [Google Scholar] [CrossRef]
  31. Lindsay, G. Educational psychology and the effectiveness of inclusive education/mainstreaming. Br. J. Educ. Psychol. 2007, 77, 1–24. [Google Scholar] [CrossRef]
  32. Haeberlin, U.; Moser, U.; Bless, G.; Klaghofer, R. Integration in Die Schulklasse: Fragebogen Zur Erfassung von Dimensionen Der Integration von Schülern: FDI 4-6: Mit Einem Heft Zur Theoretischen Und Praktischen Einführung, Einem Testbogen Zur Beurteilung Des Sozialen, Emotionalen Und Leistungsmotivationalen Integriertseins von Schülern Des 4. Bis 6. Schuljahres in Ihre Schulklasse Und Auswertungsschablonen; Haupt: Bern, Switzerland, 1989; ISBN 978-3-258-04078-3. [Google Scholar]
  33. Gibbs, Y. Kanyongo, Duquesne University Determining The Correct Number Of Components To Extract From A Principal Components Analysis: A Monte Carlo Study Of The Accuracy Of The Scree Plot. J. Mod. Appl. Stat. Methods 2005, 4, 120–133. [Google Scholar] [CrossRef]
  34. Ledesma, R.D.; Valero-Mora, P.; Macbeth, G. The Scree Test and the Number of Factors: A Dynamic Graphics Approach. Span. J. Psychol. 2015, 18, E11. [Google Scholar] [CrossRef] [PubMed]
  35. Fornell, C.; Larcker, D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  36. Crouch, R.; Keys, C.B.; McMahon, S.D. Student–Teacher Relationships Matter for School Inclusion: School Belonging, Disability, and School Transitions. J. Prev. Interv. Community 2014, 42, 20–30. [Google Scholar] [CrossRef] [PubMed]
  37. De Vroey, A.; Struyf, E.; Petry, K. Secondary schools included: A literature review. Int. J. Incl. Educ. 2016, 20, 109–135. [Google Scholar] [CrossRef]
  38. Loreman, T.; Forlin, C.; Sharma, U. Measuring Indicators of Inclusive Education: A Systematic Review of the Literature. In Measuring Inclusive Education; International Perspectives on Inclusive Education; Emerald Group Publishing Limited: Bingley, UK, 2014; Volume 3, pp. 165–187. ISBN 978-1-78441-146-6. [Google Scholar]
  39. Berg, P.; Kokkonen, M. Heteronormativity meets queering in physical education: The views of PE teachers and LGBTIQ+ students. Phys. Educ. Sport Pedagog. 2021, 1–14. [Google Scholar] [CrossRef]
  40. Neary, A.; McBride, R.-S. Beyond inclusion: Trans and gender diverse young people’s experiences of PE and school sport. Sport Educ. Soc. 2021, 1–14. [Google Scholar] [CrossRef]
  41. Knickenberg, M.; Zurbriggen, C.L.A.; Venetz, M.; Schwab, S.; Gebhardt, M. Assessing dimensions of inclusion from students’ perspective—Measurement invariance across students with learning disabilities in different educational settings. Eur. J. Spéc. Needs Educ. 2020, 35, 287–302. [Google Scholar] [CrossRef]
Figure 1. CFA for PIQ questionnaire.
Figure 1. CFA for PIQ questionnaire.
Sustainability 14 03241 g001
Figure 2. Scree plot.
Figure 2. Scree plot.
Sustainability 14 03241 g002
Figure 3. Horn’s parallel analysis.
Figure 3. Horn’s parallel analysis.
Sustainability 14 03241 g003
Table 1. Descriptive statistics.
Table 1. Descriptive statistics.
GroupFactorsMMin.Max.SDAsKu
Whole sampleEmotional inclusion11.264.0016.001.75−0.141.03
Social inclusion11.156.0016.001.86−0.200.23
Academic self-concept10.674.0016.001.96−0.500.33
Summary PIQ items33.0822.0046.003.96−0.190.13
PupilsEmotional inclusion11.304.0015.001.85−0.631.51
Social inclusion11.437.0016.001.820.120.24
Academic self-concept10.584.0014.001.68−0.651.70
Summary PIQ items33.3124.0044.003.680.160.55
Parents or legal guardiansEmotional inclusion11.135.0016.002.090.010.25
Social inclusion11.216.0016.002.03−0.070.26
Academic self-concept11.035.0016.002.06−0.480.53
Summary PIQ items33.3622.0046.004.35−0.180.63
TeachersEmotional inclusion11.218.0016.001.440.281.20
Social inclusion11.016.0016.001.91−0.37−0.13
Academic self-concept10.265.0013.002.17−0.45−0.53
Summary PIQ items32.4723.0040.003.98−0.31−0.36
PE teachersEmotional inclusion11.428.0016.001.530.210.72
Social inclusion10.977.0014.001.64−0.690.05
Academic self-concept10.805.0015.001.82−0.480.19
Summary PIQ items33.2025.0040.003.78−0.39−0.74
Table 2. CFA model fit indices for PIQ in the study groups.
Table 2. CFA model fit indices for PIQ in the study groups.
Groupχ2/dfCFISRMRRMSEA
Pupils2.940.7900.1050.132
Parents or legal guardians2.550.8270.1080.118
Teachers4.040.8240.1300.166
PE teachers3.330.8650.0850.145
Table 3. Eigenvalues for the distinguished factors.
Table 3. Eigenvalues for the distinguished factors.
ValueEigenvalue% Total VarianceCumulative EigenvalueCumulative
%
Factor 14.9541.244.9541.24
Factor 21.6713.896.6255.14
Factor 31.199.907.8065.04
Factor 1—‘emotional inclusion’; Factor 2—‘social inclusion’; Factor 3—‘academic self-concept’.
Table 4. Exploratory factor analysis.
Table 4. Exploratory factor analysis.
PIQ Item:Factor 1Factor 2Factor 3
Emotional inclusion
Factor 1
Item 1: I like going to school.0.80 *0.220.27
Item 4: I have no desire to go to school.−0.060.360.66
Item 7: I like it in school.0.72 *0.340.27
Item 10: School is fun.0.270.490.21
Social inclusion
Factor 2
Item 2: I have a lot of friends in my class.0.230.78 *0.14
Item 5: I get along very well with my classmates.0.190.80 *0.06
Item 8: I feel alone in my class.−0.390.580.50
Item 11: I have very good relationships with my classmates.0.290.77 *0.09
Academic self-concept
Factor 3
Item 3: I am a fast learner.0.290.040.80 *
Item 6: I am able to solve very difficult exercises.0.160.040.80 *
Item 9: I do well in my schoolwork.0.360.150.74 *
Item 12: Many things in school are too difficult for me.0.190.190.66
% total variance41.2413.899.90
Reliability0.820.770.83
* indicates significant factor loadings (p < 0.05). Factor 1—‘emotional inclusion’; Factor 2—‘social inclusion’; Factor 3—‘academic self-concept’.
Table 5. Analysis of the reliability of scales for groups of pupils, parents, teachers, and PE teachers.
Table 5. Analysis of the reliability of scales for groups of pupils, parents, teachers, and PE teachers.
Factor 1Factor 2Factor 3
Cronbach’s AlphaNumber of ItemsCronbach’s AlphaNumber of ItemsCronbach’s AlphaNumber of Items
Pupils0.8220.7450.805
Parents or legal guardians0.8020.5950.765
Teachers0.8420.8150.895
PE teachers0.8520.8850.855
Table 6. Summary of convergent and differential validity analysis for PIQ.
Table 6. Summary of convergent and differential validity analysis for PIQ.
CRAVEMSVFactor 1Factor 2Factor 3
Factor 10.820.700.320.837
Factor 20.800.450.320.569 ***0.673
Factor 30.840.530.310.559 ***0.457 ***0.725
Factor 1—‘emotional inclusion’; Factor 2—‘social inclusion’; Factor 3—‘academic self-concept’. ***—p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zwierzchowska, A.; Kostorz, K.; Rosołek, B.; Tomińska-Conte, E. Validation of the Perceptions of Inclusion Questionnaire including PE Teachers’ Opinion as Part of an Innovative Use of the Tool. Sustainability 2022, 14, 3241. https://doi.org/10.3390/su14063241

AMA Style

Zwierzchowska A, Kostorz K, Rosołek B, Tomińska-Conte E. Validation of the Perceptions of Inclusion Questionnaire including PE Teachers’ Opinion as Part of an Innovative Use of the Tool. Sustainability. 2022; 14(6):3241. https://doi.org/10.3390/su14063241

Chicago/Turabian Style

Zwierzchowska, Anna, Karolina Kostorz, Barbara Rosołek, and Edyta Tomińska-Conte. 2022. "Validation of the Perceptions of Inclusion Questionnaire including PE Teachers’ Opinion as Part of an Innovative Use of the Tool" Sustainability 14, no. 6: 3241. https://doi.org/10.3390/su14063241

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop