4.1. Experienced Outcomes of PLC Coaching
As indicated by the results of the ESA-S administered at the end of the PDT (
Table 2), the participants experienced the PLC coaching on ‘Converting insights into planning and undertaking concrete actions’ and ‘Having the desire to continue working on the content’ as strongly positive (
M > 4.50), albeit with a large spread.
We conducted focus-group discussions (
N = 11) to examine which aspects of the PLC the school leaders perceived as beneficial (
Table 3). The most prominent was content input (
N = 10), and particularly the sharing of practical examples and ideas, the sharing of materials and the discussion of theoretical frameworks. Most (10) of the PLC groups also indicated that the PLC had served as a sounding board. In this regard, it was mentioned that other participants can offer a critical view, contribute different perspectives and provide feedback, all of which promote reflection and depth. The participants also experienced the PLC as supportive and encouraging (10 groups). Two PLCs cited it as a welcome aid in transferring the content to their schools, which was made easier by both the input from the PLC and the time provided. Some participants (1 group) also reported experiencing follow-up, given that the PLC was structurally embedded within the programme.
Almost all participants (10 groups) noted that getting to know each other better and expanding their networks had encouraged them to continue working together. In two PLCs, sharing the same themes, experiences and challenges was mentioned as beneficial. In six PLCs, the benefit of experiencing a PLC yourself was mentioned: ‘You can read about coaching and PLCs, but by immersing yourself in it, you experience it yourself. It does inspire you to apply it in your organization’ (PLC9).
4.2. The Experienced Value of the Coach’s Didactic Approach and Coaching Skills During PLC Meetings for the Predefined Outcome Variables
As indicated in
Section 2.4, common principles guiding the didactic approach to PLC coaching were identified at the beginning of the PDT, focusing on the key elements of effective professional development for school leaders (
Tanghe & Schelfhout, 2023). In the sections below, we analyse how the participants experienced the characteristics of the coaches throughout the process of PLC coaching, and why, based on a descriptive analysis of the quantitative data and an in-depth qualitative analysis of the focus-group discussions. In line with the theoretical framework, we focused on the didactic approach, coaching skills and expertise of the coaches.
4.2.1. Didactic Approach
Results from the ESA-S indicated that school leaders perceived the coach’s didactic approach as effective and above average (
Table 4). It is interesting to note the high mean score for opportunities to network and share in the PLC (
M = 5.22;
SD = 8.71). The spread was large, however, which might have been due to differences in the approaches of individual coaches and/or in the ways in which participants appreciated these approaches.
During the focus-group discussions, the benefits of the PLC were often mentioned simultaneously with the didactic approach adopted (
Table 5). The focus was always (
N = 11) on two benefits: opportunities for interaction and sharing, and learning from and with peers. Four focus groups referred to the link the coach made during the PLC meetings with the theoretical frameworks provided during the training days, and two groups mentioned newly introduced frameworks. Action orientation was addressed in all focus groups in various ways, including being given preparatory tasks, focusing on the action plan, having participants formulate concrete goals, and following up on actions taken: ‘The coach was always focused on the group’s goal, but was still able to leave room for all the side activities needed to get there’ (PLC13). Customized support was also noted: the questions and goals of participants were central to the approaches of all coaches, as was time for feedback, the sharing of ideas, and expertise. Six focus groups mentioned that their coaches had purposefully applied a variety of didactic approaches: ‘That brought depth and a critical view of how you are doing as a school. At the same time, you receive suggestions and feedback that you can work with. Without that methodology, the conversation would have been uneven and not so constructive’ (PLC11).
Five focus groups noted that they would have liked their coach to have made an explicit link to the content of the training days, thereby promoting better embedding. Four PLCs shared extensively about what their schools were working on, but without further inspiration and depth. Participants also mentioned that there could have been more forward-thinking and action orientation (2 groups), and more critical thinking and substantive discussion (1 group). In addition, participants mentioned that the PLCs had lacked a goal-oriented approach (3 groups) with a clear practical/organizational framework to facilitate the quality of the PLC (2 groups), as well as clear expectations and responsibilities regarding preparation and assumption of roles within the PLC (3 groups). Some also mentioned that the coaches’ didactic methods had not always been appropriate. For example, one group noted that, although a particular methodology had been useful, there had been a lack of depth, due to the limited time available (1 group), too much time had been spent on introduction and exploration (1 group) or the approach had not fit the group and the purpose of the PDT.
4.2.2. Coaching Skills
The ESA examined 12 skills in PLC coaching (
Table 6). The presence of these skills amongst the coaches was rated as above average (
M > 4.50). At the same time, a very large spread (
SD > 1.000) was found for all these skills.
Eight focus groups (
Table 7) explicitly mentioned the safe and open learning environment that their coaches had created by adopting an enthusiastic, calm, nonjudgmental, supportive, sincere, constructive and appreciative approach. Participants in two focus groups reported that their coaches had used skills that converged on connection and group dynamics, involving everyone equally. Three groups mentioned the empathy of their coaches. In addition, it was mentioned that coaches had monitored goal orientation by explicitly linking back to the goals or questions formulated by the participants (7 groups). Six focus groups mentioned a good balance between creating a relaxed atmosphere without being non-committal and aimless. The focus groups referred explicitly to coaching skills in terms of asking purposeful and in-depth questions (6 groups); listening, encouraging listening, and using silences (4 groups); summarizing and synthesizing (4 groups); and giving feedback (2 groups). Five focus groups mentioned the effectiveness of the PLC in terms of preparation. Some said that the approach had felt authentic and organic (2 groups) and that some coaches had also modelled through the approaches they adopted (3 groups) and had asked for feedback themselves so they could adapt their approach to the group (2 groups).
Two groups mentioned that their coaches had not sufficiently integrated the coaching role or had not been good examples: ‘I did not feel coached, but acknowledged’ (PLC6). Where one coach was allowed to bring in more expertise, another group said that the coach had shared many examples from their expertise, but had not facilitated transfer to the contexts of the schools: ‘Sometimes, it was limited to many examples from a lot of expertise. But then, the next step should also come; specifically, let’s look at everybody’s context’ (PLC3).
The focus groups revealed that the effectiveness of an approach was determined by the expectations and needs of the PLC group and/or individual participants. According to one PLC, a great deal of listening and sharing of practical examples was not sufficient when there was a need for depth and support in the transfer to each school. In contrast, another PLC with the same coach considered it sufficient. During the focus-group discussions, participants indicated that a good coach can anticipate this. Two focus groups noted that they themselves had played a role in the effectiveness of the PLC. It might have been better to share their feedback and desires with the coach instead of simply letting things pass by.
4.2.3. Expertise of the Coach
The perceived expertise of the coaches was positive in terms of both experience in coaching (
M = 4.85) and relevant educational expertise (
M = 4.71). At the same time, however, a very wide range was also observed (
Table 8).
4.3. Indication of Differences Between PLC Coaches in Terms of Didactic Approach and Coaching Skills That May Be Associated with Differences in the Outcome Variables
In the descriptive analyses, the wide range of benefits of PLC coaching, as perceived by school leaders, was notable. This raised questions concerning whether this spread might have been due to differences between coaches. Multilevel analysis school leaders nested in the 14 PLCs proved impossible, due to the low
N for each PLC (
Maas & Hox, 2005). We therefore analysed this question according to a combination of descriptive analyses, analysis of variance and regression analysis.
Variance analysis (tests of between-subjects effects) of the predefined outcome variables—‘Converting insights into planning and undertaking concrete actions’ (F(6,131) = 5.06, p < 0.001, ηp2 = 0.197) and ‘Having the desire to continue working on the content’ (F(6,131) = 3.82, p < 0.001, ηp2 = 0.169) revealed a large effect variance between coaches. In other words, some coaches achieved better results than others did. These differences might have resulted from differences in the approaches adopted by coaches and/or in the relationships between participants and their coaches.
Variance analysis (tests of between-subjects effects) of the independent variables showed a large difference between coaches for ‘Deepening theoretical frameworks and practical examples’ (F(6,131) = 6.58, p < 0.001, ηp2 = 0.241), ‘Working towards an action plan’ (F(6,131) = 4.43, p < 0.001, ηp2 = 0.177), ‘Varied and activating approach’ (F(6,131) = 7.04, p < 0.001, ηp2 = 0.254) and ‘Coaching skills’ (F(6,131) = 15.021, p < 0.001, ηp2 = 0.421). For ‘Customized support and feedback’, there was a significant mean difference between coaches (F(6,131) = 2.99, p = 0.009, ηp2 = 0.126). For ‘Networking and sharing’, there was a small, non-significant difference (F(6,131) = 1.66, p = 0.136, ηp2 = 0.074).
These analyses provided an initial indication that the approaches adopted by the coaches could have made a difference in achieving the predefined outcomes, albeit without accounting for control variables. It remained unclear how much influence the coach had on the predefined outcome variables and which specific approach contributed the most to achieving those outcome variables.
Multiple regression analysis, without the inclusion of control variables, showed a strong explanatory value (
R2 = 0.437) for the coach’s didactic approach during the PLC for ‘
Converting insights into concrete action’ (
Table 9, Model 1). The predictors that made the largest unique contribution in addition to the joint value were ‘
Working towards an action plan’ (
β = 0.326,
p < 0.001) and ‘
Customized support and feedback’ (
β = 0.294,
p = 0.001). Coaching skills during the PLC meetings had a moderately strong explanatory value for action planning (
R2 = 0.229,
p < 0.001).
For the outcome variable of ‘Having the desire to continue working on the content’, multiple regression analysis indicated that the coach’s overall didactic approach during the PLC had very strong explanatory value (
R2 = 0.573,
p < 0.001) (
Table 10, Model 1). The predictors that made the greatest unique contribution in addition to joint value were a ‘
Varied and activating approach’ (
β = 0.314,
p = 0.002), ‘
Working towards an action plan’ (
β = 0.202,
p = 0.016) and ‘Opportunities to network and share’ (
β = 0.214,
p = 0.003). Coaching skills also had strong explanatory value for ‘Having the desire to continue working on the content’ (
R2 = 0.339,
p < 0.001).
Because multilevel analysis was not possible due to an insufficient limited
N, we examined differences between coaches using regression analysis with dummy variables (
Table 9 and
Table 10, Model 2). In this model, without accounting for control variables, each coach was treated as a separate category, and dummy variables were created for each coach (6 in total). The mean responses of group members were calculated for each coach. These group means were then compared across coaches to assess differences. The regression analysis, with the inclusion of the coach dummy variables, indicated differences between coaches. In light of the high
p-value (
p > 0.05) for the didactic approach, however, we concluded that there was no significant difference for this outcome. In contrast, the results revealed significant differences between coaches for coaching skills (
p < 0.05).
We also examined how the coaches (
N = 7) themselves perceived the implications of their coaching approaches and skills for the predefined PLC outcome variables, as well as the extent to which these perceptions corresponded to the perceptions of school leaders, as described in
Section 4.2.1 and
Section 4.2.2. During the in-depth interviews (
Table 11), the coaches identified goal-oriented and action-oriented creation and monitoring as the most effective approach (6 coaches). They felt this approach was complementary to structuring, summarizing and synthesizing (2 coaches). The coaches also felt that having the courage to adapt, challenge and enrich content was crucial (5 coaches). At the same time, one coach indicated that too much guidance with an view to timing and providing a large amount of content was not effective.
Five coaches noted that the effectiveness of their approaches was enhanced by connecting with the group, focusing more on the PLC’s learning process than on their own aspirations as coaches, and responding to group dynamics and present needs, experiences and expectations: ‘Effectiveness = quality × acceptance. I feel acceptance is very important’ (C1). One coach indicated that he had given too little direction when participants wanted to express their needs, in light of their complaints, or when they were distracted by a topic on the sidelines.
One coach did not consider himself a good coach within the context of the PDT with PLCs: ‘I am good at giving information, but that is different from coaching. In training, I can use my expertise more’ (C2).
Four coaches identified the participants as a co-determining factor in the effectiveness of PLC coaching: ‘I think you can be a very competent coach and still hit a barrier if participants are not open to participating in the PLC or if mutual dynamics prevent full participation’ (C6).
4.4. Experienced Value of the Expertise of a PLC Coach on the Predefined Outcome Variables
The explanatory value of perceived coaching expertise was found to be moderately strong for ‘Converting insights into planning and undertaking concrete actions’ (F(1,102) = 11.07, p = 0.001, R2 = 0.098). For the perceived educational expertise of the coach, the regression analysis showed a moderately strong relationship for ‘Having the desire to continue working on the content’ (F(1,102) = 11.00, p = 0.001, R2 = 0.097). As mentioned above, we did not control for variables that might have mediated this explanatory value, because it was not possible to capture potential mediating variables (e.g., professional development initiatives in which participants had been involved, existing knowledge and pre-existing attitudes toward specific forms of professional development) with a feasible set of questions that would not jeopardize the likelihood that respondents would complete the already extensive questionnaire.
In eight focus groups (
Table 12), participants expected coaches with coaching expertise to facilitate content and group dynamics, as well as to ensure transfer. According to these participants, if this did not occur, any educational expertise a coach might have would not play a role. Although a coach did not necessarily need to have experience in education, familiarity with it and an education-oriented mindset appeared to be needed (
N = 6). Although other contextual experiences could be valuable in terms of providing a broader perspective, there was a chance that a coach who was unfamiliar with the educational context might offer less depth or provide little realistic input (2 groups). A coach with a large network (outside of education) from which to gather or to which to refer input was also valued (2 groups).
To what extent did the coaches (
N = 7) confirm these findings? Six of the coaches mentioned the necessity of having coaching expertise (
Table 13), and one mentioned the need for specific experience in PLC coaching. All coaches mentioned that educational expertise should enable a coach to guide schools in transferring theoretical frameworks and practices to their schools. To this end, a coach should have sufficiently strong affinity with education, in addition to knowing the context and preconditions well and speaking the same language, thereby ensuring that input is not limited to general ideas or borrowed examples. Having educational experience made it easier to provide examples on the topic, bring in authentic experiences and be articulate, but it did not necessarily require being a school leader, according to five coaches. One coach indicated that a PLC might actually need a coach who was not familiar with education, in order to promote out-of-the-box thinking, but that the participants themselves did not realize this, and thus perceived the process guidance provided by such a coach as a mismatch. For this coach, the central question concerned the purpose of a PLC, rather than whether a coach had the right expertise.