3.1. Exploring Consensus and Divergence in Cognitive Social Structures
Each respondent drew a separate network representing their beliefs about which relationships were important in the client’s life, providing three network diagrams for examining consensus and divergence in these beliefs. The belief networks are referred to as R1’s network, R2’s network, and R3’s network. In each network, the client who was the focus of the pilot received the unique ID “E” (short for ego). The network for each respondent is shown in
Figure 4:
Respondents were allowed to freely identify all alters in the client’s (i.e., ego’s) network. The first step in the analysis is to explore the agreement on alters between each of the respondents (this is the ego–alter network). In total, 59 individuals were identified across all three networks. Of these 59 alters, only 16 were identified in all three networks (i.e., occurred in R1, R2, and R3’s diagrams). This means that of all the individuals identified, only 27% exhibited consensus ego–alter ties between all three respondents. Between R1 and R2, there were 22 consensus ego–alter ties (37%), while between R1 and R3, there were 22 consensus ego–alter ties (37%). Between R2 and R3, there were 17 consensus ego–alter ties (29%).
The next units of analysis are the ties from alter to alter (the alter–alter network), as identified by each respondent. Here, the question regards the extent of overlap between respondents in terms of the ties they perceive between alters. This agreement can be examined using the Jaccard index, where A and B are networks, and the quotient represents the proportion of ties from alter to alter in network A that appear in network B. The Jaccard indices for these data are 0.13 for R1 and R2, 0.13 for R1 and R3, and 0.04 for R2 and R3. In other words, there is very little consensus across the respondents in terms of the alter–alter networks.
As a final step, the ego–alter and alter–alter nominations can be examined together using the same measure to get an overall sense of how much consensus there is across respondents. The Jaccard indices for these data are 0.24 for R1 and R2, 0.23 for R1 and R3, and 0.13 for R2 and R3. Adding the ego–alter ties shows that much of the consensus among the respondents is due to the ego’s ties to alters. This indicates that, while there is some overlap between the respondents, there is considerable variation between whom they report to be influential in the client’s life, as is particularly the case when alter–alter ties are examined.
The overlap (or lack thereof) can be visualized by creating a weighted graph by “stacking” each individual network from the respondents. This
composite network, where thicker edges indicate more overlap in ties reported across the respondents, is shown in
Figure 5. In this plot, green nodes are those whom all three respondents identified in their networks (
n = 16), and gray nodes are those whom only one or two respondents identified (
n = 43).
In addition to identifying ego–alter and alter–alter ties, respondents also indicated the type of relationship that characterized each tie. To visualize these differences,
Figure 6 shows the respondent networks, where connections between individuals are colored based on the type of tie identified by the respondent and reclassified as either
family,
acquaintance/friend,
co-offender, or
agency. Individuals who were not identified by a specific respondent are excluded from that respondent’s network to aid with visualization. Looking across the networks, the lack of overlap is made clear by the inconsistency of certain individuals in the plots. As with
Figure 5, the color of the individual corresponds to whether the individual was nominated across all three diagrams.
In addition to identifying unique individuals who are influential to the client, another important finding shown in the plot above is that respondents differed in the extent to which they identified types of connections.
Table 1 below shows the percentage of connections that are represented by each type of tie for each respondent:
The table illustrates several important features. For R1, family and acquaintance/friend ties make up the bulk of the network, comprising 75.86% of the ties. For R2, acquaintance/friend ties make up the bulk of the network, comprising 68.29% of the network. In contrast to both R1 and R3, for R2, family ties represent only a small fraction (9.76%) of the ties. For R3, family and acquaintance/friend ties make up the bulk of the network, comprising 94.84% of the network. For R1 and R2, co-offender ties make up 11.49% and 9.76% of the network, respectively, whereas for R3, co-offender ties make up 0% of the network.
Again, employing the Jaccard index, we can examine overlap across the networks (where the units of analysis are ego–alter ties and alter–alter ties combined). For family ties, the index scores are 0.15 for R1 and R2, 0.27 for R1 and R3, and 0.08 for R2 and R3, offering an average score of 0.17. For acquaintance/friend ties, the index scores are 0.10 for R1 and R2, 0.09 for R1 and R3, and 0.09 for R2 and R3, offering an average score of 0.09. Finally, for agency ties, the index scores are 0.50 for R1 and R2, 0.45 for R1 and R3, and 0.36 for R2 and R3, offering an average score of 0.43. These calculations indicate that there are key differences in the overlap for the different types of relationships, with agency ties showing much more overlap compared to family or acquaintance/friend ties. These comparisons help reveal where there are gaps between respondents regarding their cognitive maps of a client’s social setting.
As was done above, a composite network can be created by “stacking” each of the networks to create a weighted network.
Figure 7 shows the composite network, where the thickest lines are those connections identified by all three respondents as the same type. The ties in which only two respondents provided the same designation are colored, but the line widths are thinner. The gray connections are those where either two respondents identified the tie but indicated a separate type (i.e., inconsistent naming) or only one respondent provided that tie. In other words, the other respondents did not report a connection for that individual.
3.2. Focus Group Feedback
After the pilot, a focus group was conducted with participants to gather reflections on the utility, feasibility, and potential application of network data in the context of client supervision. The focus group was conducted via Zoom with the participants, the lead researcher, and two representatives of the probation agency. For the focus group, the lead researcher created a web-based application using the pilot data to assist with the visualization of the networks. The “Probation Pilot Tool” (available at
https://jacobtnyoung.shinyapps.io/probation-pilot-app/, accessed on 27 January 2026) allows the user to select each of the networks from the pilot, display them, and adjust various visual parameters (e.g., the size of the individuals, transparency of connections, size of lines). The application also allows the user to upload a list of names that correspond to the unique IDs shown in the plot. This allows the respondent to reference the actual names of those identified during data collection but maintains anonymity for the researcher (or other parties who might be sharing the anonymized data).
Before beginning the discussion, participants were reminded of the pilot project’s goals and the data collection process. The instrument used to collect the network data was reviewed, and the participants discussed how the information was visualized in the resulting network plots. The group then worked through the Probation Pilot Tool and went through several questions. Thematic analysis (
Braun & Clarke, 2006) was used to identify themes. As the focus group was not a separate data collection phase, the discussion was not recorded. Coding was conducted during the discussion, noting key terms that were used by the participants during the process. After the focus group ended, the researcher compiled these terms and phrases into themes. These results were then reviewed by the two representatives of the probation agency to corroborate the interpretation of the salient themes of the focus group. Below, each question and the general themes of the feedback are provided.
Theme 1: “Reflections on Network Content”. This came from the following question: “The goal of this pilot was to identify relationships in a client’s life that are important. In looking at the networks, what stands out to you?” Respondents generally agreed that the tool was useful. One participant highlighted that the process of first writing out the connections for the client, drawing the maps, and finally transitioning to the network visualization was particularly effective for illustrating who is connected to whom. The visual format helped make the significance of certain relationships more immediately apparent. One respondent suggested using the tool during the intake process, thus potentially allowing the client to contribute information directly, emphasizing that this would help practitioners quickly understand the key social relationships in a client’s life. Another respondent expanded on this idea by emphasizing the importance of keeping the network up to date. As relationships evolve (e.g., new individuals enter the network, relationships change, some individuals become less influential), revising the network over time would ensure that it remains a relevant and valuable resource. This theme of maintaining a “living” network was supported across respondents. Another insight was that the tool helps center surface knowledge that practitioners may already possess but have not consciously focused on. By laying out the relationships visually, certain dynamics that were previously in the background come into sharper focus, helping practitioners identify where to direct their attention. Finally, a respondent noted the tool’s utility in both familiar and unfamiliar contexts. For a client whose network is well-known to the supervising officer, the visualization reaffirms that understanding. Conversely, for clients whose networks are less familiar, the tool would help identify knowledge gaps and inform the next steps.
Theme 2: “Value of Multiple Perspectives”. This was gleaned from responses to the following question: “
By asking several of you to provide input, we received multiple perspectives on the client’s social network. We created a “composite” network that shows information gleaned from all the respondent feedback. In reviewing that network, do you see value in having these different perspectives and aggregating them together?” Participants emphasized the value of incorporating multiple viewpoints. The composite network (i.e.,
Figure 5 and
Figure 7 discussed above) provided a way to highlight not only areas of shared understanding but also gaps in knowledge between respondents. This was especially meaningful in cases where individuals working with the client had varying degrees of insight into different parts of the client’s social world. Specifically, the probation officers had information on offending, while the CBO had information on family relationships. These differences point to the distinctive knowledge held by officers who have insights into connections that may be very important (positively or negatively) to the client but unknown to others involved. All three respondents reported value in collecting and pooling this disparate knowledge. The CBO representative shared that seeing the probation officer’s view of the network alongside their own helped to identify blind spots and opportunities for collaboration. It also enabled them to consider other individuals within the network who could be engaged to support the client. Overall, respondents emphasized that the composite visualization could serve as a tool for integrating different perspectives and identifying new avenues for intervention.
Theme 3: “Communication and Collaboration”. This came from the following question: “Does this information provide you with a useful tool for communicating with other agencies or groups?” All three respondents noted that the data collected and the visualization tool would be of great value in facilitating inter-agency communication. As mentioned previously, the CBO representative found it helpful to see the network from the probation officer’s perspective, and this benefit was seen as generalizable to other agency partners. The tool was described as a useful visual aid for discussions involving multi-agency collaborations. It also has potential for use with other stakeholders, including police representatives. By providing a shared reference point, the respondents expressed the belief that the network visualization would support clearer communication and facilitate coordinated efforts across agencies.
Theme 4: “Future Considerations: Network Data Collection Tool”. This theme emerged organically. As the focus group session continued, a recurrent theme mentioned by respondents was that any tool that may be considered would need to be simple, usable, and integrated if it were to hold value for the probation agency. To move away from the physical data collection step used in the pilot, the lead researcher developed a prototype “Network Data Collection Tool” (available for preview at:
https://jacobtnyoung.shinyapps.io/example-dashboard/, accessed on 27 January 2026) that delivers the steps developed in the pilot in an electronic format. The respondent enters the names and tie types for important alters. As the respondent does so, the tool generates an image of the network for the respondent to review. As with the pilot, in the second step of the process, the respondent constructs the alter–alter relationships. All respondents emphasized a need to collect data efficiently and dynamically. The prototype tool shown above is a step toward incorporating this insight, as it reduces the burden of physically drawing the networks and allows the respondent to update the network based on new information.