Next Article in Journal
Scientific Aspects of the Study of Transcontinental Relations and Global Settlement
Next Article in Special Issue
Exploring the Barriers to and Potential for Sustainable Transitions in Urban–Rural Systems through Participatory Causal Loop Diagramming of the Food–Energy–Water Nexus
Previous Article in Journal
Perception of the Vegetation Cover Pattern Promoting Biodiversity in Urban Parks by Future Greenery Managers
Previous Article in Special Issue
Methodological Challenges in Studying Trust in Natural Resources Management
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

No Stakeholder Is an Island: Human Barriers and Enablers in Participatory Environmental Modelling

by
Daniel C. Kenny
1,2,* and
Juan Castilla-Rho
3,4,5
1
School of Information, Systems and Modelling, Faculty of Engineering and Information Technology, University of Technology Sydney (UTS), Sydney, NSW 2007, Australia
2
PERSWADE Research Center, Sydney, NSW 2007, Australia
3
Faculty of Business, Government & Law, University of Canberra (UC), Canberra, ACT 2617, Australia
4
Institute for Governance and Policy Analysis (IGPA), Center for Change Governance (CCG), Canberra, ACT 2617, Australia
5
Sim4Action, Kiama, NSW 2533, Australia
*
Author to whom correspondence should be addressed.
Land 2022, 11(3), 340; https://doi.org/10.3390/land11030340
Submission received: 11 January 2022 / Revised: 18 February 2022 / Accepted: 21 February 2022 / Published: 25 February 2022

Abstract

:
Sustainability science strives to hone our ability to tackle problems that involve interconnected economic, social, and environmental systems. Addressing the root causes of these problems requires a more nuanced understanding of how human behaviour can undermine stakeholder engagement efforts towards effective conflict management and resolution. Participatory modelling—the co-production of knowledge via facilitated modelling workshops—plays a critical role in this endeavour by enabling participants to co-formulate problems and use modelling practices that aid in the description, solution, and decision-making actions of the group. While the difficulties of modelling with stakeholders are widely acknowledged, there is still a need to more concretely identify and categorize the barriers and opportunities that human behaviour presents to this type of engagement process. This review fills an important gap in participatory modelling practice by presenting five broad categories of barriers, along with strategies that can assist in overcoming them. We conclude with a series of actions and future research directions that the participatory modelling community as a whole can take to create more meaningful and behaviourally-attuned engagements that help stakeholders take concrete steps towards sustainability in natural resource management.

1. Introduction: Tackling Wicked Problems of SES with Participatory Modelling

Addressing the social-ecological challenges of the Anthropocene requires a more nuanced understanding of the way humans perceive conflict and how people’s knowledge, motivations and behaviours can get in the way of collaboration and the implementation of corrective actions in the face of complexity [1]. Complexity is a hallmark of social-ecological systems (SES)—characterized by uncertainty, nonlinear dynamics, the potential for regime shifts, self-organization, and a strong interdependence between ecological systems and the social systems that depend on them, driven by the interactions between resources, actors, and institutions at and across multiple scales [2,3].
Conflicts of values and interests of stakeholders seem to be a pervasive factor contributing to the ‘wickedness’ of SES issues [4]. This means human behaviour—as dominant force within SES—can be considered a root cause of undesirable trajectories or system states, but at the same time it is a central part of any solution [5]. A corollary is that, ultimately, one of the keys to improve the state and/or trajectory of SES is to transform human behaviour within it [6]. Thus, how can this be achieved? In order to improve the state or trajectory of SES, issues need to be ’owned’ by the stakeholders of the system that we seek to change. That sense of ownership helps to create a desire for change [7] and is a driving factor behind participatory approaches that are so widely advocated for.
Here, we argue that participatory approaches are only as good as our understanding of how people comprehend and assimilate knowledge about the systems they are part of. Participatory approaches ought to foster stakeholder learning of the kind that helps people transcend their own worldviews [8], sometimes referred to as transformative or loop learning [9,10,11]. Transformative learning can be thought of as a bottom–up approach—changing individuals to trigger change of the system as a whole. Working through problems of SES requires understanding how individual behaviours within the system both influence and are influenced by collaboration, group dynamics, social networks, institutions and policy [12]; feedbacks flow from the bottom–up and from the top–down. Participatory approaches prioritize this kind of bottom–up feedback, mediated through group learning. We, and other participatory modellers, conceptualize and aim for group learning that transforms stakeholders’ worldviews or mental models [13,14]. A mental model is a “personal, internal representation of external reality that people use to interact with the world around them” based on an individual’s experiences, perceptions, and understandings of the world [15]. One particular type of participatory process—so-called participatory modelling (PM), where scientists and stakeholders co-design a conceptual or empirical model of the system—has built a promising track record on building better a understanding and management of SES by providing a framework for engaging stakeholders, eliciting and shaping their mental models, and subsequently aligning them towards common goals [6,14,16,17,18].
However, we cannot expect the desired systemic outcomes to spontaneously arise after the implementation of these participatory practices. Individual learning is a necessary but not sufficient ingredient for systemic change. Learning must propagate through the system by transcending the individual to become situated and ingrained in the SES [6,19,20], sometimes referred to as social learning. Social learning plays a key role in this process, defined as changes beyond the understanding of an individual to critically deliberate, negotiate, and become situated within wider social rules, norms, power relations or communities of practice; this process occurs through social interactions between actors [6,10,21,22]. Crucially, social learning creates a shared understanding of the problem, defined as “stakeholders understand each other’s positions well enough to have intelligent dialogue about the different interpretations of the problem, and to exercise collective intelligence about how to solve it” [23]. Arriving at this ’shared understanding’, which can also be thought of as a collective ’mental model’, is a key goal of participatory modelling. Given the critical role of human behaviour in determining outcomes for SES, participatory modelling (PM) is particularly well placed to promote learning at the individual level that can scale to a group level.
Participatory modelling (PM) occurs when stakeholders are engaged in a collaborative process of building a scientific model with researchers, as opposed to researchers seeking to simply ‘extract’ information from ‘subjects’ [24]. By comparing the outcomes of the model with what is observed in the real world, researchers engage in an iterative process of refining their hypotheses and the structure of the model until the ‘artificial’ world resembles the observed system being studied [25,26]. In the attempt to simulate or ‘capture’ reality, however, models can become incredibly complex and often require expert involvement in building, interpreting, validating, and maintaining such models. That is why involving stakeholders in the modelling process is an important consideration, as they can bring intimate experience and knowledge often unavailable to researchers and experts in creating these artificial laboratories [27]. PM, as opposed to traditional ‘black box’ modelling methods, seeks the collaborative co-creation of knowledge [28], and can be seen as a way to share information between researchers and stakeholders in an effort to build a shared understanding of a given system, its components, and its relationships. Some of the defining principles and goals of this kind of participation are to empower subjects to speak up and find their own answers, to integrate expert and local knowledge, and to involve the values, needs, and concerns of the community into the research process [29,30,31]. There are many definitions of PM, but for this review, we define PM as: “a purposeful learning process for action that engages the implicit and explicit knowledge of stakeholders to create formalized and shared representations of reality” [17].
PM offers a systematic way to grapple with the complexity of SES issues by engaging stakeholders of a given problem to find a shared understanding and to implement collaborative solutions informed by science [32]. It is this ‘shared understanding’ that is so vital to the success of any PM effort, as a common understanding of definitions, the components, and relationships of a system, as well as empathy and appreciation for the perspectives of different stakeholders can create benefits long after the modelling exercise ends [33]. This is recognized in the literature, noting the positive effects when the “attitudes, beliefs, or preferences of the people managing or depending on resources are considered in the identification of problems and the development of solutions” [29,34] and it mirrors the desire for a shared understanding (not consensus) in problems of SES [35]. The more engaged stakeholders are, often the easier it is to reach that shared understanding [33] and achieve the intermediate outcomes of PM. Although there is some discrepancy over how to measure and evaluate these outcomes, some studies suggest that it is the intermediate outcomes (such as trust, communication, and the building of social networks) that seem to matter most, as they lead to the type of learning and behaviour change ultimately capable of changing the system [36,37,38].
The process of PM is often sought as the means to facilitate dialogue between stakeholders to achieve that shared understanding [33,39,40]. The model and the participatory process serve as the focal point for stakeholders and researchers to come together around a common purpose and to use the “modeling practices to define the descriptions, solutions, and decision-making actions of the group” [17]. The model thus becomes a ‘boundary object’, defined as a device that, if successfully implemented, can act as a bridge between various groups “to facilitate mutual understanding and cooperation” [26,36,41] by making people’s perceptions and worldviews, i.e., mental models, explicit. These (often visual) objects help represent the connections between the people involved in the conversation, move us toward a more concrete representation of abstract concepts, and can be changed by proposals from any stakeholder [26]. As a boundary object, participatory models can empower and integrate many perspectives, encourage both individual and social learning, facilitate an exchange of worldviews and mental models between participants, and promote conflict resolution and collective decision making by becoming the object around which a socio-environmental issue can be ‘mediated’ [42,43,44] and those individual mental models can be transformed.
While the PM literature has discussed the difficulties of working with stakeholders, there is still a need to more effectively design for and to address the barriers that the nuances of human behaviour present to this kind of modelling process. A purposive literature search was used to identify relevant studies relating to participatory modelling, socio-ecological systems, and the presence (or absence) of a ‘behavioural’ lens or focus to the study, following a strategic and adaptive approach to the literature. We intentionally used the purposive review as this allowed, even encouraged, incorporating insights and findings from other fields to yield a synthesis that would prove difficult under a more defined, systematic approach. We sought to determine “To what extent do PM studies explicitly consider human behaviour as a driving factor in PM workshops focused on issues of SES? If so, how is that behaviour accounted for? What explanatory mechanisms or accommodations are systematically incorporated into the design and facilitation of PM as a result?” This review leads to the proposition that certain non-technical barriers or challenges are presented by working with people and their behavioural tendencies, which must be accounted for if enduring transformation of stakeholders and the system is an ultimate goal of any PM exercise. Publications were identified through the following databases: Science Direct; Scopus; Elsevier, using various combinations of keywords: “Participatory Model *”; “socio-ecological systems”; “behavior * science”; and “stakeholder *”. The search was limited to peer-reviewed studies in English only. Results were screened using titles and abstracts, followed by a skim of the full text to determine relevance and to check the reference list for relevant studies in a snowball approach that encouraged triangulating any insights from a synthesis of multiple sources. Our review lays the groundwork for designing and undertaking PM practices that empower stakeholders to make meaningful progress towards resilience and sustainability, and is useful for any looking to design or facilitate a PM process seeking to improve management of SES. Our findings and recommendations can be applied over a broad range of participatory research efforts in natural resource management.
The paper is structured as follows. Section 2 discusses the role of human behaviour within participatory modelling processes. Section 3 identifies and categorizes five human barriers in the context of participatory environmental modelling and outlines a series of recommendations on how PM processes may be facilitated to overcome each barrier. Section 4 concludes with a series of actions and future research directions that the participatory modelling community can take to facilitate more meaningful and behaviourally attuned engagements that help stakeholders take concrete steps towards effective collaboration in natural resource management.

2. Human Behaviour: The Achilles Heel of Participatory Modelling

Participatory models are a way of eliciting, involving, and learning from the perspectives of stakeholders, offering a way to extract individual and collective mental models and represent them explicitly [45]. In this role as a `boundary object’, the model provides a common platform and a common `language’ to understand the system of interest. PM allows stakeholders to engage with their own and each other’s mental models, thereby “exposing personal knowledge gaps” [44] and aiding the development of an integrated understanding of complex social-ecological systems [45]. Shared understanding (not consensus), can thus be achieved, leading to enhanced communication and trust that endures long after the modelling process is over [36,40]. These and other ‘intermediate’ outcomes are among the most powerful benefits of the PM process.
Despite these benefits, there are a number of recognized shortcomings within the PM literature. Some of these are highly technical aspects, including model integration, model validation, and model sensitivity [46,47]. We are less concerned with these topics in this review. Instead, we focus on the use of the model as a boundary object and the `intermediate’ outcomes emerging from the social engagement and deliberation that occurs `around’ the modelling effort. Of the various outcomes that can be achieved by PM, intermediate outcomes (such as trust, communication, and the building of social networks) play a key role in mediating the learning and behaviour change necessary to ultimately improve the management of SES [36,37,38]. Furthermore, however, the PM community has historically paid less attention to ‘how’ this learning occurs [48,49,50,51], with unanswered questions concerning how the process can be deliberately and systematically structured to maximize those intermediate outcomes.
How can we empower SES stakeholders for systemic change? To do so, the literature suggests that our focus should be on understanding the role of human behaviour at the centre of a PM process. How, then, as facilitators, can we consistently, effectively, systematically, and consciously align with the patterns of human behaviour within a PM process? Here, the answers from within the PM community are less clear. Models support management decisions “beyond the time frame of a scientific research project” but often fail to account for human behaviour in making and executing those decisions [52]. Amazonas et al. [53] identified the need to incorporate social sciences “to better understand differences in perspectives and actions among project participants” and to incorporate cultural dynamics. Other authors have identified case studies that sought to “mitigate the BBHV (Beliefs, Biases, Heuristics, and Values) that commonly affect the judgement of all participants/experts, at both the individual and the group level”, but failed to collect compelling evidence that PM led to any change in individual or collective reasoning [48]. PM experts have thus recognized the need to address individual learning, as also shown by some of the key questions they believe the field needs to address [17,42]:
  • How can we measure learning, both of stakeholders and the wider community to which they belong?
  • How can we identify, categorize, and address issues of communication through participatory modelling?
  • How can the PM process actively understand, accommodate, and counter differing biases, beliefs, and values among stakeholders?
  • What drives motivation and engagement in a PM process? What role does trust play and how can facilitators create conditions for its success?
  • Furthermore, how do we ultimately scale participation in a PM process to ultimately impact the broader system and society at large?
All of these questions recognize the difficulty of meaningfully connecting with people as a part of PM to create an impact beyond the model that is collectively produced. Differing values and perspectives of stakeholders, particularly when dealing with socio-environmental issues, are often complicated and “deeply embedded in the minds, hearts, and practices of society” [54]. This is a barrier common to PM. For example, Squires and Renn note “that the interaction between modellers and stakeholders cannot be reduced to the communication of technical data and analytical results from modellers to stakeholders” [55]. Hare recognizes that learning may be more important than supporting decision making [56]. Furthermore, Luna-Reyes et al. identified ‘cognitive boundaries’ as a challenge, while pointing out “there is no agreed-upon process for bridging these boundaries” or clarity on what or how to communicate with stakeholders past these issues [26]. These and other studies revealed how human behaviour poses substantive challenges to the sort of transformational and systemic change sought by PM practitioners [32,49].
In the following section, we take on the question of ‘how’ to address individual and collective engagement, learning, decision-making, and collaboration while recognizing that the act of bringing people together does not guarantee success [57]. The interdisciplinary collaboration sought and often practised by PM is necessary but it is not sufficient to achieve the desired outcomes. While calls for participatory and PM efforts are growing increasingly popular, without an understanding of how we use and generate the social mechanisms needed for individual and collective learning, these efforts will continue to obtain mixed results [32]. To take PM processes to the next level, we need to integrate an understanding of the human barriers and design strategies to address them in the process, drawing from other fields of study that examine how people think, learn, and behave (see Figure 1). As stated by Bakken [58], “If participants’ intuition about interrelationships and their consequences were correct, the need for outside-facilitated assistance would be limited to help surfacing issues and insights that had been hidden to the participants”. In short, the complex and interdisciplinary nature of SES problems and modelling them with value-driven and biased stakeholders requires social fluency and accounting for human barriers, as an active responsibility of PM practitioners.

3. Human Barriers in Participatory Environmental Modelling

In this review, we divide human barriers relevant to participatory environmental modelling into five categories. These barriers, often hidden and unseen, can all be present to varying degrees in any PM exercise, and they can collectively or individually prevent stakeholders from coming together to achieve `shared understanding’ through the modelling process (see Figure 2):
  • Subjectivity and biases;
  • Managing conflict;
  • Dealing with power;
  • Communicating effectively;
  • Being consistent.
To address each of the five identified barriers of PM, we will outline a series of recommendations on how PM processes may be facilitated based on principles, strategies, tactics, and insights from organizational learning, education, business, behavioural science, psychology, and other fields (see Table 1). Our recommendations highlight the role of promoting individual learning as a foundation to scale up participatory modelling towards the better management of SES.

3.1. Subjectivity and Biases

3.1.1. The Barrier

The first barrier is the inherent subjectivity and biases of human decision-making. While a simplification, scholars often describe humans as possessing two systems of thinking, one built on intuitive and quick decision making (System 1, S1), the other built on slow, conscious, ponderous, effortful thinking (System 2, S2) [59,60]. To avoid being overstimulated, our brains seek to be as efficient as possible, moving as much of our decision making as possible into System 1 to minimize our mental exertions [61]. However, this means we rely on mental shortcuts, called cognitive biases, which while efficient, can lead to less than ideal decision making. Work by behavioural researchers such as Kahneman and Tversky, Thaler, Ariely, Cialdini, and others revealed our irrational nature, and the implications it also holds for the way in which conduct science [62,63,64,65,66]. Their findings, while increasingly embraced by the scientific community, are still finding their place in the `practice’ of scientific inquiry, as it must change to acknowledge the inherent subjectivity of our biases, beliefs, heuristics, and values (BBHVs). As stated by Glynn and others (2017), “Because our decisions and actions are often innately controlled, we need to better recognize, more explicitly incorporate, and sometimes counteract, S1 thinking… [as our] innate responses and actions are therefore often not appropriate or optimal for the longer-term, larger-scale benefit of a wider community” [61]. For PM, it is possible for that exercise to promote more S2 thinking, but that takes deliberate, informed consideration tailored to the stakeholders in the room [18,38]. It is simple in concept but much more difficult in implementation.
The issue of subjectivity applies to both stakeholders and to researchers, as both contribute to the modelling process based on their personal, biased, and subjective point of view. Such a `distorted’ perspective presents a risk that people contribute based on how they believe the world should function, as opposed to how it actually functions in reality [67]. In many ways, this is the exercise of PM: to bring this multitude of different mental models together, each flawed, in the hopes of creating a collaborative ’model’ that better represents the reality of the system.

3.1.2. Some Solutions

All stakeholders, including experts and facilitators, bring with them an imperfect perception of reality, a documented challenge within the PM literature [42,61]. This presents a challenge as bringing people together also brings their differing and conflicting ‘realities’. To address this, the first step is to adopt a strategy of building awareness. Awareness of the fact these cognitive barriers exist both for our stakeholders and for ourselves as facilitators means that we can actively and deliberately design a process to counteract our flawed perceptions. Indeed, PM helps to instil this awareness by acknowledging that no one individual is likely to have a ‘perfect’ mental model of the world, but that group collaboration means we can get closer to a ‘real’ description of the system—a shared mental model. While people tend to shape their perceptions of reality to suit their purposes or perceived advantages, a product of `confirmation bias’, collective discussions in PM can (but do not guarantee) a more nuanced and balanced understanding. As organizers and facilitators, we should seek to actively avoid people hardening their views and becoming entrenched in their positions by creating awareness about the cognitive biases that everyone brings to the table.
The inevitable involvement of BBHV means that the different perspectives of individual stakeholders, including the facilitators, can distort both the PM process and its outcomes [28,29,61]. Within PM, this distortion has been recognized, and experts advise that PM practitioners clarify their assumptions about the system of study [38], consider their bias for certain methodological tools over others [42], and make clear who they have chosen to participate in the PM process and why [6]. However, more work can be done around understanding how underlying BBHV can help “explain why people think or act the way they do” and may dictate how to better manage the PM process to improve the management of SES [1,49]. For example, it may mean there needs to be a recognition of and possibly education around System 1 and System 2 thinking with stakeholders and facilitators, so that steps can be taken to promote more critical, reflective dialogue capable of creating the learning and sharing necessary for success [61]. This includes an appreciation of the differing values people bring to the table, and the awareness of how those values can shape the outcomes of the PM process [1,29,38,49,61,68,69].
Awareness can also be elicited by proper ‘framing’. Framing refers to the way a problem is presented, as drawing attention to a certain aspect of a problem or issue dictates the way we perceive a problem, and therefore ‘frames’ the actions we might take to address it [70,71]; this is based on the focus of our attention assuming importance [72]. Put another way, when we focus on something, our mind assumes that thing is important. For example, the amount of news coverage an issue receives, such as on terrorism or climate change, is linked to the perceived significance of that issue among observers [73,74]. The more coverage terrorism receives in the media, the more important viewers believe that issue to be. As a result, PM practitioners should consider what is key information to focus on in a workshop, in that it will both direct stakeholder attention and suggest its importance.
We can take advantage of the in-built framing bias by beginning our PM process by drawing awareness to the presence of cognitive biases—informing stakeholders of what they are and what they look like. For example, confirmation bias means we look for evidence that supports our pre-existing beliefs and makes us likely to discount or ignore evidence or testimony that does not align with our views. Another bias made famous by Tversky and Kahneman is prospect theory, in which we fear a loss much more than we value any gain [62]; it hurts us more to lose, creating an underlying desire to avoid risk. (For a full list of cognitive biases, see [75]). For our own personal biases, some advice directly comes from the PM literature, where some modellers advocate that facilitators make their own mental maps before sitting down with stakeholders, to become aware of their own perceptions [76]. By acknowledging the presence of distorting cognitive biases, we make ourselves and our stakeholders more likely to watch out for them. Similarly, encouraging an atmosphere of mutual respect and ‘keeping an open mind’, perhaps in setting out the rules of engagement with stakeholders or ‘principles of good practice’ (as set out by Voinov et al. 2016 or van den Belt 2004) can also achieve a similar objective: framing the PM exercise as one in which we bring ‘imperfect’ individual mental models together, even those that do not agree with each other, in order to achieve a shared understanding [38,77].

3.2. Managing Conflict

3.2.1. The Barrier

The second barrier is the inescapable and inevitable presence of conflict in group situations. As a social process, PM exposes the values and beliefs deeply held in the hearts and minds of stakeholders [54]. Stakeholders cannot separate themselves from these values and, similar to politics, entering into discussions around the allocation of resources can be contentious and potentially disastrous for the viability and success of a PM process, and for the management of SES. Researchers must both know this conflict is inevitable [17] and prepare ways to constructively manage it. This preparation is vital so that at worst, conflict does not derail the process, and at best, it can lead to productive conversations and the sharing of differing perspectives.
As humans, we are hardwired to prefer clear divisions between ‘us’ and ‘them’ [78,79] and we typically cluster around those who we believe have similar values, attitudes, and beliefs. The drawbacks of this behaviour include groupthink, which can limit creativity [80], and conflict over deeply entrenched beliefs or values [81], often presented as a ‘Simple Truth’ [82]:
A simple truth occurs when a “proponent of some view—let us call the view p—who endeavors to convince their audience to also adopt p on the basis of the claim that p is simply and obviously true. As it would be mad to reject a simple and obvious truth, the proponent uses their firm assertion that p is a simple truth as a winning argument for p... an appeal to the Simple Truth is a way of outing those who may see themselves as part of the group, but in fact are outliers. It thus sends a strong signal to those in the audience that they must accept p, or else be regarded as an outsider, or worse yet, a poser. This is why Simple Truth is often accompanied by a kind of brow-beating; the speaker affirms p as a Simple Truth, and then pauses to survey the audience for any signs of defection” [82].
Furthermore, in any PM or participatory exercise, that stark dividing presentation of the ’simple truth’ and the clear choice it implies is to be avoided. Presenting an issue as black and white both fails to recognize the complexity of the system, and tends to ‘harden’ people’s views, potentially making conflict insurmountable.
Deeply held beliefs and values play a key role here in creating conflict [61]. Conflict is not limited to values, but they are often at the heart of many, as a stable, relatively unchanging part of all people. These differing values, if left unresolved, can then create problems for the PM process [83]. Some stakeholders may value profit, others may value protecting biodiversity, and other stakeholders may seek information for further research. For example, in the study by Borkowski and Hare (2007), they note the different objectives of researchers versus water managers, leading to the creation of models by researchers that did not meet the expectations of water managers, a result of different values and priorities. Water managers “have conflicting interests to balance. They have to manage a resource properly and in accordance with legal constraints and opportunities. They have to justify decisions to superiors and the public (and perhaps to a court of law)... Water managers, generally, have limited time to invest in models: either on being ‘guided’ on their use; being involved in their development; or reapplying tools developed in their own basin” [84]. In contrast, the researchers’ primary interest is “to do research... Researchers need to produce scientific results on the focus of their work which might include lower scientific quality in areas which are not directly linked to the project’s objectives” [84]. This has played out in numerous PM exercises, where one group values practical problems to solve, and the other values a deeper understanding of the issue [40,44,55,85,86]. Sometimes those different values can be overcome in a PM exercise. What is clear is that making a process participatory to bring those differing perspectives to the table is a necessary start, but more is needed as “simply improving communication between the two will not solve the problem alone” [84].

3.2.2. Some Solutions

Awareness and framing can help us acknowledge the ‘flawed’ perceptions of reality everyone brings to the PM process; framing can also assist with our conflicting ‘values’. Conflict created by opposing values is a recognized problem within PM, and to navigate those values, people must find agreement on the value(s) of priority and then negotiate or compromise on the practicality of enacting that value [69]. Some of this may arise from negotiating the shared problem or purpose of PM, ideally at the outset of the process and occurring with stakeholders [32]. However, additional steps can be taken in the way conflicts and arguments are presented, and the selection of guiding values, such as ‘seeking the truth’ or collaboration. Drawing from political science, instead of presenting conflict as a zero-sum game, a facilitator should present an argument and the PM process, as a way of moving closer to the truth, particularly in light of everyone’s ‘flawed’ perceptions [82]. Introduce the process as a way to reason together, and, despite disagreement, seek to see opposing viewpoints as reasonable and valid [82]. In practice, this might involve a brief session on the outset on logical fallacies or what a good argument looks like; philosophy has long discussed the essential criteria for productive argument, including a well-formed structure, relevant premises that work together to support the conclusion, and a reasoned rebuttal of critiques [87].
Disagreement arising from different values is actually a valuable part of the process, as those tensions are needed to enhance shared mental models rather than entrench people in their own static views [88,89]. There is a needed balance between conflict and collaboration but the atmosphere must be one of ‘healthy argumentation’ [82]. Establishing a shared value of collaboration at the outset can help with that, so that stakeholders during the PM process, even in conflict, can view one another as “striving to find the truth, respond to evidence, and track the best reasons”, which makes it difficult to write people off as ‘other’ [78,82]. Fortunately, PM offers a way to bring people together to jointly and collaboratively produce information, in the form of a scientific model, as a proven way to negotiate values and differing stances [57].
While many of the papers written about PM fail to evaluate or suggest how the conflict of opposing or incompatible values might be navigated in practice, Morisette et al. (2017) laid out several useful practices including the “definition of a shared problem space, “what if” thinking, reconciling evidence, and developing common mental models”. Particularly useful in creating a healthy argumentative space, Morisette and others (2017) discussed “psychological safety” in the context of PM, originally a term and concept from organizational learning and psychology [90]. Psychological safety describes the “perceptions of the consequences of taking interpersonal risks in a particular context”, such as a workplace or a PM exercise; if present, psychological safety “facilitates the willing contribution of ideas and actions to a shared enterprise” such as sharing ideas, coming up with suggestions, or taking creative initiative [91]. Psychological safety recognizes that conflict in a shared space is unavoidable. However, if learning and innovation are paramount, people must feel secure in sharing their views and take interpersonal risks without judgment [91]. Daniel Kahneman, Nobel Prize winner and one of the visionaries of behavioural economics, used to famously ask their classrooms to not point out the errors of their peers’ arguments. Instead of asking themselves, ‘is that true?’, he posed a different question: “What might that be true of?” [92]. That question and that perspective encourages curiosity and empathy. Furthermore, it builds the trust needed for people in the room to be vulnerable and share their perspective, thereby building psychological safety and enriching the process.
Trust is paramount to the process. Some trust can come from the transparency of the modelling tool, and the ease with which stakeholders can learn and use it [93]. However, building trust also involves listening, showing concern for opposing positions and perspectives, emotional vulnerability, and respect [89]. Furthermore, it is the job of those leading the PM process to facilitate that process. The facilitator can accomplish that through active listening, a strategy employed by both counselling and negotiators to ensure people feel heard [94,95]. Active listening includes skills that can be picked up and practised quite quickly, although they take practice and time to master: mirroring involves repeating the last few words of someone else’s statement, to show attentiveness and elicit further explanation; paraphrasing involves restating in one’s own words, to try and take their perspective, which is sometimes combined with emotional labelling (e.g., “it sounds like you are frustrated” or “it seems like you feel powerless”); together, these and other skills can lessen the emotionality of an atmosphere and reduce the ‘heat’ of a conflict by naming the emotions at play, and demonstrate a genuine intent to understand other perspectives [95].
Role play is another tactic available to us, as this helps stakeholders to develop empathy for positions different to their own. The ability to consider a perspective that we have not lived is a defining human characteristic, and anthropologists have theorized that this provides an evolutionary advantage as our ancestors were able to learn from the experience of others (seeing a lion) without necessarily having to endure the danger (being eaten). Encouraging stakeholders, particularly those in conflict, to take up and defend the opposing position can help them appreciate why someone might hold that view.
This has been used in business and counselling settings and mirrors Rapaport’s Rules (a social psychologist and game theorist) for good debate and argument:
  • “You should attempt to re-express your target’s position so clearly, vividly, and fairly that your target says, “Thanks, I wish I’d thought of putting it that way”;
  • You should list any points of agreement (especially if they are not matters of general or widespread agreement);
  • You should mention anything you have learned from your target;
  • Only then are you permitted to say so much as a word of rebuttal or criticism” [96].
Managing the subjective nature of humanity requires the skilful and deliberate management of conflict, as we seek to prevent people becoming hardened in their views, staunchly defending their positions with little room to budge. Thus, the tools offered to navigate conflict first involve awareness of those biases and the presence of conflict, but present them as opportunities for learning. One of the things we can do is to build empathy in our individuals for alternative or even opposing positions by creating an atmosphere of safety and trust and engaging in active listening throughout the process. It can also include additional strategies such as role play, where we are forced to take the position of an adversary and ponder why they might hold that position [57], however, at its core, managing conflict is first understanding that it is not inherently bad, and in fact is an important part of the learning process [97]. Furthermore, second, we can move towards the ‘shared understanding’ so key to the success of PM by creating an atmosphere in which people can share their perspectives without judgment and learn to understand and appreciate the views of others.

3.3. Dealing with Power

3.3.1. The Barrier

Conflict is also entrenched with our third barrier: debates about power. Stakeholders not only bring with them their values, culture, and social norms, but also their existing social hierarchies and power structures [17,29,33,40,98]. Unbalanced and unchecked power relations—or power asymmetries—in the PM process means powerful stakeholders could hijack the model or the process to serve their interests [29]. Not including powerful stakeholders means the process could lack credibility. Excluding disadvantaged groups would only further entrench existing power dynamics [33]. As such, efforts should be put into deciding who is involved in the process, and by extension, who is not included, as the power and institutional context in which PM occurs may very well determine the ultimate success or failure of the effort [93].

3.3.2. Some Solutions

Power and hierarchy may be difficult to manage within a PM exercise. It is possible that the history, culture, and conflict of a region is simply too great to overcome with a participatory model, despite all of the best planning. Some of this can be addressed by who we invite to the exercise, a balancing act between involving key voices capable of advocating for and enacting change versus not letting certain interests overtake and manipulate the process for personal gain. Unbalanced and unchecked power relations in the PM process means powerful stakeholders could hijack the model to serve their interests [29]. At the same time, the absence of powerful stakeholders from the process means any efforts would lack credibility and legitimacy among the participants while the exclusion of disadvantaged groups would only further entrench existing power dynamics [33]. The PM process cannot escape the constraints of the “social contexts in which individuals are embedded” [6,99,100]. As such, extensive work should be put into deciding who is involved in the process, and by extension, who is not included, as the power and institutional context in which PM occurs may very well determine the ultimate success or failure of the effort.
The importance of stakeholder selection has been written about in the PM community [42,70,101,102]. A number of PM processes have implemented social network mapping/analysis at the outset of the process to ensure proactive and deliberate stakeholder selection and to account for power dynamics and social hierarchies [103,104]. Social network analysis maps relationships between stakeholders (individuals or organizations) to identify who may be the most powerful, who may be marginalized, or where groups have formed with regard to the issue at stake [42,100,103,105]. This can be achieved among experts before beginning the PM process, or with stakeholders as another form of a participatory model and to identify important links and actors in the social sphere for the issue at stake [42,106]. For a full discussion of stakeholder selection and other tools available (such as focus groups), see [107].
Another tool to assist in considerations of power and hierarchy are critical questions seeking to bring to the awareness of experts and/or stakeholders the assumptions and relationships they bring with them into the PM process. Ullrich and Reynolds (2011), from critical systems heuristics, and Mingers (2000), looking at soft systems methodology and questions from operational research, have both devised questions to assist with this task [108,109]. These questions include:
  • Do my experience and skill suggest certain methods? Are those methods best suited for this situation? Have other methods been considered?
  • What is my personality or cognitive style comfortable with?
  • What is the history here? What methods have worked or not worked?
  • What and who am I committed to in this situation?
  • What resources do I have at my disposal?
  • Do I need to learn more before entering this situation?
  • What is the purpose of the system? What should be the purpose?
  • Who benefits from the system right now? Who should benefit?
  • What is the measure of success in the system right now? What should it be?
  • Who controls the success of the system? Should that change?
  • Where is there space for stakeholders to reconcile different perspectives on the system and situation at hand?
These critical questions [108,109] make us aware of our own pre-existing views and assumptions before beginning a PM exercise, and can also be used in questioning stakeholders to help them reconsider their own environment and hierarchies.
While much of this barrier of power may be beyond our control [93], we can still take an active role in the design of the PM process to mitigate, or at least reduce, the influence of power and hierarchy. As mentioned, the first step is making careful decisions around who is involved in the process. The second is coming to an agreed upon purpose with the invited stakeholders, achieving consensus on the ‘why’ of the PM exercise. During the actual exercise, group guidelines concerning how the process will be managed ought to be created, agreeing upon rules in the beginning about who will speak, for how long, and what the values guiding the process might be. A key concept for addressing power (including that of the facilitators over the process) is the transparency of the process. Being clear about what decisions are being made and why so that everyone shares in that knowledge and can protest it if they like. As facilitators of PM, awareness of this power dynamic and the power concentrated in the facilitator’s hand can play a key role in the success or failure of the group. Deciding who can participate, how people can participate, and what will be done with the outcomes can all lie within the facilitator’s discretion. While there is no one-size-fits-all, being clear about what those decisions are, why they were made that way, and how those decisions align with the ultimate goal of the PM exercise can all be helpful taking a more active role in productively managing power.
This also means leaving a space for reasonable protest. Not everyone can agree, so creating a strategy for managing conflict also stands to benefit the process by giving any opposition a voice, increasing the legitimacy of the process, and potentially preventing the distortion created by groupthink. The military developed a strategy to assist with this effort, called `Red Team’. Software developers and cybersecurity have also adopted it [110]. Creating a ‘Red Team’ means appointing a person or a team whose job may include “challenging facts and explicit assumptions, looking for implicit (unstated) assumptions, identifying cultural assumptions and developing targeted cultural questions for subject matter experts, challenging the problem frame (and proposing alternative frames), identifying cognitive biases and symptoms of underlying groupthink” and others [111]. By giving select stakeholders a role to seek out flawed arguments, particularly in the light of promoting an atmosphere of ‘healthy conflict’, we can bring awareness to the distortions in our thinking patterns, and find a way to constructively and collaboratively challenge power, whether that is of the group or an individual [112].
While the issue of power dynamics is always present in any participatory or social setting, caution needs to be exercised particularly when dealing with marginalized groups and interests [106]. Considering who stands to gain and who stands to lose (and some may be more sensitive to or damaged by losses than others) is good practice. Aside from the consideration and transparency that must be adopted as a part of the process, another tactic may be to have members of the marginalized group meet separately beforehand to discuss their interests and opinions, allowing them to build confidence in their communication and to identify potential shortfalls before proceeding to a larger PM workshop [70,113]. However, merely bringing marginalized stakeholders together is not enough, on its own, to overcome deeply entrenched power dynamics. If deliberate action is not taken to account for those social hierarchies, and to empower viewpoints and insights from these marginalized groups across major power and conflict structures, learning and transformation can stagnate [6,10,22,114]. For addressing power in particular, tactics and strategies such as those listed here can help, but a more holistic (and patient) approach is required for systemic and enduring change in the system of interest.

3.4. Communicating Effectively

3.4.1. The Barrier

Given the barriers above—subjectivity and biases, conflict, and power—how can PM practitioners address them with stakeholders? How can communication, before, during, and after the PM exercise help create ‘shared understanding’ and encourage action to be taken?
PM practitioners are not necessarily trained in the skills of effective communication, particularly in facilitation and managing a room of stakeholders (that are often in conflict). In PM, the relationships with and between stakeholders matter a great deal [28]. Effectively navigating these relationships includes practising communication skills such as metacognition, transparency, and conflict management. The degree to which communication directed by the practitioner can successfully manage and improve these social relationships determines a great deal of efficiency and success in the PM process [17,28].
While conflict is inevitable, navigating conflict during PM requires skilled facilitation which is not a guarantee for all PM practitioners [52]. Experts can often assume that subject knowledge in the system of interest is sufficient to guarantee a smooth, productive process (it is not). PM practitioners can also be completely unaware of how their own cognitive blind spots and biases can contribute to communication difficulties: polarizing debate, promoting existing power hierarchies, seeking evidence to confirm pre-existing beliefs, and others [61]. Through bias, or through a lack of skill, if practitioners are not careful, we can skew the PM process before it even begins, carrying our own distortions in what we say and what we do as we interact with others in the PM room.

3.4.2. Some Solutions

In many ways, all of the strategies we discussed are strategies of communication, but two particularly powerful ideas are dialogue and reflection. By dialogue, we draw from learning theory to mean “a sustained collective inquiry into the processes, assumptions, and certainties that compose everyday experiences” [115]. This is a deeper conversation between stakeholders, and it is essential. The spirit we seek is that of the college seminar, where all are free to exchange ideas, constructively challenge, and encourage creativity in a collegial spirit for the purpose of improving the group’s ideas [9]. It is not adversarial. The job of the facilitator is to create a space where this dialogue can happen, where views can be shared without fear of judgment or reprisal. Perhaps easier said than done, but if this is the spirit in which PM is engaged, benefits will follow.
An attitude of humility is key here. Despite the democratic spirit underlying participatory modelling, it is sometimes difficult, as experts or leaders, to remove ourselves from the certainty of our expertise. As facilitators, we should avoid assuming we have all the answers as ‘experts’, as one of the main reasons to engage in PM is to learn from the lived experience and intimate knowledge of stakeholders and to engage them in a collaborative process. While we may have scholarly knowledge, information alone will not unlock better behaviours. Believing that our stakeholders or ourselves are of the rational genus, homo economicus, has been shown time and time again to be a myth, in keeping with our first barrier [116]. Deeper work is required, and communication is crucial to unlocking those deeper levels.
The ability to question the positions of others and have your own viewpoint questioned can generate learning [88,89]. Furthermore, it is indeed dialogue, and the respect it implies, that can be used to resolve conflicts brought up in the ‘encounter’ and support the collegial learning atmosphere through social interactions in the pursuit of shared meaning [10]. Dialogue builds on the concepts we discussed: trust, empathy, psychological safety. It is not based on “winning arguments; it centrally involves finding agreement, welcoming difference, “trying on” other points of view, identifying the common in the contradictory, tolerating the anxiety implicit in paradox, searching for synthesis, and reframing” [9]. With dialogue as the focus, a PM exercise becomes less about filling people with information, as this has been shown not to drive behaviour change [116,117]. Instead, dialogue can be used to encourage the sharing, learning, and teaching of metacognitive skills such as critical thinking [118].
Similar to an attitude of humility, stakeholders (and this includes the practitioners directing the exercise) who learn metacognitive skills, to think about their own thinking and question their own assumptions are better prepared to face the complexity and uncertainty posed by the management of SES, and the modelling aspect of PM can reveal flaws in their assumptions or worldview. Ways to promote metacognition, specifically critical thinking, include but are not limited to an introduction to the concepts of double and triple loop learning [11,119,120], the questions asked by the facilitator (ex; Could you elaborate on that? Could you give an example? Do we need to look at this in other ways? (for a full list of questions, see Paul and Elder [121])), the promotion of tactics such as Rapaport’s rules and active listening [94,95,96], and the practice of reflection as a key exercise during and after the PM process.
Reflection means we are encouraging people to evaluate their own beliefs and assumptions, and giving them the space to do so. To internalize the learning, stakeholders, including PM practitioners, should be given space to consider what might have changed about their mental models, or where their worldviews might need updating [122]. Some of this is built into the PM process. The modelling process and interactions with other stakeholders and the facilitator provides feedback on an individual’s mental model, reflection is key to then “diagnosing what matters, designing what could be, doing what we can and then developing a deeper understanding from reflecting on and evaluating that practical experience” [10]. Reflection builds on the awareness of assumptions we create, but it is a vital step towards the end of the process for people to consider how their worldview fits or does not fit with what has been explored by the group, and perhaps with what has been captured by the built model [89]. The built model and or computer simulation provides explicit feedback on the suitability of someone’s mental model, and providing a space for reflections means those same models become vehicles for the transformation of mental models, of moving through the slow, logical, rational space of System 2 thinking [18].
A number of theories suggest that this reflection is where true learning happens, that when people are confronted by something that does not align with their worldview, they must then have the space to reflect and consider, so that their mental model can be updated (and hopefully improved) by what they have learned [123]. Key to this reflection is the role of feedback, at various levels [10]. That feedback comes in the form of information, whether that was sourced from a question from a facilitator, a viewpoint shared by a peer, or an unexpected statistic. Feedback shows what went wrong and why, and it is that mistake that allows for learning to happen, for neurons to fire, for the grooves to deepen in the mind [124].
One of the ways to internalize feedback is to create a mechanism, in collaboration with stakeholders, by which feedback can be provided, such as goals. In short, facilitators can and should guide the participants to choose their own feedback through a goal-setting process. However, goals are only made meaningful if it is the participants who choose them from the outset. That way, success or failure is dictated by the measurement created and owned by the people in the room. Setting out a measure or goal at the outset provides a benchmark to indicate whether or not success was achieved, providing clarity on what the group is working towards and how it is going to get there. This should be done at the beginning of the process and should occur for both the group, perhaps as part of the collective rule-setting, and for individuals, so that they can internalize and own their personal stake in the process.
Goal Framing Theory provides a template for the types of goals to create, as those in the environmental field are often more focused on the abstract ‘normative’ goals of sustainability, where it is difficult to know what the ‘right’ or ‘best’ thing to do might be [71]. To turn these into more concrete actions, and therefore more likely to be followed, we should link abstract concepts, such as sustainability, into a specific behaviour, such as recycling all glass and aluminium [71]. Using goal setting at the outset of the exercise, to have stakeholders create their own internal mechanisms provides a way for stakeholders to receive feedback (and therefore increase the chances of learning) and for them to buy into the process [71].
These goals provide a relevant form of feedback and more importantly, provide a source of reflection for the group and for individual participants [125,126]. What went well? What went wrong? Furthermore, why did that occur? The ‘why’ provides the key to reflection, encouraging participants to dig into the reasons behind something occurring, which is where feedback can occur and lessons can be learned and internalized [11,124,127]. The key is to make this feedback either neutral (from the facilitator’s perspective, any sort of ‘grading’ is to be avoided) [128] or internally driven by the stakeholders, who can do so by setting out their own personal goals at the beginning.
One way to promote reflection and to encourage an open mind from the outset is a practice known as ‘Memento Mori’. Memento Mori dates back to ancient stoicism, and literally translates as a ‘meditation on death’. The exercise is designed to consider one’s mortality and inevitable demise as a way to clarify one’s values, one’s purpose, and what is truly important. Variations of this have been used in educational settings, and include writing one’s own eulogy, visiting a graveyard, and the thought exercise of only being given five years to live. The purpose of such a morbid exercise is to create ‘unfreezing’ in stakeholders; to present a shocking scenario to force people to reconsider their daily lives and habits, to step outside of their routine and consider what a new and better path forward might look like [123,127]. It also does not have to be death: it could be a major fire or the sickness of a family member. Done properly, these grim hypotheticals seek to mirror the role of crisis in asking the question of everyday procedures and creating a window of opportunity for change [123,127,129,130]. Furthermore, it has been used in PM as part of a scenario analysis, in which practitioners gave participants extreme scenarios, such as drought or a pest infestation, designed to ‘shock’ participants with decisions and situations that could plausibly occur in real life, increasing their engagement and opening them up to learning [131,132]. However, this extreme scenario (death or otherwise) is not widely used, and it could be us as a tactic—particularly at the beginning of a PM exercise—to encourage the type of reflection needed to internalize learning.
Regardless of how it occurs, reflection is a necessary part of the learning process [9,133]. This reflection can be personal, through goal setting, or it can occur at a community level, creating a common vision, setting priorities, and then evaluating how that process has been achieved [10]. It is the job of the facilitator to consider these various levels of reflection and provide a path forward for stakeholders to receive feedback, internally and externally, so as to achieve the transformation of mental models sought by the PM process [45,134].

3.5. Being Consistent

3.5.1. The Barrier

Finally, consistency refers to the practices and standards used to successfully facilitate PM. Practitioners seek consistency in the hopes that a well-documented, systematic, and organized process can be replicated and applied to other cases, to make comparisons, to evaluate, to learn, and to ultimately improve the PM process. Usually, this is seen as a barrier of methodology or technology, as there is a recognized lack of standardization and/or best practices to “facilitate PM processes in a fair, transparent, and scientifically sound manner” [17]. There is a noted lack of “conceptual, procedural, and technological designs…for effective stakeholder participation, enhanced public understanding of socio-environmental dynamics, and clearer recognition of how such understanding connects to environmental and social improvements” [48]. However, we consider consistency to also be a human barrier because no two stakeholder groups are the same, meaning that every PM exercise is unique, and yet we still seek to learn from each exercise so as to improve and apply the lessons learned to our next PM process. ROE does provide a starting point for the PM process and its findings to be tracked (and therefore improved upon), and it should answer the larger question of how does this process and model outcomes apply to other cases with different stakeholders.
This is the question of specificity versus applicability [17]. One of the disadvantages of PM is that it involves a large investment of time and resources. It is a waste if the knowledge gained though one PM process is limited to only the issue and stakeholders involved, if there is no transfer value for other PM processes, and in turn if there is no learning incorporated from the other, previous PM processes.
Each PM process may necessitate something ranging between specificity and applicability. An ideal PM possesses enough specificity to cater to the unique situation of the participants and the system in focus, while remaining general enough to apply lessons learned to other, similar scenarios in the hopes of addressing broader challenges. Thus, the challenge of consistency means we seek to make PM systematic, repeatable, and transferable, which is difficult to achieve with the uniqueness of each PM application and the diversity of stakeholders [42].

3.5.2. Some Solutions

Finally, consistency is perhaps the hardest challenge, as people are unique, situations are unique, and no PM process is likely to be the same. Even if we follow the exact same steps or work with the same group of stakeholders, that is unlikely to guarantee the same outcomes. However, we can be consistent in the principles we use to guide a PM process and to guide our communication with stakeholders. The ones we offer here provide one way to consider this process and the implications it holds for the way we act before, during, and after PM.
A recognized way to encourage consistency within the field is through records or evaluation. There have been numerous calls for a “Record of Engagement” (ROE) within PM to both standardize the design and reporting of any PM exercise [83,135], particularly among those who recognize the role of learning as a part of the process, and the need to account for it in order to fully appreciate and evaluate any PM process [38,48,83,135,136]. Glynn et al. (2018) explicitly mentioned accounting for beliefs, biases, heuristics, and values, but do not explicitly mention a framework to capture those unavoidable elements of working with people [83]. However, Cockerill and colleagues, in their follow up, take “further steps to explicitly include documenting biases, values, beliefs and emotions into the historical record” by laying out prompts for the content and the rationale for decisions made during PM, including specific questions on the `affective atmosphere’ and the `emotional/cognitive state of participants’ [135].
One promising development in this regard of `affective atmosphere’ and the `emotional/cognitive’ state of participants is the Rich Elicitation Approach of LaMere et al. (2020), which proposes to use the direct building of mental and conceptual models with stakeholders (i.e., What are the system’s components and it’s relations?) and indirect methods which involve coding transcripts of conversations with stakeholders to see what variables and relationships may be `hidden’ in the text [45,135]. Clear documentation of this coding and its impact on any subsequent model would be paramount, in keeping with good qualitative coding practice [137]. Where further developments could be added is in using that same `indirect’ documentation with methods such as those used by Radinsky and colleagues (2017), where they visually represent interactions between stakeholders during a PM exercise, including a representation over time of topics discussed and `mapping’ who spoke to who during a particular workshop by Moallemi et al. (2020) [51,138]. While not yet a widespread practice, PM researchers have begun to develop a number of methods that seem capable of creating a more consistent measure of both process and outcome in a PM exercise.
In addition to these developments within PM, researchers can also draw from practices based in psychology to better measure a change in stakeholder behaviours and mindsets over the course of PM. Smajgl and Ward (2015) and their challenge and reconstruct learning framework [139] draw from the Theory of Planned Behavior and use psychometric testing—both pre- and post-workshop—to measure a change in systems thinking, while as mentioned, LaMere and colleagues (2020) also examined explicit and implicit discussions from stakeholders to devise their models, in recognition of distorting biases that may keep stakeholders from recognizing the gap between what they say versus what they think [45]. Both approaches offer a way to learn, measure, and account for biases, and could be supplemented by additional psychometric scales to measure concepts of interest, such as systems intelligence, psychological needs, or autonomy (based on Self-Determination Theory), or a measure of their values, beliefs, and norms [140,141]. Pre- and post-testing through questionnaires does not tell the whole story of an exercise, but it can supplement and support findings.
Additional methods from psychology include those drawing from personal construct theory [142] to draw out further explanation and insight from participants and to prevent a `misalignment’ from what is physically represented on a model versus what understanding exists in stakeholder’s minds. Those tactics include a Salmon Line, Pictor, and the Role Repertory Test as a way to “provide in-depth insight into personal experience, to establish a ‘democratic’ relationship between the researcher and participants, and to represent the participant’s ‘voice’” all of which benefit the relationship between PM practitioners and stakeholders, and improve the PM process (methods further described in [143]).
On consistency, it is equally, possibly even more important to track the behaviour and consistency of the facilitator across PM exercise as this may be one of few constants across unique PM contexts and stakeholders. While a body of work that deserves its own paper entirely, researchers in the broad fields of qualitative research and social science have been wrestling with these questions of specificity versus applicability for decades, with many concluding that while there is no one-size-fits-all solution, transparency and tracking in what decisions the researcher is making, the justification for those decisions, and the impacts of those decisions is widely recognized as an excellent start [144,145,146,147]. We identified a few tactics here that may be of use, both within and outside the PM field, but there are undoubtedly more available to researchers. Regardless of the source of insights, what is clear is that bringing our categorization of human barriers into these developed processes for PM can encourage an explicit accounting of people’s irrational behaviours, at every stage of the process.

3.6. The Importance of Transdisciplinary Insights

The bottom line is that the mere presence of humans (both as researchers and as participants) presents certain barriers to implementing successful PM processes. First and foremost, it is the nature of humans to be irrational and biased, bringing perspectives and values to the PM process that can distort ‘reality’ to suit their purposes and potentially limit the effectiveness of the process. While PM has yet to fully and systematically integrate this understanding of our own irrationality (although there are efforts underway, see [61]), there is increasing recognition that these things must be accounted for and managed as a part of any scientific effort involving people. Then, the subjectivity of people creates conflict, as tightly held values are inseparable from the process, and it may be difficult to separate people from those values and from the institutional, cultural, and power hierarchies they belong to. Ensuring the process recognizes entrenched forms of power and creating a space where conflict can be managed is essential to ensuring a productive PM process. Choosing communication strategies to address these barriers is no small task as PM must be able to effectively capture the complexity of social-ecological systems, visualize the problem to promote understanding, encourage learning, manage BBHV, and ultimately empower individual stakeholders to have a collective and systemic impact. It is then crucial to make these design and facilitation choices in a way that supports consistency in facilitation across PM exercises, both so cases can be compared, and so findings can be applied with other stakeholders elsewhere so all involved in PM may continue to learn from each other. The five barriers we identified here recognize that humans have some common cognitive and behavioural traits. Other fields of study, such as education, behavioural economics, neuroscience, and psychology, among others, present solutions on how to deal with these barriers, and drawing from them may present one way to consider the design of any PM exercise in such a systematic and principled way.
Participatory modelling stands to gain from a systematic incorporation of the science on how to overcome the five identified barriers throughout a stakeholder engagement process, leading us to the fields of social learning, behavioural economics, and others, who have made a study of understanding the way people think, act, learn, and adapt, as individuals and as groups [38]. By drawing from these fields, PM can develop more meaningful, targeted and deliberate strategies of communication designed to account for how to transform the mental models of stakeholders, thus improving the likelihood of an effective process leading to shared understanding and ultimately, positive change in a given SES (see Figure 3).

4. Going Forward

PM is an established field that already delivers benefits to practitioners and stakeholders, and is already seeking to address the big questions around how to better manage SES. Despite several decades in the field, PM is still growing, still learning, and still changing. More PM practitioners and experts are recognizing the role of people and the need to account for their values, beliefs, and worldviews [18,38,69,83,148]. The conceptualization of transforming ‘mental models’ as a crucial part of the PM process is promising, and what we have offered here, as an exploration and a call to arms, are better techniques, drawn from other disciplines, to draw out those mental models from stakeholders and to steer them towards the transformation needed in accordance with the key principles of SES management [15,69,89].
By no means are the ‘human’ barriers we presented here exhaustive. Nor should the fields of inquiry be limited to those we have named. However, as science delves deeper into our human ‘irrationality’ (see, for example Stanovich 2013 [149]), we deepen our understanding of how people think, learn, and behave as people. Those lessons, regardless of their field of origin, should be incorporated into PM as a way to increase our chances of transforming individual mental models, collective understanding, and the ways we manage our SES. The practices and examples we have laid out here are a start, and this paper and others present a strong case for the continued pursuit of a deliberate and purposeful PM process truly designed for the people at the centre of the process in all of their wondrous flaws.
Although we separated and categorized these barriers, they, like people, cannot so simply be boxed up in a black and white fashion in reality. These barriers blur into one another, and each is co-dependent on the other. However, while the categorization we present here may not reflect the messiness of reality, it can still be useful to our PM practitioners. We offer these categorizations in the spirit of seeking to synthesize the barriers of working with humans as a part of PM, as that has yet to be comprehensively drawn together in the PM literature, and to serve as a call to arms for others to utilize a transdisciplinary approach to solving the problems presented by people. Through the transdisciplinary approach we demonstrate, we describe a number of practical tools, and we hope others both find these useful and seek to add to such a list by finding more tools that exist out there.
We believe the following key areas should be explored in future research:
  • Experimental research should seek to ’test’ the efficiency and effectiveness of the solutions we presented above, both in their ability to impact stakeholder learning and in assessing the trade-offs in the time, resources, and expertise needed to successfully implement them. The challenge of assessing such impacts should not be understated, as isolating variables in social science, particularly with smaller sample sizes common in PM efforts, is difficult. However, starting from results from other fields, as done herein, and implementing their experimental methods (the work of Cialdini and colleagues is a great example) is one area that should be explored further [63,66,150].
  • Collaborative efforts with experts from multiple disciplines should continue and expand in pursuit of transdisciplinary solutions to promote stakeholder learning and SES change. While bringing experts and researchers from various disciplines does not guarantee success (and often creates its own headaches), the potential for truly innovative and discipline-spanning solutions is immense. Combining expertise and knowledge from psychology, neuroscience, education, action researchers, negotiation, behavioural economics, and other fields creates the possibility for solutions to emerge that are so much greater than the sum of its parts.
  • Stakeholder values, beliefs, and biases shape their worldview and therefore their actions. Cognitive biases tell all of us something about the world is `true’ when reality may say differently. Acknowledging the role that these cognitive biases play and more explicitly incorporating strategies to bring awareness to them and limit their impact can and should be an accepted part of PM facilitation and practice. Research that focuses on addressing a specific bias, say confirmation bias, and exploring how that can be qualitatively and quantitatively limited is a promising area for the future.
  • Various authors have called for recording the results of participatory modelling exercises as a way to both learn from past experiences and improve the practice going forward [48,83,135,136]. Work by [151,152] also provided promising developments in PM, investigating the PM process as a series of decision pathways that are influenced by the people involved in the process. Together, the authors advocate for a reflective approach to documentation and decision making and the need to consider alternative pathways during the modelling process to reach the best outcomes. The authors also note the influence of the “human factors” on extending beyond PM to management actions, and propose practices such as reflection, de-biasing, red team, and the necessity of documentation as part of diagramming decision pathways of PM that can complement the building of the model [151,152]. Regardless of whether it is a 4P Framework, Records of Engagement, the Protocol of Canberra, or a new format, the PM community should seek to move towards the increasing standardization of documentation of the process, as has been done with agent-based modelling and the ODD framework [48,83,135,136,153]. Total consensus is unlikely, but there is still value in moving towards a more widely used evaluation framework. There are outstanding questions about the format, understandably, but we hope that the outstanding issues we presented thus far demonstrate the importance of considering the ‘people’ at the centre of the process and the necessity for deliberate and proactive planning on the ‘how’ of their learning as a result.
To address problems of SES, we need solutions that recognize the complexity and uncertainty of the world we live in. We need transdisciplinary, systemic, adaptive, and participatory approaches. We need to understand how central individual and social learning are to the necessary transformation. PM offers a promising way to address that, but it also has much to learn from the fields devoted to understanding how people think, learn, behave, and decide. We hope that others take up this call to arms and further explore the areas we have shown herein, and to reach out to other areas we have not named.

Author Contributions

Conceptualization, D.C.K. and J.C.-R.; methodology, D.C.K.; investigation, D.C.K.; writing—original draft preparation, D.C.K.; writing—review and editing, D.C.K. and J.C.-R.; visualization, J.C.-R.; supervision, J.C.-R. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The Australian Research Council (ARC) Discovery Project grant number DP190101584.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We acknowledge The Mulloon Institute, Chilean Department of Primary Industries (CORFO), Chilean Directorate of Water (DGA), and the Natural Resources Access Regulator (NRAR) in Australia, who provided the institutional support and testing of participatory modelling methods with relevant stakeholders and divisions which inspired this review.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ives, C.D.; Kendal, D. The role of social values in the management of ecological systems. J. Environ. Manag. 2014, 144, 67–72. [Google Scholar] [CrossRef] [PubMed]
  2. Folke, C. Resilience: The emergence of a perspective for social—Ecological systems analyses. Glob. Environ. Change 2006, 16, 253–267. [Google Scholar] [CrossRef]
  3. Folke, C.; Carpenter, S.; Walker, B.; Scheffer, M.; Chapin, T.; Rockström, J. Resilience Thinking: Integrating Resilience, Adaptability and Transformability. Ecol. Soc. 2010, 15, 1–9. [Google Scholar] [CrossRef]
  4. Norton, B.G. The Ways of Wickedness: Analyzing Messiness with Messy Tools. J. Agric. Environ. Ethics 2012, 25, 447–465. [Google Scholar] [CrossRef]
  5. Xiang, W.N. Working with wicked problems in socio-ecological systems: Awareness, acceptance, and adaptation. Landsc. Urban Plan. 2013, 110, 1–4. [Google Scholar] [CrossRef]
  6. Reed, M.S.; Evely, A.C.; Cundill, G.; Fazey, I.; Glass, J.; Laing, A.; Newig, J.; Parrish, B.; Prell, C.; Raymond, C.; et al. What is social learning? Ecol. Soc. 2010, 15, 1–10. [Google Scholar] [CrossRef]
  7. Norton, M.I.; Mochon, D.; Ariely, D. The IKEA effect: When labor leads to love. J. Consum. Psychol. 2012, 22, 453–460. [Google Scholar] [CrossRef]
  8. Meadows, D. Leverage Points: Places to Intervene in a System; Technical report; Sustainability Institute: Hartland, VT, USA, 1999. [Google Scholar]
  9. Mezirow, J. Learning to Think Like an Adult: Core Concepts of Transformation Theory. In Learning as Transformation. Critical Perspectives on a Theory in Progress; Mezirow, J., Ed.; Jossey-Bass: San Francisco, CA, USA, 2000; pp. 3–33. [Google Scholar]
  10. Keen, M.; Brown, V.A.; Dyball, R. Social Learning in Environmental Management: Towards a Sustainable Future; Routledge: London, UK, 2005. [Google Scholar]
  11. Argyris, C.; Schön, D.A. Organizational Learning: A Theory of Action Perspective; Addison-Wesley Publishing Company: Boston, MA, USA, 1978. [Google Scholar]
  12. Levin, S.A. Complex Adaptive Systems: Exploring the known, the unknown, and the unknowable. Bull. Am. Math. Soc. 2002, 40, 3–19. [Google Scholar] [CrossRef] [Green Version]
  13. Chi, M.T.H. Three Types of Conceptual Change: Belief Revision, Mental Model Transformation, and Categorical Shift. In Handbook of Research on Conceptual Change; Vosniadou, S., Ed.; Erlbaum: Hillsdale, NJ, USA, 2008; pp. 61–82. [Google Scholar]
  14. Henly-Shepard, S.; Gray, S.A.; Cox, L.J. The use of participatory modeling to promote social learning and facilitate community disaster planning. Environ. Sci. Policy 2015, 45, 109–122. [Google Scholar] [CrossRef]
  15. Jones, N.A.; Ross, H.; Lynam, T.; Perez, P.; Leitch, A. Mental Models: An Interdisciplinary Synthesis of Theory and Methods. Ecol. Soc. 2011, 16, 46. [Google Scholar] [CrossRef]
  16. Walters, C.J.; Holling, C.S. Large-scale management experiments and learning by doing. Ecology 1990, 71, 2060–2068. [Google Scholar] [CrossRef]
  17. Jordan, R.; Gray, S.; Zellner, M.; Glynn, P.D.; Voinov, A.; Hedelin, B.; Sterling, E.J.; Leong, K.; Olabisi, L.S.; Hubacek, K.; et al. Twelve Questions for the Participatory Modeling Community. Earth’s Future 2018, 6, 1046–1057. [Google Scholar] [CrossRef]
  18. Van Bruggen, A.; Nikolic, I.; Kwakkel, J. Modeling with stakeholders for transformative change. Sustainability 2019, 11, 825. [Google Scholar] [CrossRef] [Green Version]
  19. Siebenhüner, B.; Rodela, R.; Ecker, F. Social learning research in ecological economics: A survey. Environ. Sci. Policy 2016, 55, 116–126. [Google Scholar] [CrossRef]
  20. Rodela, R. Social learning, natural resource management, and participatory activities: A reflection on construct development and testing. NJAS—Wagening. J. Life Sci. 2014, 69, 15–22. [Google Scholar]
  21. Rist, S.; Chidambaranathan, M.; Escobar, C.; Wiesmann, U.; Zimmermann, A. Moving from sustainable management to sustainable governance of natural resources: The role of social learning processes in rural India, Bolivia and Mali. J. Rural. Stud. 2007, 23, 23–37. [Google Scholar] [CrossRef]
  22. Cundill, G.; Cumming, G.S.; Biggs, D.; Fabricius, C. Soft Systems Thinking and Social Learning for Adaptive Management. Conserv. Biol. 2011, 26, 13–20. [Google Scholar] [CrossRef]
  23. Conklin, E.J. Dialogue Mapping: Building Shared Understanding of Wicked Problems; Wiley: Chichester, UK; Hoboken, NJ, USA, 2006. [Google Scholar]
  24. Van den Belt, M.; Schiele, H.; Forgie, V. Integrated freshwater solutions—A New Zealand application of mediated modeling. JAWRA J. Am. Water Resour. Assoc. 2013, 49, 669–680. [Google Scholar] [CrossRef]
  25. Black, L.J. Collaborating Across Boundaries: Theoretical, Empirical, and Simulated Explorations. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 2002. [Google Scholar]
  26. Luna-Reyes, L.F.; Black, L.J.; Ran, W.; Andersen, D.L.; Jarman, H.; Richardson, G.P.; Andersen, D.F. Modeling and Simulation as Boundary Objects to Facilitate Interdisciplinary Research. Syst. Res. Behav. Sci. 2019, 36, 494–513. [Google Scholar] [CrossRef]
  27. Wood, K.A.; Stillman, R.A.; Goss-Custard, J.D. Co-creation of individual-based models by practitioners and modellers to inform environmental decision-making. J. Appl. Ecol. 2015, 52, 810–815. [Google Scholar] [CrossRef] [Green Version]
  28. Voinov, A.; Bousquet, F. Modelling with stakeholders. Environ. Model. Softw. 2010, 25, 1268–1281. [Google Scholar] [CrossRef]
  29. Lynam, T.; Jong, W.D.; Sheil, D.; Kusumanto, T.; Evans, K. Review of tools for incorporating community knowledge, preferences, and values into decision making in natural resources management. Ecol. Soc. 2007, 12, 1–15. [Google Scholar] [CrossRef] [Green Version]
  30. Cuéllar-Padilla, M.; Calle-Collado, Á. Can we find solutions with people? Participatory action research with small organic producers in Andalusia. J. Rural Stud. 2011, 27, 372–383. [Google Scholar] [CrossRef]
  31. Gaddis, E.J.B.; Voinov, A. Participatory Modeling. In Ecological Models; Elsevier: Amsterdam, The Netherlands, 2008; pp. 2651–2655. [Google Scholar]
  32. Voinov, A.; Gaddis, E. Values in Participatory Modeling: Theory and Practice. In Environmental Modeling with Stakeholders: Theory, Methods, and Applications; Section 3; Gray, S., Paolisso, M., Jordan, R., Gray, S., Eds.; Springer: Berlin/Heidelberg, Germany, 2017; pp. 47–63. [Google Scholar]
  33. Renger, M.; Kolfschoten, G.L.; Vreede, G.J.D. Challenges in collaborative modelling: A literature review and research agenda. Int. J. Simul. Process Model. 2008, 4, 248. [Google Scholar] [CrossRef]
  34. Ramirez, R. Stakeholder analysis and conflict management. In Cultivating Peace: Conflict and Collaboration in Natural Resource Management; Buckles, D., Ed.; International Development Research Centre: Ottawa, ON, Canada, 1999; pp. 101–126. [Google Scholar]
  35. Australian Public Service Commission (APS). Tackling Wicked Problems: A Public Policy Perspective; Technical report; Australian Government: Canberra, Australia, 2007. [Google Scholar]
  36. Falconi, S.M.; Palmer, R.N. An interdisciplinary framework for participatory modeling design and evaluation-What makes models effective participatory decision tools? Water Resour. Res. 2017, 53, 1625–1645. [Google Scholar] [CrossRef]
  37. Carr, G.; Blöschl, G.; Loucks, D.P. Evaluating participation in water resource management: A review. Water Resour. Res. 2012, 48. [Google Scholar] [CrossRef] [Green Version]
  38. Voinov, A.; Kolagani, N.; McCall, M.K.; Glynn, P.D.; Kragt, M.E.; Ostermann, F.O.; Pierce, S.A.; Ramu, P. Modelling with stakeholders - Next generation. Environ. Model. Softw. 2016, 77, 196–220. [Google Scholar] [CrossRef]
  39. Askins, K. `That’s just what I do’: Placing emotion in academic activism. Emot. Space Soc. 2009, 2, 4–13. [Google Scholar] [CrossRef] [Green Version]
  40. Metcalf, S.S.; Wheeler, E.; BenDor, T.K.; Lubinski, K.S.; Hannon, B.M. Sharing the floodplain: Mediated modeling for environmental management. Environ. Model. Softw. 2010, 25, 1282–1290. [Google Scholar] [CrossRef]
  41. Huvila, I.; Anderson, T.D.; Jansen, E.H.; McKenzie, P.; Westbrook, L.; Worrall, A. Boundary objects in information science research: An approach for explicating connections between collections, cultures and communities. Proc. Am. Soc. Inf. Sci. Technol. 2014, 51, 1–4. [Google Scholar] [CrossRef]
  42. Voinov, A.; Jenni, K.; Gray, S.; Kolagani, N.; Glynn, P.D.; Bommel, P.; Prell, C.; Zellner, M.; Paolisso, M.; Jordan, R.; et al. Tools and methods in participatory modeling: Selecting the right tool for the job. Environ. Model. Softw. 2018, 109, 232–255. [Google Scholar] [CrossRef] [Green Version]
  43. Schmitt Olabisi, L.; Adebiyi, J.; Traoré, P.S.; Kakwera, M.N. Do participatory scenario exercises promote systems thinking and build consensus? Elem. Sci. Anthr. 2016, 4, 000113. [Google Scholar] [CrossRef]
  44. Zellner, M.L. Embracing complexity and uncertainty: The potential of agent-based modeling for environmental planning and policy. Plan. Theory Pract. 2008, 9, 437–457. [Google Scholar] [CrossRef]
  45. LaMere, K.; Mäntyniemi, S.; Vanhatalo, J.; Haapasaari, P. Making the most of mental models: Advancing the methodology for mental model elicitation and documentation with expert stakeholders. Environ. Model. Softw. 2020, 124, 104589. [Google Scholar] [CrossRef]
  46. Bennett, N.D.; Croke, B.F.; Guariso, G.; Guillaume, J.H.; Hamilton, S.H.; Jakeman, A.J.; Marsili-Libelli, S.; Newham, L.T.; Norton, J.P.; Perrin, C.; et al. Characterising performance of environmental models. Environ. Model. Softw. 2013, 40, 1–20. [Google Scholar] [CrossRef]
  47. Argent, R.M.; Voinov, A.; Maxwell, T.; Cuddy, S.M.; Rahman, J.M.; Seaton, S.; Vertessy, R.A.; Braddock, R.D. Comparing modelling frameworks: A workshop approach. Environ. Model. Softw. 2006, 21, 895–910. [Google Scholar] [CrossRef]
  48. Gray, S.; Voinov, A.; Paolisso, M.; Jordan, R.; Bendor, T.; Bommel, P.; Glynn, P.; Hedelin, B.; Hubacek, K.; Introne, J.; et al. Purpose, processes, partnerships, and products: Four Ps to advance participatory socio-environmental modeling. Ecol. Appl. 2018, 28, 46–61. [Google Scholar] [CrossRef] [Green Version]
  49. Hamalainen, R.P. Behavioural issues in environmental modelling—The missing perspective. Environ. Model. Softw. 2015, 73, 244–253. [Google Scholar] [CrossRef]
  50. Zellner, M.L.; Lyons, L.; Hoch, C.J.; Weizeorick, J.; Kunda, C.; Milz, D.C. Modeling, Learning, and Planning Together: An Application of Participatory Agent-based Modeling to Environmental Planning. J. Urban Reg. Inf. Syst. Assoc. 2012, 24, 77–92. [Google Scholar]
  51. Radinsky, J.; Milz, D.; Zellner, M.; Pudlock, K.; Witek, C.; Hoch, C.; Lyons, L. How planners and stakeholders learn with visualization tools: Using learning sciences methods to examine planning processes. J. Environ. Plan. Manag. 2017, 60, 1296–1323. [Google Scholar] [CrossRef]
  52. Kelly, R.A.; Jakeman, A.J.; Barreteau, O.; Borsuk, M.E.; ElSawah, S.; Hamilton, S.H.; Henriksen, H.J.; Kuikka, S.; Maier, H.R.; Rizzoli, A.E.; et al. Selecting among five common modelling approaches for integrated environmental assessment and management. Environ. Model. Softw. 2013, 47, 159–181. [Google Scholar] [CrossRef]
  53. Amazonas, I.T.; Kawa, N.C.; Zanetti, V.; Linke, I.; Sinisgalli, P.A. Using Rich Pictures to Model the `Good Life’ in Indigenous Communities of the Tumucumaque Complex in Brazilian Amazonia. Hum. Ecol. 2019, 47, 341–354. [Google Scholar] [CrossRef]
  54. Etienne, M.; Du Toit, D.; Pollard, S. ARDI: A co-construction method for participatory modelling in natural resources management. Ecol. Soc. 2011, 16, 1–14. [Google Scholar] [CrossRef] [Green Version]
  55. Squires, H.; Renn, O. Can Participatory Modelling Support Social Learning in Marine Fisheries? Reflections from the Invest in Fish South West Project. Environ. Policy Gov. 2011, 21, 403–416. [Google Scholar] [CrossRef]
  56. Hare, M. Forms of Participatory Modelling and its Potential for Widespread Adoption in the Water Sector. Environ. Policy Gov. 2011, 21, 386–402. [Google Scholar] [CrossRef]
  57. Morisette, J.T.; Cravens, A.E.; Miller, B.W.; Talbert, M.; Talbert, C.; Jarnevich, C.; Fink, M.; Decker, K.; Odell, E.A. Crossing Boundaries in a Collaborative Modeling Workspace. Soc. Nat. Resour. 2017, 30, 1158–1167. [Google Scholar] [CrossRef]
  58. Bakken, B.E. Energy transition dynamics: Does participatory modelling contribute to alignment among differing future world views? Syst. Res. Behav. Sci. 2019, 36, 184–196. [Google Scholar] [CrossRef]
  59. Kahneman, D. Thinking, Fast and Slow, 1st ed.; Farrar, Straus and Giroux: New York, NY, USA, 2011. [Google Scholar]
  60. Evans, J.S.B.T.; Stanovich, K.E. Dual-Process Theories of Higher Cognition: Advancing the Debate. Perspect. Psychol. Sci. 2013, 8, 223–241. [Google Scholar] [CrossRef]
  61. Glynn, P.D.; Voinov, A.A.; Shapiro, C.D.; White, P.A. From data to decisions: Processing information, biases, and beliefs for improved management of natural resources and environments. Earth’s Future 2017, 6, 356–378. [Google Scholar] [CrossRef]
  62. Kahneman, D.; Tversky, A. Prospect Theory: An Analysis of Decision under Risk. Econometrica 1979, 47, 263–291. [Google Scholar] [CrossRef] [Green Version]
  63. Cialdini, R.B.; Kallgren, C.A.; Reno, R.R. The Focus Theory of Normative Conduct. Handb. Theor. Soc. Psychol. 2012, 24, 295–312. [Google Scholar]
  64. Thaler, R.H. From cashews to nudges: The evolution of behavioral economics. Am. Econ. Rev. 2018, 108, 1265–1287. [Google Scholar] [CrossRef] [Green Version]
  65. Ariely, D.; Wertenbroch, K. Procrastination, Deadline, and Performance: Self-Control by Precommitment. Psychol. Sci. 2002, 13, 219. [Google Scholar] [CrossRef] [PubMed]
  66. Kenrick, D.T.E.; Goldstein, N.J.E.; Braver, S.L.E. Six Degrees of Social Influence: Science, Application, and the Psychology of Robert Cialdini; Oxford University Press: Oxford, UK, 2012. [Google Scholar] [CrossRef]
  67. Voinov, A.; Perez, P.; Castilla-Rho, J.C.; Kenny, D.C. Integrated ecological economic modeling: What is it good for? In Sustainable Wellbeing Futures; Costanza, R., Erickson, J.D., Farley, J., Kubiszewski, I., Eds.; Edward Elgar Publishing Limited: Cheltenham, UK, 2020; pp. 316–341. [Google Scholar]
  68. Stern, P.C. Toward a Coherent Theory of Environmentally Significant Behavior. J. Soc. Issues 2000, 56, 407–424. [Google Scholar] [CrossRef]
  69. Jones, N.A.; Shaw, S.; Ross, H.; Witt, K.; Pinner, B. The study of human values in understanding and managing social-ecological systems. Ecol. Soc. 2016, 21, 1–10. [Google Scholar] [CrossRef] [Green Version]
  70. Ducrot, R.; van Paassen, A.; Barban, V.; Daré, W.; Gramaglia, C. Learning integrative negotiation to manage complex environmental issues: Example of a gaming approach in the peri-urban catchment of São Paulo, Brazil. Reg. Environ. Change 2015, 15, 67–78. [Google Scholar] [CrossRef] [Green Version]
  71. Lindenberg, S.; Steg, L. Normative, Gain and Hedonic Goal Frames Guiding Environmental Behavior. J. Soc. Issues 2007, 63, 117–137. [Google Scholar] [CrossRef] [Green Version]
  72. Cialdini, R. Pre-Suasion: A Revolutionary Way to Influence and Persuade; Simon & Schuster: New York, NY, USA, 2016. [Google Scholar]
  73. Corning, A.; Schuman, H. Commemoration matters: The anniversaries of 9/11 and Woodstock. Public Opin. Q. 2013, 77, 433–454. [Google Scholar] [CrossRef]
  74. Smidt, C.D. Not all news is the same: Protests, presidents, and the mass public agenda. Public Opin. Q. 2012, 76, 72–94. [Google Scholar] [CrossRef]
  75. Gilovich, T.; Griffin, D.; Kahneman, D. Heuristics and Biases: The Psychology of Intuitive Judgment; Cambridge university press: Cambridge, UK, 2002. [Google Scholar]
  76. Ozesmi, U.; Ozesmi, S. A Participatory Approach to Ecosystem Conservation: Fuzzy Cognitive Maps and Stakeholder Group Analysis in Uluabat Lake, Turkey. Environ. Manag. 2003, 31, 518–531. [Google Scholar] [CrossRef]
  77. Van den Belt, M. Mediated Modeling: A System Dynamics Approach to Environmental Consensus Building; Island press: Washington, DC, USA, 2004. [Google Scholar]
  78. Tajfel, H.; Turner, J.C.; Austin, W.G.; Worchel, S. An integrative theory of intergroup conflict. Organ. Identity Read. 1979, 56, 65. [Google Scholar]
  79. Edmondson, A.C.; Roloff, K.S. Overcoming barriers to collaboration: Psychological safety and learning in diverse teams. In Team Effectiveness in Complex Organizations: Cross-Disciplinary Perspectives and Approaches; The Organizational Frontiers Series; Routledge/Taylor & Francis Group: New York, NY, USA, 2009; pp. 183–208. [Google Scholar]
  80. Janis, I. Groupthink. In A First Look at Communication Theory; Griffin, E., Ed.; McGrawHill: New York, NY, USA, 1991; pp. 235–246. [Google Scholar]
  81. Edmondson, A.C.; Smith, D.M. Too Hot to Handle? How to Manage Relationship Conflict. Calif. Manag. Rev. 2006, 49, 6–31. [Google Scholar] [CrossRef] [Green Version]
  82. Aikin, S.F.; Talisse, R.B. Why We Argue (And How We Should): A Guide to Political Disagreement in an Age of Unreason, 2nd ed.; Routledge: New York, NY, USA, 2018. [Google Scholar]
  83. Glynn, P.; Shapiro, C.D.; Voinov, A. Records of engagement and decision tracking for adaptive management and policy development. In Proceedings of the 2018 IEEE International Symposium on Technology and Society (ISTAS), Washington, DC, USA, 13–14 November 2018; pp. 81–87. [Google Scholar]
  84. Borowski, I.; Hare, M. Exploring the Gap Between Water Managers and Researchers: Difficulties of Model-Based Tools to Support Practical Water Management. Water Resour. Manag. 2007, 21, 1049–1074. [Google Scholar] [CrossRef]
  85. Sterling, E.J.; Zellner, M.; Jenni, K.E.; Leong, K.; Glynn, P.D.; BenDor, T.K.; Bommel, P.; Hubacek, K.; Jetter, A.J.; Jordan, R.; et al. Try, try again: Lessons learned from success and failure in participatory modeling. Elementa 2019, 7, 9. [Google Scholar] [CrossRef] [Green Version]
  86. Barnaud, C.; Van Paassen, A. Equity, power games, and legitimacy: Dilemmas of participatory natural resource management. Ecol. Soc. 2013, 18, 1–12. [Google Scholar] [CrossRef]
  87. Damer, T.E. Attacking Faulty Reasoning: A Practical Guide to Fallacy-Free Arguments, 6th ed.; Wadsworth Cengage Learning: Belmont, CA, USA, 2008. [Google Scholar]
  88. Beers, P.J.; Mierlo, B.; Hoes, A.C. Toward an Integrative Perspective on Social Learning in System Innovation Initiatives. Ecol. Soc. 2016, 21, 1–12. [Google Scholar] [CrossRef] [Green Version]
  89. Ernst, A. Research techniques and methodologies to assess social learning in participatory environmental governance. Learn. Cult. Soc. Interact. 2019, 23, 100331. [Google Scholar] [CrossRef]
  90. Edmondson, A. Psychological Safety and Learning Behavior in Work Teams. Adm. Sci. Q. 1999, 44, 350. [Google Scholar] [CrossRef] [Green Version]
  91. Edmondson, A.C.; Lei, Z. Psychological Safety: The History, Renaissance, and Future of an Interpersonal Construct. Annu. Rev. Organ. Psychol. Organ. Behav. 2014, 1, 23–43. [Google Scholar] [CrossRef] [Green Version]
  92. Lewis, M. The Undoing Project: A Friendship That Changed Our Minds; W. W. Norton & Company: New York, NY, USA, 2016. [Google Scholar]
  93. Davies, K.K.; Fisher, K.T.; Dickson, M.E.; Thrush, S.F.; Le Heron, R. Improving ecosystem service frameworks to address wicked problems. Ecol. Soc. 2015, 20, 1–11. [Google Scholar] [CrossRef] [Green Version]
  94. Evans, D.R.; Hearn, M.T.; Uhleman, M.R.; Ivey, A.E. (Eds.) Essential Interviewing: A Programmed Approach to Effective Communication, 7th ed.; Thomson-Brooks/Cole: Belmont, CA, USA, 2008. [Google Scholar]
  95. Vecchi, G.M.; Van Hasselt, V.B.; Romano, S.J. Crisis (hostage) negotiation: Current strategies and issues in high-risk conflict resolution. Aggress. Violent Behav. 2005, 10, 533–551. [Google Scholar] [CrossRef]
  96. Dennett, D.C. Intuition Pumps and other Tools for Thinking, 1st ed.; W. W. Norton & Company: New York, NY, USA, 2013. [Google Scholar]
  97. Harinck, F.; De Dreu, C.K.W. Negotiating interests or values and reaching integrative agreements: The importance of time pressure and temporary impasses. Eur. J. Soc. Psychol. 2004, 34, 595–611. [Google Scholar] [CrossRef]
  98. Tsing, A.L. Becoming a tribal elder, and other green development fantasies. In Transforming the Indonesian Uplands: Marginality, Power and Production; Routledge: London, UK, 1999; pp. 159–202. [Google Scholar]
  99. Wenger, E. Communities of practice: Learning as a social system. Syst. Think. 1998, 9, 2–3. [Google Scholar] [CrossRef]
  100. Prell, C.; Reed, M.; Racin, L.; Hubacek, K. Competing structure, competing views: The role of formal and informal social structures in shaping stakeholder perceptions. Ecol. Soc. 2010, 15, 1–18. [Google Scholar] [CrossRef] [Green Version]
  101. de Kraker, J.; Kroeze, C.; Kirschner, P. Computer models as social learning tools in participatory integrated assessment. Int. J. Agric. Sustain. 2011, 9, 297–309. [Google Scholar] [CrossRef] [Green Version]
  102. Allen, W.; Fenemor, A.; Kilvington, M.; Harmsworth, G.; Young, R.; Deans, N.; Horn, C.; Phillips, C.; Montes de Oca, O.; Ataria, J.; et al. Building collaboration and learning in integrated catchment management: The importance of social process and multiple engagement approaches. N. Z. J. Mar. Freshw. Res. 2011, 45, 525–539. [Google Scholar] [CrossRef]
  103. Newig, J.; Günther, D.; Pahl-Wostl, C. Synapses in the network: Learning in governance networks in the context of environmental management. Ecol. Soc. 2010, 15, 1–16. [Google Scholar] [CrossRef]
  104. Krupa, M.; Cenek, M.; Powell, J.; Trammell, E.J. Mapping the stakeholders: Using social network analysis to increase the legitimacy and transparency of participatory scenario planning. Soc. Nat. Resour. 2018, 31, 136–141. [Google Scholar] [CrossRef]
  105. Grimble, R.; Wellard, K. Stakeholder methodologies in natural resource management: A review of principles, contexts, experiences and opportunities. Agric. Syst. 1997, 55, 173–193. [Google Scholar] [CrossRef]
  106. Reed, M.S. Stakeholder participation for environmental management: A literature review. Biol. Conserv. 2008, 141, 2417–2431. [Google Scholar] [CrossRef]
  107. Reed, M.S.; Graves, A.; Dandy, N.; Posthumus, H.; Hubacek, K.; Morris, J.; Prell, C.; Quinn, C.H.; Stringer, L.C. Who’s in and why? A typology of stakeholder analysis methods for natural resource management. J. Environ. Manag. 2009, 90, 1933–1949. [Google Scholar] [CrossRef] [PubMed]
  108. Mingers, J. Variety is the spice of life: Combining soft and hard OR/MS methods. Int. Trans. Oper. Res. 2000, 7, 673–691. [Google Scholar] [CrossRef]
  109. Reynolds, M.; Holwell, S. Systems Approaches to Managing Change: A Practical Guide; Springer: Berlin/Heidelberg, Germany, 2010. [Google Scholar] [CrossRef]
  110. Zenko, M. Red Team: How to Succeed by Thinking Like the Enemy, 1st ed.; Basic Books: New York, NY, USA, 2015. [Google Scholar]
  111. Red Teaming Handbook; Technical Report vs. 7.0; University of Foreign Military and Cultural Studies (UFMCS): Fort Leavenworth, KS, USA, 2015.
  112. Craig, S. Reflections from a red team leader. Mil. Rev. 2007, 87, 57–60. [Google Scholar]
  113. Barnaud, C.; Van Paassen, A.; Trébuil, G.; Promburom, T. Power relations and participatory water management: Lessons from a companion modelling experiment in northern Thailand. In Proceedings of the International Forum on Water and Food, CPWF Challenge Programme of the CGIAR, Vientiane, Laos, 12–17 November 2006; p. 20. [Google Scholar]
  114. Brown, V.A.; Harris, J.A.; Russell, J.Y. Tackling Wicked Problems through the Transdisciplinary Imagination; Earthscan: London, UK, 2010. [Google Scholar]
  115. Isaacs, W.N. Taking flight: Dialogue, collective thinking, and organizational learning. Organ. Dyn. 1993, 22, 24–39. [Google Scholar] [CrossRef]
  116. Thaler, R.H. From Homo Economicus to Homo Sapiens. J. Econ. Perspect. 2000, 14, 133–141. [Google Scholar] [CrossRef] [Green Version]
  117. Bransford, J. How People Learn: Brain, Mind, Experience, and School; National Academy Press: Washington, DC, USA, 2000. [Google Scholar]
  118. Fazey, I.; Fazey, J.A.; Fischer, J.; Sherren, K.; Warren, J.; Noss, R.F.; Dovers, S.R. Adaptive capacity and learning to learn as leverage for social—Ecological resilience. Front. Ecol. Environ. 2007, 5, 375–380. [Google Scholar] [CrossRef]
  119. Gupta, J. Climate change governance: History, future, and triple-loop learning? Wiley Interdiscip. Rev. Clim. Change 2016, 7, 192–210. [Google Scholar] [CrossRef]
  120. Tosey, P.; Visser, M.; Saunders, M.N. The origins and conceptualizations of `triple-loop’ learning: A critical review. Manag. Learn. 2012, 43, 291–307. [Google Scholar] [CrossRef] [Green Version]
  121. Paul, R.; Elder, L. The Miniature Guide to Critical Thinking Concepts and Tools, 8th ed.; Thinker’s guide library, Rowman & Littlefield Publishers: Lanham, MD, USA, 2019. [Google Scholar]
  122. Wals, A.E.J. Learning in a changing world and changing in al learning world: Reflexively fumbling towards sustainability. S. Afr. J. Environ. Educ. 2007, 24, 35–45. [Google Scholar]
  123. Lewin, K. Frontiers in Group Dynamics: II. Channels of Group Life; Social Planning and Action Research. Hum. Relations 1947, 1, 143–153. [Google Scholar] [CrossRef]
  124. Tokuhama-Espinosa, T. Mind, Brain, and Education Science: A Comprehensive Guide to the New Brain-Based Teaching; W. W. Norton & Company: New York, NY, USA, 2010. [Google Scholar]
  125. Charteris, J.; Smardon, D. Second look—Second think: A fresh look at video to support dialogic feedback in peer coaching. Prof. Dev. Educ. 2013, 39, 168–185. [Google Scholar] [CrossRef]
  126. Garvey Berger, J.; Atkins, P.W. Mapping complexity of mind: Using the subject-object interview in coaching. Coach. Int. J. Theory, Res. Pract. 2009, 2, 23–36. [Google Scholar] [CrossRef]
  127. Carley, K.M.; Harrald, J.R. Organizational learning under fire: Theory and practice. Am. Behav. Sci. 1997, 40, 310–332. [Google Scholar] [CrossRef] [Green Version]
  128. Brookfield, S.D. Developing Critical Thinkers: Challenging Adults to Explore Alternative Ways of Thinking and Acting; Jossey-Bass: Hoboken, NJ, USA, 1987. [Google Scholar]
  129. Massy, C. Call of the Reed Warbler. A New Agriculture, A New Earth; University of Queensland Press: St. Lucia, QLD, Canada, 2017. [Google Scholar]
  130. Schein, E.H. Empowerment, coercive persuasion and organizational learning: Do they connect? Learn. Organ. 1999, 6, 163–172. [Google Scholar] [CrossRef]
  131. Salvini, G.; van Paassen, A.; Ligtenberg, A.; Carrero, G.C.; Bregt, A.K. A role-playing game as a tool to facilitate social learning and collective action towards Climate Smart Agriculture: Lessons learned from Apuí, Brazil. Environ. Sci. Policy 2016, 63, 113–121. [Google Scholar] [CrossRef]
  132. Vervoort, J.M.; Kok, K.; Beers, P.J.; Van Lammeren, R.; Janssen, R. Combining analytic and experiential communication in participatory scenario development. Landsc. Urban Plan. 2012, 107, 203–213. [Google Scholar] [CrossRef]
  133. Boud, D.; Cressey, P.; Docherty, P. Productive Reflection at Work: Learning for Changing Organizations; Routledge: London, UK, 2006. [Google Scholar]
  134. Capelo, C.; Dias, J.F. A feedback learning and mental models perspective on strategic decision making. Educ. Technol. Res. Dev. 2009, 57, 629–644. [Google Scholar] [CrossRef]
  135. Cockerill, K.; Glynn, P.; Chabay, I.; Farooque, M.; Hämäläinen, R.P.; Miyamoto, B.; McKay, P. Records of engagement and decision making for environmental and socio-ecological challenges. EURO J. Decis. Process. 2019, 7, 243–265. [Google Scholar] [CrossRef]
  136. Jones, N.A.; Perez, P.; Measham, T.G.; Kelly, G.J.; D’Aquino, P.; Daniell, K.A.; Dray, A.; Ferrand, N. Evaluating participatory modeling: Developing a framework for cross-case analysis. Environ. Manag. 2009, 44, 1180–1195. [Google Scholar] [CrossRef]
  137. Saldaña, J. The Coding Manual for Qualitative Researchers, 2nd ed.; SAGE: Los Angeles, CA, USA, 2013. [Google Scholar]
  138. Moallemi, E.A.; Zare, F.; Reed, P.M.; Elsawah, S.; Ryan, M.J.; Bryan, B.A. Structuring and evaluating decision support processes to enhance the robustness of complex human—Natural systems. Environ. Model. Softw. 2020, 123, 104551. [Google Scholar] [CrossRef]
  139. Smajgl, A.; Ward, J. Evaluating participatory research: Framework, methods and implementation results. J. Environ. Manag. 2015, 157, 311–319. [Google Scholar] [CrossRef] [PubMed]
  140. Triste, L.; Vandenabeele, J.; van Winsen, F.; Debruyne, L.; Lauwers, L.; Marchand, F. Exploring participation in a sustainable farming initiative with self-determination theory. Int. J. Agric. Sustain. 2018, 16, 106–123. [Google Scholar] [CrossRef]
  141. Weinstein, N.; Przybylski, A.K.; Ryan, R.M. The index of autonomous functioning: Development of a scale of human autonomy. J. Res. Personal. 2012, 46, 397–413. [Google Scholar] [CrossRef]
  142. Kelly, G.A. The Psychology of Personal Constructs. Volume 1: A Theory of Personality; W.W. Norton and Company: New York, NY, USA, 1955. [Google Scholar]
  143. Burr, V.; King, N.; Butt, T. Personal construct psychology methods for qualitative research. Int. J. Soc. Res. Methodol. 2014, 17, 341–355. [Google Scholar] [CrossRef]
  144. Creswell, J.W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches; SAGE: Newcastle upon Tyne, UK, 2014. [Google Scholar]
  145. Crouch, M.; McKenzie, H. The logic of small samples in interview-based qualitative research. Soc. Sci. Inf. 2006, 45, 483–499. [Google Scholar] [CrossRef]
  146. Miles, M.B.; Huberman, A.M. Drawing Valid Meaning from Qualitative Data: Toward a Shared Craft. Educ. Res. 1984, 13, 20. [Google Scholar] [CrossRef]
  147. Fletcher, A.J. Applying critical realism in qualitative research: Methodology meets method. Int. J. Soc. Res. Methodol. 2017, 20, 181–194. [Google Scholar] [CrossRef]
  148. Jonsson, A.; Andersson, L.; Alkan-Olsson, J.; Arheimer, B. How participatory can participatory modeling be? Degrees of influence of stakeholder and expert perspectives in six dimensions of participatory modeling. Water Sci. Technol. 2007, 56, 207. [Google Scholar] [CrossRef] [Green Version]
  149. Stanovich, K.E. Why humans are (sometimes) less rational than other animals: Cognitive complexity and the axioms of rational choice. Think. Reason. 2013, 19, 1–26. [Google Scholar] [CrossRef]
  150. Cialdini, R.B. Crafting normative messages to protect the environment. Curr. Dir. Psychol. Sci. 2003, 12, 105–109. [Google Scholar] [CrossRef] [Green Version]
  151. Zare, F.; Guillaume, J.H.A.; Jakeman, A.J.; Torabi, O. Reflective communication to improve problem-solving pathways: Key issues illustrated for an integrated environmental modelling case study. Environ. Model. Softw. 2020, 126, 104645. [Google Scholar] [CrossRef]
  152. Moallemi, E.A.; Elsawah, S.; Ryan, M.J. Strengthening ‘good’ modelling practices in robust decision support: A reporting guideline for combining multiple model-based methods. Math. Comput. Simul. 2020, 175, 3–24. [Google Scholar] [CrossRef]
  153. Grimm, V.; Berger, U.; DeAngelis, D.L.; Polhill, J.G.; Giske, J.; Railsback, S.F. The ODD protocol: A review and first update. Ecol. Model. 2010, 221, 2760–2768. [Google Scholar] [CrossRef] [Green Version]
Figure 1. In PM, practitioners and stakeholders often face the challenge of `coming together’ to create an impact beyond the model being produced. By integrating an understanding of human barriers into the process, PM practitioners can design strategies to bypass those obstacles, drawing from other fields of study that examine how people think, learn, and behave. Modelling with value-driven and biased stakeholders requires a transdisciplinary and learning skill-set, as an active responsibility of PM practitioners in order to ‘open’ up the modelling process.
Figure 1. In PM, practitioners and stakeholders often face the challenge of `coming together’ to create an impact beyond the model being produced. By integrating an understanding of human barriers into the process, PM practitioners can design strategies to bypass those obstacles, drawing from other fields of study that examine how people think, learn, and behave. Modelling with value-driven and biased stakeholders requires a transdisciplinary and learning skill-set, as an active responsibility of PM practitioners in order to ‘open’ up the modelling process.
Land 11 00340 g001
Figure 2. Often, cognitive and behavioural barriers can go undetected and limit, or even trump the success of any PM exercise which fails to account for how these factors might manifest in any given stakeholder workshop. We can group these human barriers into five categories: subjectivity and biases; managing conflict; dealing with power; communication; and consistency. Each of these barriers can show up to varying degrees in any PM exercise. Collectively or individually, they can prevent stakeholders from bringing their unique mental models together to achieve the ultimate goal of establishing a ’shared understanding’ through the modelling process.
Figure 2. Often, cognitive and behavioural barriers can go undetected and limit, or even trump the success of any PM exercise which fails to account for how these factors might manifest in any given stakeholder workshop. We can group these human barriers into five categories: subjectivity and biases; managing conflict; dealing with power; communication; and consistency. Each of these barriers can show up to varying degrees in any PM exercise. Collectively or individually, they can prevent stakeholders from bringing their unique mental models together to achieve the ultimate goal of establishing a ’shared understanding’ through the modelling process.
Land 11 00340 g002
Figure 3. Using transdisciplinary insights to help `bridge’ contrasting mental models together and sidestep human barriers, PM can more effectively bring people and their mental models together for a better and shared representation of the system.
Figure 3. Using transdisciplinary insights to help `bridge’ contrasting mental models together and sidestep human barriers, PM can more effectively bring people and their mental models together for a better and shared representation of the system.
Land 11 00340 g003
Table 1. Tools and resources that can be used to overcome the five barriers identified in this review.
Table 1. Tools and resources that can be used to overcome the five barriers identified in this review.
BarrierSolutions
Subjectivity and bias
  • Awareness of cognitive bias [59]
  • Framing [72]
  • Pre-modelling [76]
Managing conflict
  • Agreed purpose and shared value, such as collaboration [32,77]
  • Creating psychological safety [81]
  • Practising active listening [94,95]
  • Role play [57]
  • Rapaport’s rules [96]
Dealing with power
  • Social network analysis and mapping [103,104]
  • Critical questions [108,109]
  • Guidelines and rules [77]
  • Red Team [110,111]
Communication
  • Dialogue [9]
  • Teaching metacognitive skills, such as critical thinking [121,128]
  • Encouraging reflection before, during, and after the workshop [9,10,124]
  • ‘Grim’ scenarios [127,131]
  • Giving feedback [125,126,128]
  • Goal setting [71]
Consistency
  • Evaluation through records of engagement [48,51,83,136,138]
  • Psychometric scales as pre- and post-questionnaires [139,140,141]
  • Personal construct theory methods (Salmon Line, Pictor, Role Repertory Test) [142,143]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kenny, D.C.; Castilla-Rho, J. No Stakeholder Is an Island: Human Barriers and Enablers in Participatory Environmental Modelling. Land 2022, 11, 340. https://doi.org/10.3390/land11030340

AMA Style

Kenny DC, Castilla-Rho J. No Stakeholder Is an Island: Human Barriers and Enablers in Participatory Environmental Modelling. Land. 2022; 11(3):340. https://doi.org/10.3390/land11030340

Chicago/Turabian Style

Kenny, Daniel C., and Juan Castilla-Rho. 2022. "No Stakeholder Is an Island: Human Barriers and Enablers in Participatory Environmental Modelling" Land 11, no. 3: 340. https://doi.org/10.3390/land11030340

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop