Next Article in Journal
Assessing the Effects of Delivery Attributes on E-Shopping Consumer Behaviour
Previous Article in Journal
Evaluation of Transport and Location Policies to Realize the Carbon-Free Urban Society
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Simulation-Based Participatory Modelling in Urban and Production Logistics: A Review on Advances and Trends

by
Amita Singh
*,
Jannicke Baalsrud Hauge
and
Magnus Wiktorsson
KTH Royal Institute of Technology Kvarnbergagatan 12, 151 36 Södertälje, Sweden
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(1), 17; https://doi.org/10.3390/su14010017
Submission received: 29 October 2021 / Revised: 8 December 2021 / Accepted: 11 December 2021 / Published: 21 December 2021

Abstract

:
Simulation-based participatory modelling allows integration of all types of knowledge including empirical, technical and scientific from all disciplines and domains. Thus, in recent years, the use of participatory modelling has been continuously increasing in many fields including logistics. With a view of achieving better understanding of the subject, this article systematically reviews the advances made in participatory modelling in the field of urban and production logistics in the last decade. It further reports the findings transparently following a categorization based on (i) the purpose of participatory modelling in the domain, and (ii) depending on the purpose how data is collected, processed and outcomes are presented. The review resulted in 97 articles which were analysed and categorized based on the above two questions formulated in the literature surveyed. The review revealed that apart from the three existing categories of purposes, namely, reflexive, descriptive and normative there is an emerging fourth category that was analytical in nature and 15 out of 97 articles analyzed belonged to this category. The authors decided to call this category analytical field empirical modelling which is primarily based on mathematical modelling and use of computational methods. We present these results with the help of a categorization. During the analysis for the second research question, we discovered that though the conventional ways of data collection and processing, such as interviews and workshops, which remain significantly present, in electronic data crowdsourcing and data processing via computational methods are emerging.

1. Introduction

Participatory modelling is defined as a modelling approach in which stakeholders from different domains come together for problem formulation and description, input collection, problem-solving, continuous validation, and finally decision-making [1]. Therefore, stakeholders play a vital role in this process. According to Voinov et al. [1], Basco-Carrera et al. [2], Voinov et al. [3], the focus on stakeholder participation is becoming increasingly important in several fields, and participatory modelling is garnering steady importance as a consequence.
Participatory modelling gained prominence with the collaboration in citizen science when Arnstein [4] proposed the ladder of participation. It was then adopted as a purely qualitative approach to bringing together stakeholders that are involved in the process. In literature [5,6,7,8], participatory modelling has been regarded as a qualitative approach that serves a reflexive, descriptive, or normative function. However, as computational methods become more widely adopted, the landscape of participatory modelling is also evolving.
The literature observes a trend in participatory modelling wherein computer-based simulations are a part of the process [9,10] and form the core of the frameworks [2,11]. Simulation-based participatory modelling facilitates the integration of all kinds of knowledge, including empirical, technical and scientific forms, from all disciplines and domains [3]. This allows stakeholders from various backgrounds to be included in the process using both qualitative and quantitative methods, and it characterizes the requirements and risks of all stakeholders [12]. This further enables stakeholders from different functional domains with a tool to facilitate discussions as it provides granularity over the simulation model.
With the increasing number of vehicles on roads [13,14,15], the problems of pollution, congestion, emissions, noise, and road safety are also increasing [16,17]. To address these challenges in a sustainable way, city or urban logistics initiatives are launched to test different new concepts [18,19]. In literature, urban and city logistics are used interchangeably [20]. In this article, we use the term urban logistics where we mean urban or city logistics to keep the exposition simple. Similarly, goals of production logistics can be formulated as pursuance of better delivery and reliability with the minimum possible logistic cost [21].
Myopic decisions based on inaccessible or incomplete information can trigger severe harm even if not intended; thus, indicating the importance of a holistic perspective [22]. Given the inherent limited knowledge of domains, it is important to include diverse opinions on a subject matter [23]. Since both urban and production logistics include multiple stakeholders, participatory modelling is increasing being used to solve problems in the domain.
More companies and cities are adopting participatory modelling to manage the flow of goods and passengers; hence, resulting in more existing studies in the area. In their work on urban logistics, Mangano et al. [24] and Zenezini et al. [25] proposed models using participatory methods to explore the dynamics of diffusion between logistics service providers and municipalities. In addition, Le Pira et al. [26] and Marcucci et al. [27] in their recent work proposed a methodology to address the complex problem of multiple-stakeholder decision-making in urban freight logistics. System Dynamics (SD) was adopted in Mangano et al. [24] and Le Pira et al. [26]. Katsela and Pålsson [18] and Marcucci et al. [27] employed agent-based modelling (ABM) and the discrete choice method (DCM) while proposing the respective models. Recently, Singh et al. [11] proposed a framework for the involvement of stakeholders in logistics, demonstrating a growing interest for participatory modelling in urban and production logistics.
To the best of our knowledge, no review has been conducted in the field of urban and production logistics that employs simulation-based participatory modelling. Therefore, in this article, we intend to understand the different trends in simulation-based participatory modelling in the logistics domain wherein stakeholders from urban areas and companies are also involved in the decision-making processes discussed above. We achieve this via a systematic literature review that categorises the direction of participatory modelling in the last decade according to the purpose it serves.
With this view in mind, we perform a review of participatory modelling in the domain of production and urban logistics. Since 2017, we see a rise in the number of articles that employ participatory modelling using simulation-based techniques. These articles in their research work take multiple perspectives ranging from policy-making to traffic and logistics management. These articles employ participatory modelling using simulation tools while proposing models that help solve collective decision-making but no study to the best of our knowledge focusses on the methodology and advances in simulation-based participatory modelling itself. Therefore, we believe that it is apt to do a systematic review that focusses on it.
To evaluate the advancements in participatory modelling within the domain of logistics with simulation, this study considers two refined research questions:
  • With the use of computers, how is the landscape of the purpose of simulation-based participatory modelling changing?
  • With the changing landscape, what are the methods and techniques used in different phases of participatory modelling?
The first question investigates the purpose of participatory modelling and characterizes the application of computers in the limiting scope of participatory modelling in urban and production logistics in the last decade. This is achieved with the help of a systematic literature review, which analyses the literature for trends or any significant direction it takes in the domain.
Reflecting on the needs of simulation-based participatory modelling with the changing trends in literature, the second question studies the changes in the tools and methods used for participatory modelling, following the increase in the use of computers in the domain. This is further analyzed with the help of categorization during the different phases of participatory modelling which, underlines the technological changes in the field. In addition, this question is also interpreted in the limited domains of production and urban logistics.
The remainder of this article is structured as follows. In Section 2, we discuss the research methodology which first filters the articles to be studied and then explains the descriptive and thematic analyses of the articles. The first research question is analyzed through and is further classification into the categories according to the purpose participatory modelling serves in the selected articles. The second research question is analysed wherein the different phases for participatory modelling are described. In the next section, results are synthesized and presented in a categorization proposed, followed by the direction of future research. Lastly, we present the Conclusion together with limitations and implications of the work.

2. Methodology

In this Section, we transparently illustrate the findings by rigorously synthesizing prior research, which guarantees the reliability and replicability of the study. This section first underlines the procedure through which data was collected and analysed, in accordance with the steps enumerated by Säfsten and Gustavsson [28]. This work by Säfsten and Gustavsson [28] outlines a methodological approach for systematic literature reviews in the engineering field. The following steps were taken comprehensively to complete the review:
Specify the purpose of the literature review. Firstly, the a purpose and possible research questions are formulated where the idea behind carrying out the review is concretely stated. This forms the basis and facilitate the planning of the literature review.
We, in this first step, defined the scope of our literature review which is to study the evolving nature of participatory modelling in the domain of production and urban logistics with the increase in the computational power available.
Identify suitable keywords. In this step, keywords for database searches were to be identified. This depends on the research questions formulated in the first step. However, a point of departure may be the keywords for theoretical concepts. Also, different synonyms for the keywords should be included in the searches. As the relevant literature is identified, more keywords may be included from the new knowledge obtained.
Because the study primarily considers the domains of production and urban logistics, they are considered as the first group of keywords. Together with the aforementioned keywords, logical operators are used to cover the scope of this article.
Search string: ((participatory OR collaborative) AND (model* OR design)) AND (computer-based OR simulation) AND (logistics OR production AND logistics) OR (urban AND mobilit* OR development) OR (urban OR infrastructure AND plan*)
A search was conducted with the combination of the abovementioned keywords in their title, abstract, or keywords. Asterisk (*) was adopted to expand the search in the said areas.
Formulate criteria for including and excluding literature. Next we decide the basis of including literature in the review. This may be the type of publication, period of time, and language in which articles are written. It may be a good idea to be open to include different types of literature and as more knowledge is acquired exclusion criteria can be formulated. As shown in Figure 1, based on the scope of the literature review, we formulated the inclusion and exclusion criteria for articles that were required to answer the research questions.
We started with the inclusion criteria as explained in Table 1. As we obtained knowledge in the area, we iteratively formulated the exclusion criteria for the literature review. We understood the definition and scope of collaborative logistics and decided to exclude it from the review after the first round. For complete inclusion and exclusion criteria adopted in this review, please refer to Table 1.
Select search tools and databases. This is a crucial step in the literature review and should be done in consultation with senior researchers and university library as they have updated information and are very knowledgeable.
The databases selected for the systematic search were Scopus, Web of Science, IEEE Access, and Google Scholar. According to Reda et al. [31] and Tornese et al. [32], Scopus and Web of Science were used to make a complete literature review in the field of logistics engineering and science. Further, IEEE and Google Scholar were used to mitigate any bias in the study due to the chosen databases. Thus, a vast range of article were searched and filtered which cover the entirety of academic and industrial research.
Formulate a search strategy and perform searches. There are various search strategies, for example, string search and snowballing. String search is an approach where literature search is performed using identified keywords and their synonyms. In snowballing, there are two approaches (i) backward and (ii) forward. In backward snowballing, we scan the articles cited in the initially selected articles whereas in forward snowballing we identify the articles citing the initially selected articles [33,34].
Based on the search criteria, 376 articles were filtered and data corresponding to these articles were collected based on the review by the team. In total, 160 articles were filtered from Scopus whereas 192 scientific documents were retrieved from Web of Science, IEEE, and Google Scholar. Eight articles were in the purview of existing knowledge, which resulted in 29 articles via snowballing.
Summary review of identified literature. The results of the searches are evaluated throughout the process to check whether the results conform to the expectations. In this step, identified keywords or inclusion and exclusion criteria may need to be adjusted. A first round of elimination of articles is often based on the results of reading title, keywords and abstracts.
In this step during our systematic literature review, we adjusted our keywords from the knowledge obtained by reading the title, abstract and keywords of initially selected articles. We also iteratively refined our inclusion and exclusion criteria in this step as explained in Table 1.
In-depth review of identified literature. The review is carried out in more depth once the literature meeting the set criteria is identified. In this step, the identified literature is read in its entirety and literature may be excluded at the step if the set criteria is not met upon reading a complete article. At this point also, grey literature is excluded as mentioned in Table 1 and Figure 1.
During the course of our literature review, 376 articles were initially identified through databases, eight from existing knowledge, and 29 articles through snowballing. Out of these, 47 duplicate or common articles were removed from the article repository. We read and analyzed title, abstract and keywords of 366 articles which resulted in 122 articles. Full content analysis was done for these articles and further grey literature was removed upon among the authors.
Extract data and create summaries. For each article selected, relevant data need to be extracted in a suitable manner. These summaries can be created and maintained using various tools varying from sophisticated softwares to simple spreadsheets.
We created and maintained a spreadsheet wherein we collected data based on the set criteria. This spreadsheet was further color-coded depending upon the inclusion (green), exclusion (red) and maybe categories (yellow). We used fairly standard color coding. The articles falling into maybe categories were further discussed and a decision was made by the authors to either include or exclude the article.
Analyze contents. There are different techniques for analyzing the results of a systematic literature review. In case of a comprehensive literature review, both descriptive and thematic analyses are done. In descriptive analysis, an overview and description of the selected articles were considered and in thematic analysis content is analyzed based on the purpose and research questions of the literature review.
In this article, descriptive and thematic analyses form a major part of the study and was performed in detail. Below we first discuss the descriptive analysis in which we present an overview and description of the selected literature.

2.1. Descriptive Analysis

The general trend of articles published in the participatory modelling in production and urban logistics field indicate an increase in the number of articles. Particularly, in 2019, there was a surge in the number of articles in this area, as illustrated in Figure 2 and Figure 3.
The search was concluded in June 2021, showing a significant decrease in the number of articles in 2020 does not, as there are not as many articles as in the previous year. This could be attributed to the global pandemic, which disrupted meetings and other forms of data collection, although the researchers have only little evidence to support this claim. The three major journals for publishing these articles were: sustainability, Environmental Modelling and Software, and Land Use Policy. In addition, 97 scientific documents out of 366 were filtered based on the title, keywords, and abstract. Here, literature not focusing on participatory modelling was excluded. For example, our search string had both collaborative and participatory modelling; however, collaborative logistic* could mean a specific technical term in supply chain literature. Such documents were excluded from the list, thereby resulting in 97 scientific documents.
Another trend that the research team noticed was that engineering departments have increasingly started adopting participatory modelling with the rise in computational methods and empirical modelling as compared to the past research wherein researchers mostly came from the domains of management and human sciences.
The articles not included are review articles that were not pertinent to the field of logistics, collaborative modelling, and control systems, including articles focusing on future technologies in the fields of collaborative modelling and reverse logistics. Articles related to flood risk and the framework for its control were also not included in the analysis, as these articles are far from the production and urban logistics domain.

2.2. Thematic Analysis

Next, we perform thematic analysis by reviewing content of the selected literature based on the scope and research questions for the systematic literature review. We perform and present the thematic analysis based on our research questions: with the increase in computational power available (i) how is the landscape of the purpose of simulation-based participatory modelling changing; and (ii) how the methods and techniques used therein are evolving.

2.2.1. Purpose of Participatory Modelling

This section filters articles according to the purpose simulation-based participatory modelling serves in the article. Three major categories viz, communication, decision-making, and knowledge generation, have been discussed in the existing literature which is being reasserted in our literature review. However, we see an emerging field of empirical modelling in the domain that occurs due to the use of computational methods. We discuss it under the subsection emerging field.

Communication

Participatory modelling serves as a platform for cross-functional domains and thus facilitates a dialogue among stakeholders. This category in literature has been described as reflexive and instrumental in the process of participatory modelling. In the systematic literature review, we inferred that the communication could be further classified into two categories depending on the purpose it serves: conflict resolution and stakeholder engagement.
During our literature review, we deduced that 28 articles were focussing on communication in the two above mentioned forms in which three articles [35,36,37] focussed entirely on conflict resolution and other articles focussed on stakeholder engagement.
Voinov et al. [3], Mangano et al. [24], Grogan [35], Nae et al. [36], Karimi and Brown [37], Yang et al. [38], Kumar et al. [39], Kuru and Ansell [40], Leonard et al. [41], Stave et al. [42], Artopoulos and Costa [43], Pardo-García et al. [44], Andreani et al. [45], Rall et al. [46], Olazabal et al. [47], Rexhepi et al. [48], Fiandrino et al. [49], Sharifi et al. [50], Le Pira et al. [51], Olszewski et al. [52], Neuenschwander et al. [53], Shafqat et al. [54], Stauskis [55], Forlano and Mathew [56], Lewis et al. [57], Rosol [58].

Decision-Making

In our review, the second category of which we reasserted its existence the decision-making or the normative category wherein the actions were decided and recommendations were made accordingly. This category could be classified as having the outcome of the simulation-based participatory modelling as policy recommendations and planning results.
There were in total 31 articles that fall in this category and were used explicitly in decision-making based on policy or actions recommendations. During our analysis we saw that out of these articles, two articles [59,60] focus on policy recommendations as their results; whereas all other articles focus on planning actions. Hence, we divided this category further into outcomes as policy recomdations or planning results.
Malekpour et al. [8], Marcucci et al. [27], Neuenschwander et al. [53], Halligey [59], Pereverza et al. [60], González-Méndez et al. [61], Melkonyan et al. [62], He et al. [63], Firmansyah et al. [64], Indrajit et al. [65], Gashu and Gebre-Egziabher [66], Omidipoor et al. [67], Stańczuk-Gałwiaczek et al. [68], Fuldauer et al. [69], Sahin et al. [70], McEvoy et al. [71], Macmillan and Woodcock [72], Moore and Elliott [73], Krzywoszynska et al. [74], Ducrot et al. [75], Long et al. [76], Randhir and Raposa [77], Graveline et al. [78], Brits et al. [79], Vermote et al. [80], Brand [81], Khan et al. [82], Muste et al. [83], Dearden and Wilson [84], Gaddis and Voinov [85].

Knowledge Integration

The third purpose that has been described in the existing literature is the descriptive nature of participatory modelling. This refers to the purpose of knowledge integration, which can also be further classified into vertical and horizontal integrations [86]. Integration, either horizontal or vertical, depends on whether the stakeholders are on different levels in the same domain and hence they are integrated vertically or, it brings together stakeholders from different domains and integrates the knowledge produced horizontally.
A total of 23 articles focus on knowledge generation, in which four articles [87,88,89,90] explicitly discuss vertical integration [88] and the remaining implicitly involve horizontal integration, as they bring together stakeholders from different domains. Therefore, we can infer that participatory modelling in the past has mostly been used in bringing stakeholders from different domains to the table.
Voinov et al. [1], Artopoulos and Costa [43], Pascariu and Pascariu [87], Smajgl [88], Hedelin et al. [89], Pfeffer et al. [90], Kariuki et al. [91], Stritih et al. [92], Fu et al. [93], Dierich et al. [94], Weimann et al. [95], Elliot et al. [96], Smetschka and Gaube [97], Venturini et al. [98], Drogoul [99], Endo et al. [100], McDermott et al. [101], Archetti et al. [102], Leskens et al. [103], Hewitt et al. [104], Beirão et al. [105], Winkler et al. [106].

Emerging Field–Empirical Modelling

During our critical analysis of the systematic literature review of the last decade starting from 2010 to June 2021, we observed an emerging field, which employed computational methods as the primary purpose of the participatory modelling, thus yielding quantitative results for the stakeholders to base their discussions on. We call this field empirical modelling that is based on the analytical nature of the simulation-based participatory modelling.
We define empirical modelling as the modelling that is based on mathematical abstractions of the real-life scenarios, and thus the simulations and optimizations produce quantitative results that form the core of discussions in participatory modelling. We see a spike in the trend towards the end of the decade, which could also be seen as the trend inline with the availability of high computational power.
We found 15 articles out of the total 97 articles to be in the field of empirical modelling, which we could not attribute to any of the other three categories. Further, we observed two major trends of purposes within the analytical nature as numerical results and validation.
Grogan [35], Elliot et al. [96], Middya et al. [107], Li et al. [108], Thondoo et al. [109], Quan et al. [110], Vieira et al. [111], Adamek et al. [112], Silva and Novaes [113], Montalto et al. [114], Anand et al. [115], Campbell and Im [116], McGarity et al. [117], Ranjan [118].

2.2.2. Methods Adopted in Participatory Modelling

According to Voinov et al. [3], the process of participatory modelling can be divided into three major categories, namely, input collection, data processing and output presentation. In this section, we briefly describe how the input collection, data processing, and output presentation are done while adopting simulation-based participatory modelling in the domain of production and urban logistics. Accordingly, we attempt to correlate the three phases and the trend of how they are evolving with the increase in computers in the domain.
On one hand, we observe that some conventional qualitative methods still have a prominent presence in the simulation-based participatory modelling; on the other hand, there are new computational methods being employed in the field. We perform a critical analysis of how these trends appear in the three phases of participatory modelling in the production and urban logistics domain.

Input Collection

We describe input collection as the process of data collection that serves as input for the simulation-based participatory modelling and takes strict precedence over data processing data in chronological order. In the conducted review, this phase varies from crowdsourcing the data to using existing databases for input data collection. We enumerate the different kinds of tools and methods for input collection, together with the articles that employ them, in Table 2.
However, this type of data crowdsourcing involves moving to electronic databases, thus, making processes like PPGIS (voluntary public participatory GIS) possible. PPGIS is an emerging method of data collection in the conducted review.
Conventional data collection techniques such as interviews (including all forms of interviews: structured, semi-structured, and in-depth interviews) and workshops (single level, and multi level) remain an important data collection alternative while existing databases via spatial data, have emerged as the avenue for input data.
Real-time data via sensors embedded in the environment were also considered as a potential input collection approach in the review conducted. These data were directly employed in the empirical modelling using simulation and optimization techniques, as revealed in the literature review.
In the next step, we study how the forms of data processing have changed over the decade.

Data Processing

The second step of data processing in simulation-based participatory modelling is characterized by the use of computers. However, there is a gradient in the use of computational methods and computer power required to process the data. During our review, we deduced that this gradient proves to be an important factor while differentiating the various purposes for which participatory modelling was adopted.
Using a gradient in computational methods, we imply that a higher degree of computational power was required in one categorical purpose of participatory modelling. The review revealed that the computational methods varied from visualization techniques (static, augmented reality, virtual reality) to optimization methods. Visualization techniques mostly contribute to more conventional purposes of participatory modelling, such as, communication, while newer techniques such as optimization methods are paving the path for a new purpose in participatory modelling.
There are other conventional methods of model development that we discovered during the review, as presented in Table 2.

Output Presentation

In the last step, we present how the output from the processed data were presented in the reviewed articles, and how the output presentation depended on the purpose of participatory modelling.
We noted that Graphs were used in almost all cases and were the most common means of results presentation as mentioned in Table 2. On one end of the spectrum in cases of communication, results were presented in the form of workshops such as roleplaying, while the other end of numerical results were mostly the output of empirical modelling. Results in the form of policy recommendations were predominantly the outcome of decision-making, while a living lab in an instance in the review is used for demonstrating the knowledge generation. Methodology and frameworks were also considered as a common form of output presentation in the articles reviewed.

3. Results

We propose a categorization to capture the diversity and complexity of the participatory modelling found in the production and urban logistics literature. We take a systems approach to literature content analysis that allows us to address key interrelated components: Purpose, Outcome, Methods, and Tools. We, further, describe these key components as shown in Figure 4 based on different parameters.
The results further analyse and discuss the two main research questions: (i) Changing purpose of simulation-based participatory modelling, and (ii) Methods and techniques used in different phases of simulation-based participatory modelling. Further we discuss the sustainability perspective of the literature analyzed.

3.1. Changing Purpose of Simulation-Based Participatory Modelling

Simulation-based participatory modelling in the domain of logistics has been used in primarily three conventional approaches viz knowledge generation, communication and decision-making, together with an emerging fourth category of empirical modelling, which in our opinion is a significant advancement in the field. With our analysis, we differentiated articles and categorized them according to their purposes, as presented in Figure 3. We determined that the categorization was based on the fidelity of the data used as well as on the participants and stakeholders. We briefly read out the analysis for each purpose representing each quadrant to elucidate the categorization.
During the analysis, it was determined that the categorization could be made based on the nature of data and backgrounds of stakeholders. Further, the purpose led to one or more outcomes depending on the nature of participatory modelling. Tools and methods were observed to be overlap in all purposes; however, they are mentioned here in terms of prominence in a particular purpose.
Starting from the bottom right quadrant in Figure 4, we observed that there were 31 articles focussing on decision-making, with the data fidelity of type quantitative and results in planning and policy recommendations. The most frequent but not exclusive methods are backcasting and forecasting, with the frequently used tools mentioned in the diagram. Similarly, other quadrants can be read depending on the purpose, outcomes, tools, and methods.
In Figure 2 and Figure 3, we see the trends in articles based on the purpose they serve in participatory modelling in the production and urban logistics domains. As can be observed in Figure 2, since 2015, there has been an increase in the articles published in the empirical modelling category that is based on analytical results, and this trend continues. This, according to the analysis done, can be attributed to the use of mathematical models and optimization techniques. In Figure 3, a general surge trend can be observed in the number of articles in the domain employing simulation-based participatory modelling.

3.2. Methods and Techniques Used in Different Phases of Simulation-Based Participatory Modelling

We synthesize results from the previous section that correspond to the second research question regarding the tools and methods used during different phases of participatory modelling [3], that is, (i) input collection, (ii) data processing, and (iii) output presentation, of participatory modelling.
We map the tools that are used based on the different phases and various purposes they serve in simulation-based participatory modelling in the domain as shown in Table 2.
For input collection, the techniques varied from conventional methods such as interviews, and workshops to newer techniques such as crowdsourcing and data collection using sensors.
As we discussed earlier, we observed an increase in the number of quantitative methods that could consequently be mapped to the new purpose of simulation-based participatory modelling. For the other purposes of participatory modelling; namely, communication, decision-making and knowledge integration the trends followed as observed in previous literature.
For output presentation, we observed that it largely depended on the recipients of the results. If the results were to be disseminated among citizens, static and dynamic visualization techniques were used whereas if the results were input to other scientific studies analyses like uncertainty analysis were considered.

3.3. Simulation-Based Participatory Modelling Studied from Sustainability Perspective

In the review, we looked at the articles and the trends of including sustainability factors in the research work. We saw there were 73 articles which included sustainability (mostly economic) in some form in their work. We only considered sustainability as a whole while looking for articles including sustainability in their work.
However, we during the review did not delve deep into how sustainability aspects by looking into economic, social and environmental sustainability perspectives. This aspect can be analyzed and described in detail in future work.

4. Discussion

Understanding the different facets and aspects of simulation-based participatory modelling can be important to both practitioners and researchers in the domain. However, the literature available today on the topic is very limited. We looked at the different literature surveys and reviews done in the domain of production and urban logistics to have a better understanding of the research landscape. We enumerate these reviews relevant to our literature survey in Table 3.
From these reviews done in the last decade presented in Table 3, we looked at the timeframe, domain, and methods employed in these articles. We saw systematic literature review in many of these articles in domains varying from logistic strategies to policies. These also included different facets of production and urban logistics spanning from freight logistics to last-mile deliveries. Lagorio et al. [124] in their review article consolidated the research done in urban logistics in from 2000–2015 thus providing insights into the state of the research. Other analyses like, bibliometric analysis and scientometric analysis were done to classify advances and trends in production and urban logistics.
Table 3. Relevant reviews conducted in the domain of production and urban logistics.
Table 3. Relevant reviews conducted in the domain of production and urban logistics.
ReferenceYearMethodTimeframeDomain
Zunder et al. [125]2014Mixed methods approachUntil 2013Developing a local research strategy for city logistics on an academic campus
Lagorio et al. [124]2016Systematic literature review2000–2015Research in urban logistics
Aljohani and Thompson [126]2016Systematic literature review2000–2015Impacts of logistics sprawl on the urban environment and logistics
Rose et al. [19]2017Systematic literature reviewUntil 2017Review of logistic strategies
Jamshidi et al. [127]2018Decision-making methods2000–2017Priority criteria and decision-making methods applied in selection of sustainable city logistics initiatives and collaboration partners
Dolati Neghabadi et al. [128]2018Bibliometric analysis2010–2017City logistics classification and analysis
Viu-Roig and Alvarez-Palau [129]2018Systematic literature review2017–2019Impact of e-commerce-related last-mile logistics on cities
Hu et al. [130]2019Scientometric review1993–2018Research trends and advances in city logistics
Reda et al. [31]2020Systematic literature review2000–2020Identification of the regional and economic contexts of sustainable urban logistics policies
Meza-Peralta et al. [131]2020Systematic literature review1990–2019Typology of urban logistics spaces as interfaces for freight transport
Szmelter-Jarosz et al. [132]2020-Until 2020Assessing resources management for sharing economy in urban logistics
Zunder [133]2021Semi-systematic literature reviewUntil 2018Identifying research opportunities for more sustainable, receiver-led inbound urban logistics flows to large higher education institutions
Arvianto et al. [134]2021Systematic literature review2016–2019Challenges and innovative solutions in developed and developing economies
This article2021Systematic literature review2010–2021Simulation-based participatory modelling in production and urban logistics
Other literature surveys focus on the decision-making methods applied in sustainable urban and production logistics. Mixed methods approach, systems approach and qualitative measures, like interviews were employed to make these categorization. However, we in this article focus on simulation-based participatory modelling.
During our analysis, we found out that along with the three existing purposes, namely, communication, decision-making, and knowledge integration, there is a fourth emerging purpose of participatory modelling. We decided to call it empirical modelling. We believe that the nature of research in the field participatory modeling is changing. The increase in available computational power and improvements in simulation tools are adding a new dimension to the field. We further demonstrated the rise in the number of articles written in this category of purpose. We also discussed the different phases of participatory modelling within the domain followed by the evolving nature of methods and tools employed therein.

5. Conclusions

During our research in the area of participatory modelling, we observed that the use of participatory modelling is increasing in all fields, which makes the elucidation of the field crucial. Because participatory modelling can be used in all fields, the scope of this study was significantly wide. Therefore, we had to reduce the scope to make an attempt to understand the particular domain of production and urban logistics. In addition to this, the use of computers has changed the landscape of many fields. We believe that the use of computers has a crucial role to play in the changing landscape of participatory modelling. Hence, this review is important. Furthermore, to the best of our knowledge no review or survey study has been conducted to either investigate the use of computers in participatory modelling or the use of participatory modelling in urban and production logistics domain. Therefore, we combined the two fields: the research work in this article, which presents the intersection between the fields: simulation-based participatory modelling in the domain.
In this article, we critically reviewed the literature in the domain of urban and production logistics using simulation-based participatory modelling in the last decade. We studied this literature and observed the effect of using high computational power in participatory modelling. The research indicates that although the old techniques of mostly qualitative research such as interviews stay prominent in the medium of performing research in the area, there is another trend emerging with the use of high computational power. We could not attribute this to any of the existing established purposes of participatory modelling in the literature. Hence, we concluded that there is an emergence of a fourth category, which is based on the use of high computational power and employs various optimization techniques. This results in more deterministic results and hence makes validation easier with the use of numerical outcomes.

5.1. Limitations

Although the literature discussed in this article surveyed four prominent databases still there is literature that is not covered by the article. This includes other databases and white papers from industry and, thus, it could be seen as a delimitation for this work and the approach adopted for the survey.

5.2. Practical and Theoretical Implications

This article primarily analyzes theory of simulation-based participatory modelling in urban and production logistics, and hence, presents theoretical implications of the research. Practical implications of the research performed during the development of this work is discussed in the article [135] by the team in which computational methods are employed for participatory modelling in the domain. This presented deterministic results which were used in decision-making and planning by various stakeholders.

5.3. Research Agenda and Future Directions

One of the major future work of this research work is validation of the proposed categorization through surveys and empirical data collection. The categorization can also be expanded depending upon the results of the validation.
In the second research agenda for the work, sustainability has a whole is discussed to a certain extent in this article. It could be worth discussing the framework and the literature with respect to triple bottomline of sustainability and making inferences hence.

Author Contributions

Conceptualization, A.S.; methodology, A.S.; resources, J.B.H. and M.W.; data curation, A.S.; writing—original draft preparation, A.S.; writing—review and editing, M.W., J.B.H. and A.S.; supervision, M.W. and J.B.H.; project administration, J.B.H.; funding acquisition, J.B.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by an EU-project HUPMOBILE R105 (S5010EU) of the Interreg Baltic Sea Region.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Voinov, A.; Jenni, K.; Gray, S.; Kolagani, N.; Glynn, P.D.; Bommel, P.; Prell, C.; Zellner, M.; Paolisso, M.; Jordan, R.; et al. Tools and methods in participatory modeling: Selecting the right tool for the job. Environ. Model. Softw. 2018, 109, 232–255. [Google Scholar] [CrossRef] [Green Version]
  2. Basco-Carrera, L.; Warren, A.; van Beek, E.; Jonoski, A.; Giardino, A. Collaborative modelling or participatory modelling? A framework for water resources management. Environ. Model. Softw. 2017, 91, 95–110. [Google Scholar] [CrossRef]
  3. Voinov, A.; Kolagani, N.; McCall, M.K.; Glynn, P.D.; Kragt, M.E.; Ostermann, F.O.; Pierce, S.A.; Ramu, P. Modelling with stakeholders–next generation. Environ. Model. Softw. 2016, 77, 196–220. [Google Scholar] [CrossRef]
  4. Arnstein, S.R. A ladder of citizen participation. J. Am. Inst. Plan. 1969, 35, 216–224. [Google Scholar] [CrossRef] [Green Version]
  5. Hare, M.; Letcher, R.A.; Jakeman, A.J. Participatory modelling in natural resource management: A comparison of four case studies. Integr. Assess. 2003, 4, 62–72. [Google Scholar] [CrossRef]
  6. Andersson, L.; Olsson, J.A.; Arheimer, B.; Jonsson, A. Use of participatory scenario modelling as platforms in stakeholder dialogues. Water Sa 2008, 34, 439–447. [Google Scholar] [CrossRef] [Green Version]
  7. Jones, N.A.; Perez, P.; Measham, T.G.; Kelly, G.J.; d’Aquino, P.; Daniell, K.A.; Dray, A.; Ferrand, N. Evaluating participatory modeling: Developing a framework for cross-case analysis. Environ. Manag. 2009, 44, 1180–1195. [Google Scholar] [CrossRef]
  8. Malekpour, S.; de Haan, F.; Brown, R. Marrying exploratory modelling to strategic planning: Towards participatory model use. In Proceedings of the 20th International Congress on Modelling and Simulation (MODSIM2013), Adelaide, Australia, 1–6 December 2013. [Google Scholar]
  9. Siebenhüner, B.; Barth, V. The role of computer modelling in participatory integrated assessments. Environ. Impact Assess. Rev. 2005, 25, 367–389. [Google Scholar] [CrossRef] [Green Version]
  10. De Kraker, J.; Kroeze, C.; Kirschner, P. Computer models as social learning tools in participatory integrated assessment. Int. J. Agric. Sustain. 2011, 9, 297–309. [Google Scholar] [CrossRef] [Green Version]
  11. Singh, A.; Wiktorsson, M.; Baalsrud Hauge, J.; Birkie, S.E. A simulation-based participatory modelling framework for stakeholder involvement in urban logistics. In Proceedings of the 2021 Winter Simulations Conference (WSC), Phoenix, AZ, USA, 12–15 December 2021. in press. [Google Scholar]
  12. Haase, D. Participatory modelling of vulnerability and adaptive capacity in flood risk management. Nat. Hazards 2013, 67, 77–97. [Google Scholar] [CrossRef]
  13. Berry, B.J. Urbanization. In Urban Ecology; Springer: Berlin/Heidelberg, Germany, 2008; pp. 25–48. [Google Scholar]
  14. Lerner, W.; Audenhove, V.F. The future of urban mobility: Towards networked, multimodal cities in 2050. Public Transp. Int. 2012, 61, 14–18. [Google Scholar]
  15. Eurostat, S. Your Key to European Statistics. 2019. Available online: https://ec.europa.eu/eurostat/web/products-catalogues/-/ks-02-17-839 (accessed on 27 October 2021).
  16. van Wee, B.; Ettema, D. Travel behaviour and health: A conceptual model and research agenda. J. Transp. Health 2016, 3, 240–248. [Google Scholar] [CrossRef] [Green Version]
  17. Okraszewska, R.; Romanowska, A.; Wołek, M.; Oskarbski, J.; Birr, K.; Jamroz, K. Integration of a multilevel transport system model into sustainable urban mobility planning. Sustainability 2018, 10, 479. [Google Scholar] [CrossRef] [Green Version]
  18. Katsela, K.; Pålsson, H. A multi-criteria decision model for stakeholder management in city logistics. Res. Transp. Bus. Manag. 2019, 33, 100439. [Google Scholar] [CrossRef]
  19. Rose, W.J.; Bell, J.E.; Autry, C.W.; Cherry, C.R. Urban logistics: Establishing key concepts and building a conceptual framework for future research. Transp. J. 2017, 56, 357–394. [Google Scholar] [CrossRef]
  20. Anand, N.; Van Duin, R.; Quak, H.; Tavasszy, L. Relevance of city logistics modelling efforts: A review. Transp. Rev. 2015, 35, 701–719. [Google Scholar] [CrossRef]
  21. Nyhuis, P.; Wiendahl, H.P. Fundamentals of Production Logistics: Theory, Tools and Applications; Springer Science & Business Media: New York, NY, USA, 2008. [Google Scholar]
  22. Famiglietti, J.S. The global groundwater crisis. Nat. Clim. Chang. 2014, 4, 945–948. [Google Scholar] [CrossRef]
  23. Steen, M. Co-design as a process of joint inquiry and imagination. Des. Issues 2013, 29, 16–28. [Google Scholar] [CrossRef]
  24. Mangano, G.; Zenezini, G.; Cagliano, A.C.; De Marco, A. The dynamics of diffusion of an electronic platform supporting City Logistics services. Oper. Manag. Res. 2019, 12, 182–198. [Google Scholar] [CrossRef]
  25. Zenezini, G.; van Duin, J.; Tavasszy, L.; De Marco, A. Stakeholders’ Roles for Business Modeling in a City Logistics Ecosystem: Towards a Conceptual Model. In City Logistics 2: Modeling and Planning Initiatives; Wiley: Hoboken, NJ, USA, 2018; pp. 39–58. [Google Scholar] [CrossRef]
  26. Le Pira, M.; Marcucci, E.; Gatta, V.; Ignaccolo, M.; Inturri, G.; Pluchino, A. Towards a decision-support procedure to foster stakeholder involvement and acceptability of urban freight transport policies. Eur. Transp. Res. Rev. 2017, 9, 1–14. [Google Scholar] [CrossRef]
  27. Marcucci, E.; Le Pira, M.; Gatta, V.; Inturri, G.; Ignaccolo, M.; Pluchino, A. Simulating participatory urban freight transport policy-making: Accounting for heterogeneous stakeholders’ preferences and interaction effects. Transp. Res. Part E Logist. Transp. Rev. 2017, 103, 69–86. [Google Scholar] [CrossRef]
  28. Säfsten, K.; Gustavsson, M. Research Methodology: For Engineers and Other Problem-Solvers; Studentlitteratur AB: Lund, Sweden, 2020. [Google Scholar]
  29. Saenz, M.J.; Koufteros, X. Special issue on literature reviews in supply chain management and logistics. Int. J. Phys. Distrib. Logist. Manag. 2015, 45. [Google Scholar] [CrossRef]
  30. Stefansson, G. Collaborative logistics management and the role of third-party service providers. Int. J. Phys. Distrib. Logist. Manag. 2006, 36, 76–92. [Google Scholar] [CrossRef]
  31. Reda, A.K.; Gebresenbet, G.; Tavasszy, L.; Ljungberg, D. Identification of the regional and economic contexts of sustainable urban logistics policies. Sustainability 2020, 12, 8322. [Google Scholar] [CrossRef]
  32. Tornese, F.; Gnoni, M.G.; Thorn, B.K.; Carrano, A.L.; Pazour, J.A. Management and Logistics of Returnable Transport Items: A Review Analysis on the Pallet Supply Chain. Sustainability 2021, 13, 12747. [Google Scholar] [CrossRef]
  33. Wohlin, C. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, London, UK, 13–14 May 2014; pp. 1–10. [Google Scholar]
  34. Wohlin, C. Second-generation systematic literature studies using snowballing. In Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering, Limerick, Ireland, 1–3 June 2016; pp. 1–6. [Google Scholar]
  35. Grogan, P.T. Co-design and co-simulation for engineering systems: Insights from the Sustainable Infrastructure Planning Game. Des. Sci. 2021, 7, e11. [Google Scholar] [CrossRef]
  36. Nae, M.; Dumitrache, L.; Suditu, B.; Matei, E. Housing Activism Initiatives and Land-Use Conflicts: Pathways for Participatory Planning and Urban Sustainable Development in Bucharest City, Romania. Sustainability 2019, 11, 6211. [Google Scholar] [CrossRef] [Green Version]
  37. Karimi, A.; Brown, G. Assessing multiple approaches for modelling land-use conflict potential from participatory mapping data. Land Use Policy 2017, 67, 253–267. [Google Scholar] [CrossRef]
  38. Yang, L.; Zhang, L.; Philippopoulos-Mihalopoulos, A.; Chappin, E.J.; van Dam, K.H. Integrating agent-based modeling, serious gaming, and co-design for planning transport infrastructure and public spaces. Urban Des. Int. 2021, 26, 67–81. [Google Scholar] [CrossRef] [Green Version]
  39. Kumar, P.; Dasgupta, R.; Dhyani, S.; Kadaverugu, R.; Johnson, B.A.; Hashimoto, S.; Sahu, N.; Avtar, R.; Saito, O.; Chakraborty, S.; et al. Scenario-Based Hydrological Modeling for Designing Climate-Resilient Coastal Water Resource Management Measures: Lessons from Brahmani River, Odisha, Eastern India. Sustainability 2021, 13, 6339. [Google Scholar] [CrossRef]
  40. Kuru, K.; Ansell, D. TCitySmartF: A comprehensive systematic framework for transforming cities into smart cities. IEEE Access 2020, 8, 18615–18644. [Google Scholar] [CrossRef]
  41. Leonard, L.; Miles, B.; Heidari, B.; Lin, L.; Castronova, A.M.; Minsker, B.; Lee, J.; Scaife, C.; Band, L.E. Development of a participatory Green Infrastructure design, visualization and evaluation system in a cloud supported jupyter notebook computing environment. Environ. Model. Softw. 2019, 111, 121–133. [Google Scholar] [CrossRef]
  42. Stave, K.; Dwyer, M.; Turner, M. Exploring the value of participatory system dynamics in two paired field studies of stakeholder engagement in sustainability discussions. Syst. Res. Behav. Sci. 2019, 36, 156–179. [Google Scholar] [CrossRef]
  43. Artopoulos, G.; Costa, C.S. Data-Driven Processes in Participatory Urbanism: The “Smartness” of Historical Cities. Archit. Cult. 2019, 7, 473–491. [Google Scholar] [CrossRef]
  44. Pardo-García, N.; Simoes, S.G.; Dias, L.; Sandgren, A.; Suna, D.; Krook-Riekkola, A. Sustainable and Resource Efficient Cities platform–SureCity holistic simulation and optimization for smart cities. J. Clean. Prod. 2019, 215, 701–711. [Google Scholar] [CrossRef]
  45. Andreani, S.; Kalchschmidt, M.; Pinto, R.; Sayegh, A. Reframing technologically enhanced urban scenarios: A design research model towards human centered smart cities. Technol. Forecast. Soc. Chang. 2019, 142, 15–25. [Google Scholar] [CrossRef]
  46. Rall, E.; Hansen, R.; Pauleit, S. The added value of public participation GIS (PPGIS) for urban green infrastructure planning. Urban For. Urban Green. 2019, 40, 264–274. [Google Scholar] [CrossRef]
  47. Olazabal, M.; Neumann, M.B.; Foudi, S.; Chiabai, A. Transparency and reproducibility in participatory systems modelling: The case of fuzzy cognitive mapping. Syst. Res. Behav. Sci. 2018, 35, 791–810. [Google Scholar] [CrossRef]
  48. Rexhepi, A.; Filiposka, S.; Trajkovik, V. Youth e-participation as a pillar of sustainable societies. J. Clean. Prod. 2018, 174, 114–122. [Google Scholar] [CrossRef]
  49. Fiandrino, C.; Capponi, A.; Cacciatore, G.; Kliazovich, D.; Sorger, U.; Bouvry, P.; Kantarci, B.; Granelli, F.; Giordano, S. Crowdsensim: A simulation platform for mobile crowdsensing in realistic urban environments. IEEE Access 2017, 5, 3490–3503. [Google Scholar] [CrossRef]
  50. Sharifi, A.; Chelleri, L.; Fox-Lent, C.; Grafakos, S.; Pathak, M.; Olazabal, M.; Moloney, S.; Yumagulova, L.; Yamagata, Y. Conceptualizing dimensions and characteristics of urban resilience: Insights from a co-design process. Sustainability 2017, 9, 1032. [Google Scholar] [CrossRef] [Green Version]
  51. Le Pira, M.; Marcucci, E.; Gatta, V. Role-playing games as a mean to validate agent-based models: An application to stakeholder-driven urban freight transport policy-making. Transp. Res. Procedia 2017, 27, 404–411. [Google Scholar] [CrossRef]
  52. Olszewski, R.; Turek, A.; Laczynski, M. Urban Gamification as a Source of Information for Spatial Data Analysis and Predictive Participatory Modelling of a City’s Development. In Proceedings of the 5th International Conference on Data Management Technologies and Applications (DATA 2016), Lisbon, Portugal, 24–26 July 2016; pp. 176–181. [Google Scholar]
  53. Neuenschwander, N.; Hayek, U.W.; Grêt-Regamey, A. GIS-Based 3d Urban Modeling Framework Integrating Constraints and Benefits of Ecosystems for Participatory Optimization of Urban Green Space Patterns. In Proceedings of the REAL CORP 2011, Essen, Germany, 18–20 May 2011. [Google Scholar]
  54. Shafqat, O.; Stoltz, D.; Lundqvist, P.; Arias, J. Participatory Simulation for Energy Target Identification in EcoCities. Energy Procedia 2014, 61, 2079–2082. [Google Scholar] [CrossRef] [Green Version]
  55. Stauskis, G. Development of methods and practices of virtual reality as a tool for participatory urban planning: A case study of Vilnius City as an example for improving environmental, social and energy sustainability. Energy Sustain. Soc. 2014, 4, 1–13. [Google Scholar] [CrossRef] [Green Version]
  56. Forlano, L.; Mathew, A. From design fiction to design friction: Speculative and participatory design of values-embedded urban technology. J. Urban Technol. 2014, 21, 7–24. [Google Scholar] [CrossRef]
  57. Lewis, J.L.; Casello, J.M.; Groulx, M. Effective environmental visualization for urban planning and design: Interdisciplinary reflections on a rapidly evolving technology. J. Urban Technol. 2012, 19, 85–106. [Google Scholar] [CrossRef]
  58. Rosol, M. Public participation in post-Fordist urban green space governance: The case of community gardens in Berlin. Int. J. Urban Reg. Res. 2010, 34, 548–563. [Google Scholar] [CrossRef]
  59. Halligey, A. ‘Dark’cities: The role of interdisciplinary work in learning and supporting marginal city spaces. Urban Stud. 2020, 0042098020930995. [Google Scholar] [CrossRef]
  60. Pereverza, K.; Pasichnyi, O.; Kordas, O. Modular participatory backcasting: A unifying framework for strategic planning in the heating sector. Energy Policy 2019, 124, 123–134. [Google Scholar] [CrossRef]
  61. González-Méndez, M.; Olaya, C.; Fasolino, I.; Grimaldi, M.; Obregón, N. Agent-Based Modeling for Urban Development Planning based on Human Needs. Conceptual Basis and Model Formulation. Land Use Policy 2021, 101, 105110. [Google Scholar] [CrossRef]
  62. Melkonyan, A.; Koch, J.; Lohmar, F.; Kamath, V.; Munteanu, V.; Schmidt, J.A.; Bleischwitz, R. Integrated urban mobility policies in metropolitan areas: A system dynamics approach for the Rhine-Ruhr metropolitan region in Germany. Sustain. Cities Soc. 2020, 61, 102358. [Google Scholar] [CrossRef]
  63. He, J.; Li, C.; Huang, J.; Liu, D.; Yu, Y. Modeling urban spatial expansion considering population migration interaction in Ezhou, central China. J. Urban Plan. Dev. 2019, 145, 05019003. [Google Scholar] [CrossRef]
  64. Firmansyah, H.S.; Supangkat, S.H.; Arman, A.A.; Giabbanelli, P.J. Identifying the components and interrelationships of smart cities in Indonesia: Supporting policymaking via fuzzy cognitive systems. IEEE Access 2019, 7, 46136–46151. [Google Scholar] [CrossRef]
  65. Indrajit, A.; Van Loenen, B.; Van Oosterom, P. Assessing spatial information themes in the spatial information infrastructure for participatory urban planning monitoring: Indonesian cities. ISPRS Int. J. Geo-Inf. 2019, 8, 305. [Google Scholar] [CrossRef] [Green Version]
  66. Gashu, K.; Gebre-Egziabher, T. Public assessment of green infrastructure benefits and associated influencing factors in two Ethiopian cities: Bahir Dar and Hawassa. BMC Ecol. 2019, 19, 16. [Google Scholar] [CrossRef] [Green Version]
  67. Omidipoor, M.; Jelokhani-Niaraki, M.; Moeinmehr, A.; Sadeghi-Niaraki, A.; Choi, S.M. A GIS-based decision support system for facilitating participatory urban renewal process. Land Use Policy 2019, 88, 104150. [Google Scholar] [CrossRef]
  68. Stańczuk-Gałwiaczek, M.; Sobolewska-Mikulska, K.; Ritzema, H.; van Loon-Steensma, J.M. Integration of water management and land consolidation in rural areas to adapt to climate change: Experiences from Poland and the Netherlands. Land Use Policy 2018, 77, 498–511. [Google Scholar] [CrossRef]
  69. Fuldauer, L.I.; Ives, M.C.; Adshead, D.; Thacker, S.; Hall, J.W. Participatory planning of the future of waste management in small island developing states to deliver on the Sustainable Development Goals. J. Clean. Prod. 2019, 223, 147–162. [Google Scholar] [CrossRef]
  70. Sahin, O.; Bertone, E.; Beal, C. A systems approach for assessing water conservation potential through demand-based water tariffs. J. Clean. Prod. 2017, 148, 773–784. [Google Scholar] [CrossRef] [Green Version]
  71. McEvoy, S.; van de Ven, F.H.; Blind, M.W.; Slinger, J.H. Planning support tools and their effects in participatory urban adaptation workshops. J. Environ. Manag. 2018, 207, 319–333. [Google Scholar] [CrossRef]
  72. Macmillan, A.; Woodcock, J. Understanding bicycling in cities using system dynamics modelling. J. Transp. Health 2017, 7, 269–279. [Google Scholar] [CrossRef] [PubMed]
  73. Moore, K.R.; Elliott, T.J. From participatory design to a listening infrastructure: A case of urban planning and participation. J. Bus. Tech. Commun. 2016, 30, 59–84. [Google Scholar] [CrossRef]
  74. Krzywoszynska, A.; Buckley, A.; Birch, H.; Watson, M.; Chiles, P.; Mawyin, J.; Holmes, H.; Gregson, N. Co-producing energy futures: Impacts of participatory modelling. Build. Res. Inf. 2016, 44, 804–815. [Google Scholar] [CrossRef] [Green Version]
  75. Ducrot, R.; Van Paassen, A.; Barban, V.; Daré, W.; Gramaglia, C. Learning integrative negotiation to manage complex environmental issues: Example of a gaming approach in the peri-urban catchment of São Paulo, Brazil. Reg. Environ. Chang. 2015, 15, 67–78. [Google Scholar] [CrossRef] [Green Version]
  76. Long, Y.; Denman, S.; Deng, D.B.; Rong, X.; Jiao, X.; Jin, Y. The Use of Participatory Urban Sensing Data in Urban Infrastructure Investment Assessments: Insights from Two Delphi Surveys in Beijing. In Proceedings of the 15th Computers in Urban Planning and Urban Management, Cambridge, MA, USA, 7–10 July 2015. [Google Scholar]
  77. Randhir, T.O.; Raposa, S. Urbanization and watershed sustainability: Collaborative simulation modeling of future development states. J. Hydrol. 2014, 519, 1526–1536. [Google Scholar] [CrossRef]
  78. Graveline, N.; Aunay, B.; Fusillier, J.L.; Rinaudo, J.D. Coping with urban & agriculture water demand uncertainty in water management plan design: The interest of participatory scenario analysis. Water Resour. Manag. 2014, 28, 3075–3093. [Google Scholar]
  79. Brits, A.; Burke, M.; Li, T. Improved modelling for urban sustainability assessment and strategic planning: Local government planner and modeller perspectives on the key challenges. Aust. Plan. 2014, 51, 76–86. [Google Scholar] [CrossRef] [Green Version]
  80. Vermote, L.; Macharis, C.; Boeykens, F.; Schoolmeester, C.; Putman, K. Traffic-restriction in Ramallah (Palestine): Participatory sustainability assessment of pedestrian scenarios using a simplified transport model. Land Use Policy 2014, 41, 453–464. [Google Scholar] [CrossRef]
  81. Brand, R. Facilitating sustainable behavior through urban infrastructures: Learning from Singapore? Int. J. Urban Sustain. Dev. 2013, 5, 225–240. [Google Scholar] [CrossRef]
  82. Khan, Z.; Ludlow, D.; Loibl, W.; Soomro, K. ICT enabled participatory urban planning and policy development. Transform. Gov. People Process Policy 2014, 8, 205–229. [Google Scholar] [CrossRef]
  83. Muste, M.V.; Bennett, D.A.; Secchi, S.; Schnoor, J.L.; Kusiak, A.; Arnold, N.J.; Mishra, S.K.; Ding, D.; Rapolu, U. End-to-end cyberinfrastructure for decision-making support in watershed management. J. Water Resour. Plan. Manag. 2013, 139, 565–573. [Google Scholar] [CrossRef] [Green Version]
  84. Dearden, J.; Wilson, A. Using participatory computer simulation to explore the process of urban evolution. Trans. GIS 2011, 15, 273–289. [Google Scholar] [CrossRef]
  85. Gaddis, E.J.; Voinov, A. Spatially explicit modeling of land use specific phosphorus transport pathways to improve TMDL load estimates and implementation planning. Water Resour. Manag. 2010, 24, 1621–1644. [Google Scholar] [CrossRef]
  86. Warner, J.F. More sustainable participation? Multi-stakeholder platforms for integrated catchment management. Water Resour. Dev. 2006, 22, 15–35. [Google Scholar] [CrossRef]
  87. Pascariu, G.; Pascariu, S. Integrated urban development through participatory approach. A Romanian story. Rom. J. Reg. Sci. 2013, 7, 69–85. [Google Scholar]
  88. Smajgl, A. Challenging beliefs through multi-level participatory modelling in Indonesia. Environ. Model. Softw. 2010, 25, 1470–1476. [Google Scholar] [CrossRef]
  89. Hedelin, B.; Evers, M.; Alkan-Olsson, J.; Jonsson, A. Participatory modelling for sustainable development: Key issues derived from five cases of natural resource and disaster risk management. Environ. Sci. Policy 2017, 76, 185–196. [Google Scholar] [CrossRef]
  90. Pfeffer, K.; Baud, I.; Denis, E.; Scott, D.; Sydenstricker-Neto, J. Participatory spatial knowledge management tools: Empowerment and upscaling or exclusion? Inf. Commun. Soc. 2013, 16, 258–285. [Google Scholar] [CrossRef]
  91. Kariuki, R.W.; Munishi, L.K.; Courtney-Mustaphi, C.J.; Capitani, C.; Shoemaker, A.; Lane, P.J.; Marchant, R. Integrating stakeholders’ perspectives and spatial modelling to develop scenarios of future land use and land cover change in northern Tanzania. PLoS ONE 2021, 16, e0245516. [Google Scholar] [CrossRef]
  92. Stritih, A.; Rabe, S.E.; Robaina, O.; Grêt-Regamey, A.; Celio, E. An online platform for spatial and iterative modelling with Bayesian Networks. Environ. Model. Softw. 2020, 127, 104658. [Google Scholar] [CrossRef]
  93. Fu, Z.; Chao, C.; Wang, H.; Wang, Y. Toward the participatory human-centred community an exploration of cyber-physical public design for urban experience. IET Cyber-Phys. Syst. Theory Appl. 2019, 4, 209–213. [Google Scholar] [CrossRef]
  94. Dierich, A.; Tzavella, K.; Setiadi, N.J.; Fekete, A.; Neisser, F.M. Enhanced Crisis-Preparation of Critical Infrastructures through a Participatory Qualitative-Quantitative Interdependency Analysis Approach. In Proceedings of the 16th ISCRAM Conference, València, Spain, 19–22 May 2019. [Google Scholar]
  95. Weimann, A.; Nguendo-Yongsi, B.; Foka, C.; Waffo, U.; Carbajal, P.; Sietchiping, R.; Oni, T. Developing a participatory approach to building a coalition of transdisciplinary actors for healthy urban planning in African cities—A case study of Douala, Cameroon. Cities Health 2020, 1–11. [Google Scholar] [CrossRef]
  96. Elliot, T.; Bertrand, A.; Almenar, J.B.; Petucco, C.; Proença, V.; Rugani, B. Spatial optimisation of urban ecosystem services through integrated participatory and multi-objective integer linear programming. Ecol. Model. 2019, 409, 108774. [Google Scholar] [CrossRef]
  97. Smetschka, B.; Gaube, V. Co-creating formalized models: Participatory modelling as method and process in transdisciplinary research and its impact potentials. Environ. Sci. Policy 2020, 103, 41–49. [Google Scholar] [CrossRef]
  98. Venturini, G.; Hansen, M.; Andersen, P.D. Linking narratives and energy system modelling in transport scenarios: A participatory perspective from Denmark. Energy Res. Soc. Sci. 2019, 52, 204–220. [Google Scholar] [CrossRef]
  99. Drogoul, A. Agent-based modeling for multidisciplinary and participatory approaches to climate change adaptation planning. In Proceedings of the RFCC-2015 Workshop, AIT, Bangkok, Thailand, 1–3 July 2015. [Google Scholar]
  100. Endo, I.; Magcale-Macandog, D.B.; Kojima, S.; Johnson, B.A.; Bragais, M.A.; Macandog, P.B.M.; Scheyvens, H. Participatory land-use approach for integrating climate change adaptation and mitigation into basin-scale local planning. Sustain. Cities Soc. 2017, 35, 47–56. [Google Scholar] [CrossRef]
  101. McDermott, T.; Folds, D.; Ender, T.; Bollweg, N. OpenSEAT: A computer framework to jointly model qualitative evaluation and quantitative design aspects of complex sociotechnical systems. In Proceedings of the 2015 IEEE International Symposium on Systems Engineering (ISSE), Rome, Italy, 28–30 September 2015; pp. 430–437. [Google Scholar]
  102. Archetti, F.; Giordani, I.; Candelieri, A. Data Science and Environmental Management in Smart Cities. Environ. Eng. Manag. J. 2015, 14, 2095–2102. [Google Scholar]
  103. Leskens, J.; Brugnach, M.; Hoekstra, A.Y. Application of an Interactive Water Simulation Model in urban water management: A case study in Amsterdam. Water Sci. Technol. 2014, 70, 1729–1739. [Google Scholar] [CrossRef] [PubMed]
  104. Hewitt, R.; Van Delden, H.; Escobar, F. Participatory land use modelling, pathways to an integrated approach. Environ. Model. Softw. 2014, 52, 149–165. [Google Scholar] [CrossRef]
  105. Beirão, J.; Montenegro, N.; Arrobas, P. City Information Modelling: Parametric urban models including design support data. In Proceedings of the 2012 Portuguese Network of Urban Morphology, Lisbon, Portugal, 5–6 July 2012; pp. 1122–1134. [Google Scholar]
  106. Winkler, T.J.; Ziekow, H.; Weinberg, M. Municipal benefits of participatory urban sensing: A simulation approach and case validation. J. Theor. Appl. Electron. Commer. Res. 2012, 7, 101–120. [Google Scholar] [CrossRef] [Green Version]
  107. Middya, A.I.; Roy, S.; Dutta, J.; Das, R. JUSense: A Unified Framework for Participatory-based Urban Sensing System. Mobile Netw. Appl. 2020, 25, 1249–1274. [Google Scholar] [CrossRef]
  108. Li, C.; He, J.; Duan, X. Modeling the collaborative evolution of urban land considering urban interactions under intermediate intervention, in the urban agglomeration in the middle reaches of the Yangtze River in China. Land 2020, 9, 184. [Google Scholar] [CrossRef]
  109. Thondoo, M.; Mueller, N.; Rojas-Rueda, D.; de Vries, D.; Gupta, J.; Nieuwenhuijsen, M. Participatory quantitative health impact assessment of urban transport planning: A case study from Eastern Africa. Environ. Int. 2020, 144, 106027. [Google Scholar] [CrossRef]
  110. Quan, S.J.; Park, J.; Economou, A.; Lee, S. Artificial intelligence-aided design: Smart design for sustainable city development. Environ. Plan. B Urban Anal. City Sci. 2019, 46, 1581–1599. [Google Scholar] [CrossRef]
  111. Vieira, A.C.; Oliveira, M.D.; e Costa, C.A.B. Enhancing knowledge construction processes within multicriteria decision analysis: The Collaborative Value Modelling framework. Omega 2020, 94, 102047. [Google Scholar] [CrossRef]
  112. Adamek, K.; Vasan, N.; Elshaer, A.; English, E.; Bitsuamlak, G. Pedestrian level wind assessment through city development: A study of the financial district in Toronto. Sustain. Cities Soc. 2017, 35, 178–190. [Google Scholar] [CrossRef]
  113. Silva, V.M.D.; Novaes, A.G. Analysis and simulation of collaboration policies among manufacturing industries and its effects on the maritime transportation cost. Mar. Syst. Ocean Technol. 2017, 12, 65–79. [Google Scholar] [CrossRef]
  114. Montalto, F.; Bartrand, T.A.; McAfee, C.A.; Geldi, J.M.; Loomis, C.H.; Rigall, G.J.; Zidar, K. Maximizing green infrastructure in a philadelphia neighborhood. Urban Plan. 2017, 2, 115–132. [Google Scholar]
  115. Anand, N.; Meijer, D.; Van Duin, J.; Tavasszy, L.; Meijer, S. Validation of an agent based model using a participatory simulation gaming approach: The case of city logistics. Transp. Res. Part C Emerg. Technol. 2016, 71, 489–499. [Google Scholar] [CrossRef]
  116. Campbell, J.W.; Im, T. Perceived public participation efficacy: The differential influence of public service motivation across organizational strata. Public Pers. Manag. 2016, 45, 308–330. [Google Scholar] [CrossRef]
  117. McGarity, A.; Hung, F.; Rosan, C.; Hobbs, B.; Heckert, M.; Szalay, S. Quantifying benefits of green stormwater infrastructure in Philadelphia. In Proceedings of the World Environmental and Water Resources Congress 2015, Austin, TX, USA, 17–21 May 2015; pp. 409–420. [Google Scholar]
  118. Ranjan, R. Factors affecting participation in spot and options markets for water. J. Water Resour. Plan. Manag. 2010, 136, 454–462. [Google Scholar] [CrossRef]
  119. Hori, K.; Kim, J.; Kawase, R.; Kimura, M.; Matsui, T.; Machimura, T. Local energy system design support using a renewable energy mix multi-objective optimization model and a co-creative optimization process. Renew. Energy 2020, 156, 1278–1291. [Google Scholar] [CrossRef]
  120. Dembski, F.; Wössner, U.; Letzgus, M.; Ruddat, M.; Yamu, C. Urban digital twins for smart cities and citizens: The case study of Herrenberg, Germany. Sustainability 2020, 12, 2307. [Google Scholar] [CrossRef] [Green Version]
  121. Gaudron, A.; Tamayo, S.; de La Fortelle, A. Interactive simulation for collective decision making in city logistics. Transp. Res. Procedia 2020, 46, 157–164. [Google Scholar] [CrossRef]
  122. Pardo-García, S.M. Open Source in Urban Planning and Architecture: Experiences and Guidelines from Traditional Cultures, Participatory Processes and Computer Science. ArchNet-IJAR Int. J. Archit. Res. 2018, 12, 24. [Google Scholar] [CrossRef]
  123. Neuenschwander, N.; Hayek, U.W.; Grêt-Regamey, A. Integrating an urban green space typology into procedural 3D visualization for collaborative planning. Comput. Environ. Urban Syst. 2014, 48, 99–110. [Google Scholar] [CrossRef]
  124. Lagorio, A.; Pinto, R.; Golini, R. Research in urban logistics: A systematic literature review. Int. J. Phys. Distrib. Logist. Manag. 2016, 46, 908–931. [Google Scholar] [CrossRef]
  125. Zunder, T.H.; Aditjandra, P.T.; Carnaby, B. Developing a local research strategy for city logistics on an academic campus. Procedia-Soc. Behav. Sci. 2014, 125, 226–238. [Google Scholar] [CrossRef] [Green Version]
  126. Aljohani, K.; Thompson, R.G. Impacts of logistics sprawl on the urban environment and logistics: Taxonomy and review of literature. J. Transp. Geogr. 2016, 57, 255–263. [Google Scholar] [CrossRef]
  127. Jamshidi, A.; Jamshidi, F.; Ait-Kadi, D.; Ramudhin, A. A review of priority criteria and decision-making methods applied in selection of sustainable city logistics initiatives and collaboration partners. Int. J. Prod. Res. 2019, 57, 5175–5193. [Google Scholar] [CrossRef] [Green Version]
  128. Dolati Neghabadi, P.; Evrard Samuel, K.; Espinouse, M.L. Systematic literature review on city logistics: Overview, classification and analysis. Int. J. Prod. Res. 2019, 57, 865–887. [Google Scholar] [CrossRef]
  129. Viu-Roig, M.; Alvarez-Palau, E.J. The impact of E-Commerce-related last-mile logistics on cities: A systematic literature review. Sustainability 2020, 12, 6492. [Google Scholar] [CrossRef]
  130. Hu, W.; Dong, J.; Hwang, B.g.; Ren, R.; Chen, Z. A scientometrics review on city logistics literature: Research trends, advanced theory and practice. Sustainability 2019, 11, 2724. [Google Scholar] [CrossRef] [Green Version]
  131. Meza-Peralta, K.; Gonzalez-Feliu, J.; Montoya-Torres, J.R.; Khodadad-Saryazdi, A. A unified typology of urban logistics spaces as interfaces for freight transport: A Systematic Literature Review. In Supply Chain Forum: An International Journal; Taylor & Francis: New York, NY, USA, 2020; Volume 21, pp. 274–289. [Google Scholar]
  132. Szmelter-Jarosz, A.; Rześny-Cieplińska, J.; Jezierski, A. Assessing resources management for sharing economy in urban logistics. Resources 2020, 9, 113. [Google Scholar] [CrossRef]
  133. Zunder, T.H. A semi-systematic literature review, identifying research opportunities for more sustainable, receiver-led inbound urban logistics flows to large higher education institutions. Eur. Transp. Res. Rev. 2021, 13, 1–14. [Google Scholar] [CrossRef]
  134. Arvianto, A.; Sopha, B.M.; Asih, A.M.S.; Imron, M.A. City logistics challenges and innovative solutions in developed and developing economies: A systematic literature review. Int. J. Eng. Bus. Manag. 2021, 13, 18479790211039723. [Google Scholar] [CrossRef]
  135. Singh, A.; Baalsrud Hauge, J.; Wiktorsson, M.; Upadhyay, U. Optimizing Local and Global Objectives for Sustainable Mobility in Urban Areas. J. Urban Mobil. 2021, in press.
Figure 1. Step-by-step procedure of the systematic literature review.
Figure 1. Step-by-step procedure of the systematic literature review.
Sustainability 14 00017 g001
Figure 2. Categorization of articles based on the year of publication. [Comm: communication; DM: decision-making; EM: empirical modelling; KI: knowledge integration].
Figure 2. Categorization of articles based on the year of publication. [Comm: communication; DM: decision-making; EM: empirical modelling; KI: knowledge integration].
Sustainability 14 00017 g002
Figure 3. Categorization of articles based on the purpose they serve in participatory modelling. [Comm: communication; DM: decision-making; EM: empirical modelling; KI: knowledge integration].
Figure 3. Categorization of articles based on the purpose they serve in participatory modelling. [Comm: communication; DM: decision-making; EM: empirical modelling; KI: knowledge integration].
Sustainability 14 00017 g003
Figure 4. Categorization of simulation-based participatory modelling in urban and production logistics based on different parameters.
Figure 4. Categorization of simulation-based participatory modelling in urban and production logistics based on different parameters.
Sustainability 14 00017 g004
Table 1. Criteria for inclusion and exclusion of articles.
Table 1. Criteria for inclusion and exclusion of articles.
TypeCriteriaRationale
InclusionTitle, abstract and keywords must demonstrate any possible implementation of participatory modelling in production and /or urban logistics.To include all potentially relevant studies, the search was not limited to specific journals. Research from other subjects may also appear in the search. In the subsequent steps, it was ensured that articles with a clear focus on participatory modelling in the domain of production and urban logistics are included in this review.
Articles must be published in peer-reviewed journals or conference proceedings.To ensure quality control, only peer reviewed journal articles and conference proceedings were included in the review [29].
Articles published between Jan 2010–Jun 2021 were considered for the review.This criteria was deduced from the objective of the article which is understanding the recent trends and advances in the domain.
Articles must be written in English.From the different article databases, we found out that English is the dominant language in production and urban logistics domain.
ExclusionArticles focussing on collaborative logistics were excluded.Since the definition of collaborative logistics [30] indicates another area of study than participatory modelling, it was excluded in the review.
Articles not focussing on participatory modelling.The review focusses on participatory modelling in production and urban logistics; therefore, studies from other contexts were excluded as per the definition in the work by Singh et al. [11].
Table 2. Analysis of tools and methods used during different phases simulation-based participatory modelling.
Table 2. Analysis of tools and methods used during different phases simulation-based participatory modelling.
PhaseMethodToolReference
Input collectionCrowdsourcingPPGISVoinov et al. [1], Nae et al. [36], Karimi and Brown [37], Rall et al. [46], Indrajit et al. [65], Pfeffer et al. [90], Endo et al. [100]
Kuru and Ansell [40]
Field notes & surveys Karimi and Brown [37], Stave et al. [42], Rall et al. [46], Stauskis [55], Stańczuk-Gałwiaczek et al. [68], Smajgl [88], Pfeffer et al. [90], Thondoo et al. [109]
InterviewsIn-depth interviews, semi-structured interviews, etc.Voinov et al. [1], Marcucci et al. [27], Nae et al. [36], Yang et al. [38], Kumar et al. [39], Stave et al. [42], Olazabal et al. [47], Sharifi et al. [50], Shafqat et al. [54], Stauskis [55], Rosol [58], Halligey [59], He et al. [63], Firmansyah et al. [64], Omidipoor et al. [67], Stańczuk-Gałwiaczek et al. [68], Fuldauer et al. [69], Macmillan and Woodcock [72], Krzywoszynska et al. [74], Ducrot et al. [75], Long et al. [76], Vermote et al. [80], Brand [81], Smajgl [88], Hedelin et al. [89], Pfeffer et al. [90], Dierich et al. [94], Smetschka and Gaube [97], Drogoul [99], Endo et al. [100], Leskens et al. [103], Thondoo et al. [109], Vieira et al. [111], Campbell and Im [116]
WorkshopsSingle level workshops, multi-level workshops, etcOlazabal et al. [47], Rexhepi et al. [48], Olszewski et al. [52], González-Méndez et al. [61], Melkonyan et al. [62], Macmillan and Woodcock [72], Krzywoszynska et al. [74], Graveline et al. [78], Brits et al. [79], Smajgl [88], Hedelin et al. [89], Kariuki et al. [91], Dierich et al. [94], Weimann et al. [95], Hewitt et al. [104]
RoleplayingLe Pira et al. [51], Fu et al. [93]
Questionnaires Rexhepi et al. [48], Gashu and Gebre-Egziabher [66], McEvoy et al. [71], Long et al. [76], Brits et al. [79], Pascariu and Pascariu [87], Smetschka and Gaube [97], Vieira et al. [111], Hori et al. [119]
Focus groupsFocus interviews, etcVoinov et al. [1], Mangano et al. [24], Rosol [58], Ducrot et al. [75], Smajgl [88], Endo et al. [100]
Input dataSpatial data/GISNae et al. [36], Fiandrino et al. [49], Neuenschwander et al. [53], Lewis et al. [57], Omidipoor et al. [67], Vermote et al. [80], Khan et al. [82], Hedelin et al. [89], Stritih et al. [92], Dierich et al. [94], Beirão et al. [105], Dembski et al. [120], Gaudron et al. [121]
From databasesGrogan [35], Nae et al. [36], Yang et al. [38], Leonard et al. [41], Fiandrino et al. [49], He et al. [63], Fuldauer et al. [69], Sahin et al. [70], McEvoy et al. [71], Macmillan and Woodcock [72], Randhir and Raposa [77], Dearden and Wilson [84], Elliot et al. [96], Smetschka and Gaube [97], Middya et al. [107], Li et al. [108], Thondoo et al. [109], Quan et al. [110], Adamek et al. [112], Campbell and Im [116], Dembski et al. [120], Pardo-García [122]
Sensor dataArtopoulos and Costa [43], Andreani et al. [45], Moore and Elliott [73], Archetti et al. [102]
Data ProcessingModel developmentAgent Based Modelling and serious gamesVoinov et al. [1], Marcucci et al. [27], Yang et al. [38], Le Pira et al. [51], Lewis et al. [57], González-Méndez et al. [61], Smajgl [88], Smetschka and Gaube [97], Drogoul [99], Silva and Novaes [113], Montalto et al. [114], Anand et al. [115]
System DynamicsVoinov et al. [1], Mangano et al. [24], Stave et al. [42], Stave et al. [42], Melkonyan et al. [62], Sahin et al. [70], Sahin et al. [70], Macmillan and Woodcock [72], Hedelin et al. [89], Venturini et al. [98], Drogoul [99], Silva and Novaes [113]
Fuzzy Cognitive MappingVoinov et al. [1], Olazabal et al. [47], Firmansyah et al. [64], Smetschka and Gaube [97]
AHPVermote et al. [80]
Machine learning modelMiddya et al. [107]
Bayesian NetworksStritih et al. [92]
Discrete ChoiceMarcucci et al. [27], Anand et al. [115]
Cellular automataHe et al. [63], Hewitt et al. [104], Li et al. [108]
OntologyAnand et al. [115]
GISNae et al. [36], Kumar et al. [39], Olszewski et al. [52], Neuenschwander et al. [53], Omidipoor et al. [67], Kariuki et al. [91]
DelphiVieira et al. [111], Quan et al. [110], Long et al. [76]
Structured Interview MatrixSharifi et al. [50]
Simulation Leonard et al. [41], Fiandrino et al. [49], Shafqat et al. [54], Sahin et al. [70], Ducrot et al. [75], Randhir and Raposa [77], Graveline et al. [78], Muste et al. [83], Gaddis and Voinov [85], Endo et al. [100], Campbell and Im [116], Dembski et al. [120], Gaudron et al. [121]
OptimizationNSGA II, PSO, other algorithms, etc.Grogan [35], Elliot et al. [96], Quan et al. [110], Adamek et al. [112], McGarity et al. [117], Ranjan [118], Hori et al. [119]
Backcasting Pereverza et al. [60], Fuldauer et al. [69], Smetschka and Gaube [97], Hori et al. [119]
Validation Rexhepi et al. [48], Shafqat et al. [54], He et al. [63], Gashu and Gebre-Egziabher [66], Sahin et al. [70], Endo et al. [100], Anand et al. [115]
QuestionnairesDembski et al. [120]
InterviewsHori et al. [119]
Cross impact analysisDierich et al. [94], Middya et al. [107]
Multi criteria decision analysisNeuenschwander et al. [53]
MACBETHVieira et al. [111]
ETLDierich et al. [94]
SDSSOmidipoor et al. [67]
Public participationCommunity designRosol [58]
Workshops Forlano and Mathew [56], Moore and Elliott [73], Brits et al. [79], Weimann et al. [95], Leskens et al. [103], Gaudron et al. [121]
Visualization techniquesStatic, AR, VR, etcArtopoulos and Costa [43], Stauskis [55], Halligey [59], Khan et al. [82], Endo et al. [100], Quan et al. [110], Dembski et al. [120]
Results presentationVisualizationGraphsAlmost all
Videos (Agent-based visualization)Lewis et al. [57]
3D modellingNeuenschwander et al. [53], Khan et al. [82], Neuenschwander et al. [123]
MapsYang et al. [38], Dearden and Wilson [84], Pfeffer et al. [90], Kariuki et al. [91], Stritih et al. [92], Endo et al. [100], Li et al. [108]
Numerical results Marcucci et al. [27], Stauskis [55], Lewis et al. [57], Melkonyan et al. [62], Quan et al. [110], Adamek et al. [112], Silva and Novaes [113], Montalto et al. [114], Campbell and Im [116]
Roleplaying Le Pira et al. [51]
New tool as a resultGrogan [35], Leonard et al. [41], Artopoulos and Costa [43], Pardo-García et al. [44], Fiandrino et al. [49], Olszewski et al. [52], Lewis et al. [57], Omidipoor et al. [67], Khan et al. [82], Pascariu and Pascariu [87], Hedelin et al. [89], Stritih et al. [92], Stritih et al. [92], Dembski et al. [120]
Policy recommendation Marcucci et al. [27], Halligey [59], Pereverza et al. [60], Melkonyan et al. [62], Stańczuk-Gałwiaczek et al. [68], Macmillan and Woodcock [72], Gaddis and Voinov [85], Elliot et al. [96]
MethodologyFrameworkYang et al. [38], Kuru and Ansell [40], Andreani et al. [45], Stauskis [55], Pereverza et al. [60], González-Méndez et al. [61], Omidipoor et al. [67], Beirão et al. [105], McDermott et al. [101], Ranjan [118], Gaudron et al. [121]
ModelShafqat et al. [54], Smajgl [88]
Uncertainty analysis Graveline et al. [78]
Living lab Fu et al. [93]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Singh, A.; Baalsrud Hauge, J.; Wiktorsson, M. Simulation-Based Participatory Modelling in Urban and Production Logistics: A Review on Advances and Trends. Sustainability 2022, 14, 17. https://doi.org/10.3390/su14010017

AMA Style

Singh A, Baalsrud Hauge J, Wiktorsson M. Simulation-Based Participatory Modelling in Urban and Production Logistics: A Review on Advances and Trends. Sustainability. 2022; 14(1):17. https://doi.org/10.3390/su14010017

Chicago/Turabian Style

Singh, Amita, Jannicke Baalsrud Hauge, and Magnus Wiktorsson. 2022. "Simulation-Based Participatory Modelling in Urban and Production Logistics: A Review on Advances and Trends" Sustainability 14, no. 1: 17. https://doi.org/10.3390/su14010017

APA Style

Singh, A., Baalsrud Hauge, J., & Wiktorsson, M. (2022). Simulation-Based Participatory Modelling in Urban and Production Logistics: A Review on Advances and Trends. Sustainability, 14(1), 17. https://doi.org/10.3390/su14010017

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop