Next Article in Journal
Characteristics of Urban Parks in Chengdu and Their Relation to Public Behaviour and Preferences
Previous Article in Journal
Quantitative Study on the Law of Surface Subsidence Zoning in Steeply Inclined Extra-Thick Coal Seam Mining
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Empirical Evaluation of the Environmental Emergency Management Capability of Local Governments in China

1
School of Public Affairs, Zhejiang University, Hangzhou 310058, China
2
School of Marxism, Guizhou University, Guiyang 550025, China
3
School of Management, Guizhou University, Guiyang 550025, China
4
School of Engineering, University of Tasmania, Hobart, TAS 7005, Australia
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(11), 6760; https://doi.org/10.3390/su14116760
Submission received: 7 March 2022 / Revised: 23 May 2022 / Accepted: 25 May 2022 / Published: 31 May 2022
(This article belongs to the Section Environmental Sustainability and Applications)

Abstract

:
Environmental emergency management is an important practical subject for local governments. Understanding the different dimensions of environmental emergency management capability is crucial for enabling a well-informed governance performance. Based on the crisis management 4R theory (comprising four stages: reduction, readiness, response and recovery), PPRR emergency management theory (emergency management is categorized into four stages: prevention, preparation, response and recovery), crisis life cycle theory and ISO 22320, this paper divided local government environmental emergency management capability into four dimensions of a dynamic pre–during–post process: preparedness, early warning, response and recovery. This paper applied a confirmatory factor analysis model to confirm the classification standards of the four capabilities, which are strongly correlated within environmental emergency management. We found that China’s local government environmental emergency management capability is generally at an upper-middle level, according to the empirical data. We also analyzed the regional differences in local government environmental emergency management capability across China and concluded that the environmental emergency management capability of local governments in the eastern region is higher than those in other regions. The capability levels in the central, western and northeastern regions are more similar to each other and show a decreasing distribution in the east–central–west–northeast region.

1. Introduction

Since the reform and opening-up policy in the late 1970s, China’s economy has been experiencing a golden period of rapid development, which has been hailed globally as an “economic miracle”. However, frequently occurring environmental emergencies and a decline in ecological environmental quality are expected to emerge from this rapid development and become a bottleneck that restricts the economic and social development of China. The China Statistical Yearbook shows 17,442 environmental emergency events from 2000 to 2020 [1] that seriously threatened people’s safety, property and the ecological environment. For example, environmental emergencies that are caused by the improper management of urban solid waste can easily lead to environmental pollution, such as soil, water and atmosphere pollution, and threaten people’s lives and health [2]. China built its environmental emergency management system late and it is still not complete. The government performances in responding to environmental emergencies or eliminating significant environmental risks are not satisfactory. This paper aims to provide insights into the ways of building local government environmental governance capabilities in China.
Environmental emergency management is the last line of defense for environmental security. As a new research direction with strong correlations with the field of public management, environmental emergency management has been widely studied by researchers and has produced fruitful results. The existing research on emergency management has contributed to research on environmental emergency management through the discussion of the frameworks or architectures that are used in emergency management, such as “one case, three systems” [3,4,5,6], which is the emergency management system in the USA, EU and other countries [7,8,9], and emergency decision-making [10,11,12,13]. By extending these studies, researchers have explored environmental emergency management plans [14], coordination mechanisms [15,16], early warning systems [17] and governance systems [18] for environmental emergency management, but little literature has discussed how to construct an assessment of local government environmental emergency management capability within a dynamic pre–during–post process, which is explored in this paper.
Local governments are a main force and their environmental emergency management capability is critical for dealing with environmental emergencies [19]. Environmental emergency management capability is an essential indicator of local government environmental governance levels and emergency management effectiveness. Therefore, this paper is dedicated to answering the following questions: What is the connotation of the concept of the environmental emergency management capability of local governments? Which indicator system should be constructed for the measurement? Are there regional differences in local government environmental emergency management capability across China?
Drawing on the crisis management 4R theory [20], PPRR emergency management theory [21,22], the crisis life cycle theory [23] and ISO 22320 [24], this research constructed a local government environmental emergency management system with four capabilities: preparedness, early warning, response and recovery. We applied a confirmatory factor analysis to the local government environmental emergency management capability and the reliability and validity levels of the results supported the dynamic framework of that capability. We further conducted an empirical evaluation to explore regional differences in the environmental emergency management capability of local governments across China. We found that local government environmental emergency management capability in the eastern region of China is generally better, while those in the central, western and northeastern regions are relatively lacking.

2. Conceptual Framework

2.1. Local Government Environmental Emergency Management Capability

An environmental emergency refers to a course of environmental events that deviates from planned or expected actions and endangers or adversely affects humans, property or the environment and results in significant damage, loss or destruction [25]. Humans need to manage such environmental emergencies to mitigate or prevent potential losses. With the explicit goal of protecting life, property and the environment, environmental emergency management draws upon expertise from a wide array of areas, spanning science, technology, planning and management. As a fundamentally cooperative undertaking, it involves organizing collective frameworks and steering collaborative practices to address environmental problems and conflicts [17,26].
Previous literature has identified three key rationales behind environmental emergency management frameworks. The first conceives environmental emergency management as a form of regulation that is aimed at achieving specific outcomes related to environmental management or protection [27]. In contrast to the first rationale, the second holds that environmental emergency management is a process that involves negotiations between governmental and non-governmental actors, which often have different or even conflicting interests or perspectives. To enable collaborative action between these stakeholders, a channel of communication needs to be put in place to bridge or integrate their diverse interests and perspectives [28]. The third rationale argues that environmental governance arrangements need to be adaptive to be effective [29]. This is because environmental governance often needs to deal with complex dynamic processes within natural systems and the impact of human intervention is uncertain. Collectively, these conceptions imply that environmental emergency management requires dynamic adaptation and integration capabilities before it can be successfully implemented.
Different modes of environmental emergency management involve different capabilities of the actors and represent different ways of organizing and regulating collective action. For example, Hernandez and Serrano [30] used knowledge-based models to deal with flood emergencies, while Kourniotis [31] applied expert systems to assist in decision-making for the containment of chemical accidents. On the other hand, environmental emergency management includes various forms of collective decision-making that require the active participation of government actors [19,32]. Wallington et al. [33], for example, discussed a form of governance in which the central government “takes the lead” on centralized governance while local governments are responsible for decentralized governance. In this paper, we extend the previous literature by discussing environmental emergency management as an agent for governance capacity building.
Governance arrangements are ad hoc arrangements that combine the use of coalition building, discourse, rules and power to guide collective action [34]. Given the current practices and emergency management requirements of the ISO 22320 incident response, there is an exigent need for cross-system risk assessments and a shift to whole-process management. Local emergency management departments are usually responsible for planning how best to mitigate, prepare for, respond to and recover from anticipated environmental emergencies. For instance, earthquakes, tornadoes, major floods and storms, severe hurricanes and cyclones and other wide-ranging natural disasters are expected, planned for and mitigated to some extent. The scope of such disasters, however, can lead to crises that demand a swift response and immense resilience. The key is to be able to provide the necessary resources, prior training, public awareness and even political discipline to prevent major events from affecting the system in functionally unexpected ways [35,36]. It is in this spirit that this paper considered capabilities related to contingency planning and practices during disaster mitigation and post-disaster (i.e., recovery) phases.
This paper conceptualized the creation and application of a local government emergency management system as a dynamic process of knowledge, values, social order generation and resource allocation. Accordingly, we constructed a process-based framework based on the literature and classified processes into three categories: the pre-, during and post-emergency phases. Each stage involves different capacities that provide services or resources, domain-specific problem solutions, software, facilities and products for environmental emergency management [16,17,18,37]. The framework has several important characteristics (see Figure 1) and requires different agents, such as emergency prediction, response, preparedness and recovery agents, to meaningfully coordinate activities. Out of the processes introduced in this framework, actions during the pre-emergency phase are the most closely and visibly related to preparedness and early warning capabilities, whereas responses comprise the ability of actors to mobilize resources to achieve concrete results during emergencies. Environmental emergencies create crises and damage that require resilience after the events. The analytical framework that was elaborated and applied in this paper is more analytically sensitive to the dynamic emergency management framework because it combines the advantages of the 4R theory, PPRR emergency management theory, crisis life cycle theory and ISO 22320 for crisis management. As such, it conceptualizes specific governance capabilities as a corollary of the complex interplay between preparation, early warning, response and recovery.

2.1.1. Preparedness Capability

A key aspect of an environmental emergency management framework is preparation for environmental emergencies. Large-scale environmental emergencies require large and diverse resources, including real-time information, experienced personnel, appropriate facilities and advanced problem-solving skills [38], all of which demand that governments be well prepared for such emergencies. A process-based resource discovery mechanism was proposed in this study, which uses information technology to find relevant resources, design environmental risk response systems and formulate emergency plans that enable governments to be ready for environmental emergencies [39]. This mechanism requires environmental governance arrangements to be adaptive. Adaptive governance involves the ability to “understand environmental change”, “use this understanding to inform decision making” and then “act on decisions in a manner that sustains resilience of desirable system states” [40].
Moreover, it includes the ability to “review and adapt decisions as new information becomes available” [41]. Therefore, gathering knowledge by monitoring and learning the impacts of ecosystem changes and management interventions within natural systems is considered a key aspect of adaptive preparedness governance [42,43,44]. At the normative level, adaptive governance requires the willingness to adjust or modify decisions in response to changing circumstances. Emergency preparedness planning is essential for ensuring the continuity of local government operations, especially in terms of supporting response and recovery efforts. It must ensure the effective coordination of response and recovery efforts. Therefore, “H1: Preparedness Capability” was chosen as one of the four components of local government environmental emergency management.

2.1.2. Early Warning Capability

An information-based professional environmental warning system is essential for environmental governance. Considering the breadth of systemic environmental risks and the limited management resources, it makes sense to establish a priority management list and identify key items that should be regulated in advance. There is broad consensus in the literature that the creation, mobilization and utilization of environmental emergency knowledge are key issues for early warning systems [45,46,47]. One such concept is the “knowledge system”, which refers to a social system that includes knowledge claims, groups of actors and different methods for knowledge creation and exchange; these factors together form a particular worldview. The mandatory disclosure of environmental risk information would put additional public pressure on polluters and force environmental authorities to reduce risks. For example, in case of “no emergency at hand”, the prediction system would be activated to estimate the probability of a disaster occurring in the next moment and notify the emergency preparedness agency to propose measures to deal with the impending disaster in advance [28].
In situations where the consequences are high and the cost of prevention is low, it can be helpful to identify anything that could go wrong. It is important to exercise caution when facing possible threats. Environmental governance may involve learning about the impacts of environmental emergencies, protection or escapes, prior training, public awareness and bringing together knowledge from a wide range of scientific and non-scientific sources [48]. For example, a principle may say the following: “When in doubt, take protective action”, which was a lesson followed by Chinese county officials when they warned residents to vacate their homes before the 1976 Tangshan earthquake. As officials try to anticipate and prepare for all risks, heightened attention and precautions can stall them and they may take unnecessary action when faced with a highly unlikely threat. Therefore, “H2: Early Warning Capability” was chosen as one of the four components of local government environmental emergency management.

2.1.3. Responsiveness

Preparation and warnings are critical, but the ultimate test is how local governments respond when an emergency occurs. After the occurrence of an environmental emergency, local governments grade the emergency response according to the severity and development trend of that environmental emergency and organize all relevant departments to carry out on-site pollution disposal, the relocation of personnel, medical rescue, emergency monitoring, information release, maintaining social stability, etc. At its core, environmental emergency management generally means responding to all emergencies, regardless of their severity, scope or expectations. Since many local government agencies, personnel and resources are involved in planning for and response to emergencies, local governments must incorporate the prediction and management of emergencies into their overall development and management plans. Local government officials must deal with the immediate consequences of disasters, coordinate the formulation and execution of comprehensive disaster response plans, respond to citizen demands and provide additional resources and personnel, showcasing their commitment to promoting public interest and improving professional standards [49]. Additional resources based on emergency management plans and protocols may add more stringent requirements. Nonetheless, efficient decision-making and problem-solving protocols must be put in place, along with the selective use of practices, to help responders to adapt to specific disruptions to the emergency response infrastructure [5].
Emergency response agents coordinate with emergency assessment and resource discovery and allocation agents to develop strategies for mitigating the effects of ongoing emergencies [50]. For example, local governments must be familiar with the state regulations on disaster planning and mitigation, budgeting, zoning, taxation, public works management and transportation. They must provide various emergency services (such as police, fire and emergency medical services), the protection of public goods and support services (such as maintaining traffic flows). The agents responsible for resource discovery and allocation search for the relevant resources that are required and deploy the resources according to the topology of the transport network. Therefore, “H3: Responsiveness” was chosen as one of the four components of local government environmental emergency management.

2.1.4. Recovery Capability

The specific capabilities that are highlighted after an environmental emergency focus on the recovery phase. The recovery backup system for environmental emergency management has to improve error tolerance, decentralize network coupling and widely disperse and dilute risks [51]. Local officials need to ensure that all sectors provide essential services that are critical to local recovery efforts and the normal functioning of the social and economic environment [52]. It bears noting that disasters can lead to all types of changes. For example, an impending hurricane can require solutions for resource allocation, grading and evacuation methods. When time frames are longer and solutions to crises need to be learned and redesigned, as in cases of illness and psychological trauma, temporary changes to systems may be required [53]. Therefore, in practice, improving resilience against systemic environmental risks should involve competencies from the recovery phase. For example, engineering projects, such as ecosystem restoration and risk inspection, are the most immediate measures for mitigating environmental risks and improving risk resilience. Green financial instruments, such as liability insurance, within the economic system can help to maintain economic resilience in the face of damaging environmental risks. Therefore, “H4: Recovery Capability” was chosen as one of the four components of local government environmental emergency management.

3. Materials and Methods

3.1. Questionnaire

We sent out an expert sample survey to 75 environment emergency management officials from Zhejiang province who had experience of working with environmental emergency events, such as flooding and hurricanes. In this survey, officials were asked to provide extensive comments on the four capacities, covering a range of competencies within environmental emergency management. The gender ratio of male respondents to female respondents was 85.5% to 14.5%. For the age distribution, more than half of the respondents were middle-aged (aged 40 to 60), accounting for 56.5%, which is similar to the age distribution of civil servants in China. In terms of academic qualifications, 66.1% of the respondents had bachelor’s degrees and 27.4% had graduate degrees or above, which indicated that the respondents had an above-average level of education and could better understand the questionnaire. Each participant was asked to select from a list of competencies those to which they felt they belonged to some extent and many protocols needed to be adjusted or improvised. We provided semi-forced-choice schemes as alternatives for generating the empirical data.
Over an eight-week period, we contacted potential survey participants via email and/or phone to follow up and remind them to return their completed surveys as soon as possible. Of the 75 emergency management officials who were contacted, 62 supplied complete and valid responses. The demographics of the respondents showed that they were generally male, older, experienced in government and emergency management, had experienced more than one environmental crisis in their careers and had significant responsibilities. Respondents were given 37 options based on the 4R theory of crisis management, PPRR emergency management, crisis life cycle theory and ISO 22320. They were asked to choose one value from five to ten competencies that they felt would best fit the four competencies: preparedness, early warning, response and recovery. SPSS 23.0® software was used for the exploratory factor analysis to test the validity of the questionnaire. The KMO (Kaiser–Meyer–Olkin) value was 0.927 and the Bartlett sphericity test p-value was 0.000.
Data from the questionnaire survey of grassroots officials in Zhejiang province were extracted and analyzed. We used the principal component analysis method to conduct the exploratory factor analysis. The test results showed that of the four extracted factors (preparedness, early warning, response and recovery capabilities) in local government environmental emergency management, the y11 to y16 competencies were classified as one factor to evaluate the preparedness capability, the y21 to y25 competencies were classified as one factor to evaluate the early warning capability, the y31 to y38 competencies were classified as one factor to assess the response capability and the y42 to y45 competencies were classified as one factor to evaluate the recovery capability. This was consistent with the four dimensions of local government environmental emergency management capacity derived from the theory (see Table 1).
From the perspective of the cumulative variance contribution rate, the variance contribution rates of the four capabilities (preparedness, early warning, response and recovery) were 28.418%, 20.515%, 18.294% and 14.516%, respectively. The cumulative variance contribution rate was 81.743% and showed that the extracted common factors had strong explanatory power. The analysis of the test samples showed that the questionnaire on local government environmental emergency management capability had a high validity. We applied the Cronbach’s α coefficient to run the reliability test. The results showed that the Cronbach’s α coefficient of the questionnaire was 0.975. The Cronbach’s α coefficients of the four dimensions (preparedness, early warning, response and recovery) were 0.812, 0.942, 0.963 and 0.935, respectively. Therefore, the questionnaire on the local government emergency management capability and its four dimensions had a high reliability.

3.2. Sample Selection and Data Collection

It was necessary to further determine the survey objects to design a questionnaire of higher efficiency and reliability. County-level governments hold an important position within the national environmental emergency management system. Environmental emergencies often occur at the grassroots level and county-level governments are important for responding to those environmental emergencies. Therefore, county-level government officials were selected as the research subjects. The questionnaire was distributed through interviews, emails and telephone calls. From July 2020 to October 2020, we distributed 800 questionnaires and collected 791 completed questionnaires, of which 784 were valid.

4. Empirical Analysis

4.1. Confirmatory Factor Analysis

This research used AMOS23.0® software (IBM in New York, NY, USA) to implement a confirmatory factor analysis on local government environmental emergency management capability. The measurement model included four latent variables: preparedness, early warning, response and recovery capabilities. The fitting results showed that the p-value of each path was 0.000 and that the standardized path coefficients were all above 0.65, indicating that the theoretical indicators could effectively measure the level of local government environmental emergency management. However, the model fit test did not meet the standard and only seven indicators met or were close to the standard. According to the correction index of each parameter of the measurement model, the co-variation relationships between the measurement errors of indicators, such as e1 and e2, e3 and e4, e5 and e7, e8 and e10, e16 and e18, were corrected and the revised confirmatory factor analysis model was obtained (Figure 2).
The fitting effect of the revised measurement model was greatly improved and the fit index reached or was close to the model fit standard (RMSEA = 0.049 < 0.08; GFI = 0.934 > 0.90; AFI = 0.917 > 0.90; NFI = 0.971 > 0.90; RFI = 0.966 > 0.90; IFI = 0.981 > 0.90; TLI = 0.978 > 0.90; CFI = 0.981 > 0.90; PGFI = 0.849 > 0.50; PNFI = 0.840 > 0.50; PCFI = 0.849 > 0.50; CN = 337). The results showed that the confirmatory factor analysis measurement model had good fit and external qualities. The normalized load coefficient of each path coefficient was above 0.65, the p-value was 0.000 and there were no large standard errors (between 0.02 and 0.035) (Table 2).
In terms of the relationships between the latent variables, the correlation coefficients between “preparedness”, “early warning”, “response” and “recovery” were all above 0.75 and the p-value was 0.000, indicating that there was a strong correlation between the four latent variables. There could be another higher-order public latent variable above the four latent variables. They jointly measured the same latent variable: local government environmental emergency management capability. Therefore, using a measurement model (CFA) for the study was more appropriate.
According to the multivariate correlation analysis, the multivariate correlation coefficients of the remaining measurement indicators, except for y13, y14 and y15, were all above 0.50. The results indicated that the latent variables could explain at least 50% of the variance in most measurement indicators. The composite reliability (CR) of the four dimensions of local government environmental emergency management capability was above 0.9 (preparation = 0.919; early warning = 0.941; response = 0.974; recovery = 0.957). The average variance extracted (AVE) was higher than 0.65 (preparation = 0.656; early warning = 0.762; response capability = 0.822; recovery = 0.847). These results indicated that the confirmatory factor analysis model had a good inherent quality.

4.2. Descriptive Analysis

This section presents the descriptive statistical analysis of the scores for each dimension of local government environmental emergency management capability using the arithmetic mean method. Table 3 shows that the average arithmetic score of each competency exceeded 4.0 points (the total score was 7), except for “the areas with the environmental emergency have a good culture of environmental emergency management” and “the areas with the environmental emergency have the relatively developed environmental emergency industry that can provide high-quality environmental emergency products”. In other words, the scores for local government environmental emergency management capability were in the upper-middle level. The competency of “the government has good ability to mobilize the people to join in involving the environmental emergency” obtained the highest score and the competency of “the government is getting better at using experts and big data technology to help deal with environmental emergency” also reached a high level. However, the competency scores for “the areas with the environmental emergency have a good culture of environmental emergency management” and “the government actively educates the people the environmental emergency management knowledge and implements simulation exercises” were low. This showed that the respondents thought that China has a solid social mobilization ability, especially in the face of environmental emergencies and crises, across the country. In contrast, local governments did not perform well within the culture of environmental emergency management, so local governments should actively adopt diversified methods to create a cultural atmosphere of environmental emergency management and enhance citizen awareness of environmental emergency management. From the perspective of regional distribution, the scores for various measurement indicators in the eastern region were higher than those in the central, western and northeastern regions.
In conclusion, the score for the local government environmental emergency management capability and the scores for each dimension (preparedness, early warning, response and recovery) produced similar results. The eastern region had the highest score and the scores of the central, western and northeastern regions were relatively close. The above results showed the regional differences in local government environmental emergency management capability across China.

4.3. Variance Analysis

Before the variance analysis, we first examined the homogeneity of the variance test for local government environmental emergency management capability in different regions. The test results showed that the p-value was 0.395 and that local government environmental emergency management capability was homogeneous for the eastern, central, western and northeastern regions. The results of the variance analysis showed that the p-value was 0.000, indicating that the score distribution of local government environmental emergency management capability was statistically significant for the eastern, central, western and northeastern regions. We applied a post-test of the variance analysis on the premise of the homogeneity of variance (see Table 4). The test results in the LSD column show that the mean difference between the eastern region and the central, western and northeastern regions was positive and that the p-value was 0.000, indicating that the score for the eastern region was higher than those for the central, western and northeastern regions and that there was a significant difference between their capabilities. Similarly, the difference between the scores for the central and northeast regions was also significant. In contrast, the difference between the scores for the central region and the western region and between the scores for the western region and the northeast region were not significant.
As the correlation between the latent variables (preparedness, early warning, response and recovery) was significant, we used the multivariate analysis of variance to test the differences between the scores for each dimension of local government environmental emergency management capability in the different regions. The results of the Levene’s test showed that the covariance matrix had a homogenous level across the different dimensions (p-values for preparedness, early warning, response and recovery were 0.238, 0.447, 0.868 and 0.099, respectively). The results of the multivariate analysis of variance showed that the p-value obtained using the four different test methods listed in the area column (regional distribution) was 0.000, which meant that the dimensions of local government environmental emergency management capability had significant differences in the central, western and northeastern regions (see Table 5).
The post hoc test of the multivariate analysis of variance showed that in terms of preparedness, the mean difference between the eastern region and the central, western and northeastern regions was positive and that the p-value was 0.000, indicating that the score for the eastern region was higher than those of the central, western and northeastern regions. These regions had significant differences in local government environment management capability. The results were also the same for the central and northeastern regions. However, the p-value of the mean difference between the central and western regions was 0.702, indicating that the difference in scores for the central and western regions was not significant. We obtained the same conclusions from the analysis of the dimensions of preparedness, early warning, response and recovery.

4.4. Findings

The confirmatory factor analysis for local government environmental emergency management capability showed that the reliability and validity levels reached the corresponding standards, so the theoretical indicators and the corresponding questionnaire could effectively measure local government environmental emergency management capability. In addition, the overall fit of the structural equation model was good and the external quality of the measurement model was high. This showed that the confirmatory factor analysis results were consistent with the theoretical deduction, so we were able to divide local government environmental emergency management capability into the preparation, early warning, response and recovery dimensions, which were scientific and reasonable. There was a strong correlation between the preparedness, early warning, response and recovery capabilities, indicating that the four capabilities could exist objectively and operate collaboratively.
Combining with the results of the descriptive statistical analysis and the variance analysis, we found that local government environmental emergency management capability in the eastern region were generally better, while those in the central, western and northeastern regions were relatively low. This was because local government environmental emergency management capability is endogenous and closely related to economic development. The eastern region has the advantages of preferential policies and a high resource allocation efficiency, so this region has become the “first echelon” in China, with high-quality economic development and a high local government environmental emergency management capability. Affected by the spillover effect and radiation from the economy in the eastern region, the central region is the second echelon in the economy and in terms of local government environmental emergency management capability. However, most central, western and northeastern regions are in inland and border areas where economic development is relatively low and supporting facilities are insufficient, so their local government environmental emergency management capability is relatively low. Therefore, we found that the local government environmental emergency management capability in China has regional non-equilibrium characteristics and that there is significant room for improvement.

5. Conclusions and Policy Implications

5.1. Conclusions

Based on the emergency management 4R theory, PPRR emergency management theory, crisis life cycle theory and ISO 22320, we defined local government environmental emergency management capability as four dynamic dimensions. They are the preparedness, early warning, response and recovery capabilities. We applied a confirmatory factor analysis model to confirm that the classification standard of the four capabilities strongly correlated with environmental emergency management. We found that China’s local government environmental emergency management capability is generally at an upper-middle level. In detail, the local governments have a solid social mobilization ability in the face of environmental emergency events, but they do not develop a good environmental emergency management culture. We also analyzed the differences in local government environmental emergency management capability across China. We found that the eastern region had a higher environmental emergency management capability, while those of the central, western and northeastern regions were close to each other, showing a decreasing distribution in the east–central–west–northeast region. Similar results were also obtained for the four dimensions of preparedness, early warning, response and recovery capabilities across China.

5.2. Policy Implications

The performance of local government environmental emergency management may affect the results of local government environmental governance and its sustainability. Once an environmental emergency event occurs, the local government environmental emergency management capability is directly related to the safety of people’s lives and property and the quality of the ecological environment. For example, if municipal solid waste is not disposed of in time, it leads to an ecological imbalance of land, water and air pollution [54,55,56,57]. In general, to improve the local government environmental emergency management capability and reduce the negative impacts and ecological damage caused by environmental emergencies, the local governments in China should improve their environmental emergency management in the following aspects.
Firstly, China should reshape the concept of environmental emergency management as a dynamic process, including pre-, during and post-emergency stages, and pay attention to balancing the distribution of efforts and resources throughout the whole process. Environmental emergency management is a complex adaptive system that maximizes collective effectiveness. All preparation, early warning, response and recovery capacities need to be emphasized. A poor performance in any stage may lead to a significant failure in environmental emergency management practices. For example, in an emergency response stage caused by solid waste, the poor disposal of solid waste by city governors may result in serious health and environmental problems, such as unpleasant odors and the risk of explosion in landfill areas, as well as groundwater pollution because of leachate infiltration [58]. Our empirical evaluation showed that local government environmental emergency management scores in the preparation and early warning stages were lower than those in the response and recovery stages. This indicates that local government environmental emergency management focuses more on emergency response and pays less attention to preparation for and early warnings of emergencies. Therefore, local governments should balance their allocation of efforts and resources throughout the whole process of environmental emergency management. For example, local governments should pay more attention to simulation exercises, the cultivation of environmental emergency culture and the development of environmental emergency industries. In addition, local governments should apply standard environmental emergency management policy tools and real-time updates of environmental emergency management plans and enhance their pertinence and operability to prevent environmental emergency risks. Moreover, local governments should pay more attention to the comprehensive monitoring, effective identification and early warning of environmental risks, as well as playing the front-end “starter” function of environmental emergency management to prevent and avoid emergencies.
Secondly, China needs to promote the coordinated regional development of environmental emergency management capability to narrow the gap between the eastern, central, western and northeastern regions. Affected by multiple factors, such as economic development and environmental emergency management talents, local government environmental emergency management capability in the eastern region is generally more potent than those in the central, western and northeastern regions. However, environmental emergencies have spillover characteristics, such as emergencies caused by solid waste that can cause cross-regional air and water pollution [59]. Environmental governance requires holistic governance from a global perspective. Therefore, the central government should conduct the overall planning to improve local government environmental emergency management capability. For example, the central government should establish an equalization-oriented public finance system for environmental emergency management and provide appropriate policy preferences to the central, western and northeastern regions in terms of special transfer payments for environmental emergency management and the training of environmental emergency personnel. In addition, it is also possible to improve the environmental emergency management experience exchange and learning system. For example, the government should arrange for environmental emergency management officials and experts in the eastern region to serve in the central, western and northeastern regions and guide the practices of environmental emergency management in those regions.
Thirdly, the local government in China should use technology empowerment to improve local government environmental emergency management capability. For example, local governments should actively adopt big data technology within environmental emergency management for emergencies that are caused by solid waste [60], establish a comprehensive platform for environmental emergency management information systems, quickly collect, analyze and share real-time information on environmental emergencies and use experimental virtual social platforms to simulate environmental emergencies. That way, the local governments could obtain accurate data and support for early warnings, the preparation of emergency materials and emergency team deployment, thereby truly improving local government environmental emergency management capability. Local governments should also fulfill the supporting role of experts in environmental emergency management because experts play a positive role within environmental emergency management by providing rational cognition, decision-making reference and positive public opinion guidance for disseminating environmental emergency information.
This study had some limitations. The study did not conduct long-term data tracking to obtain panel data, but rather collected cross-sectional data over a short period to analyze local government environmental management capability, so we did not explore the temporal and spatial evolution of local government environmental emergency management capability. The research only provided a preliminary design for constructing and evaluating local government environmental emergency management capability using empirical data and did not discuss the mechanisms affecting those capabilities. Future work could include collecting panel data to describe the temporal and spatial evolution of local government environmental emergency management capability.

Author Contributions

Conceptualization, B.F.; writing—original draft, L.T.; writing—review and editing, C.L. and G.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Social Science Foundation of China, grant numbers 21&&ZD089.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. National Bureau of Statistics. Environmental Emergency Events from 2000 to 2020. Available online: http://www.stats.gov.cn/tjsj/ndsj/ (accessed on 9 May 2022).
  2. Troschinetz, A.M.; Mihelcic, J.R. Sustainable recycling of municipal solid waste in developing countries. Waste Manag. 2009, 29, 915–923. [Google Scholar] [CrossRef] [PubMed]
  3. Koliba, C.J.; Mills, R.M.; Zia, A. Accountability in governance networks: An assessment of public, private, and nonprofit emergency management practices following Hurricane Katrina. Public Adm. Rev. 2011, 71, 210–220. [Google Scholar] [CrossRef]
  4. French, P.E.; Raymond, E.S. Pandemic influenza planning: An extraordinary ethical dilemma for local government officials. Public Adm. Rev. 2009, 69, 823–830. [Google Scholar] [CrossRef]
  5. Urbina, E.; Wolshon, B. National review of hurricane evacuation plans and policies: A comparison and contrast of state practices. Transp. Res. Part A Policy Pract. 2003, 37, 257–275. [Google Scholar] [CrossRef]
  6. Gonzalez, R.A. Developing a multi-agent system of a crisis response organization. Bus. Process Manag. J. 2010, 16, 847–870. [Google Scholar] [CrossRef]
  7. Jennifer, W.; Yemaie, A.O. The evolution of emergency management and the advancement towards a profession in the United States and Florida. Saf. Sci. 2001, 39, 117–131. [Google Scholar]
  8. Hu, Q.; Zhang, H.B.; Kapucu, N.; Chen, W. Hybrid Coordination for Coping with the Medical Surge from the COVID-19 Pandemic: Paired Assistance Programs in China. Public Adm. Rev. 2020, 80, 895–901. [Google Scholar] [CrossRef]
  9. Christensen, T.; Danielsen, O.A.; Laegreid, P.; Rykkja, L. Comparing coordination structures for crisis management in six countries. Public Adm. 2016, 94, 316–332. [Google Scholar] [CrossRef]
  10. Lutz, L.D.; Lindell, M.K. Incident command system as a response model within emergency operation centers during Hurricane Rita. J. Conting. Crisis Manag. 2008, 16, 122–134. [Google Scholar] [CrossRef]
  11. Rosenthal, U.; Kouzmin, A. Crises and crisis management: Toward comprehensive government decision making. J. Public Adm. Res. Theory 1997, 7, 277–304. [Google Scholar] [CrossRef]
  12. Comfort, L.K.; Kapucu, N.; Ko, K.; Menoni, S.; Siciliano, M. Crisis decision-making on a global scale: Transition from cognition to collective action under threat of COVID-19. Public Adm. Rev. 2020, 80, 616–622. [Google Scholar] [CrossRef] [PubMed]
  13. Pearson, C.M.; Clair, J.A. Reframing crisis management. Acad. Manag. Rev. 1998, 23, 59–76. [Google Scholar] [CrossRef]
  14. Aboudzadeh, N.; Shoshtari, A.; Hashemnia, S. Crisis management: Planning for the inevitable. Manag. Sci. Lett. 2014, 4, 1191–1196. [Google Scholar] [CrossRef]
  15. Comfort, L.K. Crisis management in hindsight: Cognition, communication, coordination, and control. Public Adm. Rev. 2007, 67, 189–197. [Google Scholar] [CrossRef]
  16. Morris, J.C.; Morris, E.D.; Jones, D.M. Reaching for the philosopher’s stone: Contingent coordination and the military’s response to Hurricane Katrina. Public Adm. Rev. 2007, 67, 94–106. [Google Scholar] [CrossRef]
  17. Liu, K.F. Agent-based resource discovery architecture for environmental emergency management. Expert Syst. Appl. 2004, 27, 77–95. [Google Scholar] [CrossRef]
  18. Paavola, J. Institutions and environmental governance: A reconceptualization. Ecol. Econ. 2007, 63, 93–103. [Google Scholar] [CrossRef]
  19. Tacconi, L. Developing environmental governance research: The example of forest cover change studies. Environ. Conserv. 2011, 38, 234–246. [Google Scholar] [CrossRef]
  20. Heath, R. Crisis Management; China Citic Press: Beijing, China, 2001. [Google Scholar]
  21. Xue, L.; Zhang, Q.; Zhong, K. Crisis Management: A Challenge for China in Transition; Tsinghua Univeristy Press: Beijing, China, 2003. [Google Scholar]
  22. Wart, M.V.; Kapucu, N. Crisis Management Competencies. Public Manag. Rev. 2011, 13, 489–511. [Google Scholar] [CrossRef]
  23. Steven, F. American Management Association. Crisis Management: Planning for the Inevitable; Amacom: New York, NY, USA, 1989. [Google Scholar]
  24. International Organization for Standardization. ISO22320: Societal Security Emergency Management Requirements for Incident Response. Available online: https://www.iso.org/standard/53347.html (accessed on 9 May 2022).
  25. Jensen, S.F.; Jensen, S.J.; Smith, S.M.; Vigneaux, G. The next generation core competencies for emergency management. J. Emerg. Manag. 2019, 17, 17–25. [Google Scholar]
  26. Johnson, R. GIS Technology for Disasters and Emergency Management. 2000. Available online: https://www.esri.com/~/media/Files/Pdfs/library/whitepapers/pdfs/disastermgmt.pdf (accessed on 6 March 2022).
  27. Wyborn, C.A. Connecting knowledge with action through coproductive capacities: Adaptive governance and connectivity conservation. Ecol. Soc. 2015, 20, 11. [Google Scholar] [CrossRef] [Green Version]
  28. Lemos, M.C.; Agrawal, A. Environmental governance. Annu. Rev. Environ. Resour. 2006, 31, 297–325. [Google Scholar] [CrossRef]
  29. Bohensky, E.L.; Maru, Y. Indigenous knowledge, science, and resilience: What have we learned from a decade of international literature on “integration”? Ecol. Soc. 2011, 16, 4. [Google Scholar] [CrossRef] [Green Version]
  30. Folke, C.; Hahn, T.; Olsson, P.; Norberg, J. Adaptive governance of social-ecological systems. Annu. Rev. Environ. Resour. 2005, 30, 441–473. [Google Scholar] [CrossRef] [Green Version]
  31. Hernandez, J.Z.; Serrano, J.M. Knowledge-based models for emergency management systems. Expert Syst. Appl. 2001, 20, 173–186. [Google Scholar] [CrossRef]
  32. Koumiotis, S.P.; Kiranoudis, C.T.; Markatos, N.C. A system approach to effective chemical emergency management. Saf. Sci. 2001, 38, 49–61. [Google Scholar] [CrossRef]
  33. Driessen, P.P.J.; Dieperink, C.; Laerhoven, F.V.; Runhaar, H.A.C.; Vermeulen, W.J.V. Towards a conceptual framework for the study of shifts in modes of environmental governance–experiences from the Netherlands. Environ. Policy Gov. 2012, 22, 143–160. [Google Scholar] [CrossRef] [Green Version]
  34. Wallington, T.; Lawrence, G.; Loechel, B. Reflections on the legitimacy of regional environmental governance: Lessons from Australia’s experiment in natural resource management. J. Environ. Policy Plan. 2008, 10, 1–30. [Google Scholar] [CrossRef]
  35. Arts, B.; Leroy, P.; Tatenhove, J.V. Political modernization and policy arrangements: A framework for understanding environmental policy change. Public Organ. Rev. 2006, 6, 93–106. [Google Scholar] [CrossRef]
  36. Drabek, T.E.; Hoetmer, G.J. Emergency Management: Principles and Practice for Local Government; International City Management Association: Washington, DC, USA, 1991. [Google Scholar]
  37. Kapucu, N. Interorganizational coordination in complex environments of disasters: The evolution of intergovernmental disaster response systems. J. Homel. Secur. Emerg. Manag. 2009, 6. [Google Scholar] [CrossRef]
  38. Bulkeley, H. Reconfiguring environmental governance: Towards a politics of scales and networks. Political Geogr. 2005, 24, 875–902. [Google Scholar] [CrossRef] [Green Version]
  39. Boin, A.; Kuipers, S.; Overdijk, W. Leadership in times of crisis: A framework for assessment. Int. Rev. Public Adm. 2013, 18, 79–91. [Google Scholar] [CrossRef] [Green Version]
  40. Arts, B.; Tatenhove, J.V. Policy and power: A conceptual framework between the ‘old’and ‘new’policy idioms. Policy Sci. 2004, 37, 339–356. [Google Scholar] [CrossRef]
  41. Evans, L.S.; Brown, K.; Allison, E.H. Factors influencing adaptive marine governance in a developing country context: A case study of southern Kenya. Ecol. Soc. 2011, 16, 2. [Google Scholar] [CrossRef] [Green Version]
  42. Cvitanovicab, C.; Hobdaybc, A.J.; Kerkhoffa, L.V.; Wilsonde, S.K.; Dobbsf, K.; Marshallg, N.A. Improving knowledge exchange among scientists and decision-makers to facilitate the adaptive governance of marine resources: A review of knowledge and research needs. Ocean. Coast. Manag. 2015, 112, 25–35. [Google Scholar] [CrossRef] [Green Version]
  43. Federal Emergency Management Agency (FEMA). Available online: https://www.fema.gov/emergency-managers/national-preparedness/goal (accessed on 9 May 2022).
  44. Termeer, C.J.; Dewulf, A.; Lieshout, M.V. Disentangling scale approaches in governance research: Comparing monocentric, multilevel, and adaptive governance. Ecol. Soc. 2010, 15, 4. [Google Scholar] [CrossRef]
  45. Weiss, K.; Hamann, M.; Kinney, M.; Marsh, H. Knowledge exchange and policy influence in a marine resource governance network. Glob. Environ. Change 2012, 22, 178–188. [Google Scholar] [CrossRef]
  46. Meffe, G.K.; Viederman, S. Combining science and policy in conservation biology. Wildl. Soc. Bull. 1995, 23, 327–332. [Google Scholar]
  47. Giebels, D.; Buuren, A.V.; Edelenbos, J. Ecosystem-based management in the Wadden Sea: Principles for the governance of knowledge. J. Sea Res. 2013, 82, 176–187. [Google Scholar] [CrossRef]
  48. Kapucu, N.; Wart, M.V. Making matters worse: An anatomy of leadership failures in managing catastrophic events. Adm. Soc. 2008, 40, 711–740. [Google Scholar] [CrossRef]
  49. Armitagea, D.; Berkesb, F.; Dalea, A.; Schellenbergb, E.; Pattonb, E. Co-management and the co-production of knowledge: Learning to adapt in Canada’s Arctic. Glob. Environ. Change 2011, 21, 995–1004. [Google Scholar] [CrossRef]
  50. Wise, C.R. Organizing for homeland security after Katrina: Is adaptive management what’s missing? Public Adm. Rev. 2006, 66, 302–318. [Google Scholar] [CrossRef]
  51. Waugh, J.W.L.; Streib, G. Collaboration and leadership for effective emergency management. Public Adm. Rev. 2006, 66, 131–140. [Google Scholar] [CrossRef]
  52. Perry, R.W.; Lindell, M.K.; Tierney, K.J. Facing the unexpected: Disaster preparedness and response in the United States. Disaster Prev. Manag. 2002, 11, 222. [Google Scholar]
  53. Moynihan, D.P. Learning under uncertainty: Networks in crisis management. Public Adm. Rev. 2008, 68, 350–365. [Google Scholar] [CrossRef] [Green Version]
  54. Bi, J.; Yang, J.X.; Liu, M.M.; Ma, Z.W.; Fang, W. Toward Systemic Thinking in Managing Environmental Risks. Engineering 2021, 7, 1518–1522. [Google Scholar] [CrossRef]
  55. Kansal, A.; Prasad, R.K.; Gupta, S. Delhi municipal solid waste and environment—An appraisal. Indian J. Environ. Prot. 1998, 18, 123–128. [Google Scholar]
  56. Sharholy, M.; Ahmad, K.; Mahmood, G.; Trivedi, R.C. Municipal solid waste management in Indian cities—A review. Waste Manag. 2008, 28, 459–467. [Google Scholar] [CrossRef]
  57. Rathi, S. Alternative approaches for better municipal solid waste management in Mumba, India. J. Waste Manag. 2006, 26, 1192–1200. [Google Scholar] [CrossRef]
  58. Ray, M.R.; Roychoudhury, S.; Mukherjee, G.; Roy, S.; Lahiri, T. Respiratory and general health impairments of workers employed in a municipal solid waste disposal at open landfill site in Delhi. Int. J. Hyg. Environ. Health 2005, 108, 255–262. [Google Scholar] [CrossRef]
  59. Fathi, H.; Zangane, A.; Fathi, H.; Moradi, H. Municipal solid waste characterization and its assessment for potential methane generation: A case study. Sci. Total Environ. 2006, 371, 1–10. [Google Scholar]
  60. Gupta, S.; Mohan, K.; Parsad, R.; Gupta, S.; Kansal, A. Solid Waste Management in India: Options and Opportunities. Resour. Conserv. Recycl. 1998, 24, 137–154. [Google Scholar] [CrossRef]
Figure 1. The dynamic framework of environmental emergency management.
Figure 1. The dynamic framework of environmental emergency management.
Sustainability 14 06760 g001
Figure 2. Modified confirmatory factor analysis model.
Figure 2. Modified confirmatory factor analysis model.
Sustainability 14 06760 g002
Table 1. The rotation component matrix of the revised dimensions of local government environmental emergency management capability.
Table 1. The rotation component matrix of the revised dimensions of local government environmental emergency management capability.
IndicatorCapabilities
1234
y110.660
y120.692
y130.640
y140.732
y150.777
y160.559
y21 0.765
y22 0.846
y23 0.781
y24 0.837
y25 0.642
y31 0.744
y32 0.763
y33 0.763
y34 0.760
y35 0.733
y36 0.762
y37 0.752
y38 0.750
y42 0.707
y43 0.690
y44 0.713
y45 0.699
Table 2. Path coefficients of the modified confirmatory factor analysis model.
Table 2. Path coefficients of the modified confirmatory factor analysis model.
Indicator EstimatesStandardized EstimatesSdC.R.Sig.
y11Preparedness10.903
y12Preparedness0.8470.8030.02533.332***
y13Preparedness0.8610.7810.03028.843***
y14Preparedness0.7350.6460.03521.174***
y15Preparedness0.8780.7540.03227.142***
y16Preparedness1.0720.9090.02739.824***
y21Early Warning10.907
y22Early Warning0.7770.8300.02432.562***
y23Early Warning0.9350.8940.02438.811***
y24Early Warning0.8680.8700.02436.214***
y25Early Warning0.9740.8400.02933.662***
y31Early Warning10.923
y32Early Warning0.9280.8660.02438.794***
y33Response0.9740.9290.02047.722***
y34Response1.0130.9420.0250.163***
y35Response0.8370.8770.02140.081***
y36Response0.9970.9300.02147.912***
y37Response0.8750.8670.02338.848***
y38Response0.9730.9010.02243.271***
y42Recovery10.932
y43Recovery0.9840.9180.02146.347***
y44Recovery0.9420.9170.02046.220***
y45Recovery0.9770.9150.02145.913***
Note: *** The mean difference was significant at the 0.01 level.
Table 3. Arithmetic means of the dimensions of local government environmental emergency management capability.
Table 3. Arithmetic means of the dimensions of local government environmental emergency management capability.
DimensionIndicatorMeanEastern Region MeanCentral Region MeanWestern Region MeanNortheast Region Mean
Preparednessy114.34955.02044.31534.19793.8046
y124.15694.90314.15773.96353.5287
y134.26154.73984.30633.94274.0172
y143.78194.21173.52553.69273.6207
y153.96174.70923.9553.65623.4655
y164.62245.28574.59464.45314.0977
Early Warningy214.47455.20924.50454.28653.8161
y224.24235.11734.21174.0263.5345
y234.34185.18884.36944.09373.6264
y244.22965.07144.33783.9013.5057
y254.73855.40824.69374.4014.4138
Responsey314.68495.22454.69824.54174.2184
y324.55235.03574.51354.41674.2069
y334.76285.28574.76134.6254.3276
y344.69395.27044.64414.59384.2184
y355.00775.51534.90094.88544.7069
y364.73215.3014.73874.61464.2126
y374.98855.52554.93694.80734.6494
y384.75645.32144.69824.5994.3678
Recoveryy424.67355.29084.67124.45314.2241
y434.65945.25514.66224.54.1609
y444.46054.76534.54.33334.2069
y454.71565.35714.68024.55734.2126
Table 4. Post-test of the variance analysis of local government environmental emergency management capability.
Table 4. Post-test of the variance analysis of local government environmental emergency management capability.
Dependent Variable: Local Government Environmental Emergency Management Capability
(I) Region (J) RegionMean Difference (I–J)Standard Error Sig.
LSDEasternCentral0.58206 *0.144380.000
Western0.78773 *0.149570.000
Northeastern1.08184 *0.153660.000
CentralEastern−0.58206 *0.144380.000
Western0.205660.145170.157
Northeastern0.49977 *0.149390.001
WesternEastern−0.78773 *0.149570.000
Central−0.205660.145170.157
Northeastern0.294110.154410.057
NortheasternEastern−1.08184 *0.153660.000
Central−0.49977 *0.149390.001
Western−0.294110.154410.057
TamhaneEasternCentral0.58206 *0.12120.000
Western0.78773 *0.139070.000
Northeastern1.08184 *0.170010.000
CentralEastern−0.58206 *0.12120.000
Western0.205660.136040.571
Northeastern0.49977 *0.167540.018
WesternEastern−0.78773 *0.139070.000
Central−0.205660.136040.571
Northeastern0.294110.180890.486
NortheasternEastern−1.08184 *0.170010.000
Central−0.49977 *0.167540.018
Western−0.294110.180890.486
Note: * The mean difference was significant at the 0.05 level.
Table 5. Multivariate ANOVA model estimation.
Table 5. Multivariate ANOVA model estimation.
ValueFDF1DF2Sig.
InterceptPillai’s Trace0.9061881.893 a47770.000
Wilks’ Lambda0.0941881.893 a47770.000
Hotelling’s Trace9.6881881.893 a47770.000
Roy’s Largest Root9.6881881.893 a47770.000
AreaPillai’s Trace0.1157.791223370.000
Wilks’ Lambda0.8858.089122056.040.000
Hotelling’s Trace0.1298.3561223270.000
Roy’s Largest Root0.12524.336 b47790.000
Note: a. Accurate statistics. b. This statistic is the upper limit of F, which produces a lower limit on significance level.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tang, L.; Fan, B.; Li, C.; Zhao, G. Empirical Evaluation of the Environmental Emergency Management Capability of Local Governments in China. Sustainability 2022, 14, 6760. https://doi.org/10.3390/su14116760

AMA Style

Tang L, Fan B, Li C, Zhao G. Empirical Evaluation of the Environmental Emergency Management Capability of Local Governments in China. Sustainability. 2022; 14(11):6760. https://doi.org/10.3390/su14116760

Chicago/Turabian Style

Tang, Leilei, Bonai Fan, Chengjiang Li, and Gang Zhao. 2022. "Empirical Evaluation of the Environmental Emergency Management Capability of Local Governments in China" Sustainability 14, no. 11: 6760. https://doi.org/10.3390/su14116760

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop