1. Introduction
With the rapid process of urbanization and speeding-up development of the global economy, the growth of electricity consumption is accelerating and is expected to increase by a third by 2040 [
1]. Searching for the solution to satisfy the increasing need for electricity has become an urgent mission in the development of the energy economy all over the world. Simultaneously, the problems of environmental pollution and climate deterioration brought by traditional thermal power generation and the depletion of fossil fuel resources are becoming increasingly serious, which have posed great threats on the sustainable development of human beings [
2,
3]. Towards the aim of handling the problems mentioned above, all countries are shifting to generate electricity using clean and inexhaustible renewable energy, containing tidal power, wind power, biomass power, solar power, and some others [
4]. According to the British Petroleum (BP) World Energy Statistics Yearbook in 2017, by the end of 2016, renewable energy accounted for approximately a quarter of the total electricity generation, and the growth rate of renewable energy generation capacity in 2016 reached 14.1%, half of which originated from wind power generation [
5]. Although wind power generation is one of the most technically mature electricity generation patterns [
6,
7,
8], it can be impacted by lots of uncontrollable factors, including humidity, temperature, and wind speed. Therefore, wind power generation can be intermittent and fluctuating. In the process of grid-connected generation and the increasing penetration of renewable resources-based power production, this will put a power grid into high risk, such as reducing the stability of the power grid system, increasing the difficulty of system dispatching, and decreasing the economic benefits of the system operation [
9,
10]. In order to solve the risks above, great efforts have been made to explore various solutions, such as electrical ESSs, connection external grids, and demand-side management. Among all the potential solutions, an ESS has been deemed as one of the most effective solutions [
11].
An energy storage technique indicates the process of transferring energy from one form (primarily electricity) to a storable form and then the storable energy will be transferred back to electricity energy when needed [
12]. ESS has various precious functions to the electricity grid system operation and balance load, for instance: (1) it can help satisfy peak load requirements and reduce the import of electricity during a peak period, (2) it can provide time-varying electricity management, (3) it can mitigate the intermittent nature of renewable resources based electricity generation, (4) it can improve the reliability and stability of the power grid, and (5) it can help to realize smart grids. Based on the advantages of ESSs, the National Power Grid Corporation in China proposed to construct the demonstration project, combining wind and photovoltaic power generation, an ESS as well as electricity transmission together, to eliminate the fluctuation and intermittent problems of renewable resources-based electricity generation and reducing the abandoning rate of wind and photovoltaic power generation.
Considering the critical role of an ESS in the power grid, many studies focused on studying the technical features and applications of ESSs. For example, References [
13,
14,
15,
16,
17,
18] investigated and reviewed the technical features of different ESSs. Ibrahim et al. [
16] provided features of various ESSs and emphasized the necessities of storing electricity to improve the stability of a power grid. Some literature researched the operational characteristics of energy storage techniques, i.e., physical energy storage including compressed air energy storage [
19], pumped hydroelectricity storage [
20], flywheel energy storage [
21,
22], chemical energy storage containing various kinds of batteries [
23,
24,
25], electromagnetic energy storage embodying superconducting magnetic energy storage [
26], and supercapacitor energy storage [
27]. Additionally, tremendous research has focused on modeling and optimizing ESSs of real or exemplary electricity systems [
28,
29,
30,
31,
32,
33]. However, there are few studies researching the comprehensive evaluation of the application of ESSs. Zhang [
34] analyzed the economic profit and investment cost of an ESS participating in the peak load adjustment in accordance with the actual situation of the battery ESS applied to the distribution network. Das et al. [
35] proposed a generic bulk energy storage dispatch method for generation cost imitation and evaluated the performance and economic profit of storage under different system scenarios. Ren et al. [
36] developed a criteria system for sustainability evaluation of ESSs employing non-linear fuzzy prioritization. The existing studies on the comprehensive evaluation of ESSs are on the basis of the economic benefits of ESSs in a distribution network application, which cannot comprehensively and systematically evaluate the application performance of ESSs [
37].
In accordance with the three types of ESSs classified by operational characteristics mentioned above, physical energy storage is limited by water resources and the geographical environment, the application cost of electromagnetic energy storage is relatively high, and hence, the chemical energy storage technique is widely used due to its safe, economic, and environmentally friendly characteristics. Moreover, it contains various kinds of battery energy storage techniques, such as lithium-ion (Li-ion) battery, sodium–sulfur (NaS) battery, nickel–metal hydride (NiMH) battery, as well as vanadium redox-flow (VRF) battery [
12]. The selection of an ESS of various battery types is a rigorous issue for decision-makers. Hence, it is necessary to develop a comprehensive assessment system for selecting an appropriate battery energy storage technique in establishing an exemplary project combining renewable resources-based electricity generation and an ESS.
The critical devotion of this investigation is that a comprehensive and systematic evaluation system is established based on multi-criteria decision making (MCDM) model to select an appropriate battery type ESS for constructing demonstration projects combining renewable resources-based electricity generation and an ESS. This research conducts a novel integrated and comprehensive evaluation on battery ESS application. The established comprehensive evaluation system of battery ESS selection contains a relatively complete assessment index system on the basis of a fuzzy-Delphi approach from the perspectives of technological performance, economic costs and benefits, as well as social effects, a set of accurate weights determination method comprehensively considering the opinions of experts employing the best-worst method (BWM) and the actual data of objective sub-criteria utilizing an entropy method, and a mature evaluation model based on Vlsekriterijumska Optimizacija I Kompromisno Resenje (VIKOR) to select the optimal battery ESS. Based on the discussion of comprehensive evaluation results, policy implications will be given to improve the applicability of battery ESSs.
The rest of this research are organized as follows. The basic theory of the integrated comprehensive evaluation framework is elaborated in the next section.
Section 3 illustrates the conceptual framework of this research.
Section 4 gives a general description on the five selected battery ESSs.
Section 5 presents the comprehensive assessment. The comprehensive assessment results and some policy implications are discussed in
Section 6.
Section 7 draws the conclusions.
2. Basic Theory of the Integrated Comprehensive Evaluation System
The fundamental methodology of the established comprehensive evaluation system consists of three parts: (1) a fuzzy-Delphi model used to choose evaluation sub-criteria; (2) a BWM and entropy weight determination method utilized to compute weights of the sub-criteria; and (3) a VIKOR model applied to select the optimal battery ESS.
2.1. Fuzzy-Delphi Methodology
A Delphi approach, put forward by Dalky and Helmer, was employed to get the most dependable common view among several experts and was diffusely applied to make a strategic decision as well as forecasting [
38]. The traditional Delphi method provides a chance for experts to obtain replies and revise their views using four rounds of consultations [
39], which is time-consuming and hard to obtain consensus via redundant surveys. Then, a fuzzy-Delphi approach was put forward to alleviate these disadvantages, which integrated the traditional Delphi method with fuzzy theory. For the fuzzy-Delphi method, experts are required to offer three-point estimates employing triangular fuzzy numbers (TFNs) [
40]. The functions of membership degree are utilized to indicate the views of experts so that experts do not need to improve their opinions again and again. The membership degree functions can take all opinions into account, which will not lose any useful information. Owing to the superiorities of the fuzzy-Delphi method, various studies have employed it to establish an evaluation index system [
41]. The procedure of the fuzzy-Delphi methodology is illustrated as follow.
Step 1: Consulting and determining the upper limit and lower limit of importance scope ranging from 0 to 10 for every sub-criterion according to the opinions of several experts. The larger the value is, the more important the sub-criterion becomes. The upper limit represents the most optimistic value and the lower limit indicates the most conservative value.
Step 2: Calculating the conservative TFN and optimistic TFN of each sub-criterion, where and are the minimum values of the conservative and the optimistic values according to the opinions of experts, and are the geometric mean values of the most conservative and the most optimistic values, and and are the maximum values of the most conservative and optimistic values.
Step 3: Examine the coincidence of experts’ preferences and computing the consistent value
of indicator
i [
41,
42].
(1) If
, the opinions on sub-criterion
i are consistent, and the consistent value
can be calculated by
(2) For
, if the data of the gray zone
is less than
, then the consistent value
can be calculated by
For , if the value of the gray zone is larger than the value , the opinions of experts are not consistent. The steps 1 and 2 should be conducted again until the opinions are consistent. indicates the degree of consensus achieved by experts with regard to the importance of every sub-criterion. The more the is, the more important the sub-criterion becomes. In order to find a reasonable critical value for examining the importance of every indicator, the geometric average value of the upper and lower limits of all evaluation sub-criteria needs to be calculated, which is taken as the threshold value to select significant sub-criteria.
The procedure of the fuzzy-Delphi methodology is shown in
Figure 1.
2.2. Weights Determination Methods
In this research, weights of all indicators are integrated using subjective and objective weights. Subjective weights of indicators are determined by the BWM based on the opinions of experts. Objective weights of indicators are determined by the entropy weighting methodology on the basis of the actual data.
2.2.1. The BWM
The BWM is established based on a comparison that is similar to an analytic hierarchy process (AHP). The difference between BWM and AHP is that AHP obtains the optimal weights based on an inter-comparison between two arbitrary indicators that needs
comparisons (
n implies the amount of indicators), while BWM established a structural comparison model that first compares the best sub-criterion to others and then compares others to the worst one, which needs 2
n − 3 comparisons [
43]. The phases of BWM are as follows.
Step 1: Find the best and worst sub-criteria from the decision sub-criteria set to be utilized in the decision procedure. The best sub-criterion should be the most critical, while the worst sub-criterion is the opposite. It should be emphasized that the selection of the best and worst ones only considered the sub-criteria, but not the data of them.
Step 2: Identify the comparing results of the best one to others using the number ranging from 1 to 9. The higher the value is, the more significant the best one over others is. Comparison results can be written as a vector:
where
indicates the value of the best one
B to sub-criterion
i. Obviously,
.
Step 3: Identify the comparison value of others to the worst one utilizing the data ranging from 1 to 9. Results can be written as
where
indicates the value of sub-criterion
i to the worst one
W. Obviously,
.
Step 4: Calculate the weights
. Aiming at obtaining the weights of all indicators, the maximum absolute discrepancies
for all sub-criteria ought to be a minimum, which is expressed as [
43]:
Equation (5) can be calculated simply through converting it into Equation (6) shown as below [
44]:
Then we can calculate the optimal weights .
Step 5: Carry out a consistency examination to test for the comparison consistency. The value of
can be obtained after solving Equation (6). Then, we can test for the comparison consistency through calculating the consistency ratio. According to References [
43,
44], the value of
(representing the important degree of the best one to the worst one) ranging from 1 to 9 determines the value of the consistency indicator that needs to be used in calculating the consistency ratio. The values of the consistency indicator determined by the values of
are listed in
Table 1. The consistency ratio can be calculated using Equation (7).
It is noted that the lower the is, the more coherent the comparisons are.
For lots of MCDM studies, the value of evaluated object j with respect to sub-criterion i may not have actual data, and therefore the BWM can be employed to make comparisons between alternatives to get performance values.
2.2.2. Entropy Weight Determination Method
An entropy weight methodology is usually used to compute the objective weights of sub-criteria [
45,
46]. The detailed process of this approach is depicted as below.
Step 1: Normalize the performance values. The value of alternative
j for sub-criterion
i should be normalized, and the projection value
should be calculated as:
where
m implies the number of evaluated alternatives.
Step 2: The entropy value
can be computed as:
Step 3: Compute the divergence degree. The divergence degree
of every sub-criterion can be computed as:
The larger the becomes, the more important the sub-criterion is.
Step 4: Obtain weights of each sub-criterion. After obtaining the value of
, the objective weights
of every sub-criterion are obtained using:
where
n implies the amount of the sub-criteria.
The entropy weight determination approach is used as the objective weight determination method to compute the objective weights of all indicators on the basis of the actual data of indicators with regard to alternatives.
2.3. VIKOR Comprehensive Evaluation Model
VIKOR method was designed for the multi-criteria optimization of complicated systems. The VIKOR model can identify the compromise solution and the compromise rankings. It ranks the alternatives in accordance with the special evaluation of “closeness” to the “ideal” solution [
47,
48]. The evaluation principles of VIKOR can be originated from the
Lp-metric employed as an aggregate function, which is described as the following form:
where
represents the distance between the ideal solution and alternative
j,
demonstrates the weight of each sub-criterion,
implies the rating of alternative
j for sub-criterion
i,
indicates the optimal values of all alternatives for sub-criterion
i,
means the worst values of all alternatives for sub-criterion
i, and
.
Steps of VIKOR employed for comprehensive evaluation are illustrated as:
Step 1: Normalize values of all alternatives of all sub-criteria. Aiming at eliminating the attribute and dimension influences on evaluation, the initial values
aij of alternative
j for sub-criterion
i should be standardized. For maximum type sub-criteria, the normalized value
xij is obtained via Equation (13). For minimum type sub-criteria, the normalized value
xij is calculated via Equation (14).
Step 2: Search the positive and negative ideal data. Suppose
X+ and
X− indicate the positive and negative ideal solutions, respectively, and they can be obtained using:
where
I1 and
I2 are the maximum and minimum attribute sub-criteria set, respectively.
Step 3: Compute the group benefit value
Sj and the individual regret value
Rj of alternative
j utilizing Equations (16) and (17).
Step 4: Calculate the compromise sorting indicator
Qj for alternative
j. The
Qj are the critical indicators for ranking the alternatives precisely and discreetly, which can be calculated using:
where
, and
v indicates the weight of the maximal group benefit. Normally,
v = 0.5, representing that all evaluated objects are measured in a consistent method.
Step 5: Obtaining the optimal alternative via comparing Sj, Rj and Qj. If the below two requirements are met, the one with the least value of Qj is the optimal alternative.
(1)
where
and
indicates the second and the first alternatives based on the
Qj value.
(2) should also be the top alternative based on the values of Sj and Rj.
If the above two requirements are met, is the optimal alternative. If one of the requirements is not met, several compromise solutions are given as below:
If and only satisfy the first requirement, both of them are the optimal alternatives.
If the nexus between and others only satisfies the second requirement and it is difficult to satisfy the first one, alternatives that disobey the first one are treated as the compromise solutions.
3. Conceptual Framework
The integrated MCDM methodology is put forward to assess the performance of various battery ESSs. The elaborated evaluation phases are as follows.
Phase 1: Choose critical sub-criteria and construct the performance assessment index system utilizing fuzzy-Delphi. Experts in different fields are selected as the consultation group. According to the characteristics of different types of battery ESSs, 23 sub-criteria are identified. Then the fuzzy-Delphi method is used to choose the critical sub-criteria based on the experts’ views on the important degree of every original sub-criterion. The terminal assessment index system is established from technological, economic, and social aspects.
Phase 2: Identify the values of the subjective sub-criteria of each battery ESS. Considering the existence of qualitative sub-criteria, which are difficult to find the data for, BWM is utilized to identify the performance values of them through conducting pair comparisons between the best battery ESS and others and between others and the worst battery ESS of the qualitative sub-criteria.
Phase 3: Compute the integrated weights of subjective and objective weights. For the purpose of comprehensively considering the opinions of experts and the objective data, the subjective weights are computed by BWM based on experts preferences through comparing the best sub-criterion with others and others with the worst sub-criterion, and the objective weights are obtained via an entropy weight determination approach utilizing the actual value of the quantitative sub-criteria and values of qualitative sub-criteria determined by BWM. The integrated weights are computed via setting equal significance to the objective and subjective weights.
Phase 4: Evaluate the comprehensive performance of various battery ESSs based on the VIKOR model. First, the decision matrix needs to be determined through normalizing the initial data to avoid the influences of sub-criteria types as well as dimensions. Second, the positive and negative ideal values need to be found. Then the VIKOR approach is used to assess and rank the different types of battery ESSs in terms of Sj, Rj and Qj.
The proposed integrated MCDM model for the comprehensive evaluation of various battery ESSs is structured as in
Figure 2.
5. Empirical Analysis
This section evaluates the performance of the Li-ion battery, lead-acid battery, NaS battery, NiMH battery, and VRF battery employing the established integrated MCDM model, and the evaluation results can provide convincing reference for decision-makers of wind-photovoltaic-energy storage combination exemplary projects. The detailed process of empirical analysis is illustrated below.
5.1. Constructing the Assessment Index System
Towards the aim of comprehensively evaluating the performance of these battery ESSs, establishing the comprehensive assessment index system is of great significance. According to the features of battery ESSs, 23 original sub-criteria were identified from the perspectives of technology, economy, and sociality. To obtain the final indicator system, a fuzzy-Delphi model was employed to choose vital indicators. Five experts were selected from different fields to make up the expert decision-making group, containing distinguished scholars from the ESS researching field, as well as primary investors, governors, and decision-makers of wind-photovoltaic-energy storage combination exemplary projects. We also provided assistance for five experts, especially for primary investors and governors, in understanding the technical terms, such as capacity, power, efficiency, and others to make appropriate decisions, when consulting their opinions.
First, experts were required to give their preferences on the critical degree of every original sub-criterion, during the process of which we could obtain the most optimistic value and the most conservative value of each sub-criterion. Second, the values of the conservative TFN
and optimistic TFN
of each sub-criterion could be calculated. Third, the consistency of experts’ opinions could be examined using the value of
through comparing the value of
and
according to Equations (1) and (2). Finally, the critical sub-criteria could be selected through comparing the values of
with the threshold value (which was 5.2 according to the geometric average value of the upper and lower limits of all assessment sub-criteria considering experts’ preferences in this research). Results are listed in
Table 2, from which we could obtain that 16 critical sub-criteria were selected to evaluate the performance of the Li-ion battery, lead-acid battery, NiMH battery, NaS battery, and VRF battery from the perspectives of technology, economy, and sociality.
According to
Figure 3, the sub-criteria contains 13 quantitative ones and 3 qualitative ones, the qualitative ones being safety, delay of power grid construction, and energy saving and emission reduction effectiveness. Moreover, there were 13 maximum type sub-criteria and 3 minimum type ones, where the minimum type ones were self-discharge rate, investment cost, and operation and maintenance cost.
5.1.1. Technology Perspective
Since the research and application of energy storage technique is not mature at present, evaluation of ESSs from the technology perspective is of significant theoretical value for ESS applications. The technological performance is influenced by its own performance and environmental factors. In this research, the self-performance criterion contains the cell voltage, specific capacity, specific power, self-discharge rate, and maximum charge and discharge efficiency, and the environment effect criterion includes normal temperature cycle life and safety. Among these seven sub-criteria, safety was a qualitative sub-criterion, and self-discharge rate was a minimum type sub-criterion, which means the smaller, the better.
Cell voltage represents the nominal voltage of each battery monomer, which will have critical influence on the composition and cost of the battery ESS. Specific capacity, also known as capacity density, refers to the effective storage capacity of a unit mass of material. Specific power, also known as power density, indicates the effective storage power of a unit mass of material. The self-discharge rate, also known as the charge holding capacity, demonstrates the ability to maintain the amount of electricity stored in a battery when the battery is in an open circuit. The self-discharge rate is primarily related to the manufacturing process and materials. The maximum charge and discharge efficiency represents the ratio of the released energy after charging to the initial storage energy of the ESS, and higher charge and discharge efficiency can bring economic benefits for an ESS.
The normal temperature cycle life demonstrates the amount of cycles that the system can support before the ESS operates at a specified value of a certain capacity under some discharge condition at a normal temperature. Safety implies the ability of an ESS to keep safe and stable operation under the influence of an exterior environment, such as changes in temperature, pressure, and other conditions.
5.1.2. Economy Perspective
Economic assessment sub-criteria are the most intuitive evaluation sub-criteria for the cost and benefit of ESSs. In this research, the cost criterion is made up of the investment cost as well as the operation and maintenance cost, and the benefit criterion consists of the ESS profit, increased revenue of combining wind plants to the power grid, and the benefit of terminal recovery. All these sub-criteria are quantitative, and two sub-criteria in the cost level were minimum type.
The investment cost means the cost of constructing a battery ESS, including the battery system construction cost, energy conversion devices cost, and site construction cost. The operation and maintenance cost is highly bound up with the capacity of the battery ESS. There exists a significant difference between the annual operation and maintenance costs of different battery ESSs with various capacities.
The ESS profit primarily originates from the price difference, for which electricity is stored during the valley period at a low price and released during the peak period at a high electricity price. For the increased revenue of combining wind plants to the power grid, the application of the ESS plays a critical role in smoothing the wind power generation, thus increasing the grid-connected power generation of wind plants that brings the increased revenue of combining wind plants to the power grid. The benefit of terminal recovery refers to the recoverable value of different components in battery ESSs after the lifetime of the ESS, including electrodes, metal materials, and carbon materials.
5.1.3. Sociality Perspective
The social benefits of the application of ESS are mainly related to the electricity grid as well as the environment. The power grid criterion is composed of the delay of the power grid construction, the reduction of system reserve capacity, and the reduction of power grid loss. The environment criterion includes energy saving and emission reduction effectiveness. Considering the limitation of objective data, the delay of power grid construction as well as energy saving and emission reduction effectiveness are qualitative sub-criteria.
For the delay of power grid construction, the battery ESS can release electrical energy to satisfy the peak load demand during the period of day load concentration due to the fast charging and discharging features of battery ESSs, thus it takes a significant role in delaying the construction of the power grid. For the reduction of the system reserve capacity, previously the power grid needed to be equipped with a large reserve capacity owing to the randomness and volatility of wind power generation, while the use of a battery ESS can reduce the use of reserve capacity. For the reduction of power grid loss, during the peak load period, a battery ESS is used as a power discharge that will reduce the load and electrical current, therefore it can decrease the network loss. Energy saving and emission reduction effectiveness in the application of battery ESS is manifested in environmental benefits of promoting wind power grid connected power generation and ESS self-charging.
5.2. Identifying the Performance Values of Battery ESSs of Qualitative Sub-Criteria
Before evaluating the comprehensive performance of a lead-acid battery (ES1), Li-ion battery (ES2), NaS battery (ES3), NiMH battery (ES4), and VRF battery (ES5), the evaluated values of subjective sub-criteria of these five battery ESSs needed to be identified. In this research, BWM was not only employed to identify the subjective weights, but also employed to determine the values of qualitative sub-criteria, including safety, delay of power grid construction, and energy saving and emission reduction effectiveness with regard to five battery ESSs.
First, the best and worst battery ESSs needed to be identified. The best battery ESS represents the one that performs the best over others, while the worst battery ESS was the opposite. The best and worst battery ESSs of every subjective sub-criterion were identified on the basis of the opinions of five experts, and are listed in
Table 3.
Second, we needed to determine the comparison values between the best battery ESS and others and between others and the worst battery ESS employing the values ranging from 1 to 9 based on the experts’ views. The detailed comparison opinions of five experts can be found in
Table A1 and
Table A2 in the
Appendix.
Thirdly, the comparison values needed to be substituted into Equation (6) to compute the performance values of each battery ESS of corresponding qualitative sub-criterion due to five experts’ views.
Finally, the average performance values of each battery ESS of every qualitative sub-criterion were obtained, and are shown in
Table 4. The consistency ratios were all close to 0 representing the results were reliable and consistent. Therefore, the performance values of each evaluated battery ESS of the corresponding qualitative sub-criterion could be determined.
5.3. Determining the Weights of Sub-Criteria
Aiming at synthetically considering the preferences of experts and the actual data of each sub-criterion, we employed the BWM to calculate the subjective weights according to the views of five experts and the entropy weight determination approach to compute the objective weights in accordance with the actual data of quantitative sub-criteria. Performance values of qualitative sub-criteria were determined using the BWM. Then, the weights of all sub-criteria were computed through integrating the subjective weights and the objective weights.
5.3.1. Subjective Weights of All Sub-Criteria Employing the BWM
First, the best and worst sub-criteria chosen by experts are illustrated in
Table 5.
Second, experts needed to provide the comparison values via comparing the importance degree between the best sub-criterion and others, as well as between others and the worst one using the number ranging from 1 to 9. A larger number represents the best sub-criterion was more critical than others. Also, the value of 1 implies the equal significance between the best one and others. The results are presented in
Table 6 and
Table 7.
Third, the comparison values could be substituted into the linear Equation (6) and the weights were obtained utilizing the BWM. Taking the comparing results of Expert 1 as an example, the formula was written as below via substituting the concrete comparison data into Equation (6):
We employed Lingo 9.0 software (Lindo System company, Chicago, IL, USA) to calculate the linear formula to get the unique weights determined by five experts for all sub-criteria. Then the average values were computed and the final subjective weights are listed in
Table 8. The consistency ratio can also be obtained using Equation (7) through using the results of
and the consistency indicator listed in
Table 1. The consistency ratios are all close to zero, which means the results were highly consistent.
5.3.2. Objective Weights of Sub-Criteria Utilizing an Entropy Weight Determination Methodology
For the objective sub-criteria, data of these sub-criteria for the selected five evaluated battery ESSs were collected and summarized from the description of battery ESSs in References [
12,
23,
24,
25,
54]. According to the collected data of quantitative sub-criteria and the performance data of subjective ones determined by experts (shown in
Table 4), to obtain the objective weights utilizing entropy weight determination methodology, we needed to normalize the initial data (listed in
Table A3) first using Equations (13) and (14). The normalization data of all sub-criteria are demonstrated in
Table 9.
Then we could compute the objective weights employing an entropy weight determination methodology according to the Equations (8)–(11). The results of the entropy weight determination method are displayed in
Table 10.
5.3.3. Integrated Weights of the Sub-Criteria
Comprehensively considering the opinions of experts, the actual data of the quantitative sub-criteria, and the evaluated values of the qualitative ones, the final weights were computed using the combination of subjective weights and objective weights in this study. Based on the results of the subjective weights obtained using the BWM and objective weights obtained using an entropy weight determination method, the integrated weights were computed by setting an equal importance to them. The final integrated weights are illustrated in
Table 11.
5.4. Evaluating the Performance of Five Battery ESSs Using the VIKOR Model
Based on the integrated weights obtained above, we could evaluate the performance of the Li-ion battery, lead-acid battery, NiMH battery, NaS battery, and VRF battery ESSs. First, we needed to normalize the initial data of quantitative sub-criteria of five battery ESSs collected from References [
12,
23,
24,
25,
54] and qualitative sub-criteria with respect to five battery ESSs obtained based on the experts’ opinions shown in
Table 4 to get the decision matrix displayed below:
Second, the positive and negative ideal values and needed to be found in accordance with the Equation (15).
Third,
and
of the five battery ESSs were computed utilizing Equations (16) and (17). Results of them are listed in
Table 12.
Fourth, the compromise sorting indicator
for the Li-ion battery, lead-acid battery, NiMH battery, NaS battery, and VRF battery ESSs could be computed using Equation (18). Results of
are also displayed in
Table 12.
Then, we could rank the performance of the Li-ion battery, lead-acid battery, NiMH battery, NaS battery, and VRF battery ESSs through comparing
, and
, and select the optimal battery ESS that is appropriate for the construction of wind-photovoltaic-energy storage combination exemplary projects. The rankings of
, and
of five battery ESSs are demonstrated in
Table 13. According to the results and rankings indicated in
Table 12 and
Table 13, it was apparent that the values of
, and
for Li-ion battery and NaS battery satisfed the two evaluation conditions of VIKOR listed in
Section 2.3; therefore, the Li-ion battery was the optimal battery ESS, which is the most appropriate one for wind-photovoltaic-energy storage combination exemplary projects. The performance of the NaS battery ESS was close with the VRF battery ESS, both of which were superior to the lead-acid battery and NiMH battery ESSs.
6. Discussion and Policy Implications
6.1. Discussion of Evaluation Results
The performance of the Li-ion battery, lead-acid battery, NiMH battery, NaS battery, and VRF battery ESSs were evaluated through employing the integrated MCDM model integrating a fuzzy-Delphi method, the BWM, an entropy weight determination method, and the VIKOR evaluation model. The comprehensive evaluation results show that the Li-ion battery is the optimal battery ESS for wind-photovoltaic-energy storage combination exemplary projects. To get a better understanding about the comprehensive evaluation results, we will inquire into the subjective and objective weights and the performance of every sub-criterion of each battery ESS.
For the subjective weights of all sub-criteria indicated in
Table 8, the most significant sub-criteria were energy saving and emission reduction effectiveness as well as safety, and the subjective weights of them were 0.126 and 0.112, respectively, which meant the selected experts containing scholars from the ESS researching field, as well as investors, governors, and decision-makers of wind-photovoltaic-energy storage combination exemplary projects paid more attention to the characteristics of environmental protection effects and electricity supply stability brought by the construction of an ESS. This was primarily due to the rapid deterioration of the environment according to experts’ comments, such as the frequent occurrence of fog and haze weather, and the urgency of developing renewable resources for electricity generation, which made the experts neglect the impact of economic costs and benefits and emphasize the role of environmental impact and electricity supply reliability.
For objective weights of all sub-criteria listed in
Table 10, according to the actual data, the most critical sub-criteria were the self-discharge rate and energy saving and emission reduction effectiveness, the objective weights of which were 0.137 and 0.097, respectively, which indicates the technology characteristic and environment effect were highlighted based on objective data. Additionally, the weights for economic costs and benefits were the lowest according to the objective weights based on the entropy weight determination method. This was because the realization of the high proportion of renewable resources-based electricity generation is inseparable from the application of ESSs, which greatly depends on the mature technologies.
For the integrated weights of all sub-criteria summarized in
Table 11, the most important sub-criteria were the energy saving and emission reduction effectiveness, safety, and self-discharge rate, the weights of which were 0.111, 0.089, and 0.088, respectively. This was a comprehensive result that synthetically took experts’ opinions emphasizing the importance of environmental effects and power supply reliability as well as the actual data highlighting the significance of technology and environmental impacts into consideration.
For energy saving and emission reduction effectiveness, safety, and self-discharge rate, the Li-ion battery, NaS battery, and VRF battery ESSs have superior performance over lead-acid battery and NiMH battery ESSs. Comprehensively considering the performance values of other sub-criteria, the Li-ion battery is the optimal battery ESS for wind-photovoltaic-energy storage combination exemplary projects.
6.2. Policy Implications
In view of the comprehensive evaluation on selecting a battery ESS to be applied to wind-photovoltaic-energy storage combination exemplary projects, some policy implications can be proposed based on the research results that may improve the applicability of battery ESSs and provide some references for decision-makers in related fields.
- (1)
Break through technical bottle-necks, increase investment in technology research and development, and grasp independent intellectual property rights.
Currently, the core materials of the Li-ion battery and the VRF battery, which were the most optimal battery ESSs according to the comprehensive evaluation results, highly depend on imports that lead to high economic costs. Specifically, the import dependence of the Li-ion battery separators is more than 80%, and the import dependence of lithium hexafluorophosphate, which is the critical material of the Li-ion battery electrolyte, reaches 80%–90%. The perfluoro-ion-exchange membrane, which is the core component of the VRF battery, depends on import completely, the expense of which accounts for nearly 50% of economic costs of the VRF battery. Therefore, mastering independent intellectual property rights can reduce the dependence of core materials on imports, which can not only reduce costs, but also improve the quality of materials by independent research and development, so as to enhance the technology level of a battery ESS.
- (2)
Develop the application of new materials to enhance the safety of battery ESSs.
The battery pack, as the hard core component of battery ESS, is a kind of high-energy component, which is potentially dangerous. With the increase of the specific capacity and specific power, the risk of causing accidents in the process of operation will also increase. Besides the external environment, the factors affecting the safety of a battery ESS include battery materials, design level, production quality, the length of service time, the effectiveness of safety measures, and the rationality of use. Among all the above factors, the most fundamental factor is battery materials. Constantly developing new and safe materials can fundamentally reduce the risk of battery ESSs in application, so as to improve the safety of these systems and guarantee the stability and reliability of electricity supply.
- (3)
Analyze detailed data on demonstration projects and conduct appropriate financial subsidies and tax deduction and exemption policies.
China’s energy storage industry is still in the initial stage of industrial development, which is in the hard push development pattern that is a “technology push application and application push policy”. Taking a wind-energy storage combination exemplary project as an example, the application of a battery ESS increased 10%–20% of the utilization ratio of wind power and enhanced the electricity income per year by about 10–20 million yuan, but the annual depreciation cost of the battery was more than 30 million yuan. From the economic perspective, it is more economical to directly discard wind power than to apply a battery ESS. However, since the 13th Five Year Planning set the goal of reducing the rate of abandoned wind power to less than 5% in 2020 [
55], it is necessary to apply ESS to absorb wind power. Considering the high cost of battery ESSs, national policy support and subsidies are needed. Towards the aim of avoiding the blind expansion of energy storage projects, we need to clearly define the subsidy quota and the subsidy objects before the policy is released. Based on this, data analysis for demonstration projects is an essential mission before formulating the policy.
7. Conclusions
The comprehensive evaluation regarding the selection of battery ESSs is necessary for battery ESSs application on wind-photovoltaic-energy storage combination exemplary projects. Therefore, this paper proposed an integrated comprehensive evaluation framework including a comprehensive evaluation index system establishment based on a fuzzy-Delphi model, the integration of objective weights as well as subjective weights determination based on the BWM and an entropy weight computation method, and a VIKOR comprehensive assessment model to select the optimal battery ESS. The significant conclusions of this research are given below:
- (1)
Through using a fuzzy-Delphi model to choose sub-criteria, the comprehensive assessment index system was constructed from perspectives of technology, economy, and sociality containing 13 quantitative sub-criteria and 3 qualitative ones.
- (2)
Through integrating subjective weights on the basis of the BWM and objective weights on an entropy weight determination method, energy saving and emission reduction effectiveness, safety, and self-discharge rate were the most critical sub-criteria, which synthetically considered experts’ opinions emphasizing the importance of environmental effects and power supply reliability, as well as the actual data highlighting the significance of technology and environmental impacts.
- (3)
Through constructing the comprehensive evaluation model based on a VIKOR method, we could obtain that the Li-ion battery was the optimal battery ESS, the performance of NaS battery ESS was close to VRF battery ESS, and both of them were superior to lead-acid battery and NiMH battery ESSs.
- (4)
Aiming at improving the comprehensive performance of battery ESSs and the applicability of battery ESSs in wind-photovoltaic-energy storage combination exemplary projects, some policy implications were put forward to provide some references for decision-makers, which are: (1) Break through technical bottle-necks, increase investment in technology research and development, and grasp independent intellectual property rights; (2) develop the application of new materials to enhance the safety of battery ESSs; and (3) analyze detailed data on demonstration projects, and conduct appropriate financial subsidies and tax deduction and exemption policies.
The application of battery ESSs is an effective way to eliminate the intermittent and fluctuation of renewable resources-based electricity generation and to decrease the discarding rate of wind power and solar power-based electricity generation. The integrated MCDM method proposed in this investigation demonstrates an effective way for assessing and ranking the performance of battery ESSs. However, there are still some places where improvement is needed. Since the index system contained three qualitative sub-criteria, and the performance values of them were determined by the opinions of experts, in the future research, we need to validate the values of safety, delay of power grid construction, and energy saving and emission reduction effectiveness with regard to different types of battery ESSs statistically. Additionally, we will also investigate detailed data on demonstration projects, and provide references for formulating appropriate financial subsidies and tax deduction and exemption policies for ESSs.