Abstract
Short-term hydrothermal scheduling (STHS) can improve water use efficiency, reduce carbon emissions, and increase economic benefits by optimizing the commitment and dispatch of hydro and thermal generating units together. However, limited by the large system scale and complex hydraulic and electrical constraints, STHS poses great challenges in modeling for operators. This paper presents an improved proximal bundle method (IPBM) within the framework of Lagrangian relaxation for STHS, which incorporates the expert system (ES) technique into the proximal bundle method (PBM). In IPBM, initial values of Lagrange multipliers are firstly determined using the linear combination of optimal solutions in the ES. Then, each time PBM declares a null step in the iterations, the solution space is inferred from the ES, and an orthogonal design is performed in the solution space to derive new updates of the Lagrange multipliers. A case study in a large-scale hydrothermal system in China is implemented to demonstrate the effectiveness of the proposed method. Results in different cases indicate that IPBM is superior to standard PBM in global search ability and computational efficiency, providing an alternative for STHS.
1. Introduction
According to the International Energy Agency, thermal power and hydropower are basic sources of electricity production in many countries [1]. Thus, short-term hydrothermal scheduling (STHS) is necessary in power system operations. The significance of STHS is to improve water use efficiency, reduce carbon emissions, and increase economic benefits by optimizing the commitment and generation level of hydro and thermal generating units together [2]. However, limited by complex hydraulic and electrical constraints, the nature of STHS is a large-scale nonconvex, nonlinear problem with integer variables, posing great challenges in modeling for operators [3].
Many approaches have been developed for STHS, such as mixed-integer linear programming (MILP) [4], nonlinear programming (NLP) [5], dynamic programming (DP) [6], and genetic algorithm (GA) [7]. Although these approaches have achieved success in practice, challenges still exist when dealing with large-scale systems. MILP depends on linearization strategies to accurately represent the system behavior. For NLP, a convex approximation is required to improve the global search ability, and global optimum is not guaranteed. DP suffers from the “curse of dimensionality”. GA falls into premature convergence easily. For large-scale systems, common approaches are based on decomposition techniques, such as the Lagrangian relaxation (LR) [8], Benders decomposition (BD) [9], and aggregation–disaggregation [10]. BD decomposes the primal problem into a master problem and some subproblems for dimension reduction. However, BD is sensitive to integer variables, of which the computational efficiency becomes very low for problems with many integer variables. The aggregation–disaggregation method has been successfully applied in the optimization of Brazilian hydropower system operations [11], while a loss of information in the aggregation step may result in undesirable errors in operations [12]. LR is suitable for large-scale nonconvex problems. In LR, the Lagrangian dual problem is introduced by relaxing linking constraints through Lagrange multipliers, which exhibits a decomposable structure [13]. By solving the dual problem, a lower bound of the primal problem is found, acting as a good starting point for heuristics to obtain feasible solutions [14].
Within the framework of LR, the key issue is to solve the Lagrangian dual, which is nonconvex and nonsmooth [15]. The proximal bundle method (PBM) is a classic method in nonsmooth optimization [16,17]. PBM gathers historical dual values and subgradients in a “bundle” to construct the cutting-planes model, and yields new iterates by solving a quadratic program per iteration [15]. To ensure high accuracy, an ascent condition is checked per iteration to decide whether to take a null step or a serious step. The iteration of PBM ends after the stopping rule is met. Although PBM is known for its stability and precision, the bundle size increases with the iteration, leading to a growing computational burden of solving the quadratic program [18]. Additionally, in the later iterations, a sufficient ascent in dual value is hard to satisfy. As a result, many null steps are declared, causing PBM to converge to a local optimum [19]. Some improvements of PBM were developed. The authors of [20] proposed a splitting bundle approach, which partitions the bundle into two subsets to capture the convex and concave behavior around the current point. The authors of [21] introduced the notion of gradient sampling into PBM to find the search direction, rather than using the subgradient information. The authors of [22] developed a redistributed PBM, which generates cutting-planes models of a local convexification of the objective function. However, solving a quadratic program per iteration is inevitable in these improvements.
The generation scenario of STHS changes slowly in a continuous period (e.g., the water level of reservoir decreases slowly in the dry season) and presents periodicity (e.g., the reservoir inflow changes periodically in a year). In this case, some inspiration can be obtained from historical operational records to guide the solution of a current problem. Therefore, an improved PBM (IPBM) is proposed in this paper, incorporating the expert system (ES) into the PBM. The ES is an important branch of artificial intelligence, which uses knowledge and reasoning processes to solve complex decision-making problems [23,24]. ES includes two parts: a knowledge base and inference engine [25]. The knowledge base stores knowledge expressions about the problem domain. To build the knowledge base of STHS, three steps are taken: (1) represent all historical generation scenarios by eigenvectors; (2) implement scenario clustering to yield representative scenarios; and (3) extract knowledge expressions from the PBM iterations of representative scenarios and save them in the database. The inference engine works based on the knowledge base. With the inference engine, initial values of multipliers are reasoned using the linear combination of optimal solutions in the knowledge base, which can accelerate the convergence of PBM. Then, when PBM declares a null step in iterations, the solution space is reasoned from the knowledge base, and the values of Lagrange multipliers are updated by performing an orthogonal design (OD) in the solution space [26,27]. The OD can not only avoid solving quadratic programming, but also behave like a “mutation operator” to increase the likelihood of reaching global optimum. The proposed IPBM is applied to a large-scale hydrothermal system in China to make daily generation schedules. Compared with standard PBM in different scenarios, IPBM can yield better objective function values in less time, verifying its superiority in global search ability and computational efficiency.
2. Problem Formulation
2.1. Study Area
The studied hydrothermal power system is in Guizhou Province, China, serving around 34.75 million people in an area of 176,000 km2. Figure 1 illustrates the geographical distribution of the system. In the system, generating capacities of hydropower and thermal power are 9849 MW and 25,950 MW, respectively. The hydropower part includes 45 units in 13 hydropower plants, and the thermal part consists of 65 units in 22 thermal plants. The hydropower plants are located in the Wujiang river system, including 4 basins with 53 billion m3 average annual runoff. In the Wujiang river system, the wet season is in the period of May–October, and the dry season is in November–April. Since Guizhou is rich in coal resources, all the thermal plants are coal-fired plants. Detailed information about the system is presented in the appendix, including: (1) basic parameters of thermal units; and (2) basic characteristics of hydropower plants.
Figure 1.
Geographical distribution of the studied hydrothermal power system.
Although these plants belong to different generation companies, they are operated by a central dispatching center in a centralized manner. Moreover, according to local government policy, the operation objective of the hydrothermal system is to minimize coal consumption to achieve energy-saving and emission reduction. For such a large system, a small improvement in operations will translate into huge benefits, making STHS an important problem.
2.2. Optimization Model
2.2.1. Objective Function
The objective function minimizes the coal consumption of the hydrothermal system over the whole scheduling horizon:
where t, , , , and = indices of time period, thermal plant, thermal unit, hydro plant, and hydro unit, respectively; = number of time periods; = number of thermal plants; = number of thermal units in plant ; = power output of thermal unit in plant at period (MW); = power output of hydro unit in plant k at period (MW); = binary variable indicating whether or not thermal unit j in plant i is operating at period ; = binary variable indicating whether or not hydro unit in plant is operating at period ; (t/MW2h), (t/MWh), and (t/h) = fuel consumption coefficients of thermal unit in plant , respectively; = time conversion variable (h).
It is important to point out that because hydro units and thermal units are closely coupled by electrical constraints (Equations (2) and (3)), the schedules of both hydro units and thermal units will affect the objective function. Thus, the decision variables in Equation (1) are , , , and .
2.2.2. Constraints
In STHS, constraints that should be satisfied are grouped into system-wide electrical constraints, thermal power constraints, and hydropower constraints, which are formulated as follows.
1. System-wide electrical constraints
where = number of hydro plants; = number of hydro units in plant ; = system load demand at period (MW); and = the maximum output limits of thermal unit and hydro unit (MW), respectively; = the constant representing the percentage of spinning reserve in load demand.
Equation (2) sets the power balance constraints. Equation (3) sets the spinning reserve constraints.
2. Thermal power constraints
where = the minimum output limit of unit in plant (MW); = binary variable indicating whether or not the unit is started up at period ; = binary variable indicating whether or not the unit is shut down at period ; and = start-up and shut-down ramp rate limits of unit in plant (MW/h), respectively; and = ramp-up and ramp-down limits of unit in plant (MW/h), respectively; and = the minimum online and offline time periods of unit in plant (h), respectively.
Equation (4) sets the lower and upper bounds of each unit on power output. Equations (5)–(7) set the power ramping constraints of each unit, including the start-up ramp rate limit, shut-down ramp rate limit, and normal ramp-up and ramp-down limits. Equations (8) and (9) denote the logical status of unit commitment. Equations (10) and (11) set the minimum online and offline time periods of each unit, respectively.
3. Hydropower constraints
where , , and = total inflow, natural inflow, and total release of plant at time (m3/s), respectively; = the direct upstream plants set of plant ; = the direct upstream plant index of plant ; = water travel time from plant to plant (h); = storage of plant at time (m3); and = total power release and spillage of plant at time (m3/s), respectively; = power release of unit in plant at time (m3/s); and = the minimum and maximum releases of plant (m3/s), respectively; and = the minimum and maximum power releases of unit in plant (m3/s), respectively; and = the minimum and maximum storages of plant (m3), respectively; = forebay water level of plant at time (m); = the function between storage and water level of plant ; = tailrace water level of plant at time (m); = the function between tailrace water level and total release of plant ; = net water head of plant at time (m); = the function between head loss and power release of plant ; and = the initial and terminal storages of plant (m3), respectively; = power output as a function of unit power release and net head of unit in plant ; and = the minimum and maximum power outputs of unit in plant (MW), respectively; and = the upper and lower bounds of vibration zone of unit in plant (MW), respectively. Both and are related to the net water head .
Equations (12) and (13) set the water balance constraints. Equation (14) defines the total water release. Equations (15) and (16) set the discharge limit and storage limit, respectively. Equations (17) and (18) are forebay water level and storage function, and tailrace water level and release function, respectively, both of which are nonlinear and nonconvex. Equations (19) and (20) define the expression of the water head, where Equation (20) is nonlinear and convex. Equations (21) and (22) restrict the initial and terminal storages of each plant, respectively. Equation (23) is the hydropower production function, which is composed of a family of curves illustrating the nonlinear relationship between power output, water head, and power release. Equation (24) denotes the power output limit. Equation (25) sets the vibration zone limit.
3. Method Overview and Assumptions
3.1. Lagrangian Relaxation Framework
Within the LR framework, the first step is to construct a specific dual problem by relaxing linking constraints. Then, the next step consists of solving the dual problem. The obtained dual solution acts as a lower bound to the primal problem, and heuristics are adopted to convert the infeasible dual solution to a feasible solution. Through gradually narrowing the gap between dual solution and primal solution, a near-optimal solution will be finally found in multiple iterations.
In the context of STHS, Equations (1)–(25) are denominated the primal problem. The hydropower part and thermal power part are coupled by Equations (2) and (3). Therefore, the following dual function is constructed by relaxing Equations (2) and (3) via Lagrange multipliers and [28,29]:
Subject to: Equations (4)–(25).
After regrouping relevant terms, independent thermal and hydro subproblems can be split from Equation (26). Detailed forms of these subproblems can be found in [15]. To solve the thermal and hydro subproblems, MILP is adopted [30]. The reasons for using MILP are as follows: (1) the nonlinearity in hydro and thermal subproblems can be eliminated with piecewise linear techniques; (2) MILP is efficient in solving small-scale problems; and (3) MILP is easily programmed based on general mathematical solvers.
Moreover, the heuristic technique in [31] is adopted to transform the dual solution into a feasible solution, which fixes the hydropower solution first and then adjusts the thermal unit schedule using a priority-list approach. Finally, the iteration of LR stops if any of Equations (27) and (28) are satisfied:
where = the iteration index; , and = the relative duality gap, the primal value (t), and the Lagrangian dual value (t) at iteration , respectively; = the supplied minimum relative duality gap; and = the values of and at iteration , respectively; = the supplied minimum multiplier variation.
3.2. Standard Proximal Bundle Method
In the dual function (Equation (26)), subgradients with respect to and are
Let be the current iteration index. The notation is simplified by denoting and . PBM generates two related iteration sequences: and , where = past iteration index; and = the multiplier vector and subgradient vector at iteration , respectively; = the dual value associated with ; = the best multiplier vector so far at iteration nk, which provides the maximum dual value . The sequence is the so-called “bundle”, while the sequence denotes the stability centers in the bundle [32].
Having the bundle, a cutting-planes model is formulated at iteration
Then, the next iterate is obtained by solving the quadratic programming [33]
where = the penalty parameter, controlling the distance from to .
With the obtained , the ascent condition is checked:
where = the parameter defining the minimum increase in dual value; measuring the increase predicted by the cutting-planes model.
If Equation (32) holds, update the stability center sequence by setting (serious step). Otherwise, set (null step). Invoke PBM iteratively in LR iterations until the stopping rule (Equations (27) and (28)) is met.
Although PBM is known for its stability and accuracy, there are still some drawbacks: (1) The time cost of solving quadratic programming. A quadratic programming problem in the form of Equation (31) needs to be solved at each iteration to generate a new iterate. The scale of the quadratic programming increases with the size of the bundle, which could be quite time-consuming in later iterations. (2) As the iteration proceeds, the ascent condition is hard to satisfy. As a result, many null steps are declared, causing PBM to easily fall into local optimum. (3) Initial values of Lagrange multipliers have an influence on the computational efficiency of PBM, which has not been fully discussed in the literature [33].
3.3. Improved Proximal Bundle Method
To overcome the difficulties of PBM, an IPBM incorporating the ES technique with PBM is proposed in this section. The ES component in IPBM mines information from historical operational records of hydrothermal units to guide the solution of a current problem. The ES consists of two parts: a knowledge base and inference engine, where the knowledge base is a repository of facts storing the knowledge about the STHS problem domain, and the inference engine provides reasoning about the information in the knowledge base to find a solution [25].
In the solution of Lagrangian dual, the main task is to determine the optimal values of Lagrange multipliers to reduce the relative duality gap (RDG). Thus, the trajectories of RDG and multiplier values in the iteration are regarded as a kind of knowledge. By extracting knowledge expressions and building the knowledge base, decision support can be provided for STHS from the inference engine. Specifically, initial values of multipliers can be obtained by using a linear combination of optimal multiplier values in the knowledge base, providing a good lower bound to the primal problem. Moreover, when a null step is claimed in IPBM, the solution space of STHS can be narrowed based on the knowledge base. Then, OD is carried out in the solution space to derive new updates of Lagrange multipliers, which can not only avoid solving quadratic programming, but also increase the likelihood of reaching a global optimum. Hence, the difficulties that standard PBM encountered are alleviated in IPBM.
Details about the ES technique are presented in the following.
3.3.1. Knowledge Base
To build the knowledge base, knowledge expressions are extracted from PBM iterations of historical scenarios. Since different generation scenarios correspond to different iteration processes, scenarios are firstly quantified by eigenvectors. Then, considering the large number of historical generation scenarios, cluster analysis is necessary to avoid the “scenario explosion” and the noise interference to the reasoning stage. Finally, knowledge expressions are extracted from the PBM iterations of representative scenarios and are stored in the database. Detailed steps of building the knowledge base are described as follows.
(1) Representation of generation scenario
The generation scenario is characterized by operational constraints. Through interviewing experienced operators and analyzing the form of Equations (2)–(25), constraints and their associated factors are summarized in Table 1. In Table 1, constraints related to unit type and reservoir features usually do not change with scenario, or change slightly, while the rest of the constraints are dynamic. Therefore, the generation scenario is characterized by the load demand curve, natural inflows, and initial and terminal water levels of hydropower plants.
Table 1.
Constraints and their associated factors.
To quantitatively represent the generation scenario, the following eigenvector is formulated:
where = total energy demand (MWh); = peak load (MW); = peak–valley difference in the load demand curve; = the vector of basin natural inflows; = the vector of basin storage energy; = hydro basin index; = total natural inflows of hydro basin over the whole planning horizon (m3/s); = the number of hydro basins; = average storage energy of hydro basin over the whole planning horizon (MWh).
In Equation (33), elements , , and depict the characteristics of the load demand curve; denotes the natural inflows of basins; means the average storage energy, which is a function of the initial and terminal water levels of hydropower plants [34].
(2) Cluster analysis of historical generation scenarios
To obtain representative scenarios from massive historical generation scenarios, cluster analysis is necessary. First, the eigenvectors are normalized to eliminate the influence of dimension. Then, k-means clustering and silhouette coefficient are adopted to achieve scenario clustering [35]. By maximizing the silhouette coefficient of the clustering results, an optimal clustering result can be obtained. In each cluster, scenarios are sorted in ascending order according to the Euclidean distances from the centroid, and the scenario that has the minimum distance is selected as the representative scenario of the cluster.
(3) Knowledge expression extraction
For each representative scenario, standard PBM is used to solve the Lagrangian dual. Knowledge expressions are extracted from the PBM iterations in the form of Equation (36):
where and = the iteration index and maximum iteration index in the process, respectively; and = the multiplier vector and relative duality gap at iteration , respectively.
Finally, all knowledge expressions and scenario eigenvectors are saved in the database to form the knowledge base, as illustrated in Figure 2.
Figure 2.
Database schema of the knowledge base.
3.3.2. Inference Engine
The inference engine works on the basis of the knowledge base. Similar generation scenarios mean that they have similar problem domains. Therefore, assuming that the PBM iterations of similar scenarios are alike, initial values of Lagrange multipliers, and new updates of Lagrange multipliers when null steps occur, can be reasoned by the inference engine.
(1) Inferring the initial values of Lagrange multipliers
The similarity between two scenarios can be measured by the Euclidean distance between their eigenvectors:
where = eigenvector of scenario to be solved; = scenario in the knowledge base.
Initial values of multipliers can be obtained by using a linear combination of optimal multiplier values of different scenarios. The weighting coefficient is inversely proportional to the Euclidean distance and is determined as follows:
where = the set of scenarios in the knowledge base.
Hence, the initial values of multipliers are obtained (Figure 3a):
where is the optimal multiplier vector of scenario .
Figure 3.
Procedures of the inference engine: (a) inferring the initial values of Lagrange multipliers; (b) inferring new updates of Lagrange multipliers when null steps occur.
(2) Inferring new updates of Lagrange multipliers when null steps occur
In the iteration process of PBM, when Lagrange multipliers fail to improve the value of objective function sufficiently, a null step will be declared. Assume that a null step occurs at iteration ; the relative duality gap is ; and the most similar scenario in the knowledge base to the scenario to be solved is scenario . The RDG measures the optimality of a dual solution. If two iterations have a close RDG, this means that they are at a similar stage in the whole iteration process. Therefore, is used to match the knowledge expression in the knowledge base, as follows:
where = the iteration index in scenario that has the closest RDG to ; = the maximum iteration index in the iterations of scenario .
With the obtained iteration index , the range of multiplier values is derived:
where and = the upper and lower bounds of the element in vector , respectively; = the value of the element in vector at iteration .
The obtained range is also the solution space of Lagrangian dual. Figure 3b depicts the procedure to infer new updates of Lagrange multipliers when null steps occur.
Having the solution space, a complete enumeration of state combinations of multiplier values can guarantee an optimum. However, the enumeration suffers from the “curse of dimensionality”. Supposing that each of the multipliers is discretized into states, there will be state combinations to deal with, which is hard to deal with. Thus, the concept of orthogonal design (OD) is introduced. The OD is an experimental design method for multiple-factor experiments, which samples a representative subset from complete combinations based on the orthogonal array [36]. For an experiment of factors and levels per factor, there exists an orthogonal array shown as , where denotes the OD, is the number of complete combinations, and is the number of combinations to be tested in the OD. is a matrix with rows and columns, and each row represents a combination of levels. Due to the orthogonality, the array ensures that the sample combinations are scattered uniformly in the state space. Figure 4 depicts the difference between complete and orthogonal combinations of an experiment that has three factors with three levels per factor. It can be observed that the orthogonal combinations are representative and uniformly distributed in the state space. Moreover, the scale of orthogonal combinations is much smaller than complete combinations.
Figure 4.
The difference between complete and orthogonal combinations: (a) complete combinations; (b) orthogonal combinations.
Additionally, before implementing the OD, constraint violation needs to be checked.
where = the minimum power deviation (MW). If Equation (42) holds, it means that the power balance constraint at period is broken. If Equation (43) holds, it means that the spinning reserve constraint at period is broken.
Lagrange multipliers corresponding to broken constraints can be regarded as experiment factors. By scattering multipliers corresponding to broken constraints into several levels, a multiple-factor experiment is formed. Accordingly, an OD is executed to yield sample combinations. Keeping multipliers corresponding to unbroken constraints fixed, new updates of multipliers are obtained by combining sample combinations of broken multipliers with fixed unbroken multipliers. In this way, the computational burden of solving quadratic programming is avoided. More importantly, the OD behaves like a “mutation operator” to increase the likelihood of reaching global optimum. Then, after solving hydro and thermal subproblems with the obtained multiplier updates, arrange the dual values in ascending order, and update the bundle and stability centers sequences. Continue to solve the dual problem by PBM until a next null step is declared or the iteration stops.
3.4. Procedures of the Proposed IPBM
Procedures of the proposed IPBM within the LR framework are summarized as follows:
- Step 1:
- Build the knowledge base. First, represent historical generation scenarios by eigenvectors. Then, implement cluster analysis with k-means clustering and silhouette coefficient to obtain representative scenarios. Finally, extract knowledge expressions from PBM iterations of representative scenarios and save them in the database.
- Step 2:
- Relax linking constraints to form the Lagrangian dual by Equation (26).
- Step 3:
- Solve the dual problem.
- (a)
- Set the iteration index .
- (b)
- If is equal to one, determine the initial values of multipliers by Equation (39). Otherwise, update the multipliers by PBM.
- (c)
- Solve hydro and thermal subproblems by MILP with the given multipliers. Then, set . If is equal to two, go to Step 4.
- (d)
- If the ascent condition (Equation (32)) holds, a serious step is declared and go to Step 4. Otherwise, a null step is declared and update the multipliers by inference engine.
- (e)
- Solve the hydro and thermal subproblems by MILP. Then, according to the results, arrange the dual values in ascending order, and update the bundle and stability center sequences.
- Step 4:
- Primary recovery. Generate a feasible solution by the heuristic used.
- Step 5:
- Convergence test. If the stopping rule is met (Equations (27) and (28)), terminate the iteration. Otherwise, go to Step 3(b).
4. Case Study and Results
4.1. Parameter Settings and Performance Metrics of IPBM
The whole planning horizon of STHS is 24 h, with 1 h for each period. To build the knowledge base, historical operational data from 2013 to 2019 are used. There are 2380 generation scenarios at the daily scale after data correction, which are then clustered into 33 representative scenarios. Knowledge expressions are extracted from PBM iterations of these 33 representative scenarios. The knowledge base is based on MySQL Database 5.7 and structured query language. The proposed IPBM is encoded in Java language and implemented on a PC-Intel@2.60GHz. The MILP subproblems are solved with Gurobi 8.1.1 optimization solver. The OD is implemented using SPSS Statistics. Parameters associated with the computational simulation are set as follows: = 0.5%, = 10−4, = 10−2, and .
To evaluate the performance of IPBM, three metrics are adopted: (1) dual value, representing the global search ability of IPBM; (2) primal value, representing the objective optimality after repairing the infeasible dual solution by heuristics; (3) computational time, representing the computational efficiency of IPBM. Among these metrics, the dual value is a positively oriented metric—the larger the better—while the remaining two metrics are negatively oriented metrics—the lower the better.
Based on the above settings, two improvements in IPBM, inferring initial values of Lagrange multipliers and inferring new updates of multipliers when null steps occur, are firstly tested. Then, the robustness of IPBM is demonstrated in comparison with standard PBM in 12 different cases.
4.2. Performance Testing of IPBM
A typical case in the spring of 2019 is selected as the generation scenario to manifest the performance of IPBM. In this scenario, water levels of hydropower plants are at the descending period before flood season. Both the load demand and water inflows are at a low level. The energy demand and peak load demand are 2.95 × 105 MWh and 1.51 × 104 MW, respectively. The peak–valley difference is 40.2%. Average natural inflow and total storage energy of hydropower plants are 264 m3/s and 4.65 × 106 MWh, respectively.
4.2.1. Effects of Inferring the Initial Values of Lagrange Multipliers
Conventionally, initial values of multipliers are set to the marginal cost corresponding to the solution of a simplified economic dispatch, or set to zero directly. Therefore, to test the effect of initial multipliers, three techniques are compared:
- (1)
- Zero value (ZV), where multipliers are set to zero directly;
- (2)
- A simplified version of economic dispatch (SED), which relaxes the integer constraints and is described in [15];
- (3)
- The proposed method by expert system (ES1).
Moreover, to keep the single variable principle, PBM is adopted to update multipliers during the process.
Table 2 shows the comparison of different initial multiplier generation techniques. In the stage of initial multiplier generation, the initial dual value of ES1 is 103,000 t, far more than those of ZV and SED, which means that ES1 provides the best lower bound of dual value at the beginning period. In the stage of iterative calculations, dual values of three techniques converge to a close value, around 111,303 t. Figure 5 shows the evolution process of dual value by three techniques. In Figure 5, as the iteration proceeds, the difference in dual value caused by initial multipliers becomes smaller and smaller. However, the number of iterations differs a lot, causing the differences in computational time, which are 782 s, 423 s, and 359 s for ZV, SED, and ES1, respectively. Moreover, the primal values of the three techniques are basically the same. The primal value of ES1 is only 0.03% less than that of ZV.
Table 2.
Comparisons of different initial multiplier generation techniques.
Figure 5.
The evolution process of dual value by ZV, SED, and ES1.
Therefore, the conclusions are drawn: (1) the quality of initial values of multipliers has a significant influence on the computational time, but little influence on the final objective function value; and (2) initial values of Lagrange multipliers obtained by ES1 are better than those by ZV and SED, demonstrating the superiority of ES1.
4.2.2. Effects of Inferring New Updates of Multipliers When Null Steps Occur
To test the effect of multiplier updates when null steps occur, four techniques are compared:
- (1)
- Subgradient method (SG) (as in [37]);
- (2)
- Cutting-planes method (CP) (as in [38]);
- (3)
- Standard PBM;
- (4)
- The proposed method by expert system (ES2).
To keep the single variable principle, initial multiplier values of four techniques are given by ES1.
Table 3 lists the outcomes of the four techniques. Figure 6 illustrates the detailed evolution process of dual value. From Table 3, compared with SG and CP, PBM and ES2 can find better dual values and take less time. Figure 6 shows that the dual values of SG and CP oscillate violently during the iteration process, while PBM and IE2 present considerable stability. After using heuristics to obtain feasible solutions, the primal values of PBM and ES2 are less than those of SG and CP.
Table 3.
Comparisons of different multiplier updating techniques.
Figure 6.
The evolution process of dual value by SG, CP, PBM, and ES2.
To further illustrate the superiority of ES2 over PBM, the effect of the expert system is analyzed. Table 4 lists the iterations of serious steps and null steps during the whole iteration process. ES2 converges in 41 iterations, while PBM takes 44 iterations. At the 11th and 32nd iterations of ES2, null steps occur. Subsequently, two orthogonal designs are executed, which are and , respectively. In Table 4, the item → [12–31] means that there are 16 broken constraints among the relaxed constraints. An experiment of 16 factors and 2 levels per factor is thus formed, where 20 multiplier combinations are sampled by the OD. These 20 multiplier combinations correspond to 20 iterations (from iteration 12 to 31) in the process. The item → [33–40] in Table 4 has a similar meaning with the item → [12–31].
Table 4.
Detailed evolution steps of PBM and ES2.
From Figure 7, during the first OD, the improvement of the dual value by ES2 is 407 t more than that by PBM. During the second OD, the two methods improve little. Finally, the dual value of ES2 converges to 111,835 t, 532 t more than PBM, which verifies the better global searchability of ES2. Moreover, since ES2 take less iterations and orthogonal designs in ES2 to avoid solving quadratic programming, the computational efficiency of ES2 is better than PBM.
Figure 7.
Detailed evolution process of dual value by ES2 and PBM.
In summary, compared with SG, CP, and PBM, ES2 shows extraordinary stability during the iteration process. Due to the advantage of the expert system, ES2 obtains the best objective function value in the least time, demonstrating its superiority in global search ability and computational efficiency.
4.3. Comparison with Standard PBM in Different Generation Scenarios
To demonstrate the robustness of IPBM, 12 typical generation scenarios from 2019 are chosen, of which the load demand and water inflow characteristics are summarized in Table 5. The scenarios are distinguished as follows: the first number refers to the scenario index (from 1 to 12), the second term is associated with the load demand level (LLD = low load demand; MLD = medium load demand; HLD = high load demand), and the third term means the water inflow condition (DS = dry season; WS = wet season). The conclusion is obtained by comparing the performance of IPBM with PBM in 12 scenarios.
Table 5.
Description of 12 selected generation scenarios.
Table 6 lists the results for STHS by PBM and IPBM. From Table 6, it can be noticed that IPBM outperforms PBM in all scenarios in terms of dual value, primal value, and computational time. For dual value, the maximum and minimum relative differences are 0.64% in scenario 5_LLD_DS and 0.01% in scenario 4_LLD_DS, respectively, indicating that IPBM can provide a better lower bound for a primal problem. In terms of primal value, the average relative difference in 12 scenarios is −0.89%, which means that the average coal consumption reduction is 748 t by IPBM. Moreover, the computational time of IPBM is less than that of PBM in each scenario, verifying its high computational efficiency.
Table 6.
Comparative analysis of 12 scenarios.
Figure 8 illustrates the relative difference between the primal value and natural inflow in different scenarios. It can be observed that the relative difference is approximately positively correlated with the natural inflow. From scenario 2_LLD_DS to scenario 5_LLD_DS, both the natural inflow and relative difference are at a low level. From scenario 6_MLD_WS to scenario 10_LLD_WS, the natural inflow and relative difference are at a high level, and gradually decrease. The maximum relative difference is 1.36% in scenario 6_MLD_WS. The relative difference in the primal value reflects the improvement in the objective function of IPBM compared with PBM. Therefore, the improvement in the IPBM objective function is more significant in large-inflow scenarios. The reason is that when the natural inflow is high, the corresponding hydropower potential is large. IPBM can improve the water use efficiency and yield more hydropower energy. As a result, coal consumptions in large-inflow scenarios are greatly reduced.
Figure 8.
Relative differences of primal value and natural inflows in different scenarios.
5. Conclusions
Hydrothermal power accounts for a high proportion in power systems, making STHS a challenge for operators. To efficiently solve the STHS problem, an IPBM combining the ES technique and standard PBM within the LR framework is presented in this paper. In IPBM, the ES consists of two parts: a knowledge base and inference engine. The knowledge base is built by extracting knowledge expressions from historical generation scenarios. Based on the knowledge base, initial values of Lagrange multipliers and new updates of Lagrange multipliers when null steps occur are reasoned by the inference engine. In this way, the ES provides a good lower bound to the primal problem at the beginning period. Moreover, the ES avoids solving quadratic programs when a null step is declaimed and increases the likelihood of reaching global optimum. To verify the effectiveness of IPBM, a case study is conducted in a large-scale hydrothermal system in China. Results in different cases indicate that, compared with several common methods, IPBM can obtain generation schedules with less coal consumption in less time, demonstrating its superiority in global search ability, computational efficiency, and robustness. Hence, IPBM proves to be an effective method for STHS.
Due to the negative impact of dam construction on river ecosystems, the ecological dispatch of hydropower is attracting increasing attention from researchers. Therefore, for further studies, it is necessary to bring ecological flow constraints into the present solution framework.
Author Contributions
Z.Y.: Conceptualization, Methodology, Validation, Formal Analysis, Investigation, Writing—Original Draft, Data Curation, Visualization. S.L.: Conceptualization, Resources, Funding. B.L.: Writing—Review and Editing, Data Curation, Visualization, Funding. C.C.: Conceptualization, Resources, Supervision, Funding. J.M.-A.: Writing—Review and Editing. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the National Nature Science Foundation of China (No. 91547201, No. U1765103 and No. 51709035).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Some data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request, including the code of the proposed IPBM, MILP, k-means, and silhouette coefficient.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
Table A1 describes the basic parameters of thermal units. Table A2 lists the basic parameters of hydropower plants.
Table A1.
Basic parameters of thermal units.
Table A1.
Basic parameters of thermal units.
| Plant No. | Unit No. | Minimum Output (MW) | Maximum Output (MW) | a1 (t/MW2h) | b1 (t/MWh) | c1 (t/h) |
|---|---|---|---|---|---|---|
| T1 | #1 | 150 | 300 | 11.4 | 2.42 | 9.94 |
| #2 | 150 | 300 | 5.4 | 2.80 | 10.61 | |
| #3 | 150 | 300 | 18.6 | 2.14 | 15.78 | |
| #4 | 150 | 300 | 4.2 | 2.72 | 9.06 | |
| T2 | #1–#4 | 50 | 135 | 12.3 | 2.63 | 13.62 |
| T3 | #1, #2 | 330 | 660 | 11.5 | 2.45 | 12.70 |
| T4 | #1, #2 | 150 | 300 | 3.2 | 2.86 | 8.99 |
| #3, #4 | 150 | 300 | 8.0 | 2.33 | 15.21 | |
| T5 | #1, #2 | 300 | 600 | 14.1 | 1.35 | 63.65 |
| T6 | #1, #2 | 330 | 660 | 2.5 | 2.94 | 8.94 |
| T7 | #1–#3 | 300 | 600 | 2.9 | 3.70 | 10.52 |
| #4 | 300 | 630 | 10.5 | 1.63 | 56.07 | |
| T8 | #1 | 100 | 200 | 197.2 | −2.96 | 53.98 |
| #2 | 100 | 200 | 37.0 | 2.19 | 9.93 | |
| #3 | 100 | 200 | 42.8 | 1.55 | 19.42 | |
| T9 | #1 | 150 | 300 | 2.3 | 2.98 | 4.81 |
| #2 | 150 | 300 | 1.1 | 2.92 | 6.46 | |
| #3 | 150 | 300 | 0.6 | 3.06 | 0.96 | |
| #4 | 150 | 300 | 0.1 | 3.12 | 2.32 | |
| T10 | #1, #2 | 300 | 600 | 1.4 | 1.70 | 53.61 |
| T11 | #1, #2 | 300 | 600 | 37.4 | −0.56 | 74.85 |
| T12 | #1 | 150 | 300 | 2.9 | 2.94 | 5.74 |
| #2 | 150 | 300 | 2.8 | 2.88 | 7.66 | |
| T13 | #1 | 50 | 150 | 0.7 | 4.01 | −10.16 |
| #2 | 50 | 150 | 147.6 | −1.19 | 33.36 | |
| T14 | #1–#4 | 300 | 600 | 6.4 | 2.06 | 28.68 |
| T15 | #1, #2 | 330 | 660 | 13.2 | 2.34 | 12.88 |
| T16 | #1, #2 | 300 | 600 | 1.5 | 2.73 | 10.33 |
| T17 | #1, #2 | 150 | 300 | 0.4 | 3.08 | 4.85 |
| T18 | #1, #2 | 330 | 660 | 8.2 | 1.92 | 43.21 |
| T19 | #1 | 150 | 300 | 76.2 | −0.26 | 33.80 |
| #2 | 150 | 300 | 7.2 | 2.28 | 22.30 | |
| #3 | 150 | 300 | 105.6 | −2.32 | 71.72 | |
| #4 | 150 | 300 | 12.5 | 2.27 | 16.08 | |
| T20 | #1 | 150 | 300 | 0.8 | 3.03 | 3.06 |
| #2 | 150 | 300 | 24.4 | 2.00 | 14.09 | |
| #3 | 150 | 300 | 30.8 | 1.61 | 19.70 | |
| #4 | 150 | 300 | 3.1 | 3.02 | 3.03 | |
| T21 | #1, #2 | 150 | 300 | 0.8 | 3.16 | 3.79 |
| #3 | 150 | 300 | 1.3 | 2.95 | 7.37 | |
| #4 | 150 | 300 | 2.2 | 3.07 | 3.65 | |
| T22 | #1 | 150 | 300 | 2.9 | 3.34 | −4.85 |
| #2 | 150 | 300 | 0.4 | 2.50 | 10.43 | |
| #3 | 150 | 300 | 49.6 | 0.73 | 25.43 | |
| #4 | 150 | 300 | 9.9 | 2.55 | 7.35 |
1a, b, and c are fuel consumption coefficients of thermal unit, respectively.
Table A2.
Basic characteristics of hydropower plants.
Table A2.
Basic characteristics of hydropower plants.
| Plant No. | Unit Configuration 1 | Adjustment Ability | Minimum Storage (106 m3) | Maximum Storage (106 m3) | Maximum Outflow (m3/s) |
|---|---|---|---|---|---|
| H1 | 3 × 200 | Multiyearly | 1137 | 4497 | 500 |
| H2 | 3 × 190 + 1 × 125 | Seasonally | 374 | 864 | 700 |
| H3 | 3 × 200 | Daily | 101 | 169 | 700 |
| H4 | 5 × 250 | Seasonally | 781 | 2142 | 700 |
| H5 | 5 × 600 | Yearly | 2662 | 5564 | 1000 |
| H6 | 3 × 90 | Daily | 35 | 78 | 400 |
| H7 | 4 × 260 | Yearly | 1098 | 3135 | 600 |
| H8 | 4 × 180 | Daily | 106 | 137 | 700 |
| H9 | 4 × 220 | Daily | 739 | 882 | 800 |
| H10 | 3 × 28 | Seasonally | 101 | 348 | 200 |
| H11 | 3 × 120 | Seasonally | 133 | 455 | 400 |
| H12 | 2 × 100 | Seasonally | 115 | 251 | 200 |
| H13 | 2 × 75 | Daily | 51 | 69 | 200 |
1 Number of units × unit capacity (MW).
References
- Global Energy Review. 2019. Available online: https://www.iea.org/reports/global-energy-review-2019 (accessed on 16 April 2021).
- Tian, H.; Yuan, X.; Ji, B.; Chen, Z. Multi-objective optimization of short-term hydrothermal scheduling using non-dominated sorting gravitational search algorithm with chaotic mutation. Energy Conv. Manag. 2014, 81, 504–519. [Google Scholar] [CrossRef]
- Takigawa, F.Y.K.; da Silva, E.L.; Finardi, E.C.; Rodrigues, R.N. Solving the hydrothermal scheduling problem considering network constraints. Electr. Power Syst. Res. 2012, 88, 89–97. [Google Scholar] [CrossRef]
- Marchand, A.; Gendreau, M.; Blais, M.; Emiel, G. Fast near-optimal heuristic for the short-term hydro-generation planning problem. IEEE Trans. Power Syst. 2018, 33, 227–235. [Google Scholar] [CrossRef]
- Birhanu, K.; Alamirew, T.; Dinka, M.O.; Ayalew, S.; Aklog, D. Optimizing reservoir operation policy using chance constraint nonlinear programming for Koga Irrigation Dam, Ethiopia. Water Resour. Manag. 2014, 28, 4957–4970. [Google Scholar] [CrossRef]
- Feng, Z.; Niu, W.; Cheng, C.; Wu, X. Optimization of large-scale hydropower system peak operation with hybrid dynamic programming and domain knowledge. J. Clean Prod. 2018, 171, 390–402. [Google Scholar] [CrossRef]
- Azizipour, M.; Afshar, M.H. Adaptive hybrid genetic algorithm and cellular automata method for reliability-based reservoir operation. J. Water Resour. Plan. Manag. 2017, 143, 04017046. [Google Scholar] [CrossRef]
- Finardi, E.C.; daSilva, E.L. Solving the Hydro Unit Commitment Problem via Dual Decomposition and Sequential Quadratic Programming. IEEE Trans. Power Syst. 2006, 21, 835–844. [Google Scholar] [CrossRef]
- Helseth, A.; Fodstad, M.; Mo, B. Optimal hydropower maintenance scheduling in liberalized markets. IEEE Trans. Power Syst. 2018, 33, 6989–6998. [Google Scholar] [CrossRef]
- Pereira, M.V.F. Optimal stochastic operations scheduling of large hydroelectric systems. Int. J. Electr. Power Energy Syst. 1989, 11, 161–169. [Google Scholar] [CrossRef]
- Pereira, M.V.F.; Pinto, L. Stochastic optimization of a multireservoir hydroelectric system—A decomposition approach. Water Resour. Res. 1985, 21, 779–792. [Google Scholar] [CrossRef]
- Labadie, J.W. Optimal operation of multireservoir systems: State-of-the-art review. J. Water Resour. Plan. Manag. 2004, 130, 93–111. [Google Scholar] [CrossRef]
- Li, T.; Shahidehpour, M. Price-based unit commitment: A case of Lagrangian relaxation versus mixed integer programming. IEEE Trans. Power Syst. 2005, 20, 2015–2025. [Google Scholar] [CrossRef]
- Redondo, N.J.; Conejo, A.J. Short-term hydro-thermal coordination by Lagrangian Relaxation: Solution of the dual problem. IEEE Trans. Power Syst. 1999, 14, 89–95. [Google Scholar] [CrossRef]
- Borghetti, A.; Frangioni, A.; Lacalandra, F.; Nucci, C.A. Lagrangian heuristics based on disaggregated bundle methods for hydrothermal unit commitment. IEEE Trans. Power Syst. 2003, 18, 313–323. [Google Scholar] [CrossRef]
- Hare, W.; Sagastizábal, C.; Solodov, M. A proximal bundle method for nonsmooth nonconvex functions with inexact information. Comput. Optim. Appl. 2015, 63, 1–28. [Google Scholar] [CrossRef]
- Lv, J.; Pang, L.; Xu, N.; Xiao, Z. An infeasible bundle method for nonconvex constrained optimization with application to semi-infinite programming problems. Numer. Algorithms 2018, 80, 397–427. [Google Scholar] [CrossRef]
- Zhang, D.Y.; Luh, P.B.; Zhang, Y.H. A bundle method for hydrothermal scheduling. IEEE Trans. Power Syst. 1999, 14, 1355–1360. [Google Scholar] [CrossRef]
- Lv, J.; Pang, L.; Meng, F. A proximal bundle method for constrained nonsmooth nonconvex optimization with inexact information. J. Glob. Optim. 2017, 70, 517–549. [Google Scholar] [CrossRef]
- Fuduli, A.; Gaudioso, M.; Nurminski, E.A. A splitting bundle approach for non-smooth non-convex minimization. Optimization 2013, 64, 1131–1151. [Google Scholar] [CrossRef]
- Burke, J.V.; Lewis, A.S.; Overton, M.L. A robust gradient sampling algorithm for nonsmooth nonconvex optimization. SIAM J. Optim. 2005, 15, 751–779. [Google Scholar] [CrossRef]
- Hare, W.; Sagastizábal, C. A redistributed proximal bundle method for nonconvex pptimization. SIAM J. Optim. 2010, 20, 2442–2473. [Google Scholar] [CrossRef]
- Chen, P.H. Two-level hierarchical approach to unit commitment using expert system and elite PSO. IEEE Trans. Power Syst. 2012, 27, 780–789. [Google Scholar] [CrossRef]
- Sahin, S.; Tolun, M.R.; Hassanpour, R. Hybrid expert systems: A survey of current approaches and applications. Expert Syst. Appl. 2012, 39, 4609–4617. [Google Scholar] [CrossRef]
- Giarratano, J. Expert Systems: Principles and Programming, 4th ed.; Course Technology: Boston, MA, USA, 2004; pp. 112–152. [Google Scholar]
- Leung, Y.W.; Wang, Y.P. An orthogonal genetic algorithm with quantization for global numerical optimization. IEEE Trans. Evol. Comput. 2001, 5, 41–53. [Google Scholar] [CrossRef]
- Feng, Z.; Niu, W.; Cheng, C.; Lund, J.R. Optimizing hydropower reservoirs operation via an orthogonal progressive optimality algorithm. J. Water Resour. Plan. Manag. 2018, 144, 04018001. [Google Scholar] [CrossRef]
- Bertsekas, D.P. Nonlinear Programming, 3rd ed.; Athena Scientific: Belmont, MA, USA, 2016; pp. 591–642. [Google Scholar]
- Seki, T.; Yamashita, N.; Kawamoto, K. New local search methods for improving the Lagrangian-Relaxation-based unit commitment solution. IEEE Trans. Power Syst. 2010, 25, 272–283. [Google Scholar] [CrossRef]
- Cheng, C.; Wang, J.; Wu, X. Hydro unit commitment with a head-sensitive reservoir and multiple vibration zones Using MILP. IEEE Trans. Power Syst. 2016, 31, 4842–4852. [Google Scholar] [CrossRef]
- Guan, X.; Luh, P.B.; Yan, H.; Amalfi, J.A. An optimization-based method for unit commitment. Int. J. Electr. Power Energy Syst. 1992, 14, 9–17. [Google Scholar] [CrossRef]
- Liu, S. A simple version of bundle method with linear programming. Comput. Optim. Appl. 2018, 72, 391–412. [Google Scholar] [CrossRef]
- Tang, C.; Liu, S.; Jian, J.; Ou, X. A multi-step doubly stabilized bundle method for nonsmooth convex optimization. Appl. Math. Comput. 2020, 376, 125154. [Google Scholar] [CrossRef]
- Guedes, L.S.M.; Maia, P.D.M.; Lisboa, A.C.; Gomes Vieira, D.A.; Saldanha, R.R. A unit commitment algorithm and a compact MILP model for short-term hydro-power generation scheduling. IEEE Trans. Power Syst. 2017, 32, 3381–3390. [Google Scholar] [CrossRef]
- Layton, R.; Watters, P.; Dazeley, R. Evaluating authorship distance methods using the positive Silhouette coefficient. Nat. Lang. Eng. 2012, 19, 517–535. [Google Scholar] [CrossRef]
- Zhan, Z.; Zhang, J.; Li, Y.; Shi, Y. Orthogonal learning particle swarm optimization. IEEE Trans. Evol. Comput. 2011, 15, 832–847. [Google Scholar] [CrossRef]
- Fadıl, S.; Yazici, A.; Urazel, B. A solution to security constrained non-convex economic dispatch problem by modified subgradient algorithm based on feasible values. Int. J. Electr. Power Energy Syst. 2012, 43, 849–858. [Google Scholar] [CrossRef]
- Bertsimas, D.; Dunning, I.; Lubin, M. Reformulation versus cutting-planes for robust optimization. Comput. Manag. Sci. 2015, 13, 195–217. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).