Open Access This article is
- freely available
Energies 2018, 11(3), 476; https://doi.org/10.3390/en11030476
Towards Optimal Power Management of Hybrid Electric Vehicles in Real-Time: A Review on Methods, Challenges, and State-Of-The-Art Solutions
Chair of Dynamics and Control, University of Duisburg-Essen, Lotharstr. 1, 47057 Duisburg, Germany
Author to whom correspondence should be addressed.
Received: 12 January 2018 / Accepted: 19 February 2018 / Published: 25 February 2018
In light of increasing alerts about limited energy sources and environment degradation, it has become essential to search for alternatives to thermal engine-based vehicles which are a major source of air pollution and fossil fuel depletion. Hybrid electric vehicles (HEVs), encompassing multiple energy sources, are a short-term solution that meets the performance requirements and contributes to fuel saving and emission reduction aims. Power management methods such as regulating efficient energy flow to the vehicle propulsion, are core technologies of HEVs. Intelligent power management methods, capable of acquiring optimal power handling, accommodating system inaccuracies, and suiting real-time applications can significantly improve the powertrain efficiency at different operating conditions. Rule-based methods are simply structured and easily implementable in real-time; however, a limited optimality in power handling decisions can be achieved. Optimization-based methods are more capable of achieving this optimality at the price of augmented computational load. In the last few years, these optimization-based methods have been under development to suit real-time application using more predictive, recognitive, and artificial intelligence tools. This paper presents a review-based discussion about these new trends in real-time optimal power management methods. More focus is given to the adaptation tools used to boost methods optimality in real-time. The contribution of this work can be identified in two points: First, to provide researchers and scholars with an overview of different power management methods. Second, to point out the state-of-the-art trends in real-time optimal methods and to highlight promising approaches for future development.
Keywords:real-time optimal power management; pattern recognition; intelligent transportation systems; hybrid electric vehicles
Hybrid electric vehicles (HEVs) are considered as an innovative solution towards clean and efficient transportation. Compared to conventional vehicles, HEVs offer lower fuel consumption, less hazardous emissions, and extended mileage. Therefore, they are receiving more attention from scholars, industry, and governments. Consequently, development of hybrid powertrains has been through fast evolutionary paces during the last two decades .
Hybrid powertrains, encompassing two or more on-board energy sources, deal with different energy forms to perform the required vehicle propulsion. Due to the complexity of such powertrains, multiple perspectives have to be considered in the development process to achieve the desired performance level as illustrated in Figure 1. In the design level, the set of design requirements and solutions are contradictive and contending in nature. Therefore, initial determination of design goals and solutions implies a base-line powertrain performance to the operation level. However, implementing efficient control schemes, i.e., power management methods, in operation level can significantly improve fuel consumption and emission rates, mileage extension, and operation robustness .
The interdependency between these perspectives implies a necessity to determine an efficient development strategy that achieves higher impact on the vehicle performance and minimizes tuning cost and time. In this context, the conceptual review on reported strategies gives the conclusion that development of HEVs falls into three main categories: design configuration, component sizing, and power management methods . Design configuration and components sizing expend more effort to find the optimal driveline topology and the according components i.e., engine/motor size and capacity of the energy storage systems [4,5]. However, power management, defining efficient control schemes, proved to have a higher impact on powertrain performance at lower cost and the ability to target multiple objectives simultaneously or selectively .
The power management of HEVs can be defined as a set of algorithms regulating powertrain operation based on measured inputs and controlled outputs to achieve predefined process goals . The objective of such control algorithms is the goal or set of goals to be attained instantaneously or over a specified driving time. Power management objectives include fuel consumption minimization, on-board charge sustenance/depletion, emission reduction, driveability, and components life-time maximization. Recently, further objectives have been considered such as smooth gear shifting, minimizing driveline vibration, handling and ride characteristics of the vehicle. It is required from the power management method to achieve the defined objectives and accommodate the changes of vehicle and driving conditions .
The mathematical formulation of control methods in terms of inputs, outputs, objectives, and constraints is referred to as the power management problem. The solution method, number of targeted objectives, and availability of inputs (measured/estimated) affect the applicability of these methods in real-time and the optimality of the solution. In this context, power management methods are classified into two main categories: rule-based and optimization-based methods as illustrated in Figure 2. In rule-based methods, the control law is defined by deterministic on-off rules or by fuzzy-logic rules. Optimization-based methods implement optimal control approaches to find a global optimal solution. This optimality can be obtained using backward calculation in global optimization methods; however, in real-time, instant-wise control decisions are taken based on estimated future cost minimization .
1.1. Problem Statement
The conceptual evaluation of each power management category reveals that RB strategies are characterized by lower computational requirements and higher applicability in real-time, but the solution provided is non-optimal over the specified drive range. Contrarily, optimization-based methods are sophisticated approaches, capable of finding the global optimal solution to the power management problem. However, a full “priori” knowledge about driving condition should be available—which is not the case in real applications. Briefly, a real-time-applicable control method should be able to search and find power handling decisions within the runtime limits of the on-board controller. Defining power management methods that are able to approach the global optimal solution in real-time is the state-of-the-art challenge in HEVs.
To adapt the basic power management methods to real-time application, further tools are integrated to basic power management methods to provide short-time prediction, code simplification, or situation identification in real-time. These tools, here denoted as “subsidiary tools”, include pattern recognition, prediction/estimation techniques, multi-rate computing, and intelligent traffic system (ITS). A non-trivial balance between excessive complexity and solution optimality has to be achieved while integrating these tools to power management methods.
1.2. Contribution and Novelty
The main focus of this work is to review and analyze how solution optimality can be achieved in real-time power management of HEVs. To this aim, a review on power management methods in terms of mathematical formulations, objectives, and problem constraints is introduced. This review points out the pros, cons, and challenges in each method. Moreover, an in-depth analysis about the state-of-the-art trends to approach optimal solutions in real-time is given. Using categorized tables, this analysis illustrates how the subsidiary tools have been integrated into the basic power management methods.
This contribution presents, for the first time, a special insight into the real-time power management methods and reveals the associated innovative approaches. Through the comparative analysis of real-time methods and integrated subsidiary tools, this work aims to help researchers identify the promising approaches as well as the non-conquered research points in this field.
2. Rule-Based Methods
Rule-based (RB) methods are heuristic strategies in which the control law is defined as a set of “if-then” rules to determine the control action . In HEVs, RB methods are formulated using human expertise, intuition, operation boundaries, and safety considerations. The main advantage of these methods is the low computational requirements; therefore, they are widely used in several commercial vehicles like the Toyota Prius and the Honda Insight . Rule-based methods are classified into: deterministic and fuzzy RB algorithms. A brief explanation of each method is given in the sequel.
2.1. Deterministic Rule-Based Methods
Deterministic RB methods are formulated in terms of fixed rules. Briefly, engine shut-off, powersplit, or battery charging commands are regulated by algorithms wherein the operation limits are already prescribed . Deterministic RB methods are explained as follows:
2.1.1. Thermostat (on/off) Control Strategy
This is a classical control method, based on defining allowed working limits for the driveline components. The main objective of the control is to maintain the engine, electric motor, and battery working in specified operating ranges . The overall system efficiency is not achievable, considering unplanned power demand. However, this method is widely used due to its low computational requirements .
2.1.2. Power Follower (Baseline) Control Strategy
This is a well-known strategy that reformulates the on/off algorithms into a more advanced yet applicable strategy. The main idea is to define different case-based control modules for the power management. In , four cases have been established for engine on/off status based on two levels of the battery’s state of charge and engine power as illustrated in Figure 3.
The engine operating point is mapped to leveled optimal points according to the power demand and available power from the battery . The simulation results of  shows the improvement of engine power efficiency; however, the overall fuel economy could not be optimized compared to similar powertrains. This articulates the main disadvantage of such engine-oriented control schemes.
2.1.3. Modified Power Follower—Adaptive RB (ARB)
In this method, a step-wise decision-taking process is performed. According to the current operating condition, a range of acceptable operating points is defined for the next transition based on the driver demand and constraints as shown in Figure 4. The selection of the next point is based on instantaneous cost function minimization considering predicted future cost associated to each point.
A well known example  is based on further development of the baseline method applied in ADVISOR simulator . In this work, the candidate points are evaluated based on normalized constituent cost factors, user and target weighting, and final overall impact minimization. The method included emission reduction in the optimization objectives, hence, NOx have been decreased by 27% at the cost of a slight increase of 1.4% in energy consumption.
2.1.4. Frequency-Based Approach
The idea of using frequency analysis in power management is based on power demand decomposition into high and low-frequency components as shown in Figure 5. Super/ultra-capacitors are characterized by relatively high power and low energy capacity; therefore, they are more suitable to take over the load dynamics. In multi-source HEVs, batteries hold a balanced power/energy capacitance and hence are assigned to moderate dynamics load. The low frequency components are assigned to sources like engines or fuel cells to mitigate the aggressive transients of the load .
A hardware-in-the-loop validation of this method is conducted using an experimental HEV. The results have been compared to the thermostatic strategy stating fuel economy improvement of 5.9% soot emissions reduction of 62.7%, and a reduction of high current demand to the battery that lowered its average operating temperature by 3 C. The battery life is then estimated using Ah-processed model revealing a reduction of 23% and consequently extending lifespan .
2.1.5. Optimal Points Tracking
This method concurs with the baseline approach in that both are targeting optimal engine operating conditions as a primary source; however, these optimal points are here targeted at higher precision using a prescribed engine map. The application of these optimal points is performed at a higher hierarchical level, then the power splitting between secondary power sources is regulated according to the given available power and charging/discharging efficiency of the secondary sources.
In , arbitrary local optimal points have been selected according to emissions and efficiency maps of the engine achieving 22.9% improvement of fuel economy. This principle is developed to a new definition of optimal operation line for engine in HEVs . The new definition is based on merging constant battery power lines as contours to the engine map, then a new optimal line is found on these contours based on the solution of according optimization problem. The obtained power split solutions showed a qualitative fuel consumption improvement compared to the conventional line tracking method.
2.2. Fuzzy Rule-Based Methods
Fuzzy control is introduced to the power management in HEVs offering the advantages of output proportionality to different operating conditions, ease of fuzzy rules tuning, and robustness to modeling errors and inaccurate measurements. Fuzzy-based approaches are explained more in the sequel.
2.2.1. Basic Fuzzy
In this method, the controller performs the well-known basic steps of fuzzy logic. First, the inputs are fuzzified into membership functions, wherein human- and expertise-based rules are used to compute the fuzzy output. Finally, the output values are defuzzified to proportional control signals. It has been introduced to power management of HEVs using load leveling principle .
Offline control parameters optimization substantially improves the performance of fuzzy methods . The investigative analysis of the results revealed that the method is adaptive to initial and road-grade change achieving fuel consumption improvement of 20% compared to the conventional RB method .
2.2.2. Adaptive Fuzzy
The performance of basic fuzzy methods can be further enhanced if the control parameters are adaptive to the current operating conditions. In , an intelligent situation awareness agent (IEMA) is integrated to the fuzzy-based torque distribution algorithm. The driving conditions are classified based on road type and driver behavior. A learning vector quantization (LVQ) is implemented to determine the driving conditions using a limited duration of data. The results in  proved that IEMA is a successful extension of the basic fuzzy method for overall performance improvement.
On the other hand, fuzzy logic itself is applied for drive cycles classification into five sub-patterns . An RB strategy is structured and optimized using DP for every pattern, then the driving data over 100 s are used for online pattern recognition. The achieved energy saving results showed that the developed adaptive method outperforms the basic fuzzy method.
2.2.3. Predictive Fuzzy
In addition to current driving condition recognition, a prediction of upcoming scenarios can be integrated into the fuzzy controller to achieve near optimal results. In , traffic and road type data are used to acquire knowledge about near future driving conditions. Furthermore, a protective state-of-health extension strategy is integrated into the method at the price of relatively higher fuel consumption and emissions.
A versatile driving conditions preceptive model is developed based on four traffic congestion levels . Fuzzy logic parameters are optimized off-line for every condition using genetic algorithms GA. Simulation results revealed that the method is more adequate for real-life application rather than optimizing these parameters for the whole drive cycle.
3. Optimization-Based Methods
In these methods, the target of power management is to minimize the operation cost over the considered time span. From this perspective, these methods fall into two categories: global optimization and real-time optimization. Recent bibliometrics reveal that optimization-based methods grasp more attention in research with a percentage of 56.7% compared to rule-based methods 32.9% . In the following, more details about each category are given.
3.1. Global Optimization
Global optimization methods are designed to attain the global optimum solution for the whole trip based on a priori knowledge about upcoming driving conditions. The real-time application of these methods is limited due to augmented computational load; however, they can serve as a benchmark solution to analyze, tune, and evaluate other methods . The application of these methods can be conceptually categorized into dynamic and static optimization.
In dynamic optimization, the control parameters are decisively determined. The optimal values for these parameters at each time step are searched using backward calculation to minimize the overall cost function . On the other hand, static optimization aims to find a fixed optimal value for each control parameter that yields balanced results at various operating conditions. To this aim, gradient-free methods are preferable where Lipschitz condition, i.e., existence and uniqueness of an optimal solution, cannot always be fulfilled . A brief discussion on global optimization methods is presented in the following.
3.1.1. Linear Programming
Nonlinear models of hybrid powertrains can be simplified to formulate a less complex power management problem. Linearized models can be easily solved by several solvers and they achieve near optimal results at reduced computational processes. In , the convex power management problem is reduced to a linear one considering constant battery efficiency and neglecting power bus voltage ripples and engine transients to find the lower fuel consumption of a series propulsion system. In , the optimal power-split problem is formulated as a mixed-integer nonlinear optimization problem as:subject towhere T denotes trip time, N number of discrete power levels, C the gap threshold between initial and minimum battery’s , power demand, and and the discrete power level and associated efficiency. By precalculating for every discrete power level in terms of maximum, minimum, and initial s as:the optimization constraint in Equation (2) can be linearized, thus reducing the problem to a mixed-integer linear programming one. Henceforth, numerous efficient solvers can be implemented to find the global optimal solution. The obtained fuel saving results showed an improvement of 10–15% compared to the binary-mode strategy . Nevertheless, due to the fact that complex powertrain models are not always possible to be linearized, the application of this method is still limited.
3.1.2. Dynamic Programming (DP)
Dynamic programming can be applied to solve different optimization problems in discrete form based on Bellman’s principle of optimality . The discretized formulation considers a finite number of solutions at each time step k of the driving time span. The optimal solution is searched sequentially by evaluating the cost function of the states backwards in terms of instantaneous cost and remaining cost . The constraints to the optimization function can be considered using a penalty term at every step k and final step F respectively . The cost function in discrete form can be written as:
For the deterministic problem (DDP), the instantaneous cost function can be defined as:where is the individual power consumption for the Y driveline components. However, the next state should not necessarily coincide with the predefined discrete states. The associated cost function should be interpolated to the nearest discrete point . In the stochastic problem (SDP), the future operating conditions are defined as a probability function for the transition from current state to next state . This transition probability model can be described as a normal finite-state Markov model  or as a homogeneous one where the future states depend only on the knowledge of the current state and not the previous ones . The SDP problem can then be formulated as:where is a discount factor to ensure that converges to a predefined limit. The cost is evaluated backwards for and checking for convergence while iterating. The iteration of next step terminates if a predefined convergence limit is achieved or if the iteration index i reaches N complete steps.
The obtained solution by SDP is inferior to DDP due to the limited knowledge of upcoming driving condition leading to non-optimal policies . Nevertheless, due to higher computational load of DP and the fact that the solution is exclusively optimal for a given driving cycle, it is used as a benchmark solution.
3.1.3. Genetic Algorithm (GA)
Genetic algorithm is a metaheuristic method inspired by evolution mechanisms. It initially postulates a set of solutions (chromosomes) as the first population. The solutions obtained from this first population are evaluated with respect to an objective fitness function. The best solutions are given a higher chance to develop (grow) and form the next generation. This procedure is repeated up to fulfillment of the stopping criteria (solution convergence or maximum number of iterations). The mechanism in which the next generation is established is regulated by the operators of crossover, mutation, migration, and extinction .
As a derivative-free algorithm, GA explores the solution subspace more accurately and avoids being trapped in a local minimum abscissa. Therefore, it proved suitability for unconstrained multi-objective optimization problems in HEVs . Operational constraints are handled by penalty functions to degrade the infeasible solutions and reduce its fitness . In addition, to prevent premature convergence of the solution during the selection phase, simulated annealing (SA) is typically applied to the algorithm .
Non-dominant sorting GA (NSGAII) considering both subpopulations of parents and offspring into the sorting mechanism. The individuals are evaluated according to their rank which indicates the convergence to the optimal Pareto set and the crowding distance that reflects the solution diversification [38,39]. The computational load is then reduced to instead of in GA as shown in Figure 6. However, GA does not enable designers to have an insight about powertrain behavior during the optimization; therefore, expertise-based rules extraction is not practical.
3.1.4. Optimal Control Theory
In optimal control theory, the control law is defined for the given system such that the optimization goals are met. It is based on introducing Lagrangian/costate multipliers to the cost function according to the problem’s constraints so that a sufficient condition for the optimality can be found by the Hessian of the Lagrangian . Referring to the described system in Equation (6), the cost function can be defined as:where the optimization constraints are defined in denotes the control parameters vector. The nonlinear control path constraints and boundary conditions can be defined explicitly .
At lower computational effort, application of optimal control methods in a fuel cell HEV outperformed the fuel economy obtained by an equivalent cost minimization strategy (ECMS) and exhibiting smoother profile of the battery’s which is a further advantage of optimal control . Nevertheless, the estimation of initial Lagrangian parameters (similarly initial costate or Hamiltonian) has a non-negligible monotonic effect on the solution convergence if the drive cycle is not given. To bring this method into real-time application, continuous adjustment of is needed to achieve acceptable target values [41,42].
3.1.5. Particle Swarm Optimization (PSO)
Inspired by intelligent swarm behavior, PSO is introduced as an optimization method for nonlinear dynamic systems. In this optimization problem, solution parameters are defined within a multi-dimensional space. In this space, a swarm of particles (solutions) is generated as an initial set of solutions. The movement (value change) of each particle can be characterized by two variables: position and speed; then adjusted for the best values for the individual particles and the whole swarm as a group. The particle’s movement is then oriented to follow the best direction with respect to the group .
In , the initial solution is chosen based on a revised RB strategy. In this case, the optimal values are searched using PSO and SA for six different drive cycles. In , five initial solutions are set up. Considering a limit of 100 iterations, the best particle position at the last step denoted the optimal values of control parameters. However, the aforementioned contributions gave the insight that PSO suffers from limited solution optimality (based on N iterations) and improper handling of solution divergence. These issues are addressed in  using dynamically changing inertia weight (DCWPSO) by introducing a dynamic factor , where e and a denote the particle evolution and convergence respectively. This means that the range of position and speed change of each particle was adapted to the solution closeness to global optimality achieving 15.8% reduction of fuel consumption compared to normal PSO.
3.1.6. Further Methods
Many other methods are introduced into the power management problem. However, most of them are still in the early development and exploration phase. Based on an integrated use of orthogonal polynomials in DIRECT method , a method called pseudo-spectrum is developed to enhance the direct collocation algorithm . The results obtained could achieve relatively higher accuracy of the optimal solution point; however, optimality of the point itself is still not guaranteed.
Game Theory (GT) is a mathematical approach, initially presented to economics, that depends on learning, understanding, and predicting human behaviors . The behavior of different energy sources in HEVs can be modeled as a multi-agent game system, where the Nash equilibrium between these agents denote an optimal (balanced) power split ratio . The mathematical computation of GT is simpler than other methods. The solution is relatively less dependent on the drive cycle; however, it is less applicable to vehicular control schemes due to the dependency on human behavior expectation and the nonlinearity of complex powertrain models.
Space exploration and unimodal region elimination (SEUMRE) is a stochastic method based on spreading sampling points to explore the solution space and predict where the global solution may exist. The results converge to a final solution of highly nonlinear problems faster than SA and GA; however, the obtained solution is suboptimal .
3.2. Real-time Optimization
Real-time optimization methods apply instantaneous power handling policies to minimize the cost function based on future equivalence assumptions of the energy consumption. In general, the mathematical formulation of these methods should be suitable for real-time application in terms of computational requirements and memory resources . A brief review to these methods is given in the sequel.
Equivalent cost minimization strategy (ECMS) is a well-established method based on converting the on-board electric energy depletion into an equivalent fuel consumption using equivalent factors and predicts future cost to compensate this energy . The key challenge in ECMS is the estimation of these equivalent factors considering individual components’ efficiencies and transient dynamics of power sources. In the early version of ECMS, powertrain components have been assumed to have constant efficiencies (mean value), then the cost is defined as:where and are the real engine fuel consumption and electric motor equivalent fuel consumption respectively. The design variables of this problem are torque demand by the driver and gear number . The equivalence of electric energy is calculated considering different charge/discharge process of the battery as:where and are the mean specific fuel consumption for the recharge and discharge cases respectively, and are the mean efficiency of battery and electric motor, and is the motor power at torque and speed . Finally, the instantaneous optimal control problem is defined to minimize the total cost . The obtained results revealed the ability of ECMS to yield a near optimal solution compared to DP at lower computational requirements .
Due to the fact that equivalence factors estimation directly influences the performance of ECMS, this point is further investigated from two perspectives: finding optimal static values or dynamic update of the estimated value . The former is a typical static optimization problem that can be solved using DP or GA . The latter can be classified into three subcategories: First, utilizing a correction term for the offline optimized factor using feedback control . Second, considering an equivalent factor function in terms of two optimized values for charging/discharging cases and a probability factor based on current and expected electric energy depletion . Third, by implementing a multi-dimensional LUT using the current information of Vehicle load , position , speed , or trip length .
3.2.2. Pontryagin’s Minimum Principle (PMP)
As a special case of the Euler-Lagrangian equation, PMP is suitable for solving state-constrained problems in real-time under some reasonable postulates. Referring the optimal control problem in Equations (6)–(9), the Hamiltonian H be defined for all as:where, is the Lagrangian multipliers vector defined as and whose elements are the costate variables of the system. The condition for optimality states that there is an optimal control that yields an optimal state and costate’s trajectories and respectively and satisfies:in the predefined time span. Assuming in the discrete form that is a priori, i.e., , the problem becomes much simpler and can be solved in real-time to achieve a near optimal solution [61,62].
Hereby, the core factor of this method is the initial costate determination due to its direct impact on state trajectory and solution convergence to optimality. Dynamic correction of this value is realized by feedback control methods; for example, PI-control  including also observers  to reduce the estimation error. In approximate PMP (A-PMP), a simple convex approximation of the Hamiltonian could achieve fuel consumption reduction of 6.96% in a PHEV compared to the conventional PMP .
3.2.3. Model Predictive Control (MPC)
This is an intelligent method that depends on a definite model of the dynamic system to predict the output behavior then, optimize the control parameters to achieve the desired output. Referring to Equation (8), for the discrete system description in state space:the steps of typical MPC algorithm can be illustrated as follows: First, the manipulated output is predicted stepwise ahead as based on n different controller sets . An optimization function is then applied in order for to yield the desired output as shown in Figure 7. The according optimization function can also be defined as a multiobjective one as:where and are weighting matrices. The output error arising from the unknown disturbance input and inaccurate modeling of the plant P as . Finally, optimization horizon is shifted one step ahead and the procedure is performed for the new horizon. More details of the output prediction steps and solution methods of MPC constrained problems are given in [66,67].
In the lack of a priori knowledge about the driving cycles, the prediction mechanism of future driving conditions is based on stochastic Markov chain models, neural network (Hamming NN), and fuzzy logic methods [68,69,70]. Moreover, MPC can perform at a non uniform sampling time where small samples allow better stability, continuity, and smoothness of power references and large samples (relaxation) is applied for long term planning of the energy sources [71,72].
3.2.4. Adaptive Dynamic Programming (ADP)
Dynamic programming, as an efficient optimization method, received further modifications to suit real-time applicability. Here, ADP refers to the adaptive methods where the main DP algorithm is simplified, discretized, or reconstructed to reduce the computational load during real-time control. Intuitively, the simplified version yields a suboptimal solution; however, it outperforms many other real-time control methods .
Iterative DP (IDP) is an approach that uses uses relatively coarse grids for both state and control vectors to determine the optimal policies for the next iteration . These grids are refined through progressive iterations to achieve the global optimal fuel saving (29.76% compared to RB method) at substantially reduced computational steps and memory requirements . The optimal control strategy found by IDP can be fit to real-time application using Elman NN achieving a suboptimal result of 24.6%. The drawbacks of this method is that the drive cycle is required as a priori and that small changes in traffic or ridership, even for fixed-route buses, can entirely change the driving profile .
In , a multi-rate DP is introduced such that slowly evolving dynamic states, e.g., battery thermal states, can be handled at different rates than faster ones as load dynamics. In , a dual-scale DP performs two optimization problems based on an advanced traffic model. On the macro-scale, a global optimal profile is found for the whole trip. In real-time, the route is divided into nearly equal segments, for which the micro-scale DP solves a limited horizon optimization problem to find the optimal control parameters according to the objective profile. Artificial NN (ANN) are implemented in neural DP (NDP) to reinforce the algorithm making optimal decisions . However, the offline learning time of ANN is relatively long. The principle of limited horizon DP is further developed based on a generic definition of vehicle states in terms of power demand and speed dynamics of the vehicle [73,79]. The results achieved better fuel economy compared to adaptive RB methods and close to the global DP solution.
3.2.5. Extremum Seeking (ES)
Extremum seeking is a model-free real-time optimization method that differs from classical control paradigms in that stability is not exclusively addressed in its formulation . The method is based on stimulating unknown plants using periodic excitation inputs, then using the system output to probe the gradient and seek the minima/maxima at the zero-gradient locations . As shown in Figure 8, the method employs a perturbation sinusoidal signal to stimulate the nonlinear system then measure the according output. This output is filtered using a washout filter then manipulated with the same sinusoidal signal to estimate the static gradient of the plant . A final integrator is then applied to estimate a value such that a zero gradient i.e., local minimum of is achieved .
The application of ES in HEVs is comparatively studied using three different types of filters namely: first-order, high-pass, and band-pass filter to regulate a charging/discharging policy for the batteries. The experimental validation is conducted using a HiL and the results revealed near-optimal results compared to the global optimal profile found by DP. Moreover, the band-pass type outperformed the other two types with better ability to reduce load dynamics applied to the fuel cell and hence improve the durability of the energy storage system . In , the gradient probing step is improved to yield an adaptive static map. To this aim, two factors are used to modify the optimization surface of the static map, such that the optimal points achieve current required goals i.e., range extension, efficiency maximization, or maximum power delivery based on route conditions and next refueling stations. The result’s comparison to a basic RB strategy showed an improvement of energy efficiency by 1–2.1% depending of the weighting factors.
3.2.6. Robust Control (RC)
The principle of RC is applied to control systems with uncertain or unknown models, disturbance inputs, noisy or inaccurate measurements, and high-order nonlinear dynamics in order to maintain higher stability and robustness of the system. The method is based on better exploration of design parameters to achieve the desired output and mitigate the system’s sensitivity to the multiplicative effect of the aforementioned unknown inputs. In HEVs, , , and linear matrix inequalities (LMI) are typical methods to be applied in power managements of HEVs [53,84].
In power management of a parallel HEV using RC, the chemical energy (fuel in the tank), electric energy depletion in terms of and total power consumption defined in the state vector are used for the dynamic output-feedback controller . Defining the command input u as the electric power share, the fuel consumption minimization problem can then be interpreted as maintaining u as close as possible to the power demand. The obtained results have been inferior to both DP and ECMS approaches; however, better results could be obtained when the electric synergy is omitted in pure-diesel mode. The inherit disadvantages are the complexity of problem formulation, heavy online computations, and the inability to yield near-optimal solutions .
4. Towards Optimality in Real-time
Based on the introduced literature, it can be noticed that the main trend of recent power management systems is to acquire optimal solutions in real-time. To this aim, the basic methods have to be adapted to mitigate excessive computations or being trapped in non-optimal solutions. In this section, more focus is given to the subsidiary adaptation tools used to enable optimal power management in real-time.
4.1. Subsidiary Adaptation Tools
The main drawbacks of classical RB methods are their fixed formulation and mild flexibility to suit different driving conditions. On the other side, optimization-based methods are less applicable in real-time due to their augmented computational load. The subsidiary adaptation tools are integrated into both methods to address these drawbacks. The analysis of optimal-based real-time methods gives the insight that these tools can be divided into five main categories as illustrated in Table 1.
Rules optimization is applied to RB methods (deterministic and fuzzy) to increase the methods’ robustness against variation of driving conditions. This can be done by searching for optimal values of the control parameters (quantitatively) or defining the optimal structure of the control vector (qualitatively) i.e., optimal set of control parameters to achieve balanced performance at different driving conditions. Multi-rate computing enables the optimization problem to be reduced into two subproblems, whereto a suitable processing rate can be assigned. This rate can be fixed for predefined cases (slow and fast) or adaptive to the length of lookahead window to find instantaneous (short-term) optimal solutions or strategic (long-term) ones.
Pattern recognition is a well-known tool, used to apply certain optimized control modules based on situation identification. Recognized patterns can be driver style (ex. calm, aggressive), road type (urban, highway), or specific routes. Pattern recognition algorithms are formulated using fuzzy logic rules, NN, or more sophisticated machine learning approaches. In addition, prediction of upcoming driving conditions is used to solve a limited-horizon optimization problem. Often, the Markov model is applied to foresee the change in next driving conditions based on statistical data analysis. In addition, observers/Kalman filters are used to estimate the behavior so that the power split strategy can be optimized accordingly.
Intelligent traffic systems add more knowledge to the power management problem based on vehicular communication techniques. They are also referred to as Vehicle-to-everything (V2X) communication; under which, a Vehicle-to-Vehicle (V2V), Vehicle-to-Grid (V2G), Vehicle-to-Interface (V2I), and more can be found. Such intelligent systems offer more information about nearest refueling options, congested routes, traffic lights, and shortest path to the destination. This information enables better planning of power management and battery’s charge depletion/sustenance policies.
4.2. Integration to Power Management Methods
To develop optimal real-time power management methods, two main requirements have to be fulfilled: reduction of computational load to suit vehicular control platforms and the ability to search and find near optimal solution. To this aim, the above-explained adaptation tools are integrated into many power management methods. To deliver an overview from this perspective, different power management methods are sorted out in Figure 9 considering their computational load, solution optimality, and adaptation tools integrated into each method. The ability of each method to achieve near-optimal results is based on the comparative analysis within the concomitant literature. The computational load is expressed in terms of the associated mathematical operations of each method.
For example, in Region-I in Figure 9, classic conditional reasoning can be improved by defining nested case-based modules to apply related optimal control parameters. These cases are correlated to specific load levels, driving patterns, or frequency analysis of power demand [13,15,18]. Moreover, a simple nearest-optimal point selection can be defined within the deterministic rules using look-up tables [19,20]. The same principle applies to fuzzy-based reasoning where adaptive and predictive fuzzy methods can achieve better fuel saving results i.e., overall cost function reduction [22,25,27]. Nevertheless, adapted RB methods in Region-I proved better performance in comparison to the conventional on/off method; however, there is still a gap to the global optimal solution.
Methods in Region-II are based on limited horizon optimization to minimize the instantaneous equivalent cost and hence yield near optimal solutions in real-time. Moreover, pattern/route recognition is also applied to update cost equivalent factors of PMP and ECMS [59,65]. Adaptation of the computing rate is widely applied to MPC  and adaptive/stochastic DP [34,73]. More focus on some methods of Region-II is in the sequel. In Region-III, global cost minimum is searched by a systematic step-by-step backward calculation in DDP , by evolutionary algorithms [36,39,46], or by linear optimization . These methods are used as benchmark for evaluation and analysis of other methods.
4.3. Insight Into Optimal Real-Time Methods
With more focus on real-time power management methods, the role of subsidiary tools is pointed out in this section. As illustrated in Table 2, offline rules optimization has been applied in literature to RB, ECMS, and PMP methods. Rules optimization can be applied for two conceptual purposes: find optimal fixed formulation of the rules that mitigates the control sensitivity to driving conditions change (quantitatively or qualitatively) [86,87,88] or to find optimal control parameters related to every driving condition separately [25,44]. In ECMS and PMP, the equivalent factors are crucial control parameters to be optimized offline as a balance-fixed or case-based values [54,89].
Pattern recognition is an efficient tool that is applied to most of the real-time power management methods. It offers the advantage of achieving better results at much lower computational effort. An important aspect of pattern recognition application in HEVs is the determination of recognized parameters (speed, acceleration, dynamics, etc.) and their discrete values for recognition. Briefly, the set of parameters to be considered for pattern recognition determines the effort of offline optimization (number of patterns) and the accuracy of online recognition . Machine learning-based techniques are the state-of-the-art tools that enable better online recognition when a large number of recognized parameters are considered .
Once the system behavior can be characterized based on statistical analysis or classified using machine learning, a predictive model can be developed for driving conditions prediction. Stochastic or Markov models are typical examples to deliver a prediction of the upcoming driving condition, wherein low-probability predictions have to be penalized in the cost function [92,93]. System state estimation based on mathematical models can be performed by observers and Kalman filters. They are mostly used to estimates next changes due to its substantial impact on power handling strategy [64,94].
Application of multi-rate computing tools has been found limited to DP and MPC methods. It performs two parallel optimization problems: long- and short-term ones. For the long term optimization problem, slow dynamical parameters are preferred to be considered. The strategic optimal path is then applied as a target to the faster-rate problem to solve a limited-horizon optimization problem that fulfills the global optimal path . However, another concept is to adapt the sampling time of MPC according to the prediction horizon i.e., small sampling time for short-time prediction and inversely. This decoupling concept offers better control of dynamical parameters and longer horizon prediction .
Although ITS have been state-of-the-market for a few years, limited contributions considered it into the real-time power management algorithms. The information offered by different V2X communications enables the power management system to determine short- and long-term power splitting strategies yielding better fuel saving results .
4.4. Evaluation and Discussion
Based on the presented review on state-of-the-art real-time power management methods and the analysis of associated challenges, it can be observed that near optimal solutions can be achieved in real-time by two main comprehensive principles: finding optimal case-based solutions or performing limited-horizon optimization. The first is based on accurate case recognition and the latter is based on accurate driving conditions prediction and simplification of the short-term optimization problem. In this context, the integration of specific subsidiary tools is getting more and more important providing the required information in real-time.
Pattern recognition methods are the theme of modern real-time power management algorithms. They offer an essential knowledge about current operating case using a set of recognized parameters. However, no crisp discussion about the effectiveness of considering certain parameters namely to ensure better pattern recognition is reported in literature. A thorough analysis of the parameters’ impact (mean/current speed, acceleration, dynamics, number of stops, …, etc.) on case recognition (drive style, road type, …, etc.) can contribute to defining near optimal case-based solutions in real-time.
Driving conditions prediction based on machine learning is an advantageous tool due to its capability to consider a large number of parameters, evaluate their impact on the learning process, and enhance the prediction accuracy. They require relatively long offline learning time; however, the online integration to power management algorithm offers the necessary priori knowledge about next driving conditions. Moreover, simplifying the optimal control problem by considering multi-rate sub-problems is a time-efficient tool that proved better results when applied to DP and MPC.
Finally, V2X communication systems are promising tools that, so far, are not sufficiently integrated into real-time power management systems. The offered knowledge by V2X systems, if integrated to pattern recognition or machine learning tools, can enhance the accuracy of current case recognition and better long-term planning of the power management. In addition, this knowledge is transferable to other inter-connected vehicles, grids, or even a database and hence reducing the computational effort.
5. Summary and Conclusions
This contribution presents, for the first time, a special focus on real-time optimal power management methods, revealing the recent innovative trends in this field. To understand the challenges in developing such methods, a comprehensive review on basic power management methods is introduced. The explanation of each method revealed its merits, demerits, and potential improvement aspects. Rule-based methods are easier to be implemented in real-time vehicular control system; however, they are less capable of finding optimal power handling solutions. Optimization-based methods perform more mathematical operations to search the global optimal solution and hence are less applicable in real-time. Adaptation of these basic methods to develop real-time optimal ones is acquiring increasing attention in the recent literature.
The thorough analysis of these optimal real-time methods revealed a significant role of subsidiary tools, to adapt the basic power management methods to real-time application. These tools are classified into five main categories: rules optimization, multi-computing rates, pattern recognition, prediction/estimation, and intelligent transportation systems (ITS). These tools offer better situation identification, limited horizon prediction of driving conditions, and more knowledge about traffic, next refueling options and alternative routes.
The integration of the subsidiary tools to different basic power management methods is discussed in detail to explain how these tools contribute to computational load reduction and add more functionality to the basic methods in real-time application. This discussion points out the well-received approaches as well as the insufficiently investigated fields. This work aims to provide researchers and scholars with the necessary knowledge about power management methods in HEVs, to shed light on the state-of-art approaches and solution, and to help identify the most promising points for future development.
Both authors contributed equally to the paper, whereby the corresponding author was responsible for the writing, figures and literature research and the second author for organizing, reviewing, and proof reading of the entire contribution.
Conflicts of Interest
The authors declare no conflict of interest.
- Onori, S.; Serrao, L.; Rizzoni, G. Hybrid Electric Vehicles; Springer: London, UK, 2016. [Google Scholar]
- Silvas, E.; Hofman, T.; Murgovski, N.; Etman, L.F.P.; Steinbuch, M. Review of Optimization Strategies for System-Level Design in Hybrid Electric Vehicles. IEEE Trans. Veh. Technol. 2017, 66, 57–70. [Google Scholar] [CrossRef]
- Amjad, S.; Neelakrishnan, S.; Rudramoorthy, R. Review of design considerations and technological challenges for successful development and deployment of plug-in hybrid electric vehicles. Renew. Sustain. Energy Rev. 2010, 14, 1104–1110. [Google Scholar] [CrossRef]
- Emadi, A.; Rajashekara, K.; Williamson, S.S.; Lukic, S.M. Topological overview of hybrid electric and fuel cell vehicular power system architectures and configurations. IEEE Trans. Veh. Technol. 2005, 54, 763–770. [Google Scholar] [CrossRef]
- Malikopoulos, A.A. Impact of Component Sizing in Plug-In Hybrid Electric Vehicles for Energy Resource and Greenhouse Emissions Reduction. J. Energy Resour. Technol. 2013, 135, 041201. [Google Scholar] [CrossRef]
- Tie, S.F.; Tan, C.W. A review of energy sources and energy management system in electric vehicles. Renew. Sustain. Energy Rev. 2013, 20, 82–102. [Google Scholar] [CrossRef]
- Salmasi, F.R. Control Strategies for Hybrid Electric Vehicles: Evolution, Classification, Comparison, and Future Trends. IEEE Trans. Veh. Technol. 2007, 56, 2393–2404. [Google Scholar] [CrossRef]
- Wirasingha, S.G.; Emadi, A. Classification and Review of Control Strategies for Plug-In Hybrid Electric Vehicles. IEEE Trans. Veh. Technol. 2011, 60, 111–122. [Google Scholar] [CrossRef]
- Sabri, M.; Danapalasingam, K.; Rahmat, M. A review on hybrid electric vehicles architecture and energy management strategies. Renew. Sustain. Energy Rev. 2016, 53, 1433–1442. [Google Scholar] [CrossRef]
- Hofman, T.; Steinbuch, M.; Druten, R.V.; Serrarens, A. Rule-based energy management strategies for hybrid vehicles. Int. J. Electr. Hybrid Veh. 2007, 1, 71. [Google Scholar] [CrossRef]
- Zhang, P.; Yan, F.; Du, C. A comprehensive analysis of energy management strategies for hybrid electric vehicles based on bibliometrics. Renew. Sustain. Energy Rev. 2015, 48, 88–104. [Google Scholar] [CrossRef]
- Ehsani, M.; Gao, Y.; Emadi, A. Modern Electric, Hybrid Electric, and Fuel Cell Vehicles: Fundamentals, Theory, and Design; CRC Press: Boca Raton, FL, USA, 2009. [Google Scholar]
- Ali, A.; Sharaf, A.; Kamel, H.; Hegazy, S. A Theo-Practical Methodology for Series Hybrid Vehicles Evaluation and Development; SAE Technical Paper; SAE International: Warrendale, PA, USA, 2017. [Google Scholar]
- Cheng, Y.; Chen, K.; Chan, C.; Bouscayrol, A.; Cui, S. Global modeling and control strategy simulation for a hybrid electric vehicle using electrical variable transmission. In Proceedings of the 2008 IEEE Vehicle Power and Propulsion Conference, Harbin, China, 3–5 September 2008. [Google Scholar]
- Johnson, V.H.; Wipke, K.B.; Rausen, D.J. HEV Control Strategy for Real-Time Optimization of Fuel Economy and Emissions; SAE Technical Paper Series; SAE International: Warrendale, PA, USA, 2000. [Google Scholar]
- Wipke, K.B.; Cuddy, M.R.; Burch, S.D. ADVISOR 2.1: A user-friendly advanced powertrain simulation using a combined backward/forward approach. IEEE Trans. Veh. Technol. 1999, 48, 1751–1761. [Google Scholar] [CrossRef]
- Tani, A.; Camara, M.B.; Dakyo, B. Energy Management Based on Frequency Approach for Hybrid Electric Vehicle Applications: Fuel-Cell/Lithium-Battery and Ultracapacitors. IEEE Trans. Veh. Technol. 2012, 61, 3375–3386. [Google Scholar] [CrossRef]
- Kim, Y.; Salvi, A.; Siegel, J.B.; Filipi, Z.S.; Stefanopoulou, A.G.; Ersal, T. Hardware-in-the-loop validation of a power management strategy for hybrid powertrains. Control Eng. Pract. 2014, 29, 277–286. [Google Scholar] [CrossRef]
- Park, J.; Park, Y.; Park, J. Optimal power distribution strategy for series—Parallel hybrid electric vehicles. Proc. Inst. Mech. Eng. D 2008, 222, 989–1000. [Google Scholar] [CrossRef]
- Ahn, K.; Papalambros, P.Y. Engine optimal operation lines for power-split hybrid electric vehicles. Proc. Inst. Mech. Eng. D 2009, 223, 1149–1162. [Google Scholar] [CrossRef]
- Lee, H.D.; Sul, S.K. Fuzzy-logic-based torque control strategy for parallel-type hybrid electric vehicle. IEEE Trans. Ind. Electron. 1998, 45, 625–632. [Google Scholar] [CrossRef]
- Montazeri-Gh, M.; Mahmoodi-k, M. Development a new power management strategy for power split hybrid electric vehicles. Transp. Res. D Transp. Environ. 2015, 37, 79–96. [Google Scholar] [CrossRef]
- Langari, R.; Won, J.S. Intelligent Energy Management Agent for a Parallel Hybrid Vehicle—Part I: System Architecture and Design of the Driving Situation Identification Process. IEEE Trans. Veh. Technol. 2005, 54, 925–934. [Google Scholar] [CrossRef]
- Won, J.S.; Langari, R. Intelligent Energy Management Agent for a Parallel Hybrid Vehicle—Part II: Torque Distribution, Charge Sustenance Strategies, and Performance Results. IEEE Trans. Veh. Technol. 2005, 54, 935–953. [Google Scholar] [CrossRef]
- Zhang, S.; Xiong, R. Adaptive energy management of a plug-in hybrid electric vehicle based on driving pattern recognition and dynamic programming. Appl. Energy 2015, 155, 68–78. [Google Scholar] [CrossRef]
- Hajimiri, M.H.; Salmasi, F.R. A Fuzzy Energy Management Strategy for Series Hybrid Electric Vehicle with Predictive Control and Durability Extension of the Battery. In Proceedings of the 2006 IEEE Conference on Electric and Hybrid Vehicles, Pune, India, 18–20 December 2006; pp. 1–5. [Google Scholar]
- Montazeri-Gh, M.; Mahmoodi-K, M. Optimized predictive energy management of plug-in hybrid electric vehicle based on traffic condition. J. Clean. Prod. 2016, 139, 935–948. [Google Scholar] [CrossRef]
- Zhu, Y.; Chen, Y.; Tian, G.; Wu, H.; Chen, Q. A four-step method to design an energy management strategy for hybrid vehicles. In Proceedings of the 2004 IEEE American Control Conference, Boston, MA, USA, 30 June–2 July 2004; Volume 1, pp. 156–161. [Google Scholar]
- Oh, K.; Min, J.; Choi, D.; Kim, H. Optimization of control strategy for a single-shaft parallel hybrid electric vehicle. Proc. Inst. Mech. Eng. D J. Automob. Eng. 2007, 221, 555–565. [Google Scholar] [CrossRef]
- Tate, E.D.; Boyd, S.P. Finding Ultimate Limits of Performance for Hybrid Electric Vehicles; SAE Technical Paper Series; SAE International: Warrendale, PA, USA, 2000. [Google Scholar]
- Wu, G.; Boriboonsomsin, K.; Barth, M.J. Development and Evaluation of an Intelligent Energy-Management Strategy for Plug-in Hybrid Electric Vehicles. IEEE Trans. Intell. Transp. Syst. 2014, 15, 1091–1100. [Google Scholar] [CrossRef]
- Bellman, R. Dynamic programming and Lagrange multipliers. Proc. Natl. Acad. Sci. USA 1956, 42, 767–769. [Google Scholar] [CrossRef] [PubMed]
- Wegmann, R.; Döge, V.; Becker, J.; Sauer, D.U. Optimized operation of hybrid battery systems for electric vehicles using deterministic and stochastic dynamic programming. J. Energy Storage 2017, 14, 22–38. [Google Scholar] [CrossRef]
- Romaus, C.; Gathmann, K.; Bocker, J. Optimal energy management for a hybrid energy storage system for electric vehicles based on Stochastic Dynamic Programming. In Proceedings of the 2010 IEEE Vehicle Power and Propulsion Conference, Lille, France, 1–3 September 2010. [Google Scholar]
- Deb, K.; Pratap, A.; Agarwal, S.; Meyarivan, T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evolut. Comput. 2002, 6, 182–197. [Google Scholar] [CrossRef]
- Madanipour, V.; Montazeri-Gh, M.; Mahmoodi-k, M. Optimization of the component sizing for a plug-in hybrid electric vehicle using a genetic algorithm. Proc. Inst. Mech. Eng. D J. Automob. Eng. 2015, 230, 692–708. [Google Scholar] [CrossRef]
- Bertram, C.; Buecherl, D.; Thanheiser, A.; Herzog, H.G. Multi-objective optimization of a parallel hybrid electric drive train. In Proceedings of the 2011 IEEE Vehicle Power and Propulsion Conference, Chicago, IL, USA, 6–9 September 2011; pp. 1–5. [Google Scholar]
- Jozefowiez, N.; Semet, F.; Talbi, E.G. Enhancements of NSGA II and Its Application to the Vehicle Routing Problem with Route Balancing. In Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2006; pp. 131–142. [Google Scholar]
- Li, Y.; Lu, X.; Kar, N.C. Rule-Based Control Strategy With Novel Parameters Optimization Using NSGA-II for Power-Split PHEV Operation Cost Minimization. IEEE Trans. Veh. Technol. 2014, 63, 3051–3061. [Google Scholar] [CrossRef]
- Serrao, L.; Sciarretta, A.; Grondin, O.; Chasse, A.; Creff, Y.; Domenico, D.D.; Pognant-Gros, P.; Querel, C.; Thibault, L. Open Issues in Supervisory Control of Hybrid Electric Vehicles: A Unified Approach Using Optimal Control Methods. Oil Gas Sci. Technol. 2013, 68, 23–33. [Google Scholar] [CrossRef]
- Paganelli, G.; Guerra, T.; Delprat, S.; Guezennec, Y.; Rizzoni, G. Optimal control theory applied to hybrid fuel cell powered vehicle. IFAC Proc. Vol. 2002, 35, 253–258. [Google Scholar] [CrossRef]
- Delprat, S.; Hofman, T. Hybrid vehicle optimal control: Linear interpolation and singular control. In Proceedings of the 2014 IEEE Vehicle Power and Propulsion Conference (VPPC), Coimbra, Portugal, 27–30 October 2014; pp. 1–6. [Google Scholar]
- Poli, R.; Kennedy, J.; Blackwell, T. Particle swarm optimization. Swarm Intell. 2007, 1, 33–57. [Google Scholar] [CrossRef]
- Lei, Z.; Cheng, D.; Liu, Y.; Qin, D.; Zhang, Y.; Xie, Q. A Dynamic Control Strategy for Hybrid Electric Vehicles Based on Parameter Optimization for Multiple Driving Cycles and Driving Pattern Recognition. Energies 2017, 10, 54. [Google Scholar] [CrossRef]
- Chen, Z.; Xiong, R.; Cao, J. Particle swarm optimization-based optimal power management of plug-in hybrid electric vehicles considering uncertain driving conditions. Energy 2016, 96, 197–208. [Google Scholar] [CrossRef]
- Shen, P.; Zhao, Z.; Zhan, X.; Li, J. Particle swarm optimization of driving torque demand decision based on fuel economy for plug-in hybrid electric vehicle. Energy 2017, 123, 89–107. [Google Scholar] [CrossRef]
- Dosthosseini, R.; Kouzani, A.; Sheikholeslam, F. Direct method for optimal power management in hybrid electric vehicles. Int. J. Automot. Technol. 2011, 12, 943–950. [Google Scholar] [CrossRef]
- Pérez, L.; García, G. State constrained optimal control applied to supervisory control in HEVs. Oil Gas Sci. Technol. 2010, 65, 191–201. [Google Scholar] [CrossRef]
- Dextreit, C.; Kolmanovsky, I.V. Game theory controller for hybrid electric vehicles. IEEE Trans. Control Syst. Technol. 2014, 22, 652–663. [Google Scholar] [CrossRef]
- Yin, H.; Zhao, C.; Li, M.; Ma, C.; Chow, M.Y. A Game Theory Approach to Energy Management of An Engine–Generator/Battery/Ultracapacitor Hybrid Energy System. IEEE Trans. Ind. Electron. 2016, 63, 4266–4277. [Google Scholar] [CrossRef]
- Younis, A.; Zhou, L.; Dong, Z. Application of the new SEUMRE global optimisation tool in high efficiency EV/PHEV/EREV electric mode operations. Int. J. Electr. Hybrid Veh. 2011, 3, 176–190. [Google Scholar] [CrossRef]
- Paganelli, G.; Delprat, S.; Guerra, T.; Rimaux, J.; Santin, J. Equivalent consumption minimization strategy for parallel hybrid powertrains. In Proceedings of the VTC Spring: 2002 IEEE 55th Vehicular Technology Vehicular Technology Conference, Birmingham, Alabama, 6–9 May 2002. [Google Scholar]
- Pisu, P.; Rizzoni, G. A Comparative Study of Supervisory Control Strategies for Hybrid Electric Vehicles. IEEE Trans. Control Syst. Technol. 2007, 15, 506–518. [Google Scholar] [CrossRef]
- Park, J.; Park, J.H. Development of equivalent fuel consumption minimization strategy for hybrid electric vehicles. Int. J. Automot. Technol. 2012, 13, 835–843. [Google Scholar] [CrossRef]
- Pei, D.; Leamy, M.J. Dynamic programming-informed equivalent cost minimization control strategies for hybrid-electric vehicles. J. Dyn. Syst. Meas. Control 2013, 135, 051013. [Google Scholar] [CrossRef]
- Sciarretta, A.; Back, M.; Guzzella, L. Optimal control of parallel hybrid electric vehicles. IEEE Trans. Control Syst. Technol. 2004, 12, 352–363. [Google Scholar] [CrossRef]
- Musardo, C.; Rizzoni, G.; Guezennec, Y.; Staccia, B. A-ECMS: An adaptive algorithm for hybrid electric vehicle energy management. Eur. J. Control 2005, 11, 509–524. [Google Scholar] [CrossRef]
- Zhang, C.; Vahid, A. Real-time optimal control of plug-in hybrid vehicles with trip preview. In Proceedings of the IEEE American Control Conference (ACC), Baltimore, MD, USA, 30 June–2 July 2010; pp. 6917–6922. [Google Scholar]
- Sun, C.; Sun, F.; He, H. Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehicles. Appl. Energy 2017, 185, 1644–1653. [Google Scholar] [CrossRef]
- Zhang, C.; Vahidi, A. Route preview in energy management of plug-in hybrid vehicles. IEEE Trans. Control Syst. Technol. 2012, 20, 546–553. [Google Scholar] [CrossRef]
- Optimal Control with Engineering Applications; Springer: Berlin/Heidelberg, Germany, 2007.
- Rousseau, G.; Sinoquet, D.; Rouchon, P. Constrained Optimization of Energy Management for a Mild-Hybrid Vehicle. Oil Gas Sci. Technol. 2007, 62, 623–634. [Google Scholar] [CrossRef]
- Kessels, J.; Koot, M.; van den Bosch, P.; Kok, D. Online Energy Management for Hybrid Electric Vehicles. IEEE Trans. Veh. Technol. 2008, 57, 3428–3440. [Google Scholar] [CrossRef]
- Juanjuan, S.; Xinhao, Y.; Ze, L.; Fudong, W. Smooth control for hybrid electric vehicle based on the Pontryagin’s Minimum Principle and the observer. In Proceedings of the 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC), Hefei, China, 19–21 May 2017; pp. 741–744. [Google Scholar]
- Hou, C.; Ouyang, M.; Xu, L.; Wang, H. Approximate Pontryagin’s minimum principle applied to the energy management of plug-in hybrid electric vehicles. Appl. Energy 2014, 115, 174–189. [Google Scholar] [CrossRef]
- García, C.E.; Prett, D.M.; Morari, M. Model predictive control: Theory and practice—A survey. Automatica 1989, 25, 335–348. [Google Scholar] [CrossRef]
- Allgöwer, F.; Zheng, A. (Eds.) Nonlinear Model Predictive Control; Birkhäuser: Basel, Switzerland, 2000. [Google Scholar]
- Murphey, Y.L.; Park, J.; Chen, Z.; Kuang, M.L.; Masrur, M.A.; Phillips, A.M. Intelligent hybrid vehicle power control—Part I: Machine learning of optimal vehicle power. IEEE Trans. Veh. Technol. 2012, 61, 3519–3530. [Google Scholar] [CrossRef]
- Huang, Y.; Khajepour, A.; Wang, H. A predictive power management controller for service vehicle anti-idling systems without a priori information. Appl. Energy 2016, 182, 548–557. [Google Scholar] [CrossRef]
- Li, L.; You, S.; Yang, C.; Yan, B.; Song, J.; Chen, Z. Driving-behavior-aware stochastic model predictive control for plug-in hybrid electric buses. Appl. Energy 2016, 162, 868–879. [Google Scholar] [CrossRef]
- Trovao, J.P.; Dubois, M.R.; Gomozov, O.; Kestelyn, X.; Bouscayrol, A. A Model Predictive Control with Non-Uniform Sampling Times for a Hybrid Energy Storage System in Electric Vehicle Application. In Proceedings of the 2015 IEEE Vehicle Power and Propulsion Conference (VPPC), Montreal, QC, Canada, 19–22 October 2015; pp. 1–6. [Google Scholar]
- Gomozov, O.; Trovao, J.P.F.; Kestelyn, X.; Dubois, M.R. Adaptive Energy Management System Based on a Real-Time Model Predictive Control With Nonuniform Sampling Time for Multiple Energy Storage Electric Vehicle. IEEE Trans. Veh. Technol. 2017, 66, 5520–5530. [Google Scholar] [CrossRef]
- Ali, A.M.; Söffker, D. Realtime Application of Progressive Optimal Search and Adaptive Dynamic Programming in Multi-Source HEVs. In Proceedings of the ASME DSCC 2017—Dynamic Systems and Control Conference, Tysons, Virginia, 11–13 October 2017; Volume 2. [Google Scholar]
- LUUS, R. Optimal control by dynamic programming using systematic reduction in grid size. Int. J. Control 1990, 51, 995–1013. [Google Scholar] [CrossRef]
- Wang, L.; Zhang, Y.; Yin, C.; Zhang, H.; Wang, C. Hardware-in-the-loop simulation for the design and verification of the control system of a series–parallel hybrid electric city-bus. Simul. Model. Pract. Theory 2012, 25, 148–162. [Google Scholar] [CrossRef]
- Johri, R.; Liang, W.; McGee, R. Hybrid electric vehicle energy management with battery thermal considerations using multi-rate dynamic programming. In Proceedings of the ASME 2013 Dynamic Systems and Control Conference, American Society of Mechanical Engineers, Palo Alto, CA, USA, 21–23 October 2013; p. V001T05A003. [Google Scholar]
- Gong, Q.; Li, Y.; Peng, Z.R. Trip Based Optimal Power Management of Plug-in Hybrid Electric Vehicle with Advanced Traffic Modeling. SAE Int. J. Engines 2008, 1, 861–872. [Google Scholar] [CrossRef]
- Boyali, A.; Güvenç, L. Real-time controller design for a parallel hybrid electric vehicle using neuro-dynamic programming method. In Proceedings of the 2010 IEEE International Conference on Systems Man and Cybernetics (SMC), Istanbul, Turkey, 10–13 October 2010; pp. 4318–4324. [Google Scholar]
- Ali, A.M.; Söffker, D. Realtime Power Management of a Multi-Source HEV Using Adaptive Dynamic Programing and Probabilistic Drive State Model. In Proceedings of the ASME 2017 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE 2017), Cleveland, OH, USA, 6–9 August 2017; Volume 3. [Google Scholar]
- Krstić, M.; Wang, H.H. Stability of extremum seeking feedback for general nonlinear dynamic systems. Automatica 2000, 36, 595–601. [Google Scholar] [CrossRef]
- Liu, S.J.; Krstic, M. Stochastic Averaging and Stochastic Extremum Seeking; Springer: London, UK, 2012. [Google Scholar]
- Zhou, D.; Ravey, A.; Al-Durra, A.; Gao, F. A comparative study of extremum seeking methods applied to online energy management strategy of fuel cell hybrid electric vehicles. Energy Convers. Manag. 2017, 151, 778–790. [Google Scholar] [CrossRef]
- Bizon, N. Energy optimization of fuel cell system by using global extremum seeking algorithm. Appl. Energy 2017, 206, 458–474. [Google Scholar] [CrossRef]
- Pisu, P.; Silani, E.; Rizzoni, G.; Savaresi, S. A LMI-based supervisory robust control for hybrid vehicles. In Proceedings of the 2003 IEEE American Control Conference, Denver, CO, USA, 4–6 June 2003. [Google Scholar]
- Delprat, S.; Guerra, T.M.; Paganelli, G.; Lauber, J.; Delhom, M. Control strategy optimization for an hybrid parallel powertrain. In Proceedings of the IEEE American Control Conference, Arlington, VA, USA, 25–27 June 2001; Volume 2, pp. 1315–1320. [Google Scholar]
- Peng, J.; He, H.; Xiong, R. Rule based energy management strategy for a series–parallel plug-in hybrid electric bus optimized by dynamic programming. Appl. Energy 2017, 185, 1633–1643. [Google Scholar] [CrossRef]
- Wei, Z.; Xu, J.; Halim, D. HEV Energy Management Fuzzy Logic Control Based on Dynamic Programming. In Proceedings of the 2015 IEEE Vehicle Power and Propulsion Conference (VPPC), Montreal, QC, Canada, 19–22 October 2015; pp. 1–5. [Google Scholar]
- Lin, C.C.; Peng, H.; Jeon, S.; Lee, J.M. Control of a hybrid electric truck based on driving pattern recognition. In Proceedings of the 2002 Advanced Vehicle Control Conference, Hiroshima, Japan, 9–13 September 2002. [Google Scholar]
- Rezaei, A.; Burl, J.B.; Zhou, B. Estimation of the ECMS Equivalent Factor Bounds for Hybrid Electric Vehicles. IEEE Trans. Control Syst. Technol. 2017, PP, 1–8. [Google Scholar] [CrossRef]
- Ericsson, E. Independent driving pattern factors and their influence on fuel-use and exhaust emission factors. Transp. Res. D Transp. Environ. 2001, 6, 325–345. [Google Scholar] [CrossRef]
- Venditti, M. Analysis of the Performance of Different Machine Learning Techniques for the Definition of Rule-based Control Strategies in a Parallel HEV. Energy Procedia 2016, 101, 685–692. [Google Scholar] [CrossRef]
- Lin, X.; Wang, Y.; Bogdan, P.; Chang, N.; Pedram, M. Optimizing fuel economy of hybrid electric vehicles using a Markov decision process model. In Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Korea, 28 June–1 July 2015; pp. 718–723. [Google Scholar]
- Payri, F.; Guardiola, C.; Pla, B.; Blanco-Rodriguez, D. On a stochastic approach of the ecms method for energy management in hybrid electric vehicles. IFAC Proc. Vol. 2012, 45, 341–348. [Google Scholar] [CrossRef]
- Bhangu, B.S.; Bentley, P.; Stone, D.A.; Bingham, C.M. Nonlinear observers for predicting state-of-charge and state-of-health of lead-acid batteries for hybrid-electric vehicles. IEEE Trans. Veh. Technol. 2005, 54, 783–794. [Google Scholar] [CrossRef]
- Marano, V.; Rizzoni, G.; Tulpule, P.; Gong, Q.; Khayyam, H. Intelligent Energy Management for Plug-in Hybrid Electric Vehicles: The Role of ITS Infrastructure in Vehicle Electrification. Oil Gas Sci. Technol. 2012, 67, 575–587. [Google Scholar] [CrossRef]
- Ravey, A.; Blunier, B.; Miraoui, A. Control Strategies for Fuel-Cell-Based Hybrid Electric Vehicles: from Offline to Online and Experimental Results. IEEE Trans. Veh. Technol. 2012, 61, 2452–2457. [Google Scholar] [CrossRef]
- Shen, D.; Lu, L.; Müller, S. Utilization of predictive information to optimize driving and powertrain control of series hybrid vehicles. Automot. Engine Technol. 2017. [Google Scholar] [CrossRef]
- Rajagopalan, A.; Washington, G. Intelligent Control of Hybrid Electric Vehicles Using GPS Information; SAE Technical Paper Series; SAE International: Warrendale, PA, USA, 2002. [Google Scholar]
- Montazeri-Gh, M.; Ahmadi, A.; Asadi, M. Driving condition recognition for genetic-fuzzy HEV Control. In Proceedings of the 2008 3rd International Workshop on Genetic and Evolving Systems, Witten-Bommerholz, Germany, 4–7 March 2008; pp. 65–70. [Google Scholar]
- Yi, T.; Xin, Z.; Liang, Z.; Xinn, Z. Intelligent Energy Management Based on Driving Cycle Identification Using Fuzzy Neural Network. In Proceedings of the 2009 Second International Symposium on Computational Intelligence and Design, Changsha, China, 12–14 December 2009; Volume 2, pp. 501–504. [Google Scholar]
- Rajagopalan, A.; Washington, G.; Rizzoni, G.; Guezennec, Y. Development of Fuzzy Logic and Neural Network Control and Advanced Emissions Modeling for Parallel Hybrid Vehicles; Technical Report; National Renewable Energy Lab.: Golden, CO, USA, 2003.
- Onori, S.; Serrao, L. On Adaptive-ECMS strategies for hybrid electric vehicles. In Proceedings of the International Scientific Conference on Hybrid and Electric Vehicles, Rueil-Malmaison, France, 6–7 December 2011; pp. 6–7. [Google Scholar]
- Sun, C.; He, H.; Sun, F. The Role of Velocity Forecasting in Adaptive-ECMS for Hybrid Electric Vehicles. Energy Procedia 2015, 75, 1907–1912. [Google Scholar] [CrossRef]
- Jeong, J.; Lee, D.; Kim, N.; Park, Y.i.; Cha, S.W. Fuel economy analysis of a parallel hybrid bus using the optimal control theory. In Proceedings of the IEEE Vehicle Power and Propulsion Conference (VPPC), Chicago, IL, USA, 6–9 September 2011; pp. 1–5. [Google Scholar]
- Karbowski, D.; Kim, N.; Rousseau, A. Route-Based Online Energy Management of a PHEV and Sensitivity to Trip Prediction. In Proceedings of the 2014 IEEE Vehicle Power and Propulsion Conference (VPPC), Coimbra, Portugal, 27–30 October 2014; pp. 1–6. [Google Scholar]
- Onori, S.; Tribioli, L. Adaptive Pontryagin’s Minimum Principle supervisory controller design for the plug-in hybrid GM Chevrolet Volt. Appl. Energy 2015, 147, 224–234. [Google Scholar] [CrossRef]
- Johannesson, L.; Asbogard, M.; Egardt, B. Assessing the Potential of Predictive Control for Hybrid Vehicle Powertrains Using Stochastic Dynamic Programming. IEEE Trans. Intell. Transp. Syst. 2007, 8, 71–83. [Google Scholar] [CrossRef]
- Cairano, S.D.; Bernardini, D.; Bemporad, A.; Kolmanovsky, I.V. Stochastic MPC With Learning for Driver-Predictive Vehicle Control and its Application to HEV Energy Management. IEEE Trans. Control Syst. Technol. 2014, 22, 1018–1031. [Google Scholar] [CrossRef]
- Johannesson, L.; Pettersson, S.; Egardt, B. Predictive energy management of a 4QT series-parallel hybrid electric bus. Control Eng. Pract. 2009, 17, 1440–1453. [Google Scholar] [CrossRef]
- Chen, Z.; Masrur, M.A.; Murphey, Y.L. Intelligent vehicle power management using machine learning and fuzzy logic. In Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence), Hong Kong, China, 1–6 June 2008; pp. 2351–2358. [Google Scholar]
- Lv, Y.M.; Yuan, H.W.; Liu, Y.Y.; Wang, Q.S. Fuzzy Logic Based Energy Management Strategy of Battery-Ultracapacitor Composite Power Supply for HEV. In Proceedings of the 2010 First International Conference on Pervasive Computing, Signal Processing and Applications, Harbin, China, 17–19 September 2010; pp. 1209–1214. [Google Scholar]
- Xu, L.; Wang, J.; Chen, Q. Kalman filtering state of charge estimation for battery management system based on a stochastic fuzzy neural network battery model. Energy Convers. Manag. 2012, 53, 33–39. [Google Scholar] [CrossRef]
- Hu, Y.; Yang, L.; Yan, B.; Yan, T.; Ma, P. An Online Rolling Optimal Control Strategy for Commuter Hybrid Electric Vehicles Based on Driving Condition Learning and Prediction. IEEE Trans. Veh. Technol. 2016, 65, 4312–4327. [Google Scholar] [CrossRef]
- Li, W.; Xu, G.; Wang, Z.; Xu, Y. Dynamic energy management for hybrid electric vehicle based on approximate dynamic programming. In Proceedings of the 2008 7th World Congress on Intelligent Control and Automation, Chongqing, China, 25–27 June 2008; pp. 7864–7869. [Google Scholar]
- Chen, Z.; Mi, C.C.; Xu, J.; Gong, X.; You, C. Energy Management for a Power-Split Plug-in Hybrid Electric Vehicle Based on Dynamic Programming and Neural Networks. IEEE Trans. Veh. Technol. 2014, 63, 1567–1580. [Google Scholar] [CrossRef]
- Zeng, X.; Wang, J. A Parallel Hybrid Electric Vehicle Energy Management Strategy Using Stochastic Model Predictive Control With Road Grade Preview. IEEE Trans. Control Syst. Technol. 2015, 23, 2416–2423. [Google Scholar] [CrossRef]
- Hu, X.; Sun, F.; Zou, Y. Estimation of State of Charge of a Lithium-Ion Battery Pack for Electric Vehicles Using an Adaptive Luenberger Observer. Energies 2010, 3, 1586–1603. [Google Scholar] [CrossRef]
- Li, S.; Bao, K.; Fu, X.; Zheng, H. Energy Management and Control of Electric Vehicle Charging Stations. Electr. Power Compon. Syst. 2014, 42, 339–347. [Google Scholar] [CrossRef]
- Mohamed, A.; Salehi, V.; Ma, T.; Mohammed, O. Real-Time Energy Management Algorithm for Plug-In Hybrid Electric Vehicle Charging Parks Involving Sustainable Energy. IEEE Trans. Sustain. Energy 2014, 5, 577–586. [Google Scholar] [CrossRef]
- HomChaudhuri, B.; Lin, R.; Pisu, P. Hierarchical control strategies for energy management of connected hybrid electric vehicles in urban roads. Transp. Res. C Emerg. Technol. 2016, 62, 70–86. [Google Scholar] [CrossRef]
- Zhang, F.; Xi, J.; Langari, R. Real-Time Energy Management Strategy Based on Velocity Forecasts Using V2V and V2I Communications. IEEE Trans. Intell. Transp. Syst. 2017, 18, 416–430. [Google Scholar] [CrossRef]
- Du, Z.; Qiu, L.; Pisu, P. Hierarchical Energy Management Control of Connected Hybrid Electric Vehicles on Urban Roads with Efficiencies Feedback. In Proceedings of the ASME 2016 Dynamic Systems and Control Conference Minneapolis, Minneapolis, MN, USA, 12–14 October 2016; p. V001T16A002. [Google Scholar]
Figure 1. Design and operational objectives of hybrid electric vehicles.
Figure 2. Classification of power management strategies.
Figure 3. Engine on/off rules for power follower strategy (according to ).
Figure 4. Exemplification of adaptive RB principle routine.
Figure 5. Frequency-based decomposition of power demand into low, medium, and high-frequency components.
Figure 6. Illustration of multi-objective optimization steps using NSGA-II.
Figure 7. Working principle of MPC based on the “moving horizon” approach .
Figure 8. Basic ES scheme for a static map according to .
Figure 9. Comparative evaluation of different power management methods.
Table 1. Characteristic of implemented subsidiary tools in real-time optimization-based methods.
|Auxiliary Tools||Types||Conducted by||Integrated to||Achievement/Output|
|Rules optimization||- qualitative |
|Static optimization||Rule-based||Robustnes of RB methods|
|Multi-rate computing||- fixed rate |
- adaptive rate
|- case-based |
- parallel computing
|Opt-based||Computational time reduction|
|Pattern recognition||- driving patterns |
- route/road type
|- machine learning |
- fuzzy logic/NN
|Rule-based & opt-based||Case-based optimized solutions|
|Prediction/estimation||- driving conditions |
|- statistics/HMM |
|Opt-based||Priori knowledge of future drive conditions|
|Intelligent traffic systems (ITS)||- V2V |
|Communication technologies||Rule-based & opt-based||- current traffic conditions |
- next refuelling options
Table 2. Integration of subsidiary tools to real-time optimal power management methods.
|3||[44,88] [77,98]||[25,99,100] ||[57,102] || [105,106]|| [77,107]|| |
|4|| ||   ||||  || ||  |
* Numbering of subsidiary tools is acc. to Figure 9, Driving pattern recognition, Route/road type recognition; HMM, Machine learning, Statistical-based, Kalman filter, Luenberger observer, ARMA filter, NN.
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).