Abstract
This paper deals with an optimal control problem for a linear system of first-order hyperbolic equations with a function on the right-hand side determined from controlled bilinear ordinary differential equations. These ordinary differential equations are linear with respect to state functions with controlled coefficients. Such problems arise in the simulation of some processes of chemical technology and population dynamics. Normally, general optimal control methods are used for these problems because of bilinear ordinary differential equations. In this paper, the problem is reduced to an optimal control problem for a system of ordinary differential equations. The reduction is based on non-classic exact increment formulas for the cost-functional. This treatment allows to use a number of efficient optimal control methods for the problem. An example illustrates the approach.
Keywords:
hybrid systems; hyperbolic equations; non-classic increment formulas; reduction of optimal control problems MSC:
49K20
1. Introduction
This paper studies a special class of optimal control problems for linear systems of first-order hyperbolic equations. In these problems, the function on the right-hand side of the hyperbolic system is determined from controlled systems of ordinary differential equations (ODEs). Such problems arise in the simulation of some processes of chemical technology []. They also may be used for solving inverse problems in models of population dynamics [].
We consider a case of a linear hyperbolic system and a linear controlled ODE system with the coefficients of the phase variables depending on controls. Because of the latter circumstance, the Pontryagin maximum principle is not a sufficient optimality condition. On the other hand, an attempt to apply general optimization approaches [] leads to endless iterative processes. Moreover, at each iteration step, it is required in this case to repeatedly integrate a system of hyperbolic equations. There is the possibility of applying ideas of non-classic exact formulas for the increment formula for the cost-functional. The authors used this idea in [] for a special type of hyperbolic system with two orthogonal characteristics and controlled boundary conditions.
In this paper, two symmetric variants of the non-classic exact formulas for the increment of a linear cost-functional are suggested. The classical method of increments proposed by Rozonoer [] allows one to obtain in the considered problem the necessary optimality condition similar to the Pontryagin maximum principle. The proof essentially uses the local character of the increment formula. Namely, one estimates the residuals in terms of the value that characterizes the smallness of the measure of the domain of the needle variation of a control. Below, for two particular cases of the problem under consideration, we obtain non-standard, exact (without residuals) increment formulas. The use of these formulas allows to reduce the original problem to an optimal control problem for a system of ODE equations. Note that, under this approach, the hyperbolic system is integrated only two times: at the beginning of the process (after an initial admissible control has been selected) and at the end of a computational process. We present a simple example to illustrate the proposed approach.
2. Problem Statement
We consider an optimization problem for a system of first-order hyperbolic equations with a linear right-hand side:
Here, are n and m–dimensional vector-functions, respectively; generally speaking, functions are piecewise continuous functions. All components are continuously differentiable along any characteristic of the i-th family of characteristics of system (1); are absolutely continuous functions; the concepts of generalized solutions will be discussed below; is a diagonal matrix; , are matrix-functions , respectively; and is a n—dimensional vector-function. In addition, we assume that the diagonal elements of the matrix A are continuous and continuously differentiable in and do not change signs in the rectangle : ; ; . Let and be diagonal submatrices of A of orders and , respectively, composed of its positive and negative elements. Accordingly, we consider two subvectors and , corresponding to the positive and negative diagonal elements of A.
Initial and boundary conditions take the form
where the functions and are continuous with respect to their arguments on the sets S and T, respectively.
We assume the function in the right-hand side of the system (1) is determined by a controlled system of ordinary differential equations
Here, is a matrix function, and is a m-dimensional vector function. In addition, we assume that the matrices , , and and the vectors , are continuous functions of their arguments everywhere in the corresponding domains.
The admissible controls are assumed to be bounded, and measurable vector functions are determined on the interval T and satisfy, almost everywhere, an inclusion-type constraint,
where U is a compact belonging to the Euclidean space , and r is a natural number.
We assume that the goal of the optimization problem is to minimize a linear functional,
Here, the vectors and are continuous functions of their arguments everywhere in the corresponding domains, and is a designation of a scalar product in Euclidean space of corresponding dimension. The above assumptions are not sufficient for the existence and uniqueness of a (1)–(5) solution. However, our aim is not in solving this problem, but it is in reduction to an optimal control problem for a system of ODE equations.
The above assumptions are also insufficient for the existence of a classical (i.e., continuously differentiable) solution of problem (1)–(3), and we use the notion of a generalized solution [] (pp. 63–69, 90–94).
This is a solution , piecewise continuous in , for which all components are continuously differentiable along any characteristic of the i-th family of characteristics of system (1).
We introduce the notion of characteristics , defined by the ordinary differential equations
Thus, we understand a generalized solution of the boundary-value problem (1)–(3) as a function that satisfies a system of integral equations, where the integration is performed along characteristics of the initial hyperbolic system (1):
Here, is the initial point of the i-th characteristic that goes through the point .
Instead of the left side of system (1), we consider the differential operator
where is the derivative of the i-th component of the state vector along the corresponding family of characteristic curves.
In principle, we could assume that initial conditions are consistent with boundary conditions in (2):
In this case, a solution of (1)–(3) will be continuous, but not necessarily a differentiable function everywhere. For differentiability, it is necessary to assume the fulfillment of consistent conditions of a higher order [] (pp. 70–72). However, these conditions depend on right-hand sides of hyperbolic systems. In our case, these right-hand sides depend on control, and it is necessary to introduce additional restrictions for a control function. We also consider further adjoint differential systems for which such conditions are not satisfied.
Note that generalized solutions of hyperbolic balance laws [,] and the concept of entropy are well-suited to prove existence and uniqueness results in corresponding functional spaces. However, the approach based on characteristics of hyperbolic systems is suitable for optimal control methods, estimations of convergence, and so forth.
3. The Cost-Functional Increment Formulas
Although Equation (1) is linear with respect to x, the Pontryagin maximum principle is not a sufficient optimality condition. This is explained by the dependence of the matrix of coefficients in (3) on controls. Let us construct a non-classical exact increment formula of (5).
Consider two admissible controls, and . Let be the corresponding solutions of (1), (3) for , and be corresponding solutions of (1)–(3) for . Then, the system (1)–(3) takes the following form:
Here, . By transforming the right-hand side of (7) with respect to the representation
where . Then, the increment of (5) is written as
Functions and are still arbitrary vector functions with the same smoothness properties as and .
It is obvious that
for arbitrary functions and .
By applying the ordinary and generalized formulas of integration by parts [] (Chapter 8, Section 3) to the following terms, respectively,
we obtain
In the last integral, we will not transform the integrand to that in terms of the unperturbed solution (the expedient that is traditionally used in the proof of the pointwise maximum principle). Instead, we require that the functions and are solutions of the following adjoint problem:
A boundary value problem (8) has the same structure as (1) and (2). The cost-functional (5) does not contain addends depending on unfixed components and . Therefore, the corresponding boundary conditions in (8) are equal to zero.
Function is a solution of (8), piecewise continuous in , for which all components are continuously differentiable along any characteristic of the i-th family of characteristics of a hyperbolic system in (8). are absolutely continuous functions.
Finally, we obtain the following formula for the cost-functional increment:
The second increment formula is symmetric to this one. It may be obtained by using the representation
Then,
4. Variational Maximum Principle
Increment Formulas (10) and (11) make it possible to reduce the problem (1)–(5) to an optimal control problem for a system of ordinary differential equations. We consider a scheme based on Formula (10).
We introduce the following optimal control problem
Here, and are the fixed functions; is a m-dimensional state function; and is a control function satisfying the same constraints as the control function in the optimal control problem (1)–(5).
By analogy to (12), the increment formula (11) allows us to reduce the original problem (1)–(5) to a linear optimal control problem for the ODE system:
Here, and are fixed functions; is a state function, and is a control function satisfying the same constraints as the control function in the original optimal control problem.
These results enable us to formulate variational maximum principles for a linear optimization problem by hyperbolic systems.
Theorem 1.
It follows from (10), (11) that the optimal value of the functional in the original problem is given by
Thus, the following solution scheme based on Formula (10) can be proposed.
The solution scheme based on Formula (11) is as follows.
- We choose an arbitrary admissible control . Then, we calculate and .
Note that the auxiliary problems (12) and (13) are currently well-known and can be solved by applying many efficient methods developed for solving optimal control problems for systems of ordinary differential equations [,,,,,].
It is required to solve only twice the system of partial differential equations to calculate , and, if needed, , and to solve the optimal control problem for the system of ODEs linear in the state variables. Note that the solution of problem (1)–(5) by means of iteration processes of the classical maximum principle requires repeated integration of the hyperbolic system (1) at each iteration step.
5. Illustrative Example
To illustrate the main constructions of our approach, we consider a simple example.
In , we consider an optimal control problem
Note that the functions are absolutely continuous in T. The characteristics of the hyperbolic equation which are defined as solutions of the ODE have the following form: . Strongly speaking, function is a solution of a corresponding integral equation which is constructed on the characteristics of the hyperbolic equation
where . The function is continuously differentiable along any characteristic of the family of characteristics of the hyperbolic equation.
Here, functions and are from the same class of functions as and , respectively.
Let the initial control be . The solution of the adjoint problem corresponding to this control is the following:
Here,
Then, the original problem is reduced to the optimal control problem for a system of ODE equations
For solving the reduced optimal control problem, one can use a wide set of modern optimal control methods (for example, see reviews [,,]).
This problem is not a linear optimal control problem because the cost-functional and first differential equation contain terms of type. In the authors’ opinion, special methods for bilinear problems will be efficient for similar problems [,].
6. Conclusions
We considered an optimal control problem by a hybrid system of hyperbolic and ordinary differential equations. The proposed approach allows to reduce this problem to a classic optimal control problem by a system of ordinary differential equations. It is interesting that the proved necessary and sufficient optimality condition (Theorem 1) is satisfied for any fixed admissible function . It is due to the fact that increment formulas have been proved for an arbitrary pair of admissible controls, and . We did not use any local control variations.
Our further goal is to extend this approach to the case of quadratic cost-functionals. In this case, we have to use second-order, non-classic, exact-increment formulas. The authors hope that singular control problems may be considered on the base of this approach.
Author Contributions
Conceptualization, A.A.; methodology, A.A.; formal analysis, A.A. and V.P.; investigation, A.A. and V.P.; example, V.P., writing—original draft preparation, A.A. and V.P.; writing—review and editing, A.A. and V.P. All authors have read and agreed to the published version of the manuscript.
Funding
The reported study was funded by RFBR and the Government of the Irkutsk Region, project number 20-41-385002, and by RFBR, project number 20-07-00407.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| ODE | ordinary differential equation |
References
- Demidenko, N. Optimal control of thermal-engineering processes in tube furnaces. Chem. Petrol. Eng. 2006, 42, 128–130. [Google Scholar] [CrossRef]
- Petukhov, A. Modeling of threshold effects in social systems based on nonlinear dynamics. Cybern. Phys. 2019, 8, 277–287. [Google Scholar] [CrossRef]
- Vasiliev, O. Optimization Methods; World Federation Publishers Company Inc.: Atlanta, GA, USA, 1996. [Google Scholar]
- Arguchintsev, A.V.; Poplevko, V.P. Optimal control of initial conditions in canonical hyperbolic system of the first-order based on non-standard increment formulas. Rus. Math. 2008, 52, 1–7. [Google Scholar] [CrossRef]
- Rozonoer, L.I. LS Pontryagin’s maximum principle in the theory of optimum systems. Part I. Autom. Remote Contr. 1959, 20, 1288–1302. [Google Scholar]
- Rozhdestvenskiyi, B.L.; Yanenko, N.N. Systems of Quasilinear Equations and Their Applications to Gas Dynamics; Nauka: Moscow, Russia, 1968. [Google Scholar]
- Godunov, S.K. Equations of Mathematical Physics; Nauka: Moscow, Russia, 1979. [Google Scholar]
- LeVeque, R. Finite Volume Methods for Hyperbolic Problems (Cambridge Texts in Applied Mathematics); Cambridge University Press: Cambridge, UK, 2002. [Google Scholar] [CrossRef]
- Dafermos, C.M. Hyperbolic Conservation Laws in Continuum Physics (Grundlehren der Mathematischen Wissenschaften), 4th ed.; Springer: Berlin/Heidelberg, Germany, 2016; Volume 325. [Google Scholar]
- Rao, A.V. A survey of numerical methods for optimal control. Adv. Astron. Sci. 2009, 135, 1–32. [Google Scholar]
- Golfetto, W.A.; Silva Fernandes, S. A review of gradient algorithms for numerical computation of optimal trajectories. J. Aerosp. Technol. Manag. 2012, 4, 131–143. [Google Scholar] [CrossRef][Green Version]
- Biral, F.; Bertolazzi, E.; Bosetti, P. Notes on numerical methods for solving optimal control problems. IEEJ J. Ind. Appl. 2016, 5, 154–166. [Google Scholar] [CrossRef]
- Srochko, V.A.; Antonik, V.G. Optimality conditions for extremal controls in bilinear and quadratic problems. Russ. Math. 2016, 60, 75–80. [Google Scholar] [CrossRef]
- Srochko, V.A.; Aksenyushkina, E.V. Parameterization of some linear systems control problems. Bull. Irkutsk. State Univ. Ser. Math. 2019, 30, 83–98. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).