Next Article in Journal
Algebraic Basis of the Algebra of All Symmetric Continuous Polynomials on the Cartesian Product of p-Spaces
Next Article in Special Issue
Determining COVID-19 Dynamics Using Physics Informed Neural Networks
Previous Article in Journal
Generalized Vector-Valued Hardy Functions
Previous Article in Special Issue
Riemann–Liouville Fractional Sobolev and Bounded Variation Spaces
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Maximum Principle and Second-Order Optimality Conditions in Control Problems with Mixed Constraints

by
Aram V. Arutyunov
1,†,
Dmitry Yu. Karamzin
2,*,† and
Fernando Lobo Pereira
3,*,†
1
V.A. Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, 117997 Moscow, Russia
2
Federal Research Center “Computer Science and Control”, Russian Academy of Sciences, 119333 Moscow, Russia
3
Faculty of Engineering, University of Porto, 4200-465 Porto, Portugal
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Axioms 2022, 11(2), 40; https://doi.org/10.3390/axioms11020040
Submission received: 28 December 2021 / Revised: 11 January 2022 / Accepted: 15 January 2022 / Published: 20 January 2022

Abstract

:
This article concerns the optimality conditions for a smooth optimal control problem with an endpoint and mixed constraints. Under the normality assumption, which corresponds to the full-rank condition of the associated controllability matrix, a simple proof of the second-order necessary optimality conditions based on the Robinson stability theorem is derived. The main novelty of this approach compared to the known results in this area is that only a local regularity with respect to the mixed constraints, that is, a regularity in an ε -tube about the minimizer, is required instead of the conventional stronger global regularity hypothesis. This affects the maximum condition. Therefore, the normal set of Lagrange multipliers in question satisfies the maximum principle, albeit along with the modified maximum condition, in which the maximum is taken over a reduced feasible set. In the second part of this work, we address the case of abnormal minimizers, that is, when the full rank of controllability matrix condition is not valid. The same type of reduced maximum condition is obtained.

1. Introduction

In this article, second-order necessary optimality conditions for an optimal control problem with mixed equality and inequality constraints are investigated. Under the normality condition, which is ensured by the full rank of the controllability matrix, a rather simple proof of the optimality conditions is proposed based on Robinson’s theorem on the metric regularity for set-valued mappings. For the case in which the normality condition is violated, the second-order conditions are derived based on the index approach. This means that some reduced cone of Lagrange multipliers is invoked, which is defined by using the index of the quadratic form of the Lagrange function; see, e.g., [1,2,3].
In work [4], the two notions of the strong and of weak regularity of an admissible trajectory with respect to mixed constraints have been considered. Strong regularity means that the constraint qualification, or the so-called Robinson condition, is satisfied for all time-points and for all admissible control values. This corresponds to the regularity condition in the classical sense. Weak regularity means that this condition is satisfied merely in some neighborhood of the optimal process. By their nature, these two concepts correspond, respectively, to global, and local regularity settings. Under weak regularity, a refined maximum condition of Pontryagin’s type has been obtained, in which the maximum is taken over the closure of regular points of the feasible set, but not over the entire feasible set. In this article, the results of [4] are carried over to the second-order conditions in the case of global minimum.
The literature on optimality conditions for optimal control problems with mixed constraints is extensive. In the context of this research related to the study of mixed constraints, we note the works of [5,6,7,8,9,10,11,12]. Regarding the second-order conditions in mixed constrained problems, one may consider, e.g., [3,13,14] and the bibliography cited therein. At the same time, these selective lists of publications are far from exhaustive.
This work is organized as follows. In the next section, the problem formulation is presented, together with main definitions and notation. In Section 3, the issue of normality is discussed. In Section 4, the main result of this work—the normal maximum principle and second-order optimality conditions—is formulated and proved. In Section 5, the abnormal situation is taken into consideration, and the result of the previous section is refined. Section 6 concludes the work with a short summary.

2. Problem Formulation

Consider the following optimal control problem on the fixed time interval [ 0 , 1 ] :
Minimize φ ( p ) subject   to x ˙ ( t ) = f ( x ( t ) , u ( t ) , t ) for   a . a . t , e 1 ( p ) 0 , e 2 ( p ) = 0 , u ( t ) U ( x ( t ) , t ) for   a . a . t ,
where p = ( x 0 , x 1 ) , x 0 = x ( 0 ) , x 1 = x ( 1 ) , t [ 0 , 1 ] , and
U ( x , t ) : = { u R m : r 1 ( x , u , t ) 0 , r 2 ( x , u , t ) = 0 } .
The mappings φ : R 2 n R , e i : R 2 n R k i , f : R n × R m × R 1 R n , r i : R n × R m × R 1 R q i , i = 1 , 2 , satisfy the following hypothesis.
Hypothesis 1 (H1).
Mappings φ , e 1 , e 2 , f , r 1 , r 2 are twice continuously differentiable.
The vector p = ( x 0 , x 1 ) is termed the endpoint, as well as the constraints given by mappings e 1 , e 2 . The scalar function φ ( p ) defines the minimizing functional. Mappings r 1 , r 2 define the mixed constraints which are imposed on both state and control variables.
A pair of functions ( x , u ) is designed by the control process; if x ( · ) is absolutely continuous, u ( · ) is measurable and essentially bounded, whereas x ˙ ( t ) = f ( x ( t ) , u ( t ) , t ) for a.a. t [ 0 , 1 ] . A control process is feasible, provided that the endpoint, control and state constraints are satisfied. A feasible process ( x ¯ , u ¯ ) is termed optimal if, for any feasible process ( x , u ) , φ ( p ¯ ) φ ( p ) , where p ¯ = ( x ¯ ( 0 ) , x ¯ ( 1 ) ) .
This concept of the minimum is known as a global strong minimum. The purpose of this work is to derive the second-order necessary optimality conditions for this type of minimum under the normality assumptions. That is, to find such a set of Lagrange multipliers that simultaneously satisfies the maximum principle and Legendre’s condition, and for which λ 0 > 0 . Such a set of multipliers must be unique upon normalization. The abnormal situation is also examined after the normal case.
Consider the reference control process ( x ¯ , u ¯ ) , which can be optimal, extremal, regular, or normal in what follows. Denote by r = ( r 1 , r 2 ) the joint mapping acting onto R q , where q = q 1 + q 2 . Let J ( x , u , t ) : = { j : r j ( x , u , t ) = 0 } be the set of active indices, where the upper index specifies the vector component. Set J ( u , t ) : = J ( x ¯ ( t ) , u , t ) . Let U ( · ) designate the closure of function u ¯ ( · ) w.r.t. the Lebesgue measure; that is, for a given t [ 0 , 1 ] , the set U ( t ) consists of essential values of u ¯ ( · ) at point t,8]. Recall that the vector a is said to be the essential value of a function u ( · ) at point τ , provided that { t [ τ ε , τ + ε ] : u ( t ) B ε ( a ) } > 0   ε > 0 , where B ε ( a ) is the closed ball centered at a with the radius ε , and designates the Lebesgue measure on R .
The main regularity concept is as follows.
Definition 1.
The control process ( x ¯ , u ¯ ) is said to be regular w.r.t. the mixed constraints, provided that, for all t [ 0 , 1 ] and for all u U ( t ) , the active gradients ( r j ) u ( x ¯ ( t ) , u , t ) , j J ( u , t ) are linearly independent.
The following proposition represents an equivalent reformulation of the introduced regularity concept. For ε 0 , define the set
J ε ( x , u , t ) : = j { 1 , , q 1 } : r j ( x , u , t ) [ ε , 0 ] { q 1 + 1 , , q } ,
which is subject to the same conventions as the mapping J ( x , u , t ) . It is clear that J J ε , and J 0 = J .
Proposition 1.
Let the control process ( x ¯ , u ¯ ) be regular w.r.t. the mixed constraints. Then, there exists a number ε 0 > 0 such that, for all t [ 0 , 1 ] and for almost all s [ 0 , 1 ] such that | s t | ε 0 , the ε 0 -active gradients ( r j ) u ( x ¯ ( s ) , u ¯ ( s ) , s ) , j J ε 0 ( s ) are linearly independent. Moreover, the number ε 0 can be chosen such that the modulus of surjectivity for this set of gradients is not lower than ε 0 .
The proof is based on a simple contradiction argument.
The point u U ( x , t ) is termed regular provided that the gradients ( r j ) u ( x , u , t ) , j J ( x , u , t ) are positively linearly independent. The subset of all regular points of U ( x , t ) is denoted as U R ( x , t ) . Denote
Θ ( x , t ) : = clos U R ( x , t ) .
It is clear that, for the regular process ( x ¯ , u ¯ ) , one has U ( t ) Θ ( x ¯ ( t ) , t )   t [ 0 , 1 ] .
Consider the Hamilton–Pontryagin function
H ( x , u , ψ , t ) : = ψ , f ( x , u , t ) ,
and the Lagrangian
L ( p , λ ) : = λ 0 φ ( p ) + λ 1 , e 1 ( p ) + λ 2 , e 2 ( p ) .
Here, ψ ( R n ) * , λ = ( λ 0 , λ 1 , λ 2 ) ( R 1 + k 1 + k 2 ) * are the conjugate variables.
Definition 2.
The control process ( x ¯ , u ¯ ) is said to satisfy the maximum principle provided that there exists a vector λ = ( λ 0 , λ 1 , λ 2 ) ( R 1 + k 1 + k 2 ) * , where λ 0 0 and λ 1 0 , an absolutely continuous vector-valued function ψ W 1 , ( [ 0 , 1 ] ; ( R n ) * ) , and a measurable, essentially bounded, vector-valued function ν L ( [ 0 , 1 ] ; ( R q ) * ) of which the j-th component is nonnegative for j = 1 , , q 1 , such that λ 0 , and, on [ 0 , 1 ] , it holds that:
ψ ˙ ( t ) = H x ( x ¯ ( t ) , u ¯ ( t ) , ψ ( t ) , t ) + ν ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) f o r   a . a . t ,
ψ ( α ) = ( 1 ) α L x α ( p ¯ , λ ) f o r α = 0 , 1 ,
max u Θ ( x ¯ ( t ) , t ) H ( x ¯ ( t ) , u , ψ ( t ) , t ) = H ( x ¯ ( t ) , u ¯ ( t ) , ψ ( t ) , t ) f o r   a . a . t ,
H u ( x ¯ ( t ) , u ¯ ( t ) , ψ ( t ) , t ) ν ( t ) r u ( x ¯ ( t ) , u ¯ ( t ) , t ) = 0 f o r   a . a . t ,
λ 1 , e 1 ( p ¯ ) = 0 , a n d 0 1 ν ( t ) , r ( x ¯ ( t ) , u ¯ ( t ) , t ) d t = 0 .
Here, Condition (2) is the co-state equation, that is, the differential equation for the conjugate variable ψ . Equalities (3) are the transversality conditions. Equality (4) is the maximum condition. Equality (5) is the so-called Euler–Lagrange equation. Equalities (6) are known as the complementary slackness condition. Furthermore, ( λ , ψ , ν ) are known as the Lagrange multipliers.
Under the regularity condition given in Definition 1, the multipliers ψ , and ν are uniquely defined by the vector λ , where ( λ , ψ , ν ) is the set of Lagrange multipliers corresponding to ( x ¯ , u ¯ ) in view of the maximum principle. This assertion simply follows from the Euler–Lagrange equation. Then, denote by Λ = Λ ( x ¯ , u ¯ ) the set of vectors λ ( R 1 + k 1 + k 2 ) * for which there exist ( ψ , ν ) such that the corresponding set of Lagrange multipliers ( λ , ψ , ν ) generated by λ satisfies the maximum principle.

3. Normality Condition

Let us introduce the notion of normality. This notion is based on the concept of linearization of the control problem and the corresponding variational differential system. Consider the reference control process ( x ¯ , u ¯ ) , and a pair ( δ x 0 , δ u ) X : = R n × L 2 ( [ 0 , 1 ] ; R m ) . Denote by δ x ( · ) the solution to the variational differential equation on the time interval [ 0 , 1 ] , which corresponds to ( δ x 0 , δ u ) , that is,
δ x ˙ ( t ) = f x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + f u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) ,
where δ x ( 0 ) = δ x 0 . Such a solution exists on the entire time interval [ 0 , 1 ] and, as soon as δ u is an L 2 -function, one finds that δ x W 1 , 2 ( [ 0 , 1 ] ; R n ) .
In what follows, it is not restrictive to set e 1 ( p ¯ ) = 0 . Thus, all the endpoint constraints of the inequality type are assumed to be active. Consider the two following subspaces in X :
N e : = ( δ x 0 , δ u ) X : e ( p ¯ ) δ p = 0 , N r : = ( δ x 0 , δ u ) X : D ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + r u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) = 0 .
Here, e is the joint mapping of e 1 , e 2 ; δ p = ( δ x 0 , δ x 1 ) , where δ x 1 = δ x ( 1 ) , and D ( t ) is the diagonal q × q -matrix which has 1 in the position ( j , j ) iff j J ( t ) and 0 otherwise.
Consider the matrix
R ( t ) = r u ( x ¯ ( t ) , u ¯ ( t ) , t ) * D ( t ) r u ( x ¯ ( t ) , u ¯ ( t ) , t ) .
Set
M ( t ) : = R ( t ) + r u ( x ¯ ( t ) , u ¯ ( t ) , t ) * D ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) .
Here, A + stands for the generalized inverse [15]. Here, the generalized inverse R ( t ) + can be computed as follows. Let T ( t ) be a non-singular orthogonal linear transform which maps the subspace ker R ( t ) = im R ( t ) onto the subspace of R m with the first m q ( t ) coordinates vanished, where q ( t ) = | J ( t ) | is the number of active indices. Then, R ( t ) + = T 1 ( t ) [ T ( t ) R ( t ) T 1 ( t ) ] 1 T ( t ) , where the pseudo-inverse of the block 0 0 0 A 1 is understood as 0 0 0 A 1 .
Consider the matrix differential system
Φ ˙ ( t ) = f x ( x ¯ ( t ) , u ¯ ( t ) , t ) Φ ( t ) f u ( x ¯ ( t ) , u ¯ ( t ) , t ) M ( t ) Φ ( t ) ,
where Φ ( 0 ) = I . Let Φ ( t ) be the solution to (8), and P ( t ) be the matrix of orthogonal projection onto ker R ( t ) .
It is clear that by virtue of the construction, any element ( δ x 0 , δ u ) N r can be represented as
( δ x 0 , δ u ) = ( δ x 0 , P δ u + V [ δ x 0 , δ u ] ) ,
where V [ δ x 0 , δ u ] = M ( t ) δ x ( t ) , whereas
δ x ( t ) = Φ ( t ) δ x 0 + 0 t Φ 1 ( s ) f u ( x ¯ ( s ) , u ¯ ( s ) , s ) P ( s ) δ u ( s ) d s .
Conversely, any δ x 0 R n and δ v L 2 ( [ 0 , 1 ] ; R m ) : δ v ( t ) ker R ( t ) a.e. yields an element of N r as ( δ x 0 , δ v + V [ δ x 0 , δ v ] ) N r . Therefore, there is a one-to-one correspondence between N r and the space of the above-specified elements ( δ x 0 , δ v ) . At the same time, the formula for the solution δ x in N r is given by (10).
Let us proceed with the construction of the controllability matrix. Define the R n × k -matrix A as
A = e x 0 ( p ¯ ) + e x 1 ( p ¯ ) Φ ( 1 ) ,
with the R m × k -matrix B ( t ) given as
B ( t ) = e x 1 ( p ¯ ) Φ ( 1 ) Φ 1 ( t ) f u ( x ¯ ( t ) , u ¯ ( t ) , t ) .
Now, the controllability matrix Q is introduced as the R k × k -matrix:
Q = A A * + 0 1 B ( t ) P ( t ) B * ( t ) d t .
Definition 3.
The regular control process ( x ¯ , u ¯ ) is said to be normal, provided that Q > 0 , or equivalently, rank Q = k .

4. Main Result

In this section, the second-order necessary optimality conditions are addressed. Consider the two cones
C e : = y R k : y j 0 for j = 1 , , k 1 , and y j = 0 for j = k 1 + 1 , , k ,
C r : = y R q : y j 0 for j = 1 , , q 1 , and y j = 0 for j = q 1 + 1 , , q .
Define the cone
K : = { ( δ x 0 , δ u ) X : e ( p ¯ ) δ p C e , D ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + r u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) C r } .
On the space X , consider the quadratic form
Ω λ [ ( δ x 0 , δ u ) ] 2 = L p p ( p ¯ , λ ) [ δ p ] 2 0 1 H w w ( x ¯ ( t ) , u ¯ ( t ) , ψ ( t ) , t ) [ δ w ( t ) ] 2 d t + 0 1 ν ( t ) , r w w ( x ¯ ( t ) , u ¯ ( t ) , t ) [ δ w ( t ) ] 2 d t .
Here and further, for convenience of notation: w = ( x , u ) , δ w ( t ) = ( δ x ( t ) , δ u ( t ) ) .
The main result of this section consists in the following theorem.
Theorem 1.
Let ( x ¯ , u ¯ ) be an optimal control process in Problem (1). Suppose that this process is normal.
Then, Λ . Moreover, dim span ( Λ ) = 1 , and, for λ = ( λ 0 , λ 1 , λ 2 ) Λ , it holds that λ 0 > 0 , and
Ω λ [ ( δ x 0 , δ u ) ] 2 0 ( δ x 0 , δ u ) K .
The proof is preceded with the following auxiliary assertion.
Lemma 1.
Consider linear bounded operators A and A i , i = 1 , 2 , , acting in a given Hilbert space X, such that A i A pointwise. Assume that the spaces im A i and im A i * are closed and that im A im A i for all i. Assume also that the sequence of norms ( A i A i * ) 1 im A i is uniformly bounded. Let C X be a closed and convex set.
Then,
A 1 ( C ) = Limsup i A i 1 ( C ) .
Proof. 
Let ξ i A i 1 ( C ) and ξ i ξ 0 as i . By virtue of the uniform boundedness principle, A i ξ i A ξ 0 . Thus, A ξ 0 C and the embedding ‘⊇’ is proven.
Let us confirm the inverse embedding. Given ξ 0 A 1 ( C ) , it is necessary to indicate a sequence of elements ξ i A i 1 ( C ) , such that ξ i ξ 0 .
Consider the extremal problem
ξ ξ 0 2 min , A i ξ = A ξ 0 .
Denote the solution to this problem as ξ i . The solution exists since im A im A i and since the quadratic functional is weakly lower semi-continuous, whereas the closed convex set A i 1 ( A ξ 0 ) is weakly closed. Since the image of A i is closed, one can apply the Lagrange multiplier rule as follows. There exists a non-zero vector λ i im A i such that
ξ i ξ 0 + A i * λ i = 0 .
Applying A i , the multiplier is expressed as follows
λ i = ( A i A i * ) 1 ( A i ξ 0 A i ξ i ) .
Therefore,
ξ i = I A i * ( A i A i * ) 1 ( A i A ) ξ 0 .
Note that A i * ( A i A i * ) 1 A i · ( A i A i * ) 1 const by the assumption of the lemma. However, A i ξ 0 A ξ 0 , and thus, ξ i ξ 0 . □
Proof to Theorem 1.
By virtue of Theorem 3.5 in [4] and the regularity of the process ( x ¯ , u ¯ ) , there exists a set of multipliers ( λ , ψ , ν ) satisfying the maximum principle, such that λ 0 .
Firstly, we prove that the given λ satisfies the following Lagrange multipliers rule:
λ 0 φ x 0 ( p ¯ ) , δ x 0 + φ x 1 ( p ¯ ) , δ x 1 + ( λ 1 , λ 2 ) e x 0 ( p ¯ ) δ x 0 + e x 1 ( p ¯ ) δ x 1 = 0
for all ( δ x 0 , δ u ) N r .
Due to the maximum principle, one has
ψ ( 1 ) , δ x ( 1 ) = ψ ( 0 ) , δ x ( 0 ) + 0 1 ψ ˙ ( t ) , δ x ( t ) + ψ ( t ) , δ x ˙ ( t ) d t = ψ ( 0 ) , δ x ( 0 ) + 0 1 ( ψ ( t ) f x ( x ¯ ( t ) , u ¯ ( t ) , t ) + ν ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) , δ x ( t ) ψ ( t ) , f x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + f u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) ) d t = L x 0 ( p ¯ , λ ) , δ x 0 + 0 1 ν ( t ) r x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + ψ ( t ) f u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) d t .
Let us add and subtract the term ν ( t ) r u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) under the integral. Then, by virtue of (5), and also by taking into account that
ν ( t ) r x ( t ) δ x ( t ) + r u ( t ) δ u ( t ) = 0 for   a . a . t
when ( δ x 0 , δ u ) N r , we derive ψ ( 1 ) , δ x ( 1 ) = L x 0 ( p ¯ , λ ) , δ x 0 . Then, from (3),
L x 1 ( p ¯ , λ ) , δ x 1 = ψ ( 1 ) , δ x ( 1 ) = L x 0 ( p ¯ , λ ) , δ x 0 .
Hence,
L x 0 ( p ¯ , λ ) , δ x 0 + L x 1 ( p ¯ , λ ) , δ x 1 = 0 ,
and therefore, Condition (13) is proven.
Consider the endpoint constraint operator
E ( δ x 0 , δ u ) : = e ( p ¯ ) δ p
acting from X to R k . It is a straightforward task to derive that condition Q > 0 implies that E ( N r ) = R k . Then, using λ 0 , Equation (13) yields that λ 0 > 0 . Moreover, the multiplier λ is unique, upon normalization.
Let us proceed to the proof of the second-order condition (11). Take a number ε > 0 . Let D ε ( t ) designate the diagonal q × q -matrix defined as D ( t ) but, now, with the set J ( t ) replaced by J ε ( t ) . Define the cone K ε in the same way as K , but with the matrix D ( t ) replaced by D ε ( t ) . It is clear that K ε K for all ε > 0 . Firstly, we prove (11) for the reduced cone K ε . Consider the space X = R n × L ( [ 0 , 1 ] ; R n ) as the L -analogue of X , and the following image-space Y ε : = j = 1 q L ( T j ε ; R ) × R k , where T j ε = { t [ 0 , 1 ] : j J ε ( t ) } , j = 1 , , q .
Define the mapping F ε : X Y ε as follows
F ε ( x 0 , u ( · ) ) = r 1 ( x ( · ) , u ( · ) , · ) | T 1 ε , , r q ( x ( · ) , u ( · ) , · ) | T q ε , e 1 ( p ) , e 2 ( p ) , , e k ( p ) .
Set y ¯ ε = F ε ( x ¯ 0 , u ¯ ( · ) ) . Let C ε Y ε be the closed cone such that, for all pairs ( ξ ( · ) , γ ) C ε , one has ξ ( t ) C r for a.a. t [ 0 , 1 ] , and γ C e . Here, ξ j ( t ) = 0 when t T j ε .
Consider the inclusion
F ε ( x 0 , u ( · ) ) y ¯ ε + C ε , ( x 0 , u ( · ) ) X .
The Fréchet derivative F ε ( x ¯ 0 , u ¯ ( · ) ) is the linear mapping ( A ε , B ) : X Y ε , where A ε = ( A ε 1 , , A ε q ) ,
A j ( δ x 0 , δ u ) : = ( r j ) x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + ( r j ) u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) , t T j ε ,
and B ( δ x 0 , δ u ) : = e ( p ¯ ) δ p . The proof of this fact involves a standard argument.
Firstly, consider this derivative as the extended linear mapping acting from X to j = 1 q L 2 ( T j ε ; R ) × R k , that is, in Hilbert spaces. Let us prove its surjection. Since the linear mapping A ε is surjective due to regularity w.r.t. the mixed and state constraints (this is a simple task to ensure by solving the corresponding Volterra equation and using Proposition 1 in this way), it is sufficient to show that the linear mapping B is surjective on ker A ε . Let Q ε be the matrix constructed as Q; however, with the matrix D ( t ) replaced by D ε ( t ) . It is clear that Q ε Q as ε 0 . Therefore, one has that Q ε > 0 for all sufficiently small ε . At the same time, this condition implies that E ( ker A ε ) = R k . Therefore, it is simple to conclude that ( A ε , B ) is a surjective linear mapping for all sufficiently small ε .
The surjection of ( A ε , B ) as the linear mapping from X to Y ε results from the following simple argument. Firstly, notice that, in space X , one has the relation
clos ker A ε X = ker A ε ,
which is clear due to Formulas (9) and (10), as these still hold when D ( t ) is replaced by D ε ( t ) for a sufficiently small ε . Then, simply, N r = N r ( ε ) = ker A ε . At the same time, the linear operator A ε is surjective as the mapping from X to j = 1 q L ( T j ε ; R ) by virtue of the same arguments involving the solution to a Volterra equation. However, the image of B is finite-dimensional, whereas, as has already been confirmed, B is surjective on the space ker A ε . Therefore, by virtue of (15), one finds that B is surjective on the subspace ker A ε X . Thus, the derivative F ε ( x ¯ 0 , u ¯ ( · ) ) is surjective and, thereby, ( x ¯ 0 , u ¯ ( · ) ) is a normal point for the mapping F ε .
The Robinson theorem (see Theorem 1 in [16]) asserts the existence of a neighbourhood O ε of point ( x ¯ 0 , u ¯ ( · ) ) , y ¯ ε X × Y ε such that
dist ( x 0 , u ( · ) ) , F ε 1 ( y + C ε ) c dist F ε ( x 0 , u ( · ) ) , y + C ε ( x 0 , u ( · ) ) , y O ε .
Consider an arbitrary element h = ( δ x 0 , δ u ) K ε X , and a number τ > 0 . By putting in (16) the value ξ ( τ ) = ( x ¯ 0 , u ¯ ( · ) ) + τ h for ( x 0 , u ( · ) ) , and y ¯ ε for y, one obtains
dist ξ ( τ ) , F ε 1 ( y ¯ ε + C ε ) o ( τ ) ,
and, thus, the set K ε X is tangent to the solution set F ε 1 ( y ¯ ε + C ε ) ; see Corollary 2 in [16]. This means that, for every small τ , there exists a vector ω ( τ ) = ( a ( τ ) , v ( · ; τ ) ) X such that ω ( τ ) τ 0 as τ 0 , whereas F ε ( ξ ( τ ) + ω ( τ ) ) y ¯ ε + C ε .
Let us set x 0 ( τ ) : = x ¯ 0 + τ δ x 0 + a ( τ ) , and u ( t ; τ ) : = u ¯ ( t ) + τ δ u ( t ) + v ( t ; τ ) . Then, one may verify that the control pair ( x 0 ( τ ) , u ( · ; τ ) ) X is admissible to Problem (1) for all sufficiently small τ due to the construction of the mapping F ε . At this point, it is essential that ε > 0 . Let x ( · ; τ ) be the trajectory corresponding to the pair ( x 0 ( τ ) , u ( · ; τ ) ) , and p ( τ ) = ( x ( 0 ; τ ) , x ( 1 ; τ ) ) . Take the multiplier λ = ( 1 , λ 1 , λ 2 ) Λ ( x ¯ , u ¯ ) , and the corresponding multiplier ν entailed by λ . Let φ ( p ¯ ) = 0 .
Consider the inequality
L ( p ( τ ) , λ ) + 0 1 ν ( t ) , r ( x ( t ; τ ) , u ( t ; τ ) , t ) d t 0 ,
which results from the condition of minimum and from the fact that the control process ( x ( · ; τ ) , u ( · ; τ ) ) is admissible.
Consider the second-order variational system
δ x ˙ ( 1 ) ( t ; τ ) = f x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( 1 ) ( t ; τ ) + f u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ; τ ) , δ x ˙ ( 2 ) ( t ; τ ) = f x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( 2 ) ( t ; τ ) + 1 2 f w w ( x ¯ ( t ) , u ¯ ( t ) , t ) [ ( δ x ( 1 ) ( t ; τ ) , δ u ( t ; τ ) ) ] 2 , δ x ( 1 ) ( 0 ; τ ) = δ x 0 ( τ ) , δ x ( 2 ) ( 0 ; τ ) = 0 .
Here, δ x 0 ( τ ) = δ x 0 + a ( τ ) τ , and δ u ( t ; τ ) = δ u ( t ) + v ( t ; τ ) τ . It is clear that
x ( t ; τ ) = x ¯ ( t ) + τ δ x ( 1 ) ( t ; τ ) + τ 2 δ x ( 2 ) ( t ; τ ) + o ( τ 2 ) .
Therefore, by expanding in the Taylor series in (17), one has
o ( τ 2 ) L x 0 ( p ¯ , λ ) , τ δ x 0 ( τ ) + L x 1 ( p ¯ , λ ) , τ δ x ( 1 ) ( 1 ; τ ) + τ 2 δ x ( 2 ) ( 1 ; τ ) + τ 2 2 L p p ( p ¯ , λ ) ( δ x 0 ( τ ) , δ x ( 1 ) ( 1 ; τ ) ) 2 + 0 1 ν ( t ) , r x ( x ¯ ( t ) , u ¯ ( t ) , t ) [ τ δ x ( 1 ) ( t ; τ ) + τ 2 δ x ( 2 ) ( t ; τ ) ] + τ r u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ; τ ) + τ 2 2 r w w ( x ¯ ( t ) , u ¯ ( t ) , t ) [ ( δ x ( 1 ) ( t ; τ ) , δ u ( t ; τ ) ) ] 2 d t .
Using the adjoint equation, one has
d d t ψ ( t ) , δ x ( 1 ) ( t ; τ ) = ν ( t ) r x ( t ) δ x ( 1 ) ( t ; τ ) + ψ ( t ) f u ( t ) δ u ( t ; τ ) , d d t ψ ( t ) , δ x ( 2 ) ( t ; τ ) = ν ( t ) r x ( t ) δ x ( 2 ) ( t ; τ ) + 1 2 ψ ( t ) f w w ( t ) [ ( δ x ( 1 ) ( t ; τ ) , δ u ( t ; τ ) ) ] 2 .
Here, and from now on, the dependence on the optimal process is, for simplicity, omitted. Therefore, using these relations and the transversality conditions (3), and by gathering the terms with τ , and τ 2 in two different groups, we obtain
o ( τ 2 ) τ 0 1 [ H u ( t ) ν ( t ) r u ( t ) ] δ u ( t ; τ ) d t + τ 2 2 ( L p p ( p ¯ , λ ) [ ( δ x 0 ( τ ) , δ x ( 1 ) ( 1 ; τ ) ) ] 2 0 1 ψ ( t ) f w w ( t ) + ν ( t ) r w w ( t ) [ ( δ x ( 1 ) ( t ; τ ) , δ u ( t ; τ ) ) ] 2 d t ) .
Now, as the implication of (5), we obtain (11) for the given ( δ x 0 , δ u ) K ε X . Then, Estimate (11) is proven on the cone K ε by a simple passage to the limit in X .
Let us pass to the limit as ε 0 , and prove (11) on the entire cone K . Take h K . One needs to justify that, for all ε > 0 , there exists h ε K ε such that h ε h in X . Indeed, then, (11) is proven due to a simple passage to the limit. However, the existence of such h ε is yielded by Lemma 1. Indeed, it is a straightforward task to verify that the derivative operator F ε satisfies all the assumptions of this assertion; it obviously converges pointwise to F 0 as ε 0 , while its image is closed, as was confirmed above. The image of the conjugate operator is closed due to the regularity of the reference control process with respect to the mixed constraints which is merely a technical step to ensure. Another technical step is to assert that F ε [ F ε ] * is positive due to normality. Moreover, the constant of covering does not depend on ε . It is also a straightforward task to verify that the rest of the assumptions hold if we consider C 0 as C.
The proof is complete.  □

5. Abnormal Case

In this section, we consider the case when rank Q < k . This case, when the normality condition is not satisfied, is called abnormal. Then, as a simple example can show that Theorem 1 fails to hold. Firstly, the normalized multiplier λ is no longer unique, and moreover, there may not exist such a multiplier from the cone Λ for which Estimate (11) is still valid everywhere on K . Therefore, Theorem 1 requires a certain refinement in the abnormal case. Let us formulate the “abnormal” version of this statement. In this enterprise, we follow the method based on the so-called index approach.
Consider the reduced cone of Lagrange multipliers Λ a = Λ a ( x ¯ , u ¯ ) , which contains multipliers λ Λ such that
ind N Ω λ = k rank Q .
Here, the notation ind X stands for the index of a quadratic form over the space X, and N = N e N r . Consider also the following extra hypotheses.
Hypothesis 2 (H2).
Mappings f , r 2 are affine w.r.t. u, while r 1 is convex w.r.t. u.
Hypothesis 3 (H3).
Mixed constraints are globally regular, that is, U ( x , t ) = U R ( x , t ) for all x and t. Moreover, the set-valued mapping U ( x , t ) is uniformly bounded.
The main result of this section is as follows.
Theorem 2.
Let ( x ¯ , u ¯ ) be an optimal control process in Problem (1). Suppose that this process is regular with respect to the mixed constraints.
Then, Λ a . Moreover, under (H2) and (H3), one has
max λ Λ a Ω λ [ ( δ x 0 , δ u ) ] 2 0 ( δ x 0 , δ u ) K .
In the case of local weak minimum, Estimate (18) has been proven in [14]. Here, our task is to prove it in the case of global strong, or Pontryagin’s type of the minimum. In [3], the condition that the cone Λ a is non-empty has been proven in the class of generalized controls. Note that, under the normality condition of the optimal control process, Estimate (18) implies (11) since the normalized multiplier is unique. Thus, Theorem 2, in essence, represents a stronger assertion than Theorem 1, albeit under some extra assumptions such as (H2) and (H3). These two assumptions are meant to simplify the presentation. Note that (H3) is sufficient to suppose on the optimal trajectory only.
Proof. 
The proof of theorem is divided into the two stages.
Stage 1. In this stage, we prove that Λ a . In the beginning, suppose that Hypothesis (H3) is valid. Under (H1) and (H3), it is convenient to assume that f ( x , u , t ) , and r ( x , u , t ) are constant with respect to ( x , u ) , and t, outside of some sufficiently large ball. This can be obtained due to a simple problem reduction. In what follows, it will not also be restrictive to consider that φ ( p * ) = 0 , and, for the simplicity of exposition, to consider that all the constraints are scalar-valued, i.e., k 1 = k 2 = q 1 = 1 , while q 2 = 0 .
Let a , b be non-negative numbers. Consider the mapping
Δ ( a , b ) : = a b 4 if   b > 0 , 1 if   a > 0 , b = 0 , 0 if   a = b = 0 .
This function is lower semi-continuous. It will serve as a penalty function in the applied method below.
Take a pair ( x 0 , u ) X , and consider the unique solution to the Cauchy problem x ˙ ( t ) = f ( x ( t ) , u ( t ) , t ) , x ( 0 ) = x 0 , which exists on the entire time interval [ 0 , 1 ] due to the above assumptions. Set p = ( x 0 , x 1 ) , where x 1 = x ( 1 ) . Note that p depends on ( x 0 , u ) . Let { ε i } be an arbitrary sequence of positive numbers converging to zero. Consider the mapping φ i + ( p ) = ( φ ( p ) + ε i ) + , where a + = max { a , 0 } for a R . Thus, the following functional over the space X is well-defined:
F i ( x 0 , u ) : = φ i + ( p ) + Δ ( e 1 + ( p ) ) 2 + | e 2 ( p ) | 2 + 0 1 ( r ( x , u , t ) + ) 2 d t , φ i + ( p ) .
Functional F i is lower semi-continuous which is a straightforward exercise to verify due to the assumptions made above regarding the mappings f and r. At the same time, this functional is positive everywhere: F i > 0 .
Consider the following problem
Minimize F i ( x 0 , u ) , ( x 0 , u ) X .
Note that F i ( x ¯ 0 , u ¯ ) = ε i . By applying the smooth variational principle, see, e.g., in [17], for each i, there exists an element ( x 0 , i , u i ) X and a sequence of elements ( x ˜ j , u ˜ j ) X , j = 1 , 2 , , converging to ( x 0 , i , u i ) such that
F i ( x 0 , i , u i ) F i ( x ¯ 0 , u ¯ ) = ε i ,
| x 0 , i x ¯ 0 | 2 + 0 1 | u i ( t ) u ¯ ( t ) | 2 d t ε i 2 3 ,
and the pair ( x 0 , i , u i ) is the unique solution to the following problem:
Minimize F i ( x 0 , u ) + ε i 3 j = 1 2 j | x 0 x ˜ j | 2 + 0 1 | u u ˜ j ( t ) | 2 d t , ( x 0 , u ) X .
Suppose that φ i + ( p i ) = 0 . Then, φ ( p i ) < 0 and, in view of optimality, taking into account that φ ( p ¯ ) = 0 , it follows that some of constraints in (1): e 1 , or e 2 , or r, are violated. Therefore, by definition of Δ , one has F i ( x 0 , i , u i ) 1 . However, this contradicts (19) for i > 1 . Thus, φ i + ( p i ) > 0 . Consider a number δ i > 0 such that φ i + ( p ) > 0   p : | p p i | δ i . Then, by virtue of, again, the definition of Δ , the pair ( x 0 , i , u i ) is the unique global minimum to the following control problem:
Minimize z 0 + z 0 4 ( e 1 ( p ) + ) 2 + | e 2 ( p ) | 2 + 0 1 z 4 ( r ( x , u , t ) + ) 2 d t + ε i 3 j = 1 2 j | x 0 x ˜ j | 2 + 0 1 | u u ˜ j ( t ) | 2 d t , subject   to x ˙ = f ( x , u , t ) , z ˙ = 0 , for   a . a . t [ 0 , 1 ] , | p p i | δ i , z 0 = φ i + ( p ) .
Denote by x i , z i the solution to (21), that is, the trajectory corresponding to the pair ( x 0 , i , u i ( · ) ) . Note that function z i ( · ) is constant, and thus it can be treated simply as number z i R .
Problem (21) is, as a matter of fact, unconstrained. Consider the first and second-order necessary optimality conditions for this problem.
The first-order conditions are stated as follows. There exist a number λ i 0 > 0 , and absolutely continuous conjugate functions ψ i and σ i which correspond to x i , and z i , respectively, such that, for a.a. t [ 0 , 1 ] ,
ψ ˙ i ( t ) = H x ( x i ( t ) , u i ( t ) , ψ i ( t ) , t ) + 2 λ i 0 z i 4 r + ( x i ( t ) , u i ( t ) , t ) r x ( x i ( t ) , u i ( t ) , t ) , σ ˙ i ( t ) = 4 λ i 0 z i 5 ( r ( x i ( t ) , u i ( t ) , t ) + ) 2 ,
ψ i ( s ) = ( 1 ) s λ i 0 2 z i 4 e 1 + ( p i ) e 1 x s ( p i ) + e 2 ( p i ) e 2 x s ( p i ) + ( 1 s ) ε i 3 ω 1 , i ( x 0 , i ) ( 1 ) s ρ i φ x s ( p i ) , s = 0 , 1 , σ i ( 0 ) = λ i 0 1 4 z i 5 ( e 1 + ( p i ) ) 2 4 z i 5 | e 2 ( p i ) | 2 + ρ i , σ i ( 1 ) = 0 ,
max u R m H ( x i ( t ) , u , ψ i ( t ) , t ) λ i 0 z i 4 ( r ( x i ( t ) , u , t ) + ) 2 λ i 0 ε i 3 · ω 2 , i ( u , t ) = H ( x i ( t ) , u i ( t ) , ψ i ( t ) , t ) λ i 0 z i 4 ( r ( x i ( t ) , u i ( t ) , t ) + ) 2 λ i 0 ε i 3 · ω 2 , i ( u i ( t ) , t ) ,
Here, ρ i R is the multiplier corresponding to the constraint z 0 = φ i + ( p ) ,
ω 1 , i ( x ) : = j = 1 2 j | x x ˜ j | 2 ,   and   ω 2 , i ( u , t ) : = j = 1 2 j | u u ˜ j ( t ) | 2 .
Conditions (22)–(24) are the first-order optimality conditions in the form of the maximum principle. Consider the second-order optimality conditions for Problem (21).
Take an element ( δ x 0 , δ u ) X . Consider the variational differential equation related to (21), that is,
δ x ˙ i ( t ) = f x ( x i ( t ) , u i ( t ) , t ) δ x i ( t ) + f u ( x i ( t ) , u i ( t ) , t ) δ u ( t ) , δ z ˙ i ( t ) = 0 ,
for a.a. t [ 0 , 1 ] , where
δ x i ( 0 ) = δ x 0 , δ z i ( 0 ) = φ ( p i ) δ p i .
Here, δ p i : = ( δ x 0 , δ x i ( 1 ) ) .
The solution to (25) exists, and it is unique on the entire time interval [ 0 , 1 ] due to the assumptions made above. The function δ z i ( · ) is obviously constant, thus, it is treated just as number δ z i in what follows.
On the space X , consider the quadratic form
Ω i [ ( δ x 0 , δ u ) ] 2 = λ i 0 2 z i 4 e 1 ( p i ) + e 1 ( p i ) [ δ p i ] 2 + 2 z i 4 e 2 ( p i ) e 2 ( p i ) [ δ p i ] 2 + 20 z i 6 ( e 1 ( p i ) + ) 2 + | e 2 ( p i ) | 2 δ z i 2 ρ i φ ( p i ) + λ i 0 ε i 3 ω 1 , i ( p i ) [ δ p i ] 2 0 1 H w w ( x i ( t ) , u i ( t ) , ψ i ( t ) , t ) [ ( δ x i ( t ) , δ u ( t ) ) ] 2 d t + λ i 0 0 1 2 z i 4 r ( x i ( t ) , u i ( t ) , t ) + r w w ( x i ( t ) , u i ( t ) , t ) [ ( δ x i ( t ) , δ u ( t ) ) ] 2 d t + 0 1 20 z i 6 ( r ( x i ( t ) , u i ( t ) , t ) + ) 2 δ z i 2 d t + λ i 0 ε i 3 0 1 ω 2 , i ( u i ( t ) , t ) [ δ u ( t ) ] 2 d t .
Consider the closed subspace N i X of pairs ( δ x 0 , δ u ) such that
(a)
e ( p i ) δ p i = 0 ;
(b)
r x ( x i ( t ) , u i ( t ) , t ) δ x i ( t ) + r u ( x i ( t ) , u i ( t ) , t ) δ u ( t ) = 0 for a . a . t T i .
Here, T i : = { t [ 0 , 1 ] : r ( x i ( t ) , u i ( t ) , t ) 0 } .
Then, the second-order necessary optimality condition is given by the inequality
Ω i [ ( δ x 0 , δ u ) ] 2 0 ( δ x 0 , δ u ) N i .
(Note that functional F ( x 0 , u ) is not twice continuously differentiable. At the same time, the scalar function F ( x 0 , i + τ δ x 0 , u i + τ δ u ) of τ possesses the second derivative w.r.t. τ at τ = 0 , provided that ( δ x 0 , δ u ) N i . Using this fact, and the fact that Problem (21) is unconstrained, it is simple to derive (26) by applying direct variations arguments.)
The next step is to pass to the limit as i in the obtained optimality conditions. Firstly, it follows from (20) that x 0 , i x ¯ 0 , and u i ( t ) u ¯ ( t ) strongly in L 2 , and, thereby, x i ( t ) x ¯ ( t ) uniformly on [ 0 , 1 ] . Then, z i 0 . Define
λ i 1 : = 2 λ i 0 z i 4 e 1 ( p i ) + ; λ i 2 : = 2 λ i 0 z i 4 e 2 ( p i ) ; ν i ( t ) : = 2 λ i 0 z i 4 r ( x i ( t ) , u i ( t ) , t ) + ,
and consider the following normalization for the multipliers
| λ i | + | ψ i ( 0 ) | + ν i L 2 = 1 ,
where λ i = ( λ i 0 , λ i 1 , λ i 2 ) .
Let us show that σ i ( 0 ) 0 . Indeed, one has
σ i ( 0 ) = 4 0 1 λ i 0 z i 5 r ( x i ( t ) , u i ( t ) , t ) + ) 2 d t = 2 0 1 ν i ( t ) z i 1 r ( x i ( t ) , u i ( t ) , t ) + d t .
However, due to (19), one has z i 1 r ( x i ( t ) , u i ( t ) , t ) + L 2 0 . This, together with (27), implies that σ i ( 0 ) 0 . Then, the transversality condition and, again, (19) and (27) simply yield that λ i 0 ρ i 0 .
By passing to a subsequence, in view of the compactness argument, one may assume from (27) that λ i λ , ψ i ( t ) ψ ( t ) and ν i w ν weakly in L 2 as i for some multipliers λ = ( λ 0 , λ 1 , λ 2 ) , ψ and ν . Then, ρ i λ 0 . It is also clear that by passing to a subsequence, one can assert that λ i 0 z i 4 . Indeed, otherwise all the multipliers converge to zero, contradicting (27). By virtue of the regularity of the optimal control process with respect to mixed constraints, for each i, there exists a control function ζ i such that ζ i ( t ) U ( x i ( t ) , t ) a.e., and ζ i u ¯ in L . Thus, from the maximum condition (24), it follows that r ( x i ( t ) , u i ( t ) , t ) + 0 uniformly. Since the set U ( x ¯ ( t ) , t ) is uniformly bounded, this implies, again due to regularity, that the control function u i is essentially bounded uniformly with respect to i, that is u i L const .
From (24), one derives that
ν i ( t ) · r u ( x i ( t ) , u i ( t ) , t ) = H u ( x i ( t ) , u i ( t ) , ψ i ( t ) , t ) λ i 0 ε i 3 · ω 2 , i u ( u i ( t ) , t ) .
Whence, using regularity and the above obtained facts, one has
| ν i ( t ) | const | ψ i ( t ) | + λ i 0 i , t [ 0 , 1 ] .
Using the facts and estimates obtained above, one can simply pass to the limit in (22)–(24) and prove that the set of multipliers ( λ , ψ , ν ) satisfies the maximum principle. At the same time, the fact that λ 0 follows from (28).
Now, let us pass to the limit in (26). Take numbers ε > 0 and σ > 0 . Restricting to a subsequence, one can state that u i ( t ) u ¯ ( t ) for a.a. t [ 0 , 1 ] . Due to Egorov’s theorem, there is a subset E σ , the measure of which equals 1 σ , such that u i ( t ) u ¯ ( t ) uniformly on E σ . Denote T ε : = { t [ 0 , 1 ] : r ( x ¯ ( t ) , u ¯ ( t ) , t ) ε } , T ε ( σ ) : = T ε E σ .
Consider the bounded linear operator A i : X ( E σ ) L 2 ( T ε ( σ ) ; R ) such that
A i ( δ x 0 , δ u ) = r x ( x i ( t ) , u i ( t ) , t ) δ x i ( t ) + r u ( x i ( t ) , u i ( t ) , t ) δ u ( t ) | T ε ( σ ) ,
where X ( E σ ) is defined as X , but δ u ( t ) = 0 for a.a. t E σ . It is a simple matter to show that, due to the uniform convergence, one has A i A strongly, where
A ( δ x 0 , δ u ) = r x ( x ¯ ( t ) , u ¯ ( t ) , t ) δ x ( t ) + r u ( x ¯ ( t ) , u ¯ ( t ) , t ) δ u ( t ) | T ε ( σ ) .
Then, as is known, ker A i X ε ( σ ) : = ker A X ( E σ ) . It is clear that X ε ( σ ) X ε : = X ε ( 0 ) as σ 0 by virtue of its definition and the regularity condition. One needs to use the solution to a corresponding Volterra equation to prove this simple fact. Then, Lemma 1 yields that X ε N r as ε 0 if we consider C = { 0 } . Here, when treating the convergence of spaces, the symbol ‘→’ stands for Limsup .
Let Π i X denote the kernel of the endpoint operator e ( p i ) δ p i . It is clear that codim Π i k . Then, this is a simple exercise to ensure the existence of a subspace Π N e such that codim Π k and
Π N r Limsup Π i ker A i ,
where Limsup is total: firstly as i , then, as σ 0 and finally, as ε 0 . At the same time, note that T i E σ T ε ( σ ) for all large i. Therefore, one has the embedding ker A i Π i N i X ( E σ ) , and then, the passage to the limit in (26) gives the condition Λ a . In the latter deduction, Proposition 1 of [14] has been used and also the fact that the terms with δ z i 2 in Ω i converge to zero in view of (19) and (27).
Now, it is necessary to remove the extra assumptions imposed in (H3) regarding the boundedness and global regularity. However, this can be done following precisely the same method as presented in [4]. Take c > 0 , and consider the additional control constraint | u | c . For each ε > 0 , there will be N specifically constructed regular selectors of U ( x , t ) which are surrounded with N ε -tubes as in the above-cited source. Then, the passage to the limit, firstly as ε 0 , then, as N , and, at the end, as c will complete the proof for Stage 1.
The full proof for the next stage is rather lengthy. Therefore, let us present it schematically, in a sketch-form, exposing the main idea.
Stage 2. Here, under (H2) and (H3), we prove Estimate (18). For this purpose, the notion of χ -problem is used. Take any ε , δ > 0 and ( δ x 0 , δ u ) K . It is not restrictive to assume that the minimum in (1) is absolute.
Consider the problem
Minimize φ ( p ) χ φ ( p ¯ ε ) + max { 0 , χ 1 } 4 + δ | x 0 x ¯ 0 ε δ x 0 | 2 + δ 0 1 | u ( t ) u ¯ ( t ) ε δ u ( t ) | 2 d t , subject   to x ˙ ( t ) = f ( x ( t ) , u ( t ) , t ) for   a . a . t , e ( p ) χ e ( p ¯ ε ) C e , | x 0 x ¯ 0 | δ , r ( x ( t ) , u ( t ) , t ) χ r ( x ¯ ε ( t ) , u ¯ ( t ) + ε δ u ( t ) , t ) C r for   a . a . t , χ 0 .
Here, x ¯ ε ( · ) is the trajectory corresponding to the perturbed pair ( x ¯ 0 + ε δ x 0 , u ¯ ( t ) + ε δ u ( t ) ) , whereas p ¯ ε is the corresponding endpoint vector.
Note that the infimum in Problem (29) is finite due to the imposed assumptions. Moreover, it is not greater than zero, since the process ( x ¯ ε ( t ) , u ¯ ( t ) + ε δ u ( t ) ) , χ = 1 is feasible, whereas the value of the cost equals zero. At the same time, when χ = 0 , the infimum over X is positive due to the absolute optimality in (1) and since φ ( p ¯ ) = 0 . This suggests the application of the smooth variational principle, albeit in the version from Ref. [18], so the finite-dimensional variable χ is not subject to perturbation. That is, the adding to the cost due to the variational principle is within the space X only. Then, for any sufficiently small α > 0 , one can assert the solution ( x 0 , α , u α ( · ) ) , χ α to the perturbed problem such that χ α > 0 . Indeed, otherwise there is a contradiction with the range of the infimum.
The remaining arguments are somewhat standard: the results of Stage 1 are applied to the α -solutions which are regular due to (H3). By taking α = α ( ε ) appropriately small according to the given ε , one can prove the convergence of this solution to the optimal solution ( x ¯ 0 , u ¯ ( t ) ) as ε 0 . (In this enterprise, Hypothesis (H2) is essentially used together with the weak sequential compactness of controls u α ( ε ) implemented by virtue of a standard technique. It is also needed to use the form of the minimizing functional in (29) and the above obtained fact that the infimum is not greater than zero, in order to prove the strong convergence of these controls.) Then, it is necessary to pass to the limit in the obtained conditions, firstly as α 0 , then, as ε 0 and finally, as δ 0 . At the same time, the transversality condition with respect to the χ -variable will yield the desired Estimate (18) by virtue of the expansion in Taylor series.
The proof is complete.  □

6. Conclusions

In this article, second-order necessary conditions in the form of Estimate (18) have been derived for both normal and abnormal cases. The notion of normality is defined as the condition of full rank for the corresponding controllability matrix. In the normal case, the set of Lagrange multipliers is unique, upon normalization, while the multiplier λ 0 is positive. In the abnormal case, it is essential that the reduced cone of Lagrange multipliers Λ a is considered and that it has been proven non-empty. Along with the second-order necessary conditions, a refined version of the maximum condition in the form (4) has been obtained. The principal feature of the obtained result is that the maximum is taken over the reduced feasible set Θ ( x , t ) , which is the closure of the set of regular points.

Author Contributions

Conceptualization and methodology, A.V.A.; writing—original draft preparation, D.Y.K.; writing—review and editing, D.Y.K. and F.L.P.; supervision and project administration, F.L.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Science and Higher Education of the Russian Federation, project no 075-15-2020-799.

Data Availability Statement

Not applicable.

Acknowledgments

The support of SYSTEC UID/EEA/00147, Ref. POCI-01-0145-FEDER-006933; SNAP project, Ref. NORTE-01-0145-FEDER-000085; and MAGIC project, Ref. POCI-01-0145-FEDER-032485; all funded by ERDF | NORTE 2020, PT2020, FEDER | COMPETE2020 | POCI | PIDDAC | FCT/MCTES, are acknowledged. Theorem 1 is obtained by A.V. Arutyunov under financial support of Russian Science Foundation (Project No 22-21-00863). Theorem 2 was obtained by A.V. Arutyunov under financial support of Russian Science Foundation (Project No 20-11-20131). The work of D.Yu. Karamzin was carried out according to the State Assignment of Russian Federation (State registration number AAAA-A19-119092390082-8, Topic 0063-2019-0010). The useful remarks of the anonymous reviewers are also acknowledged.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Agrachev, A.A.; Gamkrelidze, R.V. Index of Extremality and Quasiextremality. Russ. Math. Dokl. 1985, 284, 11–14. [Google Scholar]
  2. Agrachev, A.A.; Gamkrelidze, R.V. Quasi-extremality for control systems. J. Sov. Math. 1991, 55, 1849–1864. [Google Scholar] [CrossRef]
  3. Arutyunov, A.V. Perturbations of extremal problems with constraints and necessary optimality conditions. J. Sov. Math. 1991, 54, 1342–1400. [Google Scholar] [CrossRef]
  4. Arutyunov, A.V.; Karamzin, D.Y.; Pereira, F.L.; Silva, G.N. Investigation of regularity conditions in optimal control problems with geometric mixed constraints. Optimization 2016, 65, 185–206. [Google Scholar] [CrossRef]
  5. Pontryagin, L.S.; Boltyanskii, V.G.; Gamkrelidze, R.V.; Mishchenko, E.F. Mathematical Theory of Optimal Processes; Nauka: Moscow, Russia, 1983. [Google Scholar]
  6. Hestenes, M.R. Calculus of Variations and Optimal Control Theory; Wiley: New York, NY, USA, 1966. [Google Scholar]
  7. Neustadt, L.W. Optimization; Princeton University Press: Princeton, NJ, USA, 1976. [Google Scholar]
  8. Dubovitskii, A.Y.; Milyutin, A.A. Necessary conditions for a weak extremum in optimal control problems with mixed constraints of the inequality type. USSR Comput. Math. Math. Phys. 1968, 8, 24–98. [Google Scholar] [CrossRef]
  9. Devdariani, E.N.; Ledyaev, Y.S. Maximum Principle for Implicit Control Systems. Appl. Math. Optim. 1999, 40, 79–103. [Google Scholar] [CrossRef]
  10. Milyutin, A.A. Maximum Principle in a General Optimal Control Problem; Fizmatlit: Moscow, Russia, 2001. (In Russian) [Google Scholar]
  11. Pinho, M.R.; Vinter, R.B.; Zheng, H. A maximum principle for optimal control problems with mixed constraints. IMA J. Math. Control Inform. 2001, 18, 189–205. [Google Scholar] [CrossRef]
  12. Clarke, F.; Pinho, M.R. Optimal control problems with mixed constraints. SIAM J. Control Optim. 2010, 48, 4500–4524. [Google Scholar] [CrossRef]
  13. Milyutin, A.A.; Osmolovskii, N.P. Calculus of Variations and Optimal Control; American Mathematical Society: Providence, RI, USA, 1998. [Google Scholar]
  14. Arutyunov, A.V.; Karamzin, D.Y. Necessary conditions for a weak minimum in an optimal control problem with mixed constraints. Differ. Equ. 2005, 41, 1532–1543. [Google Scholar] [CrossRef]
  15. Penrose, R. A generalized inverse for matrices. Math. Proc. Camb. Philos. Soc. 1955, 51, 406–413. [Google Scholar] [CrossRef] [Green Version]
  16. Robinson, S.M. Regularity and stability for convex multivalued functions. Math. Oper. Res. 1976, 1, 130–143. [Google Scholar] [CrossRef]
  17. Ioffe, A.D.; Tikhomirov, V.M. Some remarks on variational principles. Math. Notes 1997, 61, 48–253. [Google Scholar] [CrossRef]
  18. Arutyunov, A.V.; Karamzin, D. Square-root metric regularity and related stability theorems for smooth mappings. SIAM J. Optim. 2021, 31, 1380–1409. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Arutyunov, A.V.; Karamzin, D.Y.; Pereira, F.L. Maximum Principle and Second-Order Optimality Conditions in Control Problems with Mixed Constraints. Axioms 2022, 11, 40. https://doi.org/10.3390/axioms11020040

AMA Style

Arutyunov AV, Karamzin DY, Pereira FL. Maximum Principle and Second-Order Optimality Conditions in Control Problems with Mixed Constraints. Axioms. 2022; 11(2):40. https://doi.org/10.3390/axioms11020040

Chicago/Turabian Style

Arutyunov, Aram V., Dmitry Yu. Karamzin, and Fernando Lobo Pereira. 2022. "Maximum Principle and Second-Order Optimality Conditions in Control Problems with Mixed Constraints" Axioms 11, no. 2: 40. https://doi.org/10.3390/axioms11020040

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop