Next Article in Journal
Interpretable Conversation Routing via the Latent Embeddings Approach
Previous Article in Journal
UAV Mission Computer Operation Mode Optimization Focusing on Computational Energy Efficiency and System Responsiveness
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Asymptotic and Probabilistic Perturbation Analysis of Controllable Subspaces

by
Vera Angelova
1,
Mihail Konstantinov
2 and
Petko Petkov
3,*
1
Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, 1113 Sofia, Bulgaria
2
Department of Mathematics, University of Architecture, Civil Engineering and Geodesy, 1064 Sofia, Bulgaria
3
Bulgarian Academy of Sciences, 1040 Sofia, Bulgaria
*
Author to whom correspondence should be addressed.
Computation 2024, 12(12), 236; https://doi.org/10.3390/computation12120236
Submission received: 31 October 2024 / Revised: 14 November 2024 / Accepted: 25 November 2024 / Published: 28 November 2024

Abstract

In this paper, we consider the sensitivity of the controllable subspaces of single-input linear control systems to small perturbations of the system matrices. The analysis is based on the strict component-wise asymptotic bounds for the matrix of the orthogonal transformation to canonical form derived by the method of the splitting operators. The asymptotic bounds are used to obtain probabilistic bounds on the angles between perturbed and unperturbed controllable subspaces implementing the Markoff inequality. It is demonstrated that the probability bounds allow us to obtain sensitivity estimates, which are much tighter than the usual deterministic bounds. The analysis is illustrated by a high-order example.
MSC:
47A55; 93C05; 93C73; 93B05; 65F25

1. Introduction

The notion of controllable subspace plays an important role in linear control theory ([1], Ch. 1). This notion has several applications to differential algebraic systems [2], networks [3], time-varying systems [4], quantum dynamical systems [5], and switched linear systems [6], to name a few.
In this paper, we are interested in the sensitivity to small parameter perturbations of the controllable subspaces of single-input time-invariant linear control systems, described by the state equation
x ˙ ( t ) = A x ( t ) + B u ( t ) ,
where x R n is the state vector, u R 1 is the control vector and A R n × n , B R n × 1 . The subspace
C k = j = 1 k 1 A j R ( B ) = R ( [ B , A B , , A k 1 B ] ) , k = 1 , 2 , , n
is said to be the kth controllable subspace of (1). Clearly,
dim ( C k ) = rank ( [ B , A B , , A k 1 B ] ) .
We have that
C 1 C 2 C n .
The subspace C n is said to be the controllable subspace of the pair ( A , B ) . If dim ( C n ) = n , i.e., C n is the whole state space, then the system (1) and, respectively, the pair ( A , B ) are called controllable. If the system is controllable, then for every vector x T C n and T > 0 there exists a continuous control u : [ 0 , T ] R 1 , such that the state vector x ( t ) of (1) with x ( 0 ) C n satisfies x ( T ) = x T , i.e., each x T C n may be reached starting from each initial state x ( 0 ) C n . If dim ( C n ) < n , the system is said to be uncontrollable. Note that the controllability of a system is not affected by non-singular transformations of the state or control vector. As it is well known ([1], Ch. 1), the controllability is a generic property that is open and dense in the parameter space. The genericity means that each uncontrollable pair ( A , B ) can be made controllable by arbitrary small perturbations of A and B.
In case of some perturbations of the system matrices A and B, the controllable subspaces change, and for sufficiently large perturbations a controllable system may become an uncontrollable one. That is why the sensitivity of the controllable subspaces of a linear control system is closely related to the magnitude of the distance of a controllable system to an uncontrollable one, which is roughly defined as the size of the smallest perturbations in A, B that makes a controllable system an uncontrollable one [7,8,9]. Following the well-known paradigm in the numerical analysis [10], it is justified to expect that the sensitivity of the controllable subspaces is inversely proportional to the distance to an uncontrollable system. However, in contrast to the numerous papers devoted to the estimation of the distance to an uncontrollable system (see [11,12,13,14], to name a few), the sensitivity of the controllable subspaces has not been studied up to this moment.
In this paper, we consider the sensitivity of the controllable subspaces of single-input linear control systems to small perturbations of the system matrices that preserve the system controllability. The analysis is based on the new strict component-wise asymptotic bounds for the matrix of the orthogonal transformation to canonical form, derived by the method of the splitting operators [15]. The asymptotic bounds on the orthogonal transformation matrix entries are used to obtain probabilistic bounds on the angles between the perturbed and unperturbed controllable subspaces implementing the Markoff inequality. The analysis is illustrated by a high-order example. The analysis performed and the example given demonstrate that, in contrast to the deterministic bounds, the probabilistic bounds are much tighter with a sufficiently high probability. We note that the same approach of perturbation analysis is used in [16] to perform perturbation analysis of invariant, deflating and singular subspaces of matrices.
The paper is organised as follows. In Section 2, we show how to find orthonormal bases of the controllable subspaces using an appropriate system canonical form. Using the method of splitting operators, we derive asymptotic bounds on the orthonormal bases, which are then used in the perturbation analysis of controllable subspaces. In Section 3, we briefly present some results concerning the derivation of lower magnitude bounds on the entries of a random matrix using only their Frobenius norm. In the same section, we describe the application of this approach to derive probabilistic perturbation bounds for the controllable subspaces of a single-input system. A discussion on the advantages and disadvantages of the proposed new bounds is performed in Section 4. We illustrate the theoretical results with an example of a 100th-order system demonstrating that the probability bounds of the controllable subspaces are much tighter than the corresponding deterministic asymptotic bounds. Some conclusions are made in Section 6.
All computations in the paper are performed with MATLAB® Version 9.9 (R2020b) [17] using IEEE double-precision arithmetic on a machine equipped with a 12th Gen Intel(R) Core(TM) i5-1240P CPU running at 1.70 GHz and with 32 GB of RAM. M-files implementing the perturbation bounds described in the paper can be obtained from the authors.

2. Asymptotic Perturbation Bounds for the Controllable Subspaces

The sensitivity of linear subspaces to perturbations is analysed by determining the angles between the perturbed and unperturbed subspaces [18,19]. For this aim, the best results from the numerical point of view are obtained if one uses orthonormal bases for these subspaces. Therefore, our first task is to find the controllable subspaces’ orthonormal bases. This can be done by reducing the system into some special form that reveals the controllable subspaces by using orthogonal similarity transformations.

2.1. Orthonormal Bases of the Controllable Subspaces

Using a sequence of n 1 orthogonal similarity transformations (plane rotations or Householder reflections)
x i + 1 = Q i x i , i = 1 , 2 , n 1 , x 1 = x ,
the system (1) can be reduced to the form
x ˙ c ( t ) = A c x c ( t ) + B c u ( t ) ,
where x c = x n 1 and A c = U T A U , B c = U T B and U = Q 1 Q 2 Q n 1 . For appropriately chosen orthogonal transformations, the matrices A c and B c are reduced to the form
A c = a 11 a 12 a 1 , n 1 a 1 n a 21 a 22 a 2 , n 1 a 2 n a n 1 , n 1 a n 1 , n a n , n 1 a n , n , B c = b 1 0 0
and we say that the system (2) is in the orthogonal canonical form [20] or Hessenberg form [21]. Details of the reduction can be found in the references above and [22]. The corresponding algorithm is proved to be numerically stable, and it requires approximately 8 n 3 / 3 floating point operations (flops).
Since
[ B , A B , , A k 1 B ] = U [ B c , A c B c , , A c k 1 B ] = U b 1 b 1 a 21 b 1 a 21 a k , k 1 , k = 2 , 3 , , n
where * denotes an unspecified entry, it follows that the controllability of the system (1) ensures the fulfilment of the conditions
b 1 0
and
a k , k 1 0 , k = 2 , 3 , , n ,
i.e., A c is an unreduced Hessenberg matrix [23]. Note that the expression (3) represents the QR decomposition of the controllability matrix [ B , A B , , A k 1 B ] , which makes it possible to determine immediately the orthonormal bases of the controllable subspaces C 1 , C 2 , , C n . Partitioning the orthogonal transformation matrix, U, by columns as
U = U 1 , U 2 , , U n
we have that
C 1 = R ( U 1 ) , C 2 = R ( [ U 1 , U 2 ] ) , C n = R ( [ U 1 , U 2 , U n ] ) .
If the matrices A and B are subject to perturbation δ A and δ B , respectively, then, instead of the decomposition (2), we have the decomposition
x ˜ ˙ c ( t ) = A ˜ c x ˜ c ( t ) + B ˜ c u ( t ) ,
where the pair ( A ˜ c , B ˜ c ) with
A ˜ c = U ˜ T A ˜ U ˜ , A ˜ = A + δ A , B ˜ c = U ˜ T B ˜ , B ˜ = B + δ B
is again in orthogonal canonical form and U ˜ is orthogonal, i.e., U ˜ T U ˜ = I n . The columns of the perturbed matrix of the orthogonal transformation
U ˜ = [ U ˜ 1 , U ˜ 2 , , U ˜ n ]
represent the basis vectors of the perturbed controllability subspaces
C ˜ 1 = R ( U ˜ 1 ) , C ˜ 2 = R ( [ U ˜ 1 , U ˜ 2 ] ) , C ˜ n = R ( [ U ˜ 1 , U ˜ 2 , U ˜ n ] ) .
Further on, we shall assume that for small perturbations δ A and δ B the pair ( A ˜ c , B ˜ c ) preserves its controllability, i.e., dim ( C ˜ n ) = n . Note that in this case C ˜ n = C n and the perturbation analysis of the controllable subspace C n does not represent interest.
The sensitivity of the canonical form ( A c , B c ) without analyzing the sensitivity of the orthogonal transformation matrix, U, is studied by several authors [21,24,25].
Denote for brevity the controllable subspace of dimension k by X = R ( U X ) and its perturbed counterpart by X ˜ = R ( U ˜ X ) , where rank ( U X ) = rank ( U ˜ X ) = k . The sensitivity of the controllable subspace X is measured by the canonical angles
Θ 1 Θ 2 Θ k 0
between the perturbed and unperturbed subspaces. The maximum angle Θ max = Θ 1 between X ˜ and X can be computed efficiently from [18] (Ch. 4).
Θ max ( X ˜ , X ) = arcsin ( U X p e r p T U ˜ X 2 ) ,
where U X p e r p is the orthogonal complement of U X , U X p e r p T U X = 0 .

2.2. Perturbation Bounds by the Splitting Operator Method

Denote by
δ U = U ˜ U = [ δ U 1 , δ U 2 , , δ U n ] , δ A c = A ˜ c A c .
According to the splitting operator method [15], it is possible to derive separately perturbation bounds on | δ U | and | δ A c | , which allows for obtaining tight bounds. For this aim, it is appropriate to use the matrix
δ W = U T δ U = U 1 T δ U 1 U 1 T δ U 2 U 1 T δ U n U 2 T δ U 1 U 2 T δ U 2 U 2 T δ U n U n T δ U 1 U n T δ U 2 U n T δ U n R n × n
which is orthogonally equivalent to the unknown matrix δ U . Further on, we shall use the perturbation parameter vector
x = vec ( Low ( δ W ) ) = U 2 T δ U 1 U n T δ U 1 | U 3 T δ U 2 U n T δ U 2 | | U n T δ U n 1 T R p , p = n ( n 1 ) / 2 ,
where the components of x are the entries of the strictly lower triangular part of δ W . Using this vector, it is convenient to find bounds on various elements related to the orthogonal canonical form and the transformation matrix, U.
From the orthogonality of the matrix U ˜ , it follows that
( U i + δ U i ) T ( U i + δ U i ) = 1 , ( U i + δ U i ) T ( U j + δ U j ) = 0 , i < j ,
and
U i T δ U i = δ U i T δ U i / 2 , U i T δ U j = U j T δ U i δ U i T δ U j .
Hence, the matrix δ W can be represented as
δ W = δ V δ D δ Y ,
where
δ V = 0 x 1 x 2 x n 1 x 1 0 x n x 2 n 3 x 2 x n 0 x 3 n 6 x n 1 x 2 n 3 x 3 n 6 x p R n × n ,
and the matrices
δ D = δ U 1 T δ U 1 / 2 0 0 0 δ U 2 T δ U 2 / 2 0 0 0 δ U n T δ U n / 2 R n × n ,
δ Y = 0 δ U 1 T δ U 2 δ U 1 T δ U 3 δ U 1 T δ U n 0 0 δ U 2 T δ U 3 δ U 2 T δ U n 0 0 0 δ U 3 T δ U n 0 0 0 δ U n 1 T δ U n R n × n ,
contain second-order terms in δ U j , j = 1 , 2 , , n .
The vector x can be found from the perturbations δ A and δ B as follows. From the relationships
U T A U = A c , U T B = B c ,
we have that
U i T B = 0 , i = 2 , 3 , , n , U i T A U j = 0 , i = 3 , 4 , , n , j = 1 , 2 , , i 2 .
The corresponding perturbed quantities satisfy
U ˜ i T ( B + δ B ) = 0 , i = 2 , 3 , , n , U ˜ i T ( A + δ A ) U ˜ j = 0 , i = 3 , 4 , , n , j = 1 , 2 , , i 2 .
Assuming that the perturbations of the data are small, we can neglect the second-order term δ U i T A δ U j , thus obtaining asymptotic estimates. From (7) and (8), we find that
δ U i T B = U ˜ i T δ B , i = 2 , 3 , , n . U i T A δ U j + δ U i T A U j = U ˜ i T δ A U ˜ j , i = 3 , 4 , , n , j = 1 , 2 , , i 2 ,
Exploiting the identities
U T A = A c U T , A U = U A c , U T B = B c ,
the terms on the left-hand side of (9) are expressed as
δ U i T B = b 1 U 1 T δ U i , i = 2 , 3 , , n δ U i T A U j = k = 1 j + 1 a k j U k T δ U i , i = 3 , 4 , , n , j = 1 , 2 , , i 2 , U i T A δ U j = k = i 1 n a i k U k T δ U j , i = 3 , 4 , , n , j = 1 , 2 , , i 2 .
Since U ˜ i T U ˜ j = 0 , i j , up to the first-order terms we obtain
δ U i T U j = U i T δ U j , i j .
In this way
b 1 U 1 T δ U i = U ˜ i T δ B , k = i 1 n a i k U k T δ U j + k = 1 j + 1 a k j U k T δ U i = U ˜ i T δ A U ˜ j .
Denote
F = U ˜ T δ A U ˜ , G = U ˜ T δ B
and construct a vector, h, consisting of the columns of the strict lower part of the matrix H = [ G , F ] , i.e.,
h = vec ( Low ( [ G , F ] ) ) = U ˜ 2 T δ B , , U ˜ n T δ B | U ˜ 3 T δ A U ˜ 1 , , U ˜ n T δ A U ˜ 1 | | U ˜ n T δ A U ˜ n 1 T R p .
The system of equations (11) can be represented as the linear system of equations for the perturbation parameters,
M x = h ,
where M R p × p is a lower triangular matrix. The equation (12) describes the linear perturbation problem in respect to x, and the matrix M 1 can be considered as the matrix of the linear perturbation operator, which maps the perturbation vector h into the perturbation parameter vector x. According to (11), the matrix M is determined from the entries of A c and B c as
Computation 12 00236 i001
For instance, if n = 5 , then
Computation 12 00236 i002
It is possible to show that the matrix M is determined from
M = M 1 + M 2 ,
where
M 1 = Ω ( C A c ) Ω T R p × p ,
M 2 = Ω ( [ B c , A c 1 : n , 1 : n 1 ] T I n ) Ω T R p × p ,
C = 0 1 0 1 0 1
and
Ω : = diag ( Ω 1 , Ω 2 , , Ω n 1 ) , 0 p × n R p × n 2 , Ω k : = 0 ( n k ) × k , I n k R ( n k ) × n , k = 1 , 2 , , n 1 .
The triangular matrix M is non-singular since, due to the controllability of the system, the diagonal entries b 1 , a 21 , a n 1 , n 2 are different from zero. With the decreasing magnitude of these entries, the distance to the uncontrollable system decreases, and the matrix M becomes ill-conditioned. If some or several diagonal elements become zeros, the system becomes uncontrollable, and the matrix M becomes singular. This shows that there is a close connection between the singular values of M and the distance to the uncontrollable system. More specifically, for small perturbations δ A and δ B , the smallest singular value of M can be considered as an asymptotic estimate of the distance to an uncontrollable system.
Since h 2 δ A F 2 + δ B F 2 , we have that
| x | x l i n , = 1 , 2 , , p ,
where
x l i n = M , 1 : p 1 2 δ A F 2 + δ B F 2
is the asymptotic (linear) bound on | x | .
According to (6), the matrix | δ W | can be estimated as
| δ W | δ W l i n + Δ W ,
where
δ W l i n = 0 x 1 l i n x 2 l i n x n 1 l i n x 1 l i n 0 x n l i n x 2 n 3 l i n x 2 x n l i n 0 x 3 n 6 l i n x n 1 l i n x 2 n 3 l i n x 3 n 6 l i n 0 R n × n
is a first-order approximation of | δ W | and Δ W contains higher-order terms in x. Thus, an asymptotic (linear) approximation of the matrix | δ U | can be determined as
| δ U | δ U l i n = | U | | U H δ U | = | U | δ W l i n .
The determination of an estimate of the basis vector perturbation δ U allows to find estimates of the angles between the perturbed and unperturbed controllability subspaces. Consider the sensitivity of a controllable subspace X = R ( U X ) of dimension k. Since
U ˜ X = U X + δ U X , U X p e r p T U X = 0 ,
we have that
sin ( Θ max ( X ˜ , X ) ) = U X p e r p T U ˜ X 2 = U X p e r p T δ U X 2 = δ W k + 1 : n , 1 : k 2 .
Equation (19) shows that the sensitivity of the controllable subspace X of dimension k is connected to the values of the perturbation parameters x = U i T δ U j , = i + ( j 1 ) n j ( j + 1 ) 2 , i > k , j = 1 , 2 , , k . Consequently, if the perturbation parameters are known, it is possible to find at once sensitivity estimates for all controllable subspaces with dimension k = 1 , 2 , , n 1 . More specifically, let
δ W = x 1 x 2 x n x n 1 x 2 n 3 x 3 n 6 .
Then, the maximum angle between the perturbed and unperturbed controllable subspace of dimension k is given by
Θ max ( X ˜ , X ) = arcsin ( δ W k + 1 : n , 1 : k 2 ) .
Thus, we obtain the following result.
Theorem 1. 
Let the system (1) be reduced into an orthogonal canonical form (2) and assume that the Frobenius norms of the perturbations δ A and δ B are known. Set
L = M 1 , 1 : p 1 M 2 , 1 : p 1 M n , 1 : p 1 M n 1 , 1 : p 1 M 2 n 3 , 1 : p 1 M 3 n 6 , 1 : p 1 R n × n . p ,
where the matrix M is determined as in (12). Then, for the kth controllable subspace of (1), the following asymptotic perturbation bound holds,
Θ max l i n ( X ˜ , X ) arcsin ( L k + 1 : n , 1 : k p 2 h 2 ) arcsin L k + 1 : n , 1 : k p 2 δ A F 2 + δ B F 2 .
The proof of Theorem 1 follows directly from (20), replacing the matrix δ W by its linear approximation δ W l i n and substituting each x l i n by its approximation (16). Note that, as always, in the case of perturbation bounds, the equality can be achieved only for specially constructed perturbation matrices δ A and δ B .
Similarly to the component-wise sensitivity analysis of the orthogonal transformation matrix, it is possible to find perturbation bounds on the entries of the matrices A c and B c .

3. Probabilistic Perturbation Bounds for Controllable Subspaces

The asymptotic perturbation bounds for controllability subspaces are usually pessimistic, especially for high-order systems. The conservatism of these estimates can be substantially reduced if, instead of the quantities δ A F and δ B F , producing the maximum possible (and unrealistic) perturbation bound (21), we use their estimates obtained for a specified probability. This can be achieved by exploiting the properties of perturbation matrices with random entries. For this aim, we use the Markoff inequality, which allows for a given probability to reduce substantially the magnitude estimates of the perturbation matrix entries. We note that our approach to the analysis of the random matrices is different from the random matrix analysis methods proposed by Edelman and Rao [26] and Stewart [27].

3.1. Probabilistic Bounds for Random Matrices

Assume we are given an n × m random matrix, δ A , with uncorrelated elements. To bound the entries of this matrix in the perturbation analysis, we have to use the matrix bound Δ A = [ Δ a i j ] , Δ a i j > 0 , so that | δ A | Δ A , i.e.,
| δ a i j | Δ a i j , i = 1 , 2 , , n , j = 1 , 2 , , m ,
where Δ a i j = δ A and . is some matrix norm. If we use the Frobenius norm of δ A , we have the deterministic bound Δ a i j = δ A F that guarantees the fulfilment of (22). However, for such a bound we have that
Δ A F = m n δ A F ,
which yields very pessimistic results for large n and m. That is why to decrease Δ A F , we shall reduce the entries of Δ A , taking a bound with Δ a i j = δ A F / Ξ , where Ξ > 1 . Obviously, in the general case, such a bound may not satisfy (22) for all i and j. However, we can allow to exist some entries, δ a i j , of the perturbation δ A that exceed in magnitude with some prescribed probability the corresponding bound Δ a i j . The probability that | δ a i j | > Δ a i j can be determined by the Markoff inequality [28] (Sect. 5-4)
P { ξ a } E { ξ } a ,
where P { ξ a } is the probability that the random variable ξ is greater or equal to a given number, a, and E { ξ } is the average (mean value) of ξ . We note that the Markoff inequality is valid for the arbitrary distribution of ξ , which makes it conservative for a specific probability distribution. Applying the Markoff inequality with ξ equal to the entry | δ a i j | and a equal to the corresponding bound Δ a i j , we obtain the following result [29].
Theorem 2. 
For an n × m random perturbation, δ A , and a desired probability 0 < P r e f < 1 , the estimate Δ A = [ Δ a i j ] , where
Δ a i j = δ A F Ξ ,
and
Ξ = ( 1 P r e f ) m n ,
satisfies the inequality
P { | δ a i j | < Δ a i j } P r e f , i = 1 , 2 , , n , j = 1 , 2 , , m .
According to Theorem 2, the using of the scaling factor (25) guarantees that the inequality
| δ a i j | < Δ a i j
holds for each i and j with a probability no less than P r e f .
Theorem 2 can be used to decrease the mean value of the bound Δ A and hence the magnitude of its entries by the quantity Ξ , choosing the desired probability, P r e f , less than 1. The value P r e f = 1 corresponds to the case of the deterministic bound Δ A , which fulfils (22). The value P r e f < 1 corresponds to Δ a i j = δ A F / Ξ , where Ξ > 1 . We note that the probability bound produced by the Markoff inequality is very conservative, and the actual results are much better than the results predicted by the probability P r e f .
In perturbation analysis, we frequently encounter the problem of determining a bound on the elements of the vector
x = M f ,
where M is given matrix and f R p is a random vector with a known probabilistic bound on its elements. It may be shown that it is valid for the following deterministic linear component-wise bound
| x | x l i n : = M , 1 : p 2 f 2 , = 1 , 2 , , p .
A probability bound on | x | , = 1 , 2 , , p can be determined by the following theorem [29].
Theorem 3. 
If the estimate of the parameter vector x is chosen as x e s t = | M f | / Ξ , where Ξ is determined according to
Ξ = p ( 1 P r e f ) ,
then
P { | x | x e s t 2 } P r e f .
Since
x e s t 2 M 2 f 2 / Ξ ,
the inequality (29) shows that the probability estimate of the component | x | can be determined if in the linear estimate (27) we replace the perturbation norm f 2 by the probability estimate f 2 / Ξ , where the scaling factor Ξ is taken as in (28) for a specified probability, P r e f . In this way, instead of the linear estimate, x l i n , we obtain the probabilistic estimate
x e s t = x l i n / Ξ = M , 1 : p 2 f 2 / Ξ , = 1 , 2 , , p .
Theorems 2 and 3 can be used to decrease the asymptotic bounds on the sensitivity of the controllable subspaces replacing for a given probability the quantities δ A F and δ B F by their probability estimates obtained by using (24). Due to the conservatism of the Markoff inequality, such probability bounds for controllable subspaces can produce reliable results, reducing the bound size significantly.

3.2. Probabilistic Sensitivity Analysis of Controllable Subspaces

To determine tighter perturbation bounds of the controllable subspaces, we replace the Frobenius norms of the matrix perturbations δ A and δ B in the linear estimate (21) by much smaller probabilistic estimates of the perturbations entries, determined by using Theorems 2 and 3. This makes it possible to decrease with a specified probability the perturbation bounds for the different subspaces, achieving realistic results for higher- dimensional problems. For this aim, we replace δ A F and δ B F in (21) by the ratios δ A F / Ξ A and δ B F / Ξ B , where
Ξ A = n ( 1 P r e f ) , Ξ B = n ( 1 P r e f ) .
Using Theorem 3, the probabilistic perturbation bounds of x and δ U can be found from (16) and (18), replacing in (16) the perturbation norms δ A F and and δ B F by the quantities δ A F / Ξ A and δ B / Ξ B , respectively. In this way, we obtain the probabilistic asymptotic estimate
Θ max e s t ( X ˜ , X ) = arcsin ( L k + 1 : n , 1 : k p 2 δ A F / Ξ )
of the maximum angle between the perturbed and unperturbed invariant subspace of dimension k. Comparing (30) and (21), we see that, for small angles, the probabilistic bound is approximately Ξ times smaller than the deterministic one.

4. Discussion on the Results

The deterministic approach to the perturbation analysis of orthogonal canonical forms is already used in [24,25], but it is based on the implementation of the sensitivity estimates for the QR decomposition of a matrix, which does not allow us to find at once an estimate of the perturbation δ U and leads to conservative bounds. In this respect, the asymptotic bounds derived in Section 2 are strict, but they may also produce large overestimates in cases of high-order problems.
The proposed probabilistic perturbation bounds are slight modifications of the asymptotic bounds, which allows us to compute them simultaneously with the deterministic bounds. The probabilistic approach makes it possible to reduce the bounds considerably, producing realistic results with a high probability. This approach is justified in the case of high-order systems when the strict deterministic bounds are very conservative.
Consider briefly the numerical aspects of computing the asymptotic and probability estimates. The main computational operations in both cases are the reduction into the orthogonal canonical form, the computation of the matrix M and its inverse, and the calculation of the perturbation bounds. As mentioned above, the reduction into the canonical form is numerically stable due to the use of orthogonal transformations. As shown in [23], the lower triangular matrix M inversion is also stable. Finally, the perturbation bounds are computed by manipulating orthonormal vectors, which is always carried out with high precision. Hence, the asymptotic and probabilistic perturbation bounds are evaluated stably. A disadvantage of the method presented is the large number of operations for high-order systems due to the use of the Kronecker product. The inversion of a triangular matrix of order p = n ( n 1 ) / 2 requires p 3 / 6 n 6 / 48 flops, but this figure is largely overestimated since the matrix M is structured. The largest diagonal block of this matrix is of order n 1 , and it is a strictly diagonal matrix whose inversion is straightforward.

5. A Numerical Example

In this example, we present the asymptotic deterministic perturbation bounds for the controllable subspaces, along with the probabilistic bounds obtained by using the Markoff inequality.
Example 1. 
Consider a single-input linear system with matrix A, taken as
A = Q 0 A 0 Q 0 1 , B = Q 0 B 0 ,
where
A 0 = p 2 p 3 p 4 p ( n 1 ) p n p 5.0 ( n + 1 ) p ( n + 2 ) p ( n + 3 ) p ( 2 n 2 ) p ( 2 n 1 ) p 5.0 2 n p ( 2 n + 1 ) p ( 3 n 4 ) p ( 3 n 3 ) p 5.0 ( 3 n 1 ) p ( 4 n 6 ) p ( 4 n 6 ) p 5.0 ( ( n 2 + n ) / 2 2 ) p ( ( n 2 + n ) / 2 1 ) p 5.0 ( ( n 2 + n ) / 2 ) p , p = 0.00001 B 0 = 1 0 0 0 0 0 T ,
and the matrix Q 0 is constructed as [30]
Q 0 = H 2 Σ H 1 , Q 0 1 = H 1 Σ 1 H 2 , H 1 = I n 2 u u T / n , H 2 = I n 2 v v T / n , u = [ 1 , 1 , 1 , , 1 ] T , v = [ 1 , 1 , 1 , , ( 1 ) n 1 ] T , Σ = diag ( 1 , σ , σ 2 , , σ n 1 ) ,
where H 1 , H 2 are elementary reflections, σ is taken equal to 1.01 and cond ( Q 0 ) = 2.678 . The parameter σ is used to change the conditioning of the matrix Q 0 and the parameter p is used to change the conditioning of the controllable subspaces.
The perturbation of A and B are taken as δ A = 10 8 A r , δ B = 10 8 B r , where A r and B r are matrices with random entries with normal distribution and δ A F = 9.91429 × 10 7 , δ B F = 9.50807 × 10 8 . The matrix M in (12) is of order p = 4950 and its inverse satisfies M 1 2 = 1.88694 × 10 4 . This shows that the problem for the sensitivity of the controllable subspaces is ill-conditioned since the perturbations of A and B can be magnified 10 4 times in x and, consequently, in δ U and Θ ( X ˜ , X ) . The minimum singular value of M equals 5.29957 × 10 5 , which shows that small perturbations may transform the given system into an uncontrollable one. The computation of the asymptotic estimate was carried out for approximately 15 s, of which 13 s were necessary to compute the matrix M and 1.45 s for its inversion. The computation of all 99 asymptotic bounds required 0.02 s.
In Figure 1, we show the mean value of the matrix [ Δ a i j / | δ a i j | ] and the relative number N { Δ a i j | δ a i j | } / ( n 2 ) of the entries of the matrix | δ A | for which | δ a i j | | Δ a i j | , and in Figure 2 the corresponding quantities for | δ B | , obtained for the normal distribution of the entries of δ A and | δ B | and for different values of the desired probability, P r e f . For the case of P r e f = 90 % , the size of the probability entry bound Δ a i j decreases 10 times in comparison with the size of the entry bound δ A F , which allows us to decrease the mean value of the ratio Δ a i j / | δ a i j | from 840.86 to 84.086 (Table 1). For P r e f = 40 % , the probability bound Δ a i j is 60 times smaller than the bound δ A F and, even for this small, desired probability, the number of entries for which | δ a i j | | Δ a i j | is still 90.34 % . The corresponding quantities for δ B are shown in Table 2.
In Figure 3, we compare the asymptotic bound δ U l i n and the probabilistic estimate δ U p r o b with the actual component-wise perturbations | δ U | for normal distribution of perturbation entries and probabilities P r e f = 90 % , 80 % and 60 % . The probabilistic bound δ U p r o b is much tighter than the linear bound δ U l i n and the inequality | δ U | δ U p r o b is satisfied for all entries and chosen probabilities. In particular, the size of the estimate δ U p r o b is 10 times smaller than the linear estimate δ U l i n for P r e f = 90 % , 20 times for P r e f = 80 % and 40 times for P r e f = 60 % . In Figure 4, we show the ratio [ δ U i j l i n / | δ U i j | ] (left) and the ratio [ δ U i j p r o b / | δ U i j | ] (right) for P r e f = 0.6 for normal random distributions of the entries of the matrices A and B. Note that the mean value of the ratio for the probabilistic estimate is 40 times smaller than the mean value for the deterministic estimate, and its value for each i and j is greater than 1.
In Figure 5, we show the asymptotic bound δ Θ k l i n and the probabilistic estimate δ Θ k p r o b along with the exact value | δ Θ k | of the maximum angle between the perturbed and unperturbed controllable subspace of dimension k = 1 , 2 , , n 1 for the same probabilities P r e f = 90 % , 80 % and 60 % . The probability estimate satisfies | δ Θ k | < δ Θ k e s t for all 1 k < 100 . Note that the sensitivity of the controllable subspaces varies from 10 7 for k = 1 to 10 4 for k = 75 .

6. Conclusions

In this paper, we present strict asymptotic perturbation bounds of the controllability subspaces of single-input linear systems implementing the splitting operator method. An advantage of the analysis is the possibility of determining the perturbation bounds of all controllability subspaces using a single matrix representing the linear approximation of the auxiliary matrix δ W = U T δ U . Since the bounds obtained are overestimated, especially for high-order systems, we propose to use probabilistic bounds based on the Markoff inequality. The probabilistic bounds are found easily from the asymptotic bounds, allowing for a significant decrease in the sensitivity estimates with a guaranteed probability of near 1 in practice. This makes the probability bounds suitable for high-order problems. The analysis presented in this paper is also valid for linear discrete-time single-input systems with a state-space description
x k + 1 = A x k + B u k .
By duality, the results of this paper can be also used to analyse the observability subspaces of linear single-input systems.
A possible extension of the presented results can be performed in the following directions. An important problem not treated in this paper is the sensitivity of the controllable subspaces of multi-input systems. The perturbation analysis of the orthogonal canonical form of such systems presented in [24,25], is concerned only with the changes in the form itself and does not deal with the changes in the corresponding orthogonal transformation matrix. A possible approach to the solution of this problem can be the use of component-wise estimates of the QR and SVD decomposition to find tight asymptotic estimates of the changes in the orthogonal transformation that can be applied to find perturbation bounds of the controllable subspaces. Since the evaluation of the new bounds requires a considerable volume of operations, it is appropriate to consider the implementation of parallel algorithms in the computation of the matrix M of the linear perturbation operator. Another possible research direction is to enhance the application of the probability perturbation estimates to solve other problems in control systems analysis.

Author Contributions

Conceptualization, P.P. and M.K.; methodology, P.P.; software, P.P.; validation, M.K. and V.A.; formal analysis, M.K. and V.A., writing, V.A., M.K. and P.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated during the current study are available from the author upon reasonable request.

Acknowledgments

The authors are thankful to the reviewers for their remarks and suggestions improving the manuscript.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.

Notation

R the set of real numbers
R n × m the space of n × m real matrices
A = [ a i j ] a matrix with entries a i j
A j the jth column of A
A i , 1 : n the ith row of an m × n matrix A
A i 1 : i 2 , j 1 : j 2 the part of matrix A from row i 1 to i 2 and from column j 1 to j 2
Low ( A ) the strictly lower triangular part of A
| A | the matrix of absolute values of the entries of A
A T the transpose of A
A 1 the inverse of A
0 m × n the zero m × n matrix
I n the unit n × n matrix
δ A the perturbation of A
σ i ( A ) the ith singular value of A
A F the Frobenius norm of A
: = equal by definition
relation of partial order. If a , b R n then a b means a i b i , i = 1 , 2 , , n
X = R ( X ) the subspace spanned by the columns of X
U the orthogonal complement of U, U H U = 0
A B the Kronecker product of A and B
vec ( A ) the vec mapping of A R n × m . If A is partitioned column-wise as A = [ a 1 , a 2 , a m ] ,
then vec ( A ) = [ a 1 T , a 2 T , , a m T ] T
P v e c the vec-permutation matrix. vec ( A T ) = P v e c vec ( A )
P { y > y } the probability of the event { y > y }
E { ξ } the average value or mean of the random variable ξ
N { a i j b i j } the number of the entries of A that are greater or equal to the corresponding entries of B

References

  1. Wonham, W.M. Linear Multivariable Control. A Geometric Approach, 3rd ed.; Springer-Verlag: New York, NY, USA, 1985; ISBN 0-387-96071-6. [Google Scholar]
  2. Berger, T.; Reys, T. Controllability of linear differential-algebraic systems—A Survey. In Surveys in Differential-Algebraic Equations I. Differential-Algebraic Equations Forum; Ilchmann, A., Reis, T., Eds.; Springer: Berlin, Germany, 2013. [Google Scholar] [CrossRef]
  3. Liu, Y.; Ding, J.; Li, X. New measure for network controllability robustness based on controllable subspace. In Proceedings of the 2024 IEEE International Symposium on Circuits and Systems (ISCAS), Singapore, 19–22 May 2024. [Google Scholar] [CrossRef]
  4. Maarouf, H. Controllable subspace for linear time varying systems. Eur. J. Control 2019, 50, 72–78. [Google Scholar] [CrossRef]
  5. Ming, Z.; Dai, H.-Y.; Gong, E.-L.; Xie, H.-W.; Hu, D.-W. Controllable subspaces of open quantum dynamical systems. Commun. Theor. Phys. 2008, 49, 61. [Google Scholar] [CrossRef]
  6. Zhu, Y.; Sun, Z. Minimum realization for controllability/observability of switched linear systems. Nonlinear Anal. Hybrid Syst. 2024, 51, 101426. [Google Scholar] [CrossRef]
  7. Boley, D.; Lu, W.-S. Measuring how far a controllable system is from an uncontrollable one. IEEE Trans. Automat. Control 1986, 31, 249–251. [Google Scholar] [CrossRef]
  8. Eising, R. Between controllable and uncontrollable. Syst. Control Lett. 1984, 4, 263–264. [Google Scholar] [CrossRef]
  9. Paige, C. Properties of numerical algorithms related to computing controllability. IEEE Trans. Automat. Control 1981, 26, 130–138. [Google Scholar] [CrossRef]
  10. Demmel, J.W. On Condition numbers and the distance to the nearest ill-posed problem. Numer.. Math. 1987, 51, 251–289. [Google Scholar] [CrossRef]
  11. Johnson, S.C.; Wicks, M.; Žefran, M.; DeCarlo, R.A. The structured distance to the nearest system without property P . IEEE Trans. Automat. Control 2018, 63, 2960–2975. [Google Scholar] [CrossRef]
  12. Mengi, E. On the estimation of the distance to uncontrollability for higher order systems. SIAM J. Matrix Anal. Appl. 2008, 30, 154–172. [Google Scholar] [CrossRef]
  13. Wicks, M.; DeCarlo, R.A. Computing the distance to an uncontrollable system. IEEE Trans. Automat. Control 1991, 36, 39–49. [Google Scholar] [CrossRef]
  14. Yun, Z.; Chengwu, Y. Formulae for the distance between controllable and uncontrollable linear systems. Syst. Control Lett. 1993, 21, 173–180. [Google Scholar] [CrossRef]
  15. Konstantinov, M.; Petkov, P. Perturbation Methods in Matrix Analysis and Control; NOVA Science Publishers, Inc.: New York, NY, USA, 2020; Available online: https://novapublishers.com/shop/perturbation-methods-in-matrix-analysis-and-control (accessed on 24 November 2024).
  16. Petkov, P. Probabilistic perturbation bounds for invariant, deflating and singular subspaces. Axioms 2024, 13, 597. [Google Scholar] [CrossRef]
  17. The MathWorks, Inc. MATLAB Version 9.9.0.1538559 (R2020b). Natick, MA, 2020. Available online: http://www.mathworks.com (accessed on 24 November 2024).
  18. Stewart, G. Matrix Algorithms; Vol. II: Eigensystems; SIAM: Philadelphia, PA, USA, 2001; ISBN 0-89871-503-2. [Google Scholar]
  19. Stewart, G.W.; Sun, J.-G. Matrix Perturbation Theory; Academic Press: New York, NY, USA, 1990; ISBN 978-0126702309. [Google Scholar]
  20. Konstantinov, M.; Petkov, P.; Christov, N. Invariants and canonical forms for linear multivariable systems under the action of orthogonal transformation groups. Kybernetika 1981, 17, 413–424. [Google Scholar]
  21. Laub, A.J.; Linnemann, A. Hessenberg and Hessenberg/triangular forms in linear system theory. Int. J. Control 1986, 44, 1523–1547. [Google Scholar] [CrossRef]
  22. Dooren, P.M.V. The generalized eigenstructure problem in linear system theory. IEEE Trans. Automar. Contr. 1981, 26, 111–129. [Google Scholar] [CrossRef]
  23. Golub, G.H.; Van Loan, C.F. Matrix Computations, 4th ed.; The Johns Hopkins University Press: Baltimore, MD, USA, 2013; ISBN 978-1-4214-0794-4. [Google Scholar]
  24. Konstantinov, M.; Petkov, P.; Gu, D.; Postlethwaite, I. Perturbation analysis of orthogonal canonical forms. Linear Algebra Appl. 1997, 251, 267–291. [Google Scholar] [CrossRef][Green Version]
  25. Petkov, P. Perturbation bounds for orthogonal canonical forms and numerical controllability analysis. IEEE Trans. Automat. Control 1993, 38, 639–643. [Google Scholar] [CrossRef]
  26. Edelman, A.; Rao, N.R. Random matrix theory. Acta Numer. 2005, 14, 1–65. [Google Scholar] [CrossRef]
  27. Stewart, G.W. Stochastic perturbation theory. SIAM Rev. 1990, 32, 579–610. [Google Scholar] [CrossRef]
  28. Papoulis, A. Probability, Random Variables and Stochastic Processes, 3rd ed.; McGraw Hill, Inc.: New York, NY, USA, 1991; ISBN 0-07-048477-5. [Google Scholar]
  29. Petkov, P. Probabilistic perturbation bounds of matrix decompositions. Numer. Linear Algebra Appl. 2024, 31, 1–40. [Google Scholar] [CrossRef]
  30. Bavely, C.A.; Stewart, G.W. An algorithm for computing reducing subspaces by block diagonalization. SIAM J. Numer. Anal. 1979, 16, 359–367. [Google Scholar] [CrossRef][Green Version]
Figure 1. The mean value of [ Δ a i j / | δ a i j | ] as a function of P r e f (left) and the mean value of N { Δ a i j > | δ a i j | } / n 2 (right) as a function of P r e f for normal random distributions of the entries of the 100 × 100 matrix A.
Figure 1. The mean value of [ Δ a i j / | δ a i j | ] as a function of P r e f (left) and the mean value of N { Δ a i j > | δ a i j | } / n 2 (right) as a function of P r e f for normal random distributions of the entries of the 100 × 100 matrix A.
Computation 12 00236 g001
Figure 2. The mean value of [ Δ b i j / | δ b i j | ] as a function of P r e f (left) and the mean value of N { Δ b i j > | δ b i j | } / n 2 (right) as a function of P r e f for normal random distributions of the entries of the 100 × 1 matrix B.
Figure 2. The mean value of [ Δ b i j / | δ b i j | ] as a function of P r e f (left) and the mean value of N { Δ b i j > | δ b i j | } / n 2 (right) as a function of P r e f for normal random distributions of the entries of the 100 × 1 matrix B.
Computation 12 00236 g002
Figure 3. Perturbation bounds of the entries of U for different probabilities.
Figure 3. Perturbation bounds of the entries of U for different probabilities.
Computation 12 00236 g003
Figure 4. The ratio [ δ U i j l i n / | δ U i j | ] (left) and the ratio [ δ U i j p r o b / | δ U i j | ] for P r e f = 0.6 (right) for normal random distributions of the entries of the matrices A and B.
Figure 4. The ratio [ δ U i j l i n / | δ U i j | ] (left) and the ratio [ δ U i j p r o b / | δ U i j | ] for P r e f = 0.6 (right) for normal random distributions of the entries of the matrices A and B.
Computation 12 00236 g004
Figure 5. Angles between the perturbed and unperturbed controllable subspaces and their bounds.
Figure 5. Angles between the perturbed and unperturbed controllable subspaces and their bounds.
Computation 12 00236 g005
Table 1. The mean value of the ratios [ Δ a i j / | δ a i j | ] and the relative number of entries for which N { Δ a i j > | δ a i j | } / n 2 , obtained for different values of P r e f , n = 100 .
Table 1. The mean value of the ratios [ Δ a i j / | δ a i j | ] and the relative number of entries for which N { Δ a i j > | δ a i j | } / n 2 , obtained for different values of P r e f , n = 100 .
P ref Ξ E { [ Δ a ij / | δ a ij | ] } N { Δ a ij > | δ a ij | } / n 2
% %
100.0 1.0000 × 10 0 8.4086 × 10 2 100.0000
90.0 1.0000 × 10 1 8.4086 × 10 1 100.0000
80.0 2.0000 × 10 1 4.2043 × 10 1 100.0000
70.0 3.0000 × 10 1 2.8029 × 10 1 99.8800
60.0 4.0000 × 10 1 2.1022 × 10 1 98.8200
50.0 5.0000 × 10 1 1.6817 × 10 1 98.8200
40.0 6.0000 × 10 1 1.4014 × 10 1 90.3400
Table 2. The mean value of the ratios [ Δ b i j / | δ b i j | ] and the relative number of entries for which N { Δ b i j > | δ b i j | } / n , obtained for different values of P r e f , n = 100 .
Table 2. The mean value of the ratios [ Δ b i j / | δ b i j | ] and the relative number of entries for which N { Δ b i j > | δ b i j | } / n , obtained for different values of P r e f , n = 100 .
P ref Ξ E { [ Δ b ij / | δ b ij | ] } N { Δ b ij > | δ b ij | } / n 2
% %
100.0 1.0000 × 10 0 4.3503 × 10 1 100.0000
90.0 1.0000 × 10 0 4.3503 × 10 1 100.0000
80.0 2.0000 × 10 0 2.1751 × 10 1 100.0000
70.0 3.0000 × 10 0 1.4501 × 10 1 100.0000
60.0 4.0000 × 10 0 1.0876 × 10 1 97.0000
50.0 5.0000 × 10 0 8.7005 × 10 0 94.0000
40.0 6.0000 × 10 0 7.2504 × 10 0 88.0000
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Angelova, V.; Konstantinov, M.; Petkov, P. Asymptotic and Probabilistic Perturbation Analysis of Controllable Subspaces. Computation 2024, 12, 236. https://doi.org/10.3390/computation12120236

AMA Style

Angelova V, Konstantinov M, Petkov P. Asymptotic and Probabilistic Perturbation Analysis of Controllable Subspaces. Computation. 2024; 12(12):236. https://doi.org/10.3390/computation12120236

Chicago/Turabian Style

Angelova, Vera, Mihail Konstantinov, and Petko Petkov. 2024. "Asymptotic and Probabilistic Perturbation Analysis of Controllable Subspaces" Computation 12, no. 12: 236. https://doi.org/10.3390/computation12120236

APA Style

Angelova, V., Konstantinov, M., & Petkov, P. (2024). Asymptotic and Probabilistic Perturbation Analysis of Controllable Subspaces. Computation, 12(12), 236. https://doi.org/10.3390/computation12120236

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop