Abstract
The relationship among eigenvalues, singular values, and quadratic forms associated with linear transforms of doubly stochastic matrices has remained an important topic since 1949. The main objective of this article is to present some useful theorems, concerning the spectral properties of doubly stochastic matrices. The computation of the bounds of structured singular values for a family of doubly stochastic matrices is presented by using low-rank ordinary differential equations-based techniques. The numerical computations illustrating the behavior of the method and the spectrum of doubly stochastic matrices is then numerically analyzed.
1. Introduction
A real stochastic matrix M is a matrix whose row sums or column sums are equal to 1. All the entries of a real stochastic matrix are non-negative. A real symmetric matrix with non-negative entries with row sums and column sums equal to 1 is called doubly stochastic matrix.
A list of n real numbers, i.e., is realizable if there exists a symmetric doubly stochastic matrix M with its spectrum denoted by . Doubly stochastic matrix describes the transitions corresponding to finite state symmetric Markov chains and this transition acts as a special class of this family. Doubly stochastic matrices are the convex hull for transition matrices with element set [1].
The inverse eigenvalue problems for non-negative doubly stochastic matrices have its origin in work of [2,3,4,5]. For more details on inverse eigenvalue problems, we refer the reader to [6,7,8,9,10] and references therein.
The non-negative matrix M has a real eigenvalue such that for all i. The eigenvalues for all i are the eigenvalues of M other than . From the Perron–Frobenius theorem an eigenvector corresponding to is such that each of its entries are non-negative and sums to 1. For more details, we refer to [11,12,13].
[14] showed that the eigenvector has the form corresponding to eigenvalue for , where denotes the real line. The spectrum of a doubly stochastic matrix is bounded by 1, that is for all i. Three important eigenvalue problems for doubly stochastic matrices are considered in [14] whenever there is a possibility that eigenvalues can be placed in complex plane, denoted by . The first problem deals with necessary and sufficient conditions for tuples to be the spectrum of a given doubly stochastic matrix. The second problem is about the fact that which real numbers acts as the spectrum of the doubly stochastic matrix. The last problem deals with the study in which set of n real numbers act as the spectrum of the symmetric doubly stochastic inverse eigenvalue problems.
The matrix M over a field such that each row sum and column sum is , is called the generalization of doubly stochastic matrices by means of Lie theory and algebra of set of generalized doubly stochastic matrices studied in [15].
In the literature [6,7,10,14,15], much attention has been payed to study the eigenvalues or eigen-spectrum of doubly stochastic matrices. According to the best of our knowledge, however, the study of spectral properties, such as structured singular values for doubly stochastic matrices, is utterly missing from the literature. The current paper deals with the study of the spectral properties, such as singular values and structured singular values for a class of doubly stochastic matrices. The main contribution is to fill this gap which reflects the novelty of our results presented in paper.
The paper is arranged as follows: In Section 2 we provide definitions of symmetric stochastic matrices, singular values and structured singular values. In Section 3 we give a detailed explanation of the computation of singular values for symmetric doubly stochastic matrices. Section 4 of this article contains the geometrical interpretation of eigenvalues and singular values of doubly stochastic matrices. The computation of structured singular values for doubly stochastic matrices is addressed in Section 5. Whereas the numerical experimentation is discussed in Section 6. Section 7 summarizes the conclusions.
2. Preliminaries
Definition 1.
The dimensional matrix is said to be a doubly stochastic matrix if
Definition 2.
The dimensional matrix is said to be symmetric doubly stochastic matrix if its transpose is doubly stochastic matrix.
Definition 3.
The singular values of a matrix M are the non-negative real numbers and
Definition 4.
The set of block diagonal matrices is denoted by and is defined as:
In the above definition S and F represent the number of repeated real or complex scalar blocks and the number of full real or complex blocks respectively.
Definition 5.
The structured singular value of with respect to set is denoted by and is defined as:
3. Computing Singular Values of Doubly Stochastic Matrices
Theorem 1.
Let be dimensional symmetric stochastic matrices with row and column sum equals to 1. Let and are singular values with and as left and right singular vectors respectively with for and , are the left and right singular vectors respectively with for . The leading singular vectors and are orthogonal to and for all , respectively. Let be the singular vector corresponding to and then any vector which is orthogonal to is not a singular vector to and
Proof.
The result is proved by expanding and taking sum of all components of the singular value problem of the form:
In Equation (1), is a singular vector corresponding to a singular value . The singular vector is not a singular vector corresponding to singular values and
We write
Taking sum of all components of , we have
because D is a symmetric stochastic matrix with row and column sums equal to 1. Equation (2) implies that,
Now, by taking the sum of righthand side of Equation (1) gives,
Theorem 2.
Let be dimensional symmetric stochastic matrices with row and column sum equals to 1. Let and be singular values corresponding to singular vectors as defined in Theorem 1. The matrix is the matrix with and along the main diagonal. The singular values of do not contain original singular values and appearing along the main diagonal of a matrix with
The off diagonal of contains the rank-1 matrices and consisting of leading left and right singular vectors corresponding to and , respectively.
Proof.
We prove the result by computing the singular vectors of the singular value problem of the form:
In Equation (6), the set of vectors for all is the singular vectors corresponding to singular values The vector for all acts as a singular vector corresponding to The vector acts as a singular vector corresponding to singular value From above discussion it is clear that the vectors of the form for all act as a singular vectors for matrix while the vectors acts as singular vectors corresponding to singular values and of ☐
Theorem 3.
Let be two symmetric doubly stochastic matrices. Let and be leading singular values corresponding to singular vectors and , respectively.
Let
with I is an identity matrix with the same dimension as of and and ρ is any constant. The singular values of does not contains the leading singular values of and . The leading singular values are contained in with
Proof.
We prove the result by computing singular values of singular value problem,
The singular values of are , where which are the singular values of
Because represent the singular vectors corresponding to singular values can be treated as Similarly for the singular vector holds true. This show that the singular vector corresponding to can be expressed as and finally the vectors act as singular vectors to and ☐
Theorem 4.
A two dimensional symmetric doubly stochastic matrix has singular values 1 and if and only if
Proof.
To complete the prove its sufficient to see the fact that for the matrix
is symmetric and doubly stochastic matrix. ☐
Theorem 5.
A three dimensional symmetric doubly matrix has singular values if and only if , , and
Proof.
The proof is similar to the one in [15] and hence is omitted. ☐
4. Geometrical Interpretation of Spectrum
In this section, we present the geometrical interpretation of the spectrum of symmetric doubly stochastic matrices. In particular, we discuss the geometry of the eigenspace and singular values and left, right singular vectors of such a class of matrices.
Example 1.
We take doubly stochastic matrices and taken from [16] as
The spectrum of is shown in Figure 1a,b of Example 1, respectively. The maximum eigenvalue for both is 1 and lies exactly on the spectral circle. The Figure 1c,d show the geometrical interpretation of the singular values and singular vectors obtained for of Example 1, respectively.
Figure 1.
Geometrical interpretation of spectrum and singular values/vectors of Example 1. (a) and (b): spectrum of of Example 1, respectively; (c) and (d): geometrical interpretation of the singular values and singular vectors obtained for of Example 1, respectively.
Example 2.
We take five dimensional doubly stochastic matrices from [17] as
The spectrum of is shown in Figure 2a,b of Example 2, respectively. The maximum eigenvalue for both is 1 and lies exactly on the spectral circle. Figure 2c,d show the geometrical interpretation of the singular values and singular vectors obtained for of Example 2, respectively.
Figure 2.
Geometrical interpretation of spectrum and singular values/vectors of Example 2. (a) and (b): spectrum of of Example 2, respectively; (c) and (d): geometrical interpretation of the singular values and singular vectors obtained for of Example 2, respectively
Example 3.
We take eight and nine dimensional doubly stochastic matrices from [18]. The largest eigenvalue corresponding to each matrix attains the maximum value 1. The spectrum is shown in Figure 3a,b of Example 3, respectively. The Figure 3c,d show the geometrical interpretation of the singular values and singular vectors of Example 3, respectively.
Figure 3.
Geometrical interpretation of spectrum and singular values/vectors of Example 3. (a) and (b): spectrum of Example 3, respectively; (c) and (d): geometrical interpretation of the singular values and singular vectors of Example 3, respectively
5. Computing Structured Singular Values
In this section, our aim is to discuss the spectral properties of doubly stochastic matrices based on the computation of Structured Singular Values (SSV). For this purpose, we compute SSV for a class of matrices as considered in Section 4. SSV is the straight forward generalization of the singular values for the constant matrices. The computation of the exact value of SSV is NP-hard. For this reason, one needs to approximate its bounds, i.e., lower and upper bounds.
From an application point of view, the computation of lower bounds of SSV gives sufficient information about the instability of some feedback system while the upper bounds discuss the stability of feedback system under consideration. The computation of the bounds of SSV presented in this section is based on two powerful mathematical techniques: First technique is based on power method for approximating spectrum [19]. The upper bound of SSV is computed by means of the balanced/AMI technique [20] for computing the upper bound from [21]. The second technique [22] is based on the low rank ODEs-based techniques in order to approximate the lower bounds of SSV. This technique works on a two level algorithm, i.e., inner-outer algorithm. We give a brief description of inner-outer algorithms in the subsequent subsections.
5.1. Inner-Algorithm
The inner-algorithm is used to solve the minimization problem addressed in Equation (5). For this purpose, one needs to construct and then solve a gradient system of ordinary differential equations associated with the optimization problem. The construction of system of ODEs involves the approximation of the local extremizers of structured spectral values sets [22]. Following Theorem 6 helps us to approximate the local extremizer of structured spectral vale sets
Theorem 6.
[22]. For a perturbation with the block diagonal structure
with acts as a local extremizer of structured spectral value set. For a simple smallest eigenvalue of matrix valued function with the right and left eigenvetors x and y scaled as and let . The non-degeneracy conditions
hold. Then the magnitude of each complex scalar appears to be exactly equal to 1 while each full block possesses a unit 2-norm.
Proof.
For proof we refer to [22].
The system of ordinary differential equations corresponding to a perturbation is to approximate an extremizer of smallest eigenvalue in magnitude, i.e., which is obtained as,
where for and is a characteristic function. For further discussion on the construction of system of ordinary differential equations in above equations, we refer to [22]. ☐
5.2. Outer-Algorithm
The main aim of the outer-algorithm is to vary a small positive parameter known as the perturbation level. To vary perturbation level a fast Newton’s iteration was used in [22]. The quantity provides the approximation of lower bound to SSV.
The fast Newton’s iteration to solve a problem is
To solve Equation (10), we compute the derivative
To compute , one need following Theorem 7
Theorem 7.
[22]. Let be the matrix valued function and let x and y as a function of are right and left eigenvectors of the perturbed matrix . Consider the scaling of vectors x and y accordingly to Theorem 6. Let and consider that the non-degenracy conditions as discussed in Theorem 6 holds true, then it yields that
For the proof of the above statement, we refer to [22].
6. Numerical Experimentation
The aim of this section is to present numerical eperimentations for lower bounds of SSV for a class of doubly stochastic matrices obtained in Section 4. The numerical experimentations show that the obtained lower bounds with the help of algorithm [22] are either tighter or equal to one approximated with MATLAB function mussv.
Example 4.
We consider a three dimensional real doubly stochastic valued matrix taken from [16]
We take block uncertainties The admissible perturbation E is approximated as
with The lower bound of SSV by using algorithm [22] is obtained as 1 which is equal to the lower bound approximated by mussv function.
Moreover, by using mussv function, the admissible perturbation ∇ is obtained as
such that The mussv function approximates the same lower and upper bounds of SSV, i.e., 1.
Example 5.
We consider a five dimensional real doubly stochastic valued matrix taken from [17]
We take block uncertainties The admissible perturbation E is approximated as
with The lower bound of SSV by using algorithm [22] is obtained as 1 which is same as the upper bound approximated by mussv function.
Moreover, by using mussv function, the admissible perturbation ∇ is obtained as
such that Themussvfunction approximates the lower bounds as and upper bound 1 for SSV.
Example 6.
We consider a five dimensional real doubly stochastic valued matrix taken from [17]
We take block uncertainties The admissible perturbation E is approximated as
with The lower bound of SSV by using algorithm [22] is obtained as 1.
Moreover, by using mussv function, the admissible perturbation ∇ is obtained as
such that The mussv function approximates the lower bounds as and upper bound 1 for SSV.
7. Conclusions
In this article, we presented some useful theorems concerning the spectral properties such as singular values and structured singular values for a class of doubly stochastic matrices. We used low-rank ordinary differential equations-based techniques and MATLAB function mussv to approximate bounds of structured singular values corresponding to doubly stochastic matrices. The numerical experimentations show the behavior of singular values and structured singular values which agree with the fact that the largest value of each singular value and structured singular value for doubly stochastic matrix is bounded above by 1. The obtained results for singular values and structured singular values agree with the results obtained for eigenvalues of doubly stochastic matrices, that is:
- The doubly stochastic matrix has an eigenvalue 1.
- The absolute value of any eigenvalue corresponding to a doubly stochastic matrix is less than or equal to 1. The results achieved in this study for structured singular values of doubly stochastic matrices could lead the way to discuss the stability and instability analysis of:
- Stochastic optimal control systems.
- Linear feedback systems in control.
Author Contributions
M.-U.R. and A.H. both contributed in conceptualization, methodology, writing manuscript and validation of results, while J.H.B. and J.A. contributed in writing-review and editing. All authors have read and agreed to the published version of the manuscript.
Funding
J. Alzabut would like to thank Prince Sultan University for funding this work through research group Nonlinear Analysis Methods in Applied Mathematics (NAMAM) group with fund number RG-DES-2017-01-17.
Acknowledgments
The authors acknowledge the anonymous reviewers for their potential inputs to increase the quality of the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Gnacik, M.; Kania, T. Inverse problems for symmetric doubly stochastic matrices whose suleimanova spectra spectra are to be bounded below by 1/2. arXiv 2019, arXiv:1909.01291. [Google Scholar] [CrossRef]
- Perfect, H. On positive stochastic matrices with real characteristic roots. In Mathematical Proceedings of the Cambridge Philosophical Society; Cambridge University Press: Cambridge, UK, 1952; Volume 48, pp. 271–276. [Google Scholar]
- Perfect, H. Methods of constructing certain stochastic matrices. Duke Math. J. 1965, 69, 35–57. [Google Scholar] [CrossRef]
- Suleimanova, H.R. Stochastic matrices with real characteristic values. Dokl. Akad. Nauk SSSR 1949, 66, 343–345. [Google Scholar]
- Suleimanova, H.R. The question of a necessary and sufficient condition for the existence of a stochastic matrix with prescribed characteristic numbers. Trudy Vsesojuz. Zaocn. Energet. Inst. Vyp 1965, 28, 33–49. [Google Scholar]
- Ccapa, J.; Soto, R.L. On spectra perturbation and elementary divisors of positive matrices. Electron. J. Linear Algebra 2009, 18, 462–481. [Google Scholar] [CrossRef][Green Version]
- Hwang, S.-G.; Pyo, S.-S. The inverse eigenvalue problem for symmetric doubly stochastic matrices. Linear Algebra Appl. 2004, 379, 77–83. [Google Scholar] [CrossRef][Green Version]
- Johnson, C.R.; Paparella, P. Perron spectratopes and the real nonnegative inverse eigenvalue problem. Linear Algebra Appl. 2016, 493, 281–300. [Google Scholar] [CrossRef]
- Lei, Y.-J.; Xu, W.-R.; Lu, Y.; Niu, Y.-R.; Gu, X.-M. On the symmetric doubly stochastic inverse eigenvalue problem. Linear Algebra Appl. 2014, 445, 181–205. [Google Scholar] [CrossRef]
- Mourad, B.; Abbas, H.; Mourad, A.; Ghaddar, A.; Kaddoura, I. An algorithm for constructing doubly stochastic matrices for the inverse eigenvalue problem. Linear Algebra Appl. 2013, 439, 1382–1400. [Google Scholar] [CrossRef]
- Berman, A.; Plemmons, R.J. Non-Negative Matrices in the Mathematical Sciences; SIAM Publications: Philadelphia, PA, USA, 1994. [Google Scholar]
- Bhatia, R. Matrix Analysis; Springer: New York, NY, USA, 1997. [Google Scholar]
- Seneta, E. Non-Negative Matrices and Markov Chains, 2nd ed.; Springer: New York, NY, USA, 1981. [Google Scholar]
- Mourad, B. On a spectral property of doubly stochastic matrices and its application to their inverse eigenvalue problem. Linear Algebra Appl. 2012, 436, 3400–3412. [Google Scholar] [CrossRef]
- Mourad, B. Generalized Doubly-Stochastic Matrices and Inverse Eigenvalue Problems; University of New South Wales: Sydney, Australia, 1998. [Google Scholar]
- Mehlum, M. Doubly Stochastic Matrices and the Assignment Problem. Master’s Thesis, University of Oslo, Oslo, Norway, 2012. [Google Scholar]
- Mashreghi, J.; Rivard, R. On a conjecture about the eigenvalues of doubly stochastic matrices. Linear Multilinear Algebra 2007, 55, 491–498. [Google Scholar] [CrossRef]
- Xu, W.-R.; Chen, G.-L. Some results on the symmetric doubly stochastic inverse eigenvalue problem. Bull. Iran. Math. Soc. 2017, 43, 853–865. [Google Scholar]
- Young, P.M.; Doyle, J.C. Computation of mu with real and complex uncertainties. In Proceedings of the 29th IEEE Conference on Decision and Control, Honolulu, HI, USA, 7 December 1990; pp. 1230–1235. [Google Scholar]
- Young, P.M.; Newlin, M.P.; Doyle, J.C. Practical computation of the mixed μ problem. In Proceedings of the 1992 American Control Conference, Chicago, IL, USA, 26 June 1992; pp. 2190–2194. [Google Scholar]
- Fan, M.K.H.; Doyle, J.C.; Tits, A.L. Robustness in the presence of parametric uncertainty and unmodeled dynamics. Adv. Comput. Control. 1989, 130, 363–367. [Google Scholar]
- Guglielmi, N.R.; Mutti, U.; Kressner, D. A novel iterative method to approximate structured singular values. SIAM J. Matrix Anal. Appl. 2019, 38, 361–386. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).


