1. Introduction
Throughout, let
denote the collections of all
matrices with complex numbers;
denote the conjugate transpose;
denote the rank of
A, i.e., the maximum order of the invertible submatrix of
A;
and
denote the range and the null space of a matrix
, respectively;
denote the identity matrix of order
m; and
denote a columnwise partitioned matrix consisting of two submatrices
A and
B. The Moore–Penrose generalized inverse of
, denoted by
, is the unique matrix
that satisfies the four Penrose equations:
see [
1]. Starting with Penrose himself, a matrix
X is called a
-generalized inverse of
A, denoted by
, if it satisfies the
ith,
th equations in (
1). The collection of all
-generalized inverses of
A is denoted by
. There are in all 15 types of
-generalized inverses of
A by definition, but matrix
X is called an inner inverse of
A if it satisfies
and is denoted by
.
In this paper, we focus our attention on
-generalized inverses of matrices. As usual, we denote matrix qualities composed of
-generalized inverses by
where
,
are given matrices of appropriate sizes. For a given general algebraic matrix equality, a primary task that we are confronted with is to determine clear and intrinsic identifying conditions for it to hold. However, there do not exist effective and useful rules and techniques of characterizing a given algebraic equality by means of ordinary operations of matrices and their generalized inverses because of the noncommutativity of matrix algebra and the singularity of matrices. In view of this fact, few of (
2) can be described with satisfactory conclusions in the theory of generalized inverses except some kinds of special cases with simple and reasonable forms. As well-known examples of (
2), we mention the following two matrix equalities:
where
and
Obviously, they can be viewed as the direct extensions of the two ordinary reverse-order laws
and
for the products of two or three invertible matrices of the same size, and therefore, they are usually called the reverse-order laws for generalized inverses of the matrix products
and
, respectively. Apparently, the two reverse-order laws in (
3) and their special forms, such as
and
, seem simple and neat in comparison with many other complicated matrix equalities that involve generalized inverses. On the other hand, since
and
do not necessarily hold for a singular matrix
M, the two reverse-order laws in (
3) do not necessarily hold for singular matrices. Therefore, it is a primary work to determine the necessary and sufficient conditions for the two reverse-order laws in (
3) to hold before we can utilize them in dealing with calculations related to matrices and their generalized inverses. In fact, they were well known as classic objects in the theory of generalized inverses of matrices and have been studied by many authors since the 1960s; see, e.g., [
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13,
14] for the historical perspective and development on the subject area of reverse-order laws.
In addition to ordinary forms of reverse-order laws in (
3), there are many other kinds of simple and complicated algebraic equalities that are composed of mixed reverse-order products of given matrices and their generalized inverses, such as
These equalities are usually called the mixed or nested reverse-order laws for generalized inverses of matrices. Clearly, these reverse-order laws of special kinds are all constructed from the ordinary algebraic operations of the given matrices and their generalized inverses, and each of them has certain reasonable interpretations; in particular, they can be reduced to the reverse-order laws for standard inverses of matrix products when the given matrices in them are all invertible. Admittedly, knowing how to deal with a given matrix equality composed by matrices and their generalized inverses is a difficult problem. In fact, these kinds of problems have no uniformly acceptable solutions, and no algebraists and algebraic techniques can accurately tell people what to do with complicated matrix operations and matrix equalities.
The rest of this paper is organized as follows. In
Section 2, the author introduces a group of known formulas, facts, and results about ranks, ranges, and generalized inverses. In
Section 3, the author derives several groups of equivalent facts related to the matrix equalities in (
3)–(7) and gives some of their consequences.
Section 4 gives some remarks and further research problems pertaining to characterizations of matrix equalities for generalized inverses of matrix products.
2. Some Preliminaries
We begin with presentations and expositions of a series of known facts and results regarding matrices and their ordinary operations, which can be found in various reference books about linear algebra and matrix theory (cf. [
2,
15,
16,
17]).
Note from the definitions of generalized inverses of a matrix that they are in fact defined to be (common) solutions of some matrix equations. Thus, analytical expressions of generalized inverses of matrices, as shown below, can be written as certain matrix-valued functions with one or more variable matrices.
Lemma 1 ([
1]).
Let Then, the general expression of of A can be written aswhere and are arbitrary. There is much good to be said about equalities and inequalities for ranks of matrices. In what follows, we present a series of well-known or established results and facts concerning ranks of matrices, which we shall use to deal with matrix equality problems and matrix set inclusion problems with regard to the generalized inverses of matrix products described above.
Lemma 2. Let and Then, Lemma 3 ([
18]).
Let and Then,In particular, the following results hold:
- (a)
⇔
- (b)
⇔
- (c)
⇔
- (d)
and
Lemma 4 ([
8]).
Let and Then, Lemma 5 ([
18]).
Let and Then,hold for all and In particular, the following results hold:- (a)
The rank of satisfies the following inequalities: - (b)
The rank of satisfies the following inequalities: - (c)
- (d)
⇔ and
- (e)
⇔ and
Lemma 6 ([
19,
20]).
Let and be given. Then, There is no doubt that analytical formulas for calculating ranks of matrices can be used to establish and analyze various complicated matrix expressions and matrix equalities. Specifically, the rank equalities and their consequences in the above four lemmas are understandable in elementary linear algebra. When the matrices are given in various concrete forms, these established results can be simplified further by usual computations of matrices, so that we can employ them to describe a variety of concrete matrix equalities that involve products of matrices and their generalized inverses in matrix analysis and applications.
At the end of this section, we give a known result regarding a matrix equality composed of six matrices and their generalized inverses.
Lemma 7 ([
21]).
Let , , , , and be given. Then, the following five statements are equivalent:- (a)
The equality holds for all and
- (b)
The product is invariant with respect to the choices of and and
- (c)
One of the following six conditions holds:
- (i)
and
- (ii)
and
- (iii)
and
- (iv)
and
- (v)
and
- (vi)
and
- (d)
One of the following six conditions holds:
- (i)
and
- (ii)
and
- (iii)
and
- (iv)
and
- (v)
and
- (vi)
and
- (e)
One of the following six conditions holds:
- (i)
and
- (ii)
and
- (iii)
and
- (iv)
and
- (v)
and
- (vi)
Obviously, all the preceding formulas and facts belong to mathematical competencies and conceptions in matrix algebra. Specifically, the rank equalities for block matrices in Lemma 7 are easy to understand and grasp, and thereby, they can technically and perspicuously be utilized to establish and describe many kinds of concrete matrix expressions and equalities consisting of matrices and their generalized inverses. As a matter of fact, the matrix rank method has been highly regarded as the ultimate manifestation of the characterizations of algebraic matrix equalities in comparison with other algebraic tools in matrix theory.
3. Set Inclusions for Generalized Inverses of Matrix Products
The formulas and facts in Lemma 7 are explicit in form and easily manageable for the different choices of the given matrices, and thereby, they are readily used to solve a wide range of problems for establishing algebraic equalities for matrices and generalized inverses. In this section, we propose a rich variety of matrix set inclusions that are originated from the reverse-order laws in (
3)–(7) and derive several groups of equivalent statements associated with these matrix set inclusions through the use of formulas and facts prepared in
Section 2.
Referring to Lemma 7, we can perspicuously illustrate how to describe matrix set inclusions for generalized inverses of different matrices.
Theorem 1. Let , , , , and Then, we have the following results:
- (a)
The following five statements are equivalent:
- (i)
namely, holds for all and
- (ii)
- (iii)
- (iv)
or
- (v)
or
- (b)
The following four statements are equivalent:
- (i)
namely holds for all and
- (ii)
- (iii)
- (iv)
or
- (c)
Let and Then, the following four statements are equivalent:
- (i)
namely holds for all
- (ii)
- (iii)
- (iv)
or
Proof. By definition, the set inclusion is equivalent to holds for all and . In this case, replacing with and with in Lemma 7(a) and (e), and then simplifying lead to the equivalence of (i) and (iv) in (a) of this theorem.
Furthermore, it is easy to verify by elementary block matrix operations that the following rank equality:
holds. Substituting it into (vi) of Lemma 7(e) leads to the equivalence of (iv) and (v) in (a) of this theorem.
Pre- and post-multiplying both sides of the set inclusion in (i) of (a) of this theorem with A, respectively, lead to (ii) and (iii) in (a) of this theorem. Conversely, post- and pre-multiplying both sides of the set inclusions in (ii) and (iii) of (a) of this theorem with A, respectively, lead to (i) in (a) of this theorem.
Results (b) and (c) are direct consequences of (a) under the given assumptions. □
Mindful of the differences of both sides of the matrix set inclusions in the above theorem, we may say that the statements in Theorem 1 in fact provide some useful strategies and techniques of describing matrix set inclusions via matrix rank equalities, and thereby, they can be utilized to construct and solve various equality problems that appear in matrix theory and its applications with regard to products of matrices and their generalized inverses.
In the following, we present some applications of the above results in the characterizations of reverse-order laws for generalized inverses of two or more matrix products. Recall that there were plenty of classic discussions in the literature on the construction and characterization of reverse-order laws for generalized inverses of the matrix product
, which motivated from time to time deep-going considerations and explorations of various universal algebraic methods to deal with reverse-order law problems. The first reverse-order law in (
3) was proposed and well approached in the theory of generalized inverses of matrices; see, e.g., [
7,
9,
14,
22,
23,
24]. In view of this fact, we first derive from Theorem 1(c) a group of equivalent facts concerning the matrix set inclusion
and its variation forms.
Theorem 2. Let and be given. Then, the following 23 statements are equivalent:
- (i)
- (ii)
- (iii)
- (iv)
- (v)
- (vi)
- (vii)
- (viii)
- (ix)
- (x)
- (xi)
- (xii)
- (xiii)
- (xiv)
- (xv)
- (xvi)
- (xvii)
- (xviii)
- (xix)
- (xx)
or
- (xxi)
or for some/all and
- (xxii)
or
- (xxiii)
or
Proof. Replacing
C with
in (i) and (iv) of Theorem 1(c), we see that (i) in this theorem holds if and only if
or
establishing the equivalence of (i) and (xx).
By (i) and (v) in Theorem 1(a), (ii) in this theorem holds if and only if
or
establishing the equivalence of (ii) and (xx).
By (i) and (v) in Theorem 1(a), (iii) in this theorem holds if and only if
or
establishing the equivalence of (iii) and (xx).
The equivalences of (i) and (xii)–(xx) follow from the following rank equalities:
The equivalences of (i)–(xi) in this theorem follow from (i), (ii), and (iii) in Theorem 1(a). The equivalences of (i) and (xx)–(xxiii) in this theorem were proven in [
14]. □
Theorem 3. Let and Then, the following 16 statements are equivalent:
- (i)
i.e.,
- (ii)
- (iii)
- (iv)
- (v)
- (vi)
- (vii)
- (viii)
- (ix)
- (x)
- (xi)
- (xii)
- (xiii)
- (xiv)
- (xv)
- (xvi)
Proof. The equivalence of (i) and (xvi) follows from the well-known rank formula:
see [
25,
26].
By (i) and (iv) in Theorem 1(b), (ii) in this theorem holds if and only if
or
Note also that is a special case of the above matrix rank equality, thus establishing the equivalence of (ii) and (xvi).
The equivalences of (i) and (ix)–(xvi) in this theorem follow from (
27)–(29), and
The equivalences of (i)–(viii) in this theorem follow from (i), (ii), and (iii) in Theorem 1(b). □
In the following, the author presents two groups of results on set inclusions associated with the two reverse-order laws and and their variation forms for a triple matrix product .
Theorem 4. Let and be given, and denote . Then, the following 36 statements are equivalent:
- (i)
- (ii)
- (iii)
- (iv)
- (v)
- (vi)
- (vii)
- (viii)
- (ix)
- (x)
- (xi)
- (xii)
- (xiii)
- (xiv)
- (xv)
- (xvi)
- (xvii)
- (xviii)
- (xix)
- (xx)
- (xxi)
- (xxii)
- (xxiii)
- (xxiv)
- (xxv)
- (xxvi)
- (xxvii)
- (xxviii)
- (xxix)
- (xxx)
- (xxxi)
- (xxxii)
- (xxxiii)
- (xxxiv)
- (xxxv)
or for some/all and
- (xxxvi)
or
Proof. By (i) and (iv) in Theorem 1(b), (i) in this theorem holds if and only if
establishing the equivalence of (i) and (xxxvi). The equivalences of (i)–(xxviii) in this theorem can also be shown by Theorem 1(b) and (c). The details of the proofs are omitted here due to space limitation.
The equivalences of (i), (xxix)–(xxxiv), and (xxxvi) follow from the following basic facts:
The equivalence of (xxxv) and (xxxvi) follows from (19). □
Theorem 5. Let and be given, and denote . Then, the following 27 statements are equivalent:
- (i)
- (ii)
- (iii)
- (iv)
and
- (v)
and
- (vi)
- (vii)
- (viii)
- (ix)
and
- (x)
and
- (xi)
- (xii)
- (xiii)
- (xiv)
and
- (xv)
and
- (xvi)
- (xvii)
- (xviii)
- (xix)
and
- (xx)
and
- (xxi)
- (xxii)
- (xxiii)
- (xxiv)
- (xxv)
or
- (xxvi)
or and
- (xxvii)
or and
Proof. We first obtain from Lemma 5(b) the following inequalities:
which we shall use in the sequel. By (i) and (iv) in Theorem 1(b), (i) in this theorem holds if and only if
holds for all
. Applying (
25) to the block matrix in (
33), we obtain
Substituting this result into the second equality in (
33) and simplifying by (
30)–(32) lead to
Combining (
35) with the first condition
in (
33) leads to the equivalence of (i) and (xxv).
The equivalences of (i)–(xx) in this theorem can be shown from Theorem 1(a) and (b) by similar approaches, and therefore, their proofs are omitted here.
From Lemma 5(b) also, we obtain the following inequalities:
These facts imply that (xxv), (xxvi), and (xxvii) are equivalent.
The equivalences of (i) and (xxi)–(xxiv) follow from the basic rank equalities , , and . □
Theorem 6. Let and be given, and denote Then, the following 36 statements are equivalent:
- (i)
- (ii)
- (iii)
- (iv)
- (v)
- (vi)
- (vii)
- (viii)
- (ix)
- (x)
- (xi)
- (xii)
- (xiii)
- (xiv)
- (xv)
- (xvi)
- (xvii)
- (xviii)
- (xix)
- (xx)
- (xxi)
- (xxii)
- (xxiii)
- (xxiv)
- (xxv)
- (xxvi)
- (xxvii)
- (xxviii)
- (xxix)
- (xxx)
- (xxxi)
- (xxxii)
- (xxxiii)
- (xxxiv)
or
- (xxxv)
or
- (xxxvi)
or
Proof. We first obtain from Lemma 5(b) the following inequalities:
By (i) and (iv) in Theorem 1(b), (i) in this theorem holds if and only if
holds for all
, where by (
25), the maximum rank of the block matrix in (
39) is
Substituting this result into the second equality in (
39) and simplifying by (
36)–(38) lead to
Combining (
41) with the first condition
in (
39) leads to the equivalence of (i) and (xxxiv). The equivalences of (i)–(xxxiii) can be shown by similar approaches, and therefore, the details are omitted.
The equivalences of (xxxiv), (xxxv), and (xxxvi) in this theorem follow from Lemma 5(b). □
Given the above results and their derivations, we believe intuitively that there exist many possible variations and extensions of the matrix set inclusion problems. We conclude this section with direct applications of the preceding results to some specified operations of matrices.
Corollary 1. Let be given. Then, the following matrix set inclusions always hold: Proof. Recall that the following three rank formulas:
are well known in elementary linear algebra. In this situation, applying Theorem 2(i) and (xx), Theorem 5(i) and (xxv), and the above three rank formulas to the matrix products
,
, and
lead to (
42)–(48). □
Theorem 7. Let be given. Then, the following six statements are equivalent:
- (i)
- (ii)
- (iii)
- (iv)
- (v)
- (vi)
or
Proof. Writing the sum as and applying Theorem 4 to this triple matrix product yield the desired results. □
4. Concluding Remarks
The author collected and proposed a series of known and novel equalities for products of matrices and their generalized inverses, including a wide range of reverse-order laws for generalized inverses (matrix set inclusions associated with generalized inverses), and also presented various necessary and sufficient conditions for these matrix equalities to hold through the skillful use of various equalities and inequalities for ranks of matrices. Clearly, this study is a critical manifestation of how to construct reasonable matrix equalities that involve generalized inverses and how to describe these equalities by means of the cogent matrix rank method.
Finally, the author gives some additional remarks about relevant research problems regarding reverse-order laws. It has been recognized that the construction and characterization of reverse-order laws for generalized inverses of multiple matrix products are a huge algebraic work in matrix theory and applications, which mainly includes the following research topics:
- (I)
Construct and classify different types of reverse-order laws.
- (II)
Establish necessary and sufficient conditions for each reverse-order law to hold through the use of various matrix analysis methods and techniques.
Furthermore, the author points out that this kind of research problems can reasonably be proposed and studied for generalized inverses of elements in other algebraic systems, in which many different kinds of generalized inverses can properly be defined; see, e.g., [
22,
27,
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
41] for their expositions.