Abstract
In this paper, we obtain a new equivalent fixed-point form of the linear complementarity problem by introducing a relaxed matrix and establish a class of relaxed modulus-based matrix splitting iteration methods for solving the linear complementarity problem. Some sufficient conditions for guaranteeing the convergence of relaxed modulus-based matrix splitting iteration methods are presented. Numerical examples are offered to show the efficacy of the proposed methods.
MSC:
90C33, 65F10, 65F50, 65G40
1. Introduction
In this paper, we focus on the iterative solution of the linear complementarity problem, abbreviated as ‘LCP()’, whose form is
where and are given, and is unknown, and for two matrices and the order means for any i and j. As is known, as a very useful tool in many fields, such as the free boundary problem, the contact problem, option pricing problem, nonnegative constrained least squares problems, see [1,2,3,4,5], LCP() is most striking in the articles, see [6,7,8,9,10,11].
Designing iteration methods to fast and economically computing the numerical solution of the LCP() is one of the hotspot nowadays, which were widely discussed in the articles, see [1,2,8,9,12,13] for more details. Recently, by using and with for the LCP(), Bai in [14] expressed the LCP() as the fixed-point form
where is a splitting of matrix A and denotes a positive diagonal matrix, and then first desgined a class of modulus-based matrix splitting (MMS) iteration methods. Since the MMS method has the advantages of simple form and fast convergence rate, it was regarded as a powerful method of solving the LCP(), and raises concerns. For several variants and applications of the MMS method, one can see [2,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32].
In this paper, based on the MMS method, we will create a type of new iteration methods to solve the LCP(). Our strategy is to introduce a relaxed matrix for both sides of Equation (2) and obtain a new equivalent fixed-point form of the LCP(). Based on this new equivalent form, we can establish a class of relaxed modulus-based matrix splitting (RMMS) iteration methods for solving the LCP(). This class of new iteration methods not alone inherits the virtues of the modulus-based methods. A more important one is that we can choose the relaxed matrix to enhance the computational efficiency of the classical MMS method in [14]. To guarantee the convergence of the RMMS iteration method, some sufficient conditions will be given under suitable conditions. Numerical examples are provided to verify that the RMMS iteration method are feasible and overmatch the classical MMS iteration method in terms of the computational efficiency.
The layout of this paper is as follows. In Section 2, for the sake of discussion in the rest of this paper, we provide some necessary definitions, lemmas and notations. In Section 3, we present a class of relaxed modulus-based matrix splitting (RMMS) iteration methods to solve the LCP(). The convergence conditions of the RMMS iteration method are presented in Section 4. Numerical experiments with regard to the proposed methods compared to the classical MMS iteration method are reported in Section 5. In Section 6, we summarize this work. Finally, some simple discussions are given in Section 7.
2. Preliminaries
Some necessary definitions, lemmas and notations, which are used in the sequel discussions, are primitively introduced in this section.
Let . Then it is named as a Z-matrix if ; a nonsingular M-matrix if A is a Z-matrix and ; its comparison matrix is with being
Further, a matrix is named as an H-matrix if is an M-matrix; an -matrix if A is an H-matrix with ; a P-matrix if all of its principal minors are positive [33,34]. In addition, we let .
Let be a splitting of matrix . Then it is named as an M-splitting if M is a nonsingular M-matrix and ; an H-splitting if is a nonsingular M-matrix. As is known, if is an M-splitting and A is a nonsingular M-matrix, then , where indicates the spectral radius (the maximum value of the absolute value of the eigenvalues) of the matrix, see [33,34]. Finally, denotes the Euclidean norm on .
Lemma 1
([19]). Let with . If there exists with such that , then .
Lemma 2
([35]). Let be an H-matrix, D be the diagonal part of the matrix A, and . Then matrices A and are nonsingular, and .
Lemma 3
([34]). Let A be an M-matrix and B be a Z-matrix with . Then B is an M-matrix.
In addition, there exists a famous result for the existence and uniqueness of the LCP(), that is to say, the LCP() has a unique solution if and only if a matrix A is a P-matrix, see [1]. Obviously, when A is an -matrix, the LCP() has a unique solution as well.
3. Relaxed Modulus-Based Matrix Splitting Method
In this section, we introduce a class of relaxed modulus-based matrix splitting (RMMS) iteration methods for solving the LCP(). For this purpose, by introducing an identical equation for Equation (2), where is a given relaxed matrix, then we obtain
or,
Based on Equations (3) and (4), we can establish the following iteration method, which is named as a class of relaxed modulus-based matrix splitting (RMMS) iteration methods for the LCP().
Method 1.
Let be a splitting of the matrix . Let and matrix be nonsingular, where Ω is a positive diagonal matrix and is a given relaxed matrix. Given an initial vector , compute
where can be obtained by solving the linear system
or
Clearly, when , method 1 reduces to the well-known MMS iteration method in [14]. Similarly, by introducing an identical equation, Wu and Li in [22] presented two-sweep modulus-based matrix splitting iteration methods for the LCP. The goal of introducing the relaxed matrix R in (5) or (6) is that the computational efficiency of the RMMS iteration method may be better than the classical MMS iteration method in [14].
In fact, method 1 is a general framework of RMMS iteration methods for solving the LCP. This implies that we can construct some concrete forms of RMMS iteration methods by the specific splitting matrix of matrix A and the iteration parameters. If we take
where D, L and U, respectively, are the diagonal, the strictly lower-triangular and the strictly upper-triangular parts of the matrix A, then this leads to the relaxed modulus-based AOR (RMAOR) iteration method
with . When , , and , respectively, the RMAOR method (7) can yield the corresponding relaxed modulus-based SOR (RMSOR) method, the relaxed modulus-based Gauss–Seidel (RMGS) method and the relaxed modulus-based Jacobi (RMJ) method.
4. Convergence Analysis
In this section, some sufficient conditions are given to guarantee the convergence of method 1.
Theorem 1.
Let be a splitting of the matrix with A being a P-matrix, and matrix be nonsingular, where Ω is a positive diagonal matrix and is a given relaxed matrix. Let
where
When , Method 1 with converges to the unique solution of the LCP for an initial vector.
Proof.
Let be a solution pair of the LCP(). Then satisfies
This indicates that
Obviously, when , method 1 is convergent. □
Since
the following corollary can be obtained.
Corollary 1.
Let be a splitting of the matrix with A being a P-matrix, and matrix be nonsingular, where Ω is a positive diagonal matrix and is a given relaxed matrix. Let
where
When , Method 1 with converges to the unique solution of the LCP for an initial vector.
Similar to the above proof, if we take instead of , we can also obtain Corollary 2.
Corollary 2.
Let be a splitting of the matrix with A being a P-matrix, and matrix be nonsingular, where Ω is a positive diagonal matrix and is a given relaxed matrix. Let
and
When or , Method 1 with converges to the unique solution of the LCP for an initial vector.
Theorem 2.
Let be a splitting of the matrix with A being a P-matrix, and matrix be nonsingular and matrix be nonsingular M-matrix, where Ω is a positive diagonal matrix and is a given relaxed matrix. Let
When , method 1 with converges to the unique solution of the LCP for an initial vector.
Proof.
This implies
Further, we have
where
Clearly, when , Method 1 is convergent. □
Similarly, we have Corollary 3.
Corollary 3.
Let be a splitting of the matrix with A being a P-matrix, and matrix be nonsingular and be nonsingular M-matrix, where Ω is a positive diagonal matrix and is a given relaxed matrix. Let
When , method 1 with converges to the unique solution of the LCP for an initial vector.
Theorem 3.
Let be a splitting of the matrix , where A is an -matrix, and be an M-matrix with . Let matrix satisfy and . Then method 1 with converges to the unique solution of the LCP for an initial vector.
Proof.
First, we prove that is an M-matrix. In fact, since
we obtain
Further, we have
which is equal to
In addition,
Therefore,
where matrix satisfy
It noted that
Based on Lemma 3, matrix is an M-matrix. Based on (10) and (11), we have
which implies that is an matrix.
Based on (9) and Lemma 2, we have
By calculation, it is easy to obtain that matrix is a nonnegative diagonal matrix. It follows that matrix
is an M-matrix. Further, there exists a positive vector u such that
Therefore,
Let
Then
Based on Lemma 1, we can obtain that . which completes the proof. □
When matrix R is a diagonal matrix, Corollary 4 can be obtained.
Corollary 4.
Let be a splitting of the matrix , where A is an -matrix, and be an M-matrix with being a diagonal matrix. Let matrix satisfy and . Then Method 1 with converges to the unique solution of the LCP for an initial vector.
When matrix R is a zero matrix, Corollary 4 reduces to the following result, which is a main result in [36].
Corollary 5.
[36] Let be a splitting of the matrix , where A is an -matrix, and be an M-matrix. Let satisfy and . Then method 1 with and converges to the unique solution of the LCP for an initial vector.
Further, when matrix R is a zero matrix and is a positive diagonal matrix, Corollary 4 reduces to the following result, which is a main result in [37].
Corollary 6.
[37] Let be a splitting of the matrix , where A is an -matrix, and be an M-matrix. Let the positive diagonal matrix satisfy . Then Method 1 with and converges to the unique solution of the LCP for an initial vector.
Theorem 4.
Let and , where is an -matrix. Assume that the positive diagonal matrix Ω satisfies , matrix R is a lower-triangular matrix with , and , where . Then for an initial vector, the RMAOR iteration method with is convergent if the parameters α and β satisfy
Proof.
From the proof of Theorem 3, we take
Since and , obviously, matrix is an -matrix. Based on Lemma 2, we have
with and . Let
Then by the simple computations we have
Since
and
then
where
Note that . Then there exists an arbitrary small number such that
where and . Based on Perron–Frobenius theorem in [34], there exists a positive vector such that
Therefore,
Based on Lemma 1, we can obtain that , which implies that the result of Theorem 4 is true. □
When matrix R in Theorem 4 is a nonpositive diagonal matrix, Theorem 4 reduces to the following result.
Corollary 7.
Let and , where is an -matrix. Assume that the positive diagonal matrix Ω satisfies , matrix R is a nonpositive diagonal matrix and . Then for an initial vector, the RMAOR iteration method with is convergent if the parameters α and β satisfy
5. Numerical Experiments
In this section, we utilize two examples to illustrate the computational efficiency of the RMMS iteration method in terms of iteration steps (IT) and elapsed CPU time (CPU) in seconds, and the following norm of absolute residual vectors (RES)
where the minimum is componentwisely taken.
To show the advantages of the RMMS iteration method, we compare the RMMS iteration method with the classical MMS iteration method. During these tests, all initial vectors are chosen to be
all the iterations are stopped once RES() or the number of iteration exceeds 500. For convenience, here we consider the relaxed modulus-based SOR (RMSOR) method and the modulus-based SOR (MSOR) method. The basis of this comparison is that the modulus-based SOR (MSOR) method in [14] outperforms other forms of the modulus-based matrix splitting iteration method, the projected relaxation methods and the modified modulus method. In actual implementations, we take and for the RMSOR method and the MSOR method. All of computations are performed in MATLAB 7.0. In addition, in the following tables, ‘–’ denotes that the iteration steps exceed 500 or the residual norms exceed .
In our computations, we take the following two examples, which were considered in [14,18]. Parts of two examples are symmetry, see case 1 of Example 1 and the diagonal matrix of Example 2. Of course, we consider the non-symmetry case, see case 2 of Example 1 and Example 2.
Example 1
([14]). Let the LCP() be given by and , where
with
and
is the unique solution of the LCP().
Example 2 (([18]). Let the LCP() be given by
with
In Examples 1 and 2, the value of m is chosen to be a prescribed positive integer, and then . For Example 1, we consider two cases: one is the symmetric case and the other is the nonsymmetric case. For the former, we take ; for the latter, we take and . In the implementations, the value of the iteration parameter α used in both the RMSOR method and the MSOR method is chosen to be 1.3. For convenience, the value of matrix is chosen to be for the RMSOR method, where I is the identity matrix.
For Example 1, for different problem sizes of m and the different values of , the numerical results (including IT, CPU and RES) for the RMSOR method and the MSOR method are listed in Table 1 when . Clearly, the RMSOR method and the MSOR method can rapidly compute a satisfactory approximation to the solution of the LCP().
Table 1.
Numerical results for Example 1 with .
From the numerical results in Table 1, fixed the value of , the iteration steps and the CPU times of the RMSOR method and the MSOR method are incremental when the problem size is increasing. Whereas, fixing the value of the problem size , the iteration steps and the CPU times of the RMSOR method and the MSOR method are descended when the value of is increasing. This implies that both may be fit for the larger when as a solver for solving the LCP().
Base on the presented numerical results in Table 1, our numerical experiment show that the RMSOR method compared to the MSOR method requires less iteration steps and CPU times. This shows that when both RMSOR and MSOR methods are used to solve the LCP(), the former is superior the latter.
Table 2 presents the numerical results of the nonsymmetric case of Example 1. Specifically, some numerical results (including IT, CPU and RES) for the RMSOR method and the MSOR method for different problem sizes of m and the different values of are listed when and . Table 2 shows that the RMSOR method and the MSOR method can still rapidly compute a satisfactory approximation to the solution of the LCP().
Table 2.
Numerical results for Example 1 with and .
From Table 2, these numerical results further verify the observed results from Table 1. Our numerical experiments show that the computational efficiency of the RMSOR method is better than the MSOR method. It is noted that compared with the symmetric case, the iteration steps and the CPU times of the RMSOR method and the MSOR method slightly decrease in the nonsymmetric case.
Table 3 presents the numerical results of Example 2. To compare the RMSOR method with the MSOR method, Table 3 lists the numerical results (including IT, CPU and RES) for the different values of under the same iteration parameter . From the presented numerical results in Table 3, our numerical experiments show that that the RMSOR method requires less iteration steps and CPU times than the MSOR method. The numerical results in Table 3 confirm that the RMSOR method is still superior to the MSOR method.
Table 3.
Numerical results for Example 2.
6. Conclusions
In this paper, by introducing a relaxed matrix to obtain a new equivalent fixed-point form of the LCP(), we establish a class of relaxed modulus-based matrix splitting (RMMS) iteration methods. Some sufficient conditions are presented to guarantee the convergence of RMMS iteration methods. Numerical examples show that the RMMS iteration method is feasible and overmatches the classical MMS iteration method under certain conditions.
It is noted that our approach can be extended to other modulus-based matrix splitting methods, such as two-step modulus-based matrix splitting iteration methods, accelerated modulus-based matrix splitting methods, and so on.
7. Discussion
From our numerical experiments, we find that both the MMS iteration method and the RMMS iteration method are sensitive to the iteration parameter. This implies that the iteration parameter may play an important part in these two methods. Therefore, the determination of the optimal parameters for these two methods could be still an open problem, which is an interesting topic in the future.
Author Contributions
Conceptualization, methodology, software S.W.; original draft preparation, C.L.; data curation, P.A.; guidance, review and revision, P.A.; translation, editing and review, S.W.; validation, S.W. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by National Natural Science Foundation of China (No.11961082).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
The authors would like to thank two anonymous referees for providing helpful suggestions, which greatly improved the paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Cottle, R.W.; Pang, J.-S.; Stone, R.E. The Linear Complementarity Problem; Academic: San Diego, CA, USA, 1992. [Google Scholar]
- Murty, K.G. Linear Complementarity, Linear and Nonlinear Programming; Heldermann: Berlin, Germany, 1988. [Google Scholar]
- Cottle, R.W.; Dantzig, G.B. Complementary pivot theory of mathematical programming. Linear Algebra Appl. 1968, 1, 103–125. [Google Scholar] [CrossRef]
- Schäfer, U. A linear complementarity problem with a P-matrix. SIAM Rev. 2004, 46, 189–201. [Google Scholar] [CrossRef]
- Zheng, N.; Hayami, K.; Yin, J.-F. Modulus-type inner outer iteration methods for nonnegative constrained least squares problems. SIAM J. Matrix Anal. Appl. 2016, 37, 1250–1278. [Google Scholar] [CrossRef]
- Ahn, B.H. Solutions of nonsymmetric linear complementarity problems by iterative methods. J. Optim. Theory Appl. 1981, 33, 175–185. [Google Scholar] [CrossRef]
- Cryer, C.W. The solution of a quadratic programming using systematic overrelaxation. SIAM J. Control. 1971, 9, 385–392. [Google Scholar] [CrossRef]
- Kappel, N.W.; Watson, L.T. Iterative algorithms for the linear complementarity problems. Int. J. Comput. Math. 1986, 19, 273–297. [Google Scholar] [CrossRef]
- Mangasarian, O.L. Solutions of symmetric linear complementarity problems by iterative methods. J. Optim. Theory Appl. 1977, 22, 465–485. [Google Scholar] [CrossRef]
- Pang, J.-S. Necessary and sufficient conditions for the convergence of iterativemethods for the linear complementarity problem. J. Optim. Theory Appl. 1984, 42, 1–17. [Google Scholar] [CrossRef]
- Tseng, P. On linear convergence of iterative methods for the variational inequality problem. J. Comput. Appl. Math. 1995, 60, 237–252. [Google Scholar] [CrossRef]
- Bai, Z.-Z. On the convergence of the multisplitting methods for the linear complementarity problem. SIAM J. Matrix Anal. Appl. 1999, 21, 67–78. [Google Scholar] [CrossRef]
- Bai, Z.-Z.; Evans, D. Matrix multisplitting methods with applications to linear complementarity problems: Parallel asynchronous methods. Int. J. Comput. Math. 2002, 79, 205–232. [Google Scholar] [CrossRef]
- Bai, Z.-Z. Modulus-based matrix splitting iteration methods for linear complementarity problems. Numer. Linear Algebra Appl. 2010, 17, 917–933. [Google Scholar] [CrossRef]
- Van Bokhoven, W.M.G. A Class of Linear Complementarity Problems is Solvable in Polynomial Time; Unpublished Paper; Dept. of Electrical Engineering, University of Technology: Delft, The Netherlands, 1980. [Google Scholar]
- Dong, J.-L.; Jiang, M.-Q. A modified modulus method for symmetric positive-definite linear complementarity problems. Numer. Linear Algebra Appl. 2009, 16, 129–143. [Google Scholar] [CrossRef]
- Hadjidimos, A.; Tzoumas, M. Nonstationary extrapolated modulus algorithms for the solution of the linear complementarity problem. Linear Algebra Appl. 2009, 431, 197–210. [Google Scholar] [CrossRef]
- Bai, Z.-Z.; Zhang, L.-L. Modulus-based synchronous multisplitting iteration methods for linear complementarity problems. Numer. Linear Algebra Appl. 2013, 20, 425–439. [Google Scholar] [CrossRef]
- Bai, Z.-Z.; Zhang, L.-L. Modulus-based synchronous two-stage multisplitting iteration methods for linear complementarity problems. Numer. Algor. 2013, 62, 59–77. [Google Scholar] [CrossRef]
- Zheng, N.; Yin, J.-F. Accelerated modulus-based matrix splitting iteration methods for linear complementarity problems. Numer. Algor. 2013, 64, 245–262. [Google Scholar] [CrossRef]
- Zhang, L.-L. Two-step modulus-based matrix splitting iteration method for linear complementarity problems. Numer. Algor. 2011, 57, 83–99. [Google Scholar] [CrossRef]
- Wu, S.-L.; Li, C.-X. Two-sweep modulus-based matrix splitting iteration methods for linear complementarity problems. J. Comput. Math. 2016, 302, 327–339. [Google Scholar] [CrossRef]
- Li, W. A general modulus-based matrix splitting method for linear complementarity problems of H-matrices. Appl. Math. Lett. 2013, 26, 1159–1164. [Google Scholar] [CrossRef]
- Hadjidimos, A.; Lapidakis, M.; Tzoumas, M. On iterative solution for linear complementarity problem with an H+-matrix. SIAM J. Matrix Anal. Appl. 2011, 33, 97–110. [Google Scholar] [CrossRef]
- Ma, C.-F.; Huang, N. Modified modulus-based matrix splitting algorithms for a class of weakly nondifferentiable nonlinear complementarity problems. Appl. Numer. Math. 2016, 108, 116–124. [Google Scholar] [CrossRef]
- Xia, Z.-C.; Li, C.-L. Modulus-based matrix splitting iteration methods for a class of nonlinear complementarity problem. Appl. Math. Comput. 2015, 271, 34–42. [Google Scholar] [CrossRef]
- Xie, S.-L.; Xu, H.-R.; Zeng, J.-P. Two-step modulus-based matrix splitting iteration method for a class of nonlinear complementarity problems. Linear Algebra Appl. 2016, 494, 1–10. [Google Scholar] [CrossRef]
- Huang, N.; Ma, C.-F. The modulus-based matrix splitting algorithms for a class of weakly nondifferentiable nonlinear complementarity problems. Numer. Linear Algebra Appl. 2016, 23, 558–569. [Google Scholar] [CrossRef]
- Hong, J.-T.; Li, C.-L. Modulus-based matrix splitting iteration methods for a class of implicit complementarity problems. Numer. Linear Algebra Appl. 2016, 23, 629–641. [Google Scholar] [CrossRef]
- Wu, S.-L.; Guo, P. Modulus-based matrix splitting algorithms for the quasi-complementarity problems. Appl. Numer. Math. 2018, 132, 127–137. [Google Scholar] [CrossRef]
- Mezzadri, F.; Galligani, E. Modulus-based matrix splitting methods for horizontal linear complementarity problems. Numer. Algor. 2020, 83, 201–219. [Google Scholar] [CrossRef]
- Zheng, N.; Yin, J.-F. Convergence of accelerated modulus-based matrix splitting iteration methods for linear complementarity problem with an H+-matrix. J. Comput. Appl. Math. 2014, 260, 281–293. [Google Scholar] [CrossRef]
- Varga, R.S. Matrix Iterative Analysis; Prentice-Hall: Englewood Cliffs, NJ, USA, 1962. [Google Scholar]
- Berman, A.; Plemmons, R.J. Nonnegative Matrices in the Mathematical Sciences; Academic: New York, NY, USA, 1979. [Google Scholar]
- Frommer, A.; Mayer, G. Convergence of relaxed parallel multisplitting methods. Linear Algebra Appl. 1989, 119, 141–152. [Google Scholar] [CrossRef]
- Xu, W.-W. Modified modulus-based matrix splitting iteration methods for linear complementarity problems. Numer. Linear Algebra Appl. 2015, 22, 748–760. [Google Scholar] [CrossRef]
- Zhang, L.-L.; Ren, Z.-R. Improved convergence theorems of modulus-based matrix splitting iteration methods for linear complementarity problems. Appl. Math. Lett. 2013, 26, 638–642. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).