Abstract
In this paper we design a fast bisection algorithm for computing a prescribed eigenvalue of a symmetric quasiseparable matrix represented by its Cholesky-like factorization , where is a lower triangular quasiseparable matrix and is a signature matrix. The workhorse of the algorithm is an efficient linear-time scheme for updating the factorization under shifting. Numerical experiments illustrate the effectiveness and the robustness of the proposed method.
MSC:
65F15; 65F05; 65F25
1. Introduction
Symmetric eigenvalue problems arise, directly or indirectly, in many areas of science and engineering. Bisection is one of the standard tools for computing all the eigenvalues of a matrix, or only a selected few, and it remains attractive because it lends itself to parallel and concurrent implementation. We do not deal here with the computation of eigenvectors; this can be carried out by any preferred technique, for instance inverse iteration with shift. There is currently a growing interest in the design of efficient eigenvalue algorithms for quasiseparable and, more generally, rank-structured matrices (see, for instance, [1,2]). Such matrices arise naturally in applications, for example, in structural mechanics and fluid dynamics, through the spatial discretization of partial differential equations and integral equations. They are often very large, but they are structured, in the sense that their off-diagonal blocks have low rank relative to the size of the matrix. The class of quasiseparable matrices contains the banded matrices as a subclass.
Fast adaptations of the bisection method for the eigenvalue computation of Hermitian quasiseparable matrices have been proposed in [3,4]. These methods rely on efficient schemes for evaluating the Sturm sequence of polynomials associated with a Hermitian quasiseparable matrix by means of short-term recurrence relations. For quasiseparable matrices of order one, such a scheme was first presented in [5]. Polynomials and recurrences lead to elegant and theoretically fast algorithms, but they also cause serious numerical stability problems in floating-point arithmetic. To mitigate these issues, scaling procedures are introduced in [3,4] in order to keep the growth of the intermediate coefficients under control. Even so, these techniques may lose accuracy on matrices with clustered eigenvalues or with entries of widely varying magnitude.
Symmetric factorizations provide an alternative to Sturm sequences for counting the positive and the negative eigenvalues of a symmetric matrix A [6]. Let , where , is lower triangular and is a signature matrix, be a Cholesky-like factorization of the shifted matrix . If does not belong to the spectrum of A, then Sylvester’s law of inertia (Theorem 4.5.8 in [7]) shows that the number of eigenvalues of A smaller than equals the number of negative diagonal entries of .
In this paper we present a fast bisection-type method for the eigenvalue computation of Hermitian quasiseparable matrices of arbitrary order. The method is based on an efficient algorithm for updating the triangular factorization of under shifting, that is, for carrying out the transformations and . If all the eigenvalues of lie in the interval , then the initial factorization of can be obtained by updating the Cholesky factorization of the definite matrix or . Efficient linear-complexity algorithms for computing the Cholesky factorization of a definite quasiseparable matrix are available in the literature [2].
The updating procedure makes use of (generalized) orthogonal and hyperbolic transformations [8]. Non-unitary variants of standard algorithms for computing all the eigenvalues of structured matrices have already appeared in the literature (see, for instance, [9,10]). Because the transformations are not unitary, stability is not guaranteed, and such algorithms can occasionally terminate prematurely or lose accuracy through the growth of the coefficients. These occurrences are nevertheless very rare, they can be monitored dynamically, and they can be dealt with by restarting or by shifting.
Whenever our factorization scheme runs to completion, it returns the updated triangular factor , represented via generators, together with the updated signature matrix . Computing the initial Cholesky factorization of a symmetric quasiseparable matrix of size n and quasiseparability order given by its generators costs flops [11], and it returns the generators of the lower and upper triangular factors with quasiseparability order at most . Starting from these generators, the updating procedure computes a representation of in the out-of-band quasiseparable form of [12], in which most of the generators of coincide with those of . The approach therefore saves a substantial amount of work in terms of the leading constants. Moreover, if is semiseparable of order , then the modified factorization can be computed in flops, so that our bisection method needs flops to perform ℓ bisection steps. Numerical results are reported to confirm the effectiveness and the robustness of the resulting algorithm.
The paper is organized as follows. In Section 2 we fix the notation and recall some preliminary results, whereas in Section 3 we review the updating procedure for symmetric triangular factorizations. Section 4 develops our bisection eigenvalue algorithm for symmetric quasiseparable matrices of arbitrary order. Section 5 is devoted to the numerical experiments, which confirm the efficiency and the robustness of the proposed method. Conclusions and directions for future work are given in Section 6.
2. Preliminaries
This paper is concerned with the eigenvalue computation of rank-structured matrices specified in terms of generators. We first recall the following definition [11].
Definition 1.
A matrix is quasiseparable of order κ if there exist lower generators , , , , , and upper generators , , , , , , such that
where we denote
When , the identity matrix of order κ, , the matrix A is called semiseparable of order κ.
The triangular factors of a quasiseparable matrix inherit the rank structure of the matrix itself [2].
Definition 2.
Let be a symmetric possibly indefinite matrix. A Cholesky-like factorization of A has the form where is lower triangular and is some diagonal signature matrix.
A strongly nonsingular symmetric matrix admits an essentially unique Cholesky-like factorization. If A is quasiseparable of order and admits a Cholesky-like factorization with L invertible, then L is quasiseparable of order at most . In addition, by Sylvester’s law of inertia (see Theorem 4.5.8 in [7]), A and have the same numbers of positive, negative and zero eigenvalues.
In this paper we consider the problem of computing a modified Cholesky-like factorization of a quasiseparable matrix under shifting.
Definition 3.
Given the Cholesky-like factorization of the symmetric matrix , that is, where is lower triangular and is some diagonal signature matrix, the modified Cholesky-like factorization problem consists of computing a Cholesky-like factorization of .
Efficient numerical algorithms for solving the modified Cholesky-like factorization problem for matrices of low displacement rank, based on generalized unitary and hyperbolic transformations, are already available (see [8] and the references therein). The following definition generalizes the notion of a unitary matrix to vector spaces equipped with an indefinite scalar product [13].
Definition 4.
For a given diagonal signature matrix a matrix is called D-orthogonal if .
A vector can be reduced to a scalar multiple of the last column of by a D-orthogonal matrix Q, annihilating one entry of x at a time in a process akin to the use of orthogonal Givens rotations. We may therefore restrict ourselves to the case . For stability reasons it is also important to avoid the growth of the intermediate entries. If and satisfies with , then the Givens plane rotation matrix
is such that
If and with , then the hyperbolic rotation matrix
maps x as required
and, moreover, it satisfies
where
Therefore, is D-orthogonal.
Givens and hyperbolic plane rotation matrices are extended to the complementary case by setting
If , then the hyperbolic transformation is not defined. If , then , whereas for we find . We denote by the procedure that, given as input and a signature matrix D, first determines and then applies it to x and to D in order to compute and . We set . A sequence of generalized plane rotations can then be used to annihilate the entries of a vector one after the other.
Remark 1.
Some clarifications about the applicability of Procedure ELIMINATE stated in Algorithm 1 are in order. An annihilation scheme based on generalized plane rotations applied in a prescribed order can clearly break down prematurely. The order used here is dictated by our application to the modified Cholesky-like factorization problem for quasiseparable matrices. As with hyperbolic rotations, hyperbolic and unified Householder reflections [8,14] can be introduced as generalizations of the classical orthogonal Householder elementary matrices. If , then a generalized Householder matrix Q can be determined so that and . Generalizations of the schemes proposed here that use generalized Householder matrices will be treated elsewhere.
| Algorithm 1 Procedure ELIMINATE. Given a vector and a signature matrix , this algorithm attempts to compute a sequence of generalized plane rotations such that the cumulative product satisfies and , with a suitable signature matrix. A Boolean flag is also returned, indicating whether the zeroing scheme has run to completion. |
|
3. An Updating Procedure for Symmetric Triangular Factorizations of Shifted Quasiseparable Matrices
In this section we present the algorithm developed in [15] for the efficient solution of the modified Cholesky-like factorization problem for symmetric quasiseparable matrices. This algorithm is the fundamental building block of the bisection method proposed here.
Let be a symmetric, possibly indefinite, matrix and let be its Cholesky-like triangular factorization, where is lower triangular and is a signature matrix. We are interested in computing a Cholesky-like triangular factorization of the shifted matrix , . Following [8], we first describe the general strategy for the modified Cholesky problem and then show how to adapt it to quasiseparable matrices.
Let us start by observing that
The matrix is again a signature matrix, which makes it possible to devise an orthogonalization-like process that annihilates the entries of and incrementally. Specifically, define such that
When A is quasiseparable, a fast algorithm for computing the updated triangular factorization of can be obtained by interlacing band reduction stages with a bulge chasing scheme. The reduction to banded form is accomplished by a process similar to the modification of the Dewilde-van der Veen method described in [16]. Some of the computations in the band reduction stages can be performed offline and stored, which saves work in the updating procedure.
To convey the idea, and for the sake of simplicity, we begin with quasiseparable matrices of quasiseparability rank . Let be as in (3), where is quasiseparable with upper quasiseparability rank . We first apply a plane rotation in the plane of the coordinates in order to zero some entries in the first row of . Because of the rank structure, this reduces R to the form
The annihilation in the first row generates a bulge in the top-left corner of the matrix R. We then nullify the first column of this bulge by applying two plane rotations in the planes and to annihilate and , respectively. Notice that the newly generated row in the bottom part of R is a linear combination of the first two rows and therefore it exhibits an out-of-band quasiseparable structure. Moreover, after this zeroing, the second row of R also has an out-of-band quasiseparable representation. At the end of the first step the matrix R has the following profile:
The out-of-band quasiseparable structure is preserved throughout the zeroing process, so that, if the algorithm terminates successfully, at the very end the matrix R has the form
where the triangular factor in the lower part of R has an out-of-band quasiseparable parametrization with quasiseparability rank at most 1.
The generalization of this approach to quasiseparable matrices of arbitrary order is considered below in more detail. Let be an upper quasiseparable matrix of order with upper generators , , , , , . Set and such that . Recall that
The updating of and to and proceeds in steps:
where is upper triangular, the matrices are signature matrices and for . The algorithm makes repeated calls to Procedure ELIMINATE, which is always assumed to terminate successfully. The first and the last steps of the algorithm are special, because of boundary constraints and initializations, whereas the ℓ-th step, , is generic. For the sake of illustration, we describe the initial step and a generic step below.
At the first step we consider the matrices
Then, by means of Procedure ELIMINATE we find a generalized QL factorization of of the form
with
for a suitable diagonal signature matrix . The computation of , , and does not depend on the shift and can therefore be carried out offline and stored. It follows that
with
and
where is generated from by modifying its first rows so that
and
The matrix contains the bulge. Depending on the signatures involved, we now apply Givens or hyperbolic plane rotations in the planes of the coordinates , in order to annihilate the first column of . Notice that is such that
The application of Procedure ELIMINATE to the first column of converts into with given by
where is lower triangular. At the end of the first step we therefore find and a diagonal signature matrix such that
with
and
At the second step the reduction is continued by first factoring the matrix
as
We then annihilate the first column of the bulge matrix , which is determined so that
Here and hereafter ⊕ denotes the direct sum of matrices. Note that has a zero entry in position . During the first steps the matrix keeps growing by one row at a time, with zero entries entering from the right. After that, its first row becomes zero and can be discarded, so that the matrix moves down along the main diagonal with the constant size .
At the generic step ℓ the zeroing scheme first computes the generalized QL decomposition of as , with , and , . It then computes and acts on the submatrix given by
where is lower triangular and, moreover, is a trapezoidal matrix such that
The application of Procedure ELIMINATE to the first column of modifies this submatrix so that becomes
where is lower triangular. In this way, after steps, at the very end of the zeroing scheme we obtain a matrix and a signature matrix such that
where
and is lower triangular with a suitable rank structure. Specifically, we obtain that
A formal proof of (4) follows by induction on the structure of the matrices , using the relations given above. Only the vectors and have to be computed in order to obtain the structured representation of the matrix . Therefore, can be represented by a band profile of bandwidth and a quasiseparable structure of order above the band. Such matrices are called out-of-band quasiseparable matrices in [12]. The resulting updating procedure is denoted by . It takes as input the lower triangular matrix represented via generators, the signature matrix and the shift , and whenever is true it returns the generators of together with the signature matrix such that . The computational cost of FACTORIZE can be estimated as , where and denote the cost of performing the matrix multiplication and the cost of factoring the matrix in its QL decomposition, respectively. The worst-case complexity is thus . Recall, however, that is lower triangular of size . Hence, if according to Definition 1 belongs to the subclass of semiseparable matrices of order with , , the overall cost is flops, which is optimal both with respect to the size n and with respect to the quasiseparability order . The same asymptotic cost is obtained for the updating of the Cholesky-like factorization of banded matrices.
4. A Bisection Eigenvalue Algorithm for Symmetric Quasiseparable Matrices
The first step of the bisection method is to choose a starting interval large enough to contain all the eigenvalues of the matrix A. Let the eigenvalues of A be labeled . Assume that , , and that we want to compute an approximation of . The endpoints a and b can be determined by means of Gerschgorin’s theorem or of the Bendixson-Hirsch theorem [17]. The first shift is the midpoint of a and b, so that the original interval is split into two subintervals. Whenever tighter bounds are available for the eigenvalue of interest, say , the first shift is taken as the midpoint of and . The triangular factorization is computed and then the number of eigenvalues of A less than is determined. Observe that, in view of Sylvester’s law of inertia,
The factors and are obtained from the initial Cholesky factorization by means of the updating procedure described in the previous section. The value of is then used to update the lower and the upper bound of , and the procedure is iterated until the difference between these two bounds is smaller than the desired accuracy. The following algorithm outlines the resulting scheme. Without loss of generality we assume .
In the next section we present numerical results that confirm the robustness of Algorithm 2.
| Algorithm 2 Procedure BISECTION. Given , an integer , a lower bound and an upper bound with and the accuracy threshold , this procedure attempts to return the approximation of the m-th eigenvalue of . |
|
5. Numerical Results
We have implemented Procedure BISECTION in MATLAB R2025b and then carried out numerical experiments in two different scenarios. The matrices of the first scenario are generated by the discretization of the linear operator
where is semiseparable, that is,
The operator is discretized over a grid of equispaced points , , , and the integral is approximated by the trapezoidal rule. Setting and we obtain , where and with for . Hence A is symmetric with quasiseparability order . The coefficient matrix can be symmetrized further by noticing that
In our numerical tests we apply Procedure BISECTION to compute selected eigenvalues of the positive definite matrix for different choices of the functions and . The eigendecomposition of the matrix can be exploited by the methods proposed in [18,19] in order to solve certain evolution equations for the operator . The Cholesky factorization of the matrix is generated by the algorithm of [16] applied to the QR decomposition of B. This algorithm returns a lower triangular factor represented in quasiseparable form by generators of length at most .
In the first experiment we consider and
Figure 1 shows the execution times of our updating procedure when it is used to compute the triangular factorization of for , starting from the triangular factor of represented via generators in quasiseparable form. The running times grow linearly with n, in agreement with the theoretical complexity estimates.
Figure 1.
Runtime versus matrix size for the factorization updating algorithm. The linear fit is a good approximation of the measured data; its equation is .
Procedure BISECTION is used to compute the eigenvalues of the matrix of size . It follows from the symmetry of the matrix that the eigenvalue problem is well conditioned. Therefore the MATLAB function eig, which implements a backward-stable algorithm, yields the most accurate numerical results. The input parameters are set to , = , , where is the machine precision. The matrix has clustered eigenvalues located in the interval . In (5) we show on the left the “exact” eigenvalues , , computed by the eig function of MATLAB, and on the right their approximations returned by Procedure BISECTION, together with the corresponding absolute errors. Since the eigenvalues of the leading principal submatrices interlace, by Cauchy’s theorem, the shifted matrices have several nearly singular leading principal submatrices close to convergence. Our method nevertheless behaves robustly. Only for the last two eigenvalues (marked with ★), and only at the last iteration, does the algorithm report a breakdown of the updating procedure. This premature termination does not affect the accuracy of the computed approximations.
In the second experiment we set
whereas the remaining parameters are as in the first experiment. The matrix now has entries of widely varying magnitude. Its eigenvalues lie in the interval . In (6) and (7) we illustrate the convergence of our method when it approximates the three smallest and the three largest eigenvalues of , respectively. Note that the Bauer-Fike theorem [17] predicts an absolute error of order for the computed eigenvalues. The measured errors agree with these conditioning estimates, which confirms the robustness of the method.
In the last experiment we consider
with the remaining parameters as above. Here is a singular diagonal-plus-rank-two matrix. Our implementation nevertheless makes use of a non-minimal quasiseparable representation of order 6. In (8) we report the results obtained by Procedure BISECTION for the five smallest eigenvalues of . The approximations are as accurate as one can expect.
In the second scenario we have considered symmetric semiseparable matrices of size with generators of order generated at random by means of the MATLAB function rand. Our bisection algorithm is used to compute all the eigenvalues of the input matrix. In Figure 2 we show the results obtained in the first cases (at the beginning of the experimental session the random number generator was initialized using the default generator algorithm and seed). In each experiment the “exact” eigenvalues of the input matrix are computed by the MATLAB function eig, and the absolute errors between these eigenvalues and the approximations returned by our method are then evaluated. In runs of Procedure BISECTION we observe only 3 (≃0.04%) premature breakdowns, all of them occurring where the matrix entries grow in magnitude to the order of . Only one of these, at iteration 22 in the computation of the 59-th eigenvalue of the input matrix, produces a significant deterioration of the measured absolute error.
Figure 2.
Maximum measured absolute error per eigenvalue (a) and per iteration (b).
To avoid these accuracy problems, we propose the following modification. While the algorithm is running, we monitor the growth in magnitude of the entries of the generalized Givens matrices. If a prescribed threshold is exceeded, the algorithm is restarted from a different starting point. In our implementation we set and, at the very beginning only, we take . Figure 3 shows the results of this modified algorithm on the same test problems as in Figure 2. The results are now consistently accurate.
Figure 3.
Maximum measured absolute error per eigenvalue (a) and per iteration (b) for the modified algorithm with the growth threshold.
6. Conclusions and Future Work
In this work we have designed a fast adaptation of the bisection method for computing the eigenvalues of symmetric matrices with quasiseparable structure. Numerical experiments are reported to confirm the robustness of the proposed algorithm when it is combined with a restarting technique. Our current research is mainly concerned with the design of a parallel algorithm for computing the eigenvalues of large symmetric quasiseparable matrices on concurrent processors while minimizing the communication between them. The parallel scheme retains the main structure of the sequential algorithm, and it exploits the multiprocessor environment by carrying out the required matrix factorizations concurrently. This approach has already proved to be very efficient for tridiagonal matrices [20]. It would also be of interest to compare the performance of implementations of parallel algorithms based on generalized Givens rotations and on Householder reflections for the updating of the triangular factorization of quasiseparable matrices.
Funding
This research received no external funding.
Data Availability Statement
The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.
Acknowledgments
The author is a member of INdAM/GNCS. The author acknowledges the use of AI tools to proofread the final version of this work.
Conflicts of Interest
The author declares no conflicts of interest.
References
- Vandebril, R.; Van Barel, M.; Mastronardi, N. Matrix Computations and Semiseparable Matrices. Volume II Eigenvalue and Singular Value Methods; Johns Hopkins University Press: Baltimore, MD, USA, 2008; pp. xvi+498. [Google Scholar]
- Eidelman, Y.; Gohberg, I.; Haimovici, I. Separable Type Representations of Matrices and Fast Algorithms. Volume 2 Eigenvalue Method; Operator Theory: Advances and Applications; Birkhäuser/Springer Basel AG: Basel, Switzerland, 2014; Volume 235, pp. xii+359. [Google Scholar]
- Eidelman, Y.; Haimovici, I. The bisection eigenvalue method for unitary Hessenberg matrices via their quasiseparable structure. Electron. Trans. Numer. Anal. 2023, 59, 60–88. [Google Scholar] [CrossRef] [Scilit]
- Eidelman, Y.; Haimovici, I. Bisection eigenvalue method for Hermitian matrices with quasiseparable representation and a related inverse problem. In Operator Theory, Analysis and the State Space Approach: In Honor of Rien Kaashoek; Springer International Publishing: Cham, Switzerland, 2018; pp. 181–200. [Google Scholar] [CrossRef] [Scilit]
- Fasino, D.; Gemignani, L. Direct and Inverse Eigenvalue Problems for Diagonal-Plus-Semiseparable Matrices. Numer. Algorithms 2003, 34, 313–324. [Google Scholar] [CrossRef] [Scilit]
- Utku, S. Sturm sequences or law of inertia of quadratic forms? Comput. Struct. 1973, 3, 419–420. [Google Scholar] [CrossRef] [Scilit]
- Horn, R.A.; Johnson, C.R. Matrix Analysis; Cambridge University Press: Cambridge, UK, 1985; pp. xiii+561. [Google Scholar] [CrossRef] [Scilit]
- Bojanczyk, A.; Qiao, S.; Steinhardt, A.O. Unifying unitary and hyperbolic transformations. Linear Algebra Appl. 2000, 316, 183–197. [Google Scholar] [CrossRef] [Scilit]
- Aurentz, J.L.; Vandebril, R.; Watkins, D.S. Fast Computation of the Zeros of a Polynomial via Factorization of the Companion Matrix. SIAM J. Sci. Comput. 2013, 35, A255–A269. [Google Scholar] [CrossRef] [Scilit]
- Uhlig, F. The DQR algorithm, basic theory, convergence, and conditional stability. Numer. Math. 1997, 76, 515–553. [Google Scholar] [CrossRef] [Scilit]
- Eidelman, Y.; Gohberg, I.; Haimovici, I. Separable Type Representations of Matrices and Fast Algorithms. Volume 1 Basics. Completion Problems. Multiplication and Inversion Algorithms; Operator Theory: Advances and Applications; Birkhäuser/Springer Basel AG: Basel, Switzerland, 2014; Volume 234, pp. xv+399. [Google Scholar]
- Eidelman, Y.; Gohberg, I. Out-of-band quasiseparable matrices. Linear Algebra Appl. 2008, 429, 266–289. [Google Scholar] [CrossRef] [Scilit][Green Version]
- Gohberg, I.; Lancaster, P.; Rodman, L. Matrices and Indefinite Scalar Products; Birkhäuser Verlag: Basel, Switzerland, 1983. [Google Scholar]
- Alexander, S.; Pan, C.T.; Plemmons, R. Analysis of a recursive least squares hyperbolic rotation algorithm for signal processing. Linear Algebra Appl. 1988, 98, 3–40. [Google Scholar] [CrossRef] [Scilit][Green Version]
- Gemignani, L. Solving Shifted Systems for Quasiseparable Matrices. arXiv 2026, arXiv:2606.26952. [Google Scholar]
- Eidelman, Y.; Gohberg, I. A modification of the Dewilde–van der Veen method for inversion of finite structured matrices. Linear Algebra Appl. 2002, 343–344, 419–450. [Google Scholar] [CrossRef] [Scilit]
- Golub, G.; Van Loan, C. Matrix Computations, 4th ed.; Johns Hopkins Studies in the Mathematical Sciences; Johns Hopkins University Press: Baltimore, MD, USA, 2013; pp. xiv+756. [Google Scholar]
- Boito, P.; Eidelman, Y.; Gemignani, L. Numerical solution of nonclassical boundary value problems. Numer. Algorithms 2025, 100, 745–768. [Google Scholar] [CrossRef] [Scilit]
- Aceto, L.; Gemignani, L. Computing the action of the matrix generating function of Bernoulli polynomials on a vector with an application to non-local boundary value problems. Adv. Comput. Math. 2025, 51, 19. [Google Scholar] [CrossRef] [Scilit]
- Chang, H.; Utku, S.; Salama, M. Eigenvalue computation of large symmetric tridiagonal matrices on concurrent processors. Comput. Struct. 1988, 29, 323–329. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.


