Abstract
This paper develops a new rational fixed-point iteration for whose scalar prototype enjoys half-plane global convergence and a quartic local error contraction. By embedding M into a block matrix and exploiting the classical sign–square root identity, the proposed iteration yields and within a single iterative run under standard spectral admissibility conditions. A norm-balancing scaling strategy is also incorporated to accelerate the initial phase without changing the asymptotic order. Numerical experiments in a unified implementation demonstrate that the method reduces iteration counts and time compared with Newton-type and Padé-based competitors.
Keywords:
sign function; principal matrix square root; rational iteration; quartic convergence; scaling acceleration MSC:
41A25
1. Introduction
A matrix function is a mathematical mapping in which the argument is a matrix, usually a square one, and the resulting value is again a matrix of the same size. Several equivalent definitions of matrix functions have been developed in the literature. Among the most common constructions are those via the Jordan canonical form, the Cauchy integral formula, and Hermite matrix polynomial representations; for further details, see [1,2]. These formulations constitute an essential theoretical and computational basis for the treatment of matrix functions in many areas of applied mathematics.
Although traditional approaches, such as diagonalization and contour-integral techniques, are frequently used for evaluating matrix functions, iterative procedures have become increasingly important. This is especially the case when the entries of the matrix vary with time or when reliable initial estimates are available [3,4]. In such circumstances, iterative schemes provide both flexibility and computational efficiency, and therefore play an important role in large-scale and real-time computations [5].
This paper is concerned with the iterative evaluation of MSRs, with particular attention to their algorithmic formulation and convergence properties. One of the main motivations behind this study comes from applications involving matrix differential equations [1]. As a simple illustration, consider the first-order matrix differential equation
where is a real-valued function and denotes an arbitrary square root of the matrix M. Under suitable assumptions, the exact solution of this equation can be written explicitly as
which highlights the direct influence of the matrix square root (MSR) on the time evolution of the solution. Another related model is the second-order matrix differential equation
whose vector solution is given by
MSRs also arise naturally in Monte Carlo simulation of correlated asset returns. Let denote the covariance matrix of asset returns. A square root factor L, for instance obtained through the Cholesky decomposition [6], satisfies
To generate a correlated random vector , one can first sample a standard normal vector and then set
This operation transfers the required covariance and correlation structure to the simulated vector. Such a procedure is widely employed in multi-asset [7] derivative valuation and portfolio simulation. Beyond these classical applications, MSRs and inverse MSRs also occur in several modern computational fields. In machine learning and data analysis, the inverse square root of a covariance matrix is a central ingredient in whitening transformations and covariance normalization, where correlated features are transformed into approximately uncorrelated components with normalized variance [8]. Matrix square roots also arise in quantum information theory, for example in the computation of fidelity-type quantities between density matrices, where expressions involving the square root of positive semi-definite operators play a fundamental role [9]. These contemporary applications further motivate the development of accurate and stable algorithms for computing and , especially when the matrix dimension is large or when repeated evaluations are required.
Observing the (4), both the principal MSR and its inverse are essential components in constructing the corresponding numerical solution [10]. It should also be recalled that a square root of exists iff the ascent sequence of integers , which characterizes the sizes of the Jordan blocks associated to each eigenvalue, contains no pair of identical odd integers. This criterion was established in [11] and is expressed through
In this work, we develop a new higher-order iterative procedure for obtaining both the principal square root of a matrix and its inverse, provided that the matrix satisfies the required admissibility assumptions. It is shown that, under appropriate conditions, the proposed method globally converges to the principal square root. In addition, the convergence order of the scheme is four, which makes it an efficient approach for numerical implementation.
Before introducing the proposed method, we recall several basic facts concerning the matrix sign function, since this function is closely related to the computation of MSRs both theoretically and algorithmically. The sign function of a matrix can be defined through the following Cauchy-type integral representation:
Here, the integral is interpreted within the framework of complex matrix functions, and it is assumed that M has no eigenvalues on the imaginary axis. An important point is that, although the matrix sign function satisfies , it does not necessarily coincide with either I or , unless the full spectrum of M lies strictly in the open right or left half-plane of the complex plane, respectively [12]. Therefore, the matrix sign function may be regarded as a non-primary MSR of the identity.
It is also useful to note that many mathematical problems, despite not appearing at first sight to belong to nonlinear equation theory, can be reformulated as root-finding problems in more general settings, such as spaces of operators [13,14]. The present paper is mainly focused on iterative methods in matrix computations [15]. Starting from a suitable initial matrix, such methods act as fixed-point or Newton-type processes [16,17,18], producing a sequence of matrix approximations that converges to the desired solution. Although the connection between iterative methods for the matrix sign function and classical nonlinear root solvers may not be immediately obvious, it becomes clear by observing that many sign iterations are obtained by transferring scalar root-finding ideas to the nonlinear equation [19]
wherein is given. This viewpoint establishes a useful bridge between two apparently different frameworks and helps guide the construction and analysis of efficient algorithms for matrix functions.
The remainder of this article is structured as follows. Section 2 reviews several well-known iterative methods with different convergence orders for obtaining matrix functions, in particular the matrix sign function and the MSR. Section 3 presents the new iterative scheme for the simultaneous computation of the MSR and its inverse. In that section, we discuss the mathematical formulation of the method, its relation to the matrix sign function, and the derivation of its global convergence properties. The convergence rate of the presented iteration is also examined in detail. Section 4 investigates the computational performance of the method through a collection of numerical experiments on test matrices of arbitrary dimensions, thereby confirming the theoretical results. Finally, Section 5 summarizes the main conclusions and indicates possible directions for future work.
2. Review of Classic Iterative Schemes
By applying the standard Newton method to matrixeq), one obtains the classical solver for computing the matrix sign function, as described in [10]:
Here, represents the sequence of matrix approximations produced by the iterative process. A classical approach for computing a MSR is also furnished by Newton’s method, which can be expressed in the recursive form
where is a suitably chosen starting matrix. Although the iteration in (9) is attractive from a theoretical point of view, it may suffer from numerical instability, especially when the initial approximation is not properly selected or when the matrix M has structural properties that adversely affect the convergence process.
To overcome such drawbacks and to obtain better stability together with improved convergence behavior, several modified iterations have been proposed in the literature [20]. One such second-order scheme, developed from the Newton iteration in (9), was introduced in [20] and is given by
The process defined in (10) is known to possess favorable numerical stability properties, and the sequence produced by this scheme tends to the principal MSR of M, denoted by .
Another well-known technique for evaluating MSRs is obtained from the cyclic reduction algorithm, originally proposed in [21]:
This method constructs a sequence that asymptotically tends to . Hence, although the iteration converges to a scaled form of the desired square root, the principal MSR is recovered by applying the corresponding normalization to the final approximation.
Padé-Based Competitor Solvers for the Matrix Sign Function
An important family of optimal iterations for computing the matrix sign function was developed in [22]. These schemes are obtained by using Padé approximants of the scalar function
together with the change of variable . This construction produces a class of rational functions that form the basis of the Padé-type sign iterations. Owing to their optimality properties and favorable numerical stability, these methods are regarded as strong competitors among iterative techniques for matrix function computation. The resulting rational iterations exhibit rapid convergence to the sign function and arise from the identity
Assume that , and let the Padé approximant of be denoted by . Then, one obtains the iteration
which converges to with order . In this Padé framework, the symbols P and Q denote the numerator and denominator polynomials of the corresponding Padé approximant, respectively.
Generally speaking, the iterations represented by (13), together with their reciprocal variants, are obtained from the and Padé approximants of the underlying function. These classes of schemes are globally convergent. Furthermore, the convergence behavior of each method depends on the selected Padé indices, which determine the degree of the associated rational approximation; see also [23].
Within this Padé-based class, some iterations attain fourth-order convergence while retaining global stability for a wide range of input matrices. Typical examples of globally convergent fourth-order schemes are listed as follows:
3. An Enhanced Approach
3.1. Construction of an Improved Scheme
To enhance the accuracy and convergence behavior of Newton’s scheme [24], we add a supplementary correction step based on a divided-difference approximation. This modification gives rise to an enhanced iterative algorithm for solving the nonlinear equation in (7):
wherein . Throughout this subsection, , , and are scalar variables. When the method is transferred to the matrix sign problem, their corresponding matrix iterates will be denoted by capital letters.
The iteration in (16) is designed with two main objectives. The first is to improve the classical Newton process by increasing the convergence order. The second, which is even more important for matrix computations, is to obtain a formulation with global convergence characteristics. Hence, the proposed construction combines high local efficiency with global stability, making it suitable for nonlinear matrix problems where both reliability and computational performance are essential.
Theorem 1.
Let be a simple zero of a sufficiently differentiable function . If the initial point is selected close enough to the exact zero , then the method defined by (16) satisfies the error relation
where and , .
Proof.
Expanding the relevant terms around by Taylor’s formula gives
Therefore, using the first step of (16), we obtain
For the second stage of (16), expanding the rational Newton-type correction about and inserting the Taylor coefficients of f and leads to the third-order error representation
where
For the divided difference appearing in (16), we have . By expanding and around and then using (20), it follows that
Moreover, since , we also have
Combining (22) and (23) gives
Consequently, from the last step of (16) together with (21), we arrive at
which proves (17). □
3.2. Extension to the Sign Function
Applying (16) to the nonlinear Equation (7) and extending the resulting scalar iteration to matrices in a direct manner yields the following high-order method for computing the matrix sign function:
where the initial matrix is chosen for a nonsingular square complex matrix as
By using the same construction, one may also write the reciprocal counterpart in the form
It should be stressed that the efficiency of an iterative method cannot be judged solely from its convergence order. The computational work required at each step is also a decisive factor, since it affects the total cost of the algorithm. Comparing the iterations in (25) and (27) with the Padé-based schemes in (14) and (15) shows that all these methods require 4 matrix–matrix multiplications and one linear solve, equivalently one inverse factor in compact mathematical notation, per iteration. Thus, the new schemes in (25)–(27) form competitive alternatives to the Padé iterations of the same convergence order, while also retaining global convergence properties.
Remark 1.
Although the iterations (25) and (27) are written with inverse notation, this notation should be understood as a compact mathematical representation rather than as a recommendation to explicitly compute matrix inverses. In practical implementations, the inverse factor should be avoided. For instance, in (27), define
Then (27) may be written as
Instead of forming , one should compute as the solution of the right linear matrix equation
Equivalently, this can be implemented by solving the transposed system
In dense matrix computations, this system can be solved by LU factorization with partial pivoting, while for structured or sparse matrices one may use a factorization or Krylov-type linear solver adapted to the matrix structure. The same convention is used for the other inverse factors appearing in the competing schemes. Therefore, the stated cost of one matrix inversion per iteration should be interpreted in the standard numerical-linear-algebra sense as one linear solve with the corresponding coefficient matrix.
3.3. Convergence over the Entire Domain for Matrix Sign
To investigate the global nature of convergence, we employ the concept of basins of attraction [25]. This tool provides both graphical and theoretical information about the regions in which an iterative method converges [26]. More precisely, we take into account the complex domain and discretize it into a sufficiently fine grid. Each grid point is used as an initial approximation, and the point is colored according to the root to which the iteration converges. Points that fail to converge are displayed in black. The stopping rule used in this experiment is .
The corresponding graphical results are reported in Figure 1 and Figure 2. In these figures, the intensity of the color indicates the number of iterations required to satisfy the convergence criterion. To provide a comparison, some Padé-based competitor schemes are also included, so that the distinction between local and global convergence behavior can be observed.
Figure 1.
Attraction basins for (9) in left and Padé 1–4 in right.
Although the iterations (9), (27), and (14) all display global convergence, a more careful comparison of their attraction basins shows a clear advantage for the scheme (27). In particular, the lighter regions associated with this method indicate that fewer iterations are generally required to reach convergence. This improvement is especially meaningful because all compared methods have the same per-step computational cost in terms of the number of matrix products and matrix inversions.
Theorem 2.
Let be the rational mapping generated by (27), namely
Consider the fixed-point process
Then, for every initial value satisfying , the sequence is well-defined and converges globally to the corresponding solution of ; that is,
The exceptional set is the imaginary axis , which constitutes the common boundary of the two attraction regions.
Proof.
Let be selected so that ; equivalently, when and when . Define the Cayley transform
The equivalence
implies that gives .
A direct simplification of (28) yields the exact recurrence
Furthermore, for every and , one has
and therefore implies
If , then (31) gives , so that (33) is applicable with . Taking absolute values in (32), we get
It follows that implies for every j, and the inequality forces . By (30), the relation is equivalent to . This proves global convergence to for all initial values with . Finally, when , Equation (31) gives , and hence the strict contraction argument above is no longer valid. The imaginary axis is therefore exactly the boundary separating the attraction basins of and . This completes the proof. □
3.4. Computation of the MSR
To adapt the iteration in (25) to the computation of MSRs, we use the following key identity, given in [1]:
If M is nonsingular and , then the block matrix satisfies . Hence, is well-defined, and (35) simultaneously provides and . This relation creates the essential link between the matrix sign function and the MSR problem. In particular, it converts the computation of the MSR into the evaluation of a matrix sign function by embedding the original matrix into the block matrix .
Another relevant structural property of the proposed iterations should also be noted when they are applied to a nonsingular matrix M whose spectrum avoids the negative real axis, that is, when M has no eigenvalues on , [27]. Under this condition, assume that the initial approximation is chosen to commute with M, namely . Then, by induction, every subsequent iterate generated by the method preserves this commutativity. Thus, each matrix satisfies , meaning that the iteration remains consistent with the spectral structure of M during the entire convergence process. This invariance is useful for numerical stability and also simplifies the theoretical analysis of the MSR computation.
3.5. Error Estimate and Convergence Order
Theorem 3.
Let M be nonsingular with and take . Then, the iteration (27) converges to with fourth-order convergence.
Proof.
To identify the convergence order at the matrix level, set . Since , every is a rational function of M; therefore, . Thus, the following factorization is valid, where :
Taking an appropriate matrix norm in (41) immediately gives
which verifies that the method in (27) converges with order four. The proof is complete. □
We establish quartic convergence to for the initial choice . The corresponding conclusions for the MSR and are obtained by applying the same sign iteration to the block matrix in (35). Recall that every complex square matrix M, whether diagonalizable or defective, can be represented in Jordan form as , where T is nonsingular and J is composed of Jordan blocks associated with the eigenvalues of M. This decomposition allows the convergence analysis of the iteration to be reduced to the behavior on individual Jordan blocks.
In this transformed setting, the eigenvalues of the iterates, denoted by , can be followed through a scalar recurrence that describes the passage from step j to step . Let , , and define
which is meaningful because of the assumption . Since (27) is rational, each iterate is a rational function of , and hence of M. Therefore, the spectral mapping theorem applies. In particular, if denotes the eigenvalue corresponding to with algebraic multiplicity taken into account, then the scalar iteration induced by (27) is
Introduce the Cayley-type quantity
A direct algebraic simplification of the scalar map in (36), using , gives
Taking absolute values in (38) yields
Also, for any and , the identity
implies
Since by the definition of , and since for , it follows from (36) by induction that for all j. Thus, the multiplicative factor in (39) is always strictly smaller than 1. Consequently, decreases monotonically and satisfies a fourth-order superlinear contraction. Hence,
The preceding convergence argument is spectral in nature and is valid under the stated admissibility assumptions. In finite-precision arithmetic, however, highly non-normal matrices may exhibit transient behavior that is not fully described by eigenvalues alone, since their pseudospectra can be much larger than their spectra. For this reason, the numerical section also includes a Jordan-type non-normal test matrix in Example 3, where the iteration history is reported explicitly to monitor possible transient growth.
3.6. Scaling
It is well known that iterative algorithms for matrix functions [28] may converge slowly during the first few iterations. This behavior is often caused by an initial approximation that is not adequately close to the desired matrix function. A common remedy for this difficulty is the use of scaling, which can considerably accelerate the early stage of convergence.
The scaling idea has been discussed in detail in ([1], Chapter 5.5), especially for Newton-type iterations. Its main purpose is to modify the current iterate dynamically by means of a scalar scaling factor. Instead of applying the iterative update directly to , one first replaces it by , where is determined adaptively during the computation. This adjustment improves stability and may substantially speed up convergence when the starting matrix is not close to the required limit.
In practice, such a strategy often produces better numerical behavior and can reduce the number of iterates needed to satisfy a prescribed tolerance. For rational sign iterations, including (27), the convergence rate is controlled by the proximity of the spectrum to . Equivalently, it depends on the magnitude of the Cayley-type expression
because the scalar map associated with (27) satisfies a contraction relation of the form
and the corresponding matrix statement follows from spectral mapping. Thus, any preliminary transformation that decreases for improves the initial convergence behavior.
Accordingly, at the jth step we replace by the scaled matrix before carrying out the rational update. For a scalar z satisfying , the function is minimized when is close to 1. In the matrix setting, a practical substitute is to balance the sizes of and in the selected norm, namely
Since and , condition (44) implies
For a higher-order sign iteration such as (27), the update contains odd powers up to , and therefore an overly strong scaling may have a more pronounced effect. A customary stabilization is to employ a tempered balancing strategy, which enforces (44) at the squared-magnitude level. This gives
Thus, the scaling parameter
agrees with the general scaling strategy for matrix sign and square root iterations discussed in ([1], Section 5.5), and is also consistent with norm-based scaling accelerations used in higher-order MSR algorithms; see, for example, [28].
In practical computations, the quantity in (45) may not be evaluated by explicitly forming . Instead, it is replaced by an inverse-norm estimate:
This estimate can be obtained by standard inverse-norm or condition–number estimators, such as the Hager–Higham estimator [1], which require only matrix–vector products and linear solves. In particular, for (27), define
Since is a polynomial in , it commutes with ; hence,
Therefore, the action of on a vector (matrix) can be evaluated without forming : one first solves a linear system with coefficient matrix , using the same LU factorization already needed for the rational update, and then multiplies the result by . Similarly, the transpose or adjoint operations required by inverse-norm estimators can be implemented through the corresponding triangular solves with the LU factors. Thus, the scaling parameter in (45) can also be computed by somewhat inexpensive norm estimation based on linear solves.
4. Numerical Experiments
This section is devoted to examining the performance of the iterative methods discussed above for building both the MSR and its inverse. All computational tests were carried out in the Mathematica 14.0 computing environment [29], using the same hardware configuration in order to ensure a consistent and fair comparison. The numerical assessment includes several representative solvers, namely the Newton iteration (9), the Denman–Beavers iteration (10), the cyclic-reduction scheme (11), the Padé-based iterations (14) and (15), the proposed method (27), and its scaled version based on (45). In what follows, these methods are denoted respectively by NM2, DB2, CR2, PD1, PD2, NEM, and ANEM. To broaden the numerical comparison in response to recent developments in matrix-function algorithms, we also include an additional solver, denoted by SCH, as a Schur-based direct algorithm [1] for the principal MSR. Since SCH is a direct method, no iteration count is associated with it.
To measure the convergence behavior of the iterations, we employ the following relative error criterion in the -norm:
where is the prescribed tolerance. According to this stopping rule, the iterative process is terminated once two consecutive approximations become sufficiently close.
The example considered below should be viewed not as a single test problem, but as a benchmark family involving matrices of different sizes. More precisely, four test cases with distinct matrix dimensions are examined in order to provide a broader comparison under different computational settings.
Remark 2.
MSRs also appear in risk decomposition problems. Let be a vector of portfolio weights, and let denote the corresponding covariance matrix. The total variance of the portfolio is expressed as
where
is a symmetric MSR of M. The vector
can then be used to interpret the marginal contribution of each component to the overall portfolio risk. This idea is frequently employed in risk parity methods and factor-based risk decomposition. Therefore, efficient and accurate algorithms for computing MSRs are relevant in several applied fields, including control theory, financial mathematics, and systems engineering.
We also record the leading per-step floating-point cost of the fourth-order competitors used in the numerical comparison. For dense real matrices, one matrix–matrix multiplication costs approximately flops. Moreover, solving a dense matrix equation with n right-hand sides by LU factorization with partial pivoting costs
flops, where the first term corresponds to the LU factorization and the second term to the two triangular solves. Therefore, inverse notation in formulas such as (27), (14), and (15) should be interpreted computationally as one dense linear solve, as discussed in Remark 1.
For the proposed method (27), the powers and can be formed using two matrix products, and the denominator factor
requires one additional matrix product. The update is then obtained by solving the right matrix equation
Thus, the leading cost of one NEM step is
flops. The same leading-order count is obtained for the Padé-type competitors PD1 and PD2, since they also require the construction of , , one additional product for the denominator or numerator factor, and one dense linear solve. The scaled version ANEM has the same leading rational-update cost, but it includes an additional scaling overhead due to the norm-balancing parameter in (45). This overhead is usually lower order if norm estimates are used, but it can be noticeable when full inverse-related quantities are computed (Table 1).
Table 1.
Leading per-step dense flop counts for the fourth-order iterative competitors.
For the largest dimension used in Example 1, namely , the leading cost
is approximately
flops per iteration for PD1, PD2, and NEM. Hence, for high-dimensional covariance matrices of the type discussed in Remark 2, reducing the number of iterations directly reduces the total leading arithmetic cost. This explains why the iteration count reported in the numerical tables is a meaningful indicator of computational efficiency, provided that all fourth-order rational methods are implemented through comparable dense linear solves rather than explicit matrix inverses.
Example 1.
Motivated by Remark 2, and in order to compare the behavior of different solvers in this setting [28], we take into account the following symmetric positive definite (SPD) matrix of size n and calculate its square root together with its inverse:
For every tested dimension n, we numerically confirmed that ; hence, M is SPD.
To obtain a reliable comparison among the competing iterative procedures, all numerical implementations were carried out under the same experimental conditions. In particular, each method was initialized with the identical starting matrix
which is a standard admissible initialization for matrix sign-based and square-root-based iterations when M is nonsingular and . No solver was supplied with a problem-specific or preconditioned initial approximation.
Furthermore, the same termination rule was used for all methods. The iterations were stopped as soon as the relative difference between two successive iterates satisfied (46) with the common tolerance throughout all experiments, as stated in (46). This criterion is independent of the exact solution and is widely used in computations involving matrix functions. All algorithms were implemented in the same computational environment, relying on identical matrix arithmetic operations and the same norm evaluations. No solver-specific tuning, adaptive restarting, or problem-dependent optimization was employed. Thus, the reported iteration numbers reflect the intrinsic convergence behavior of the methods rather than differences in implementation. This unified experimental design ensures that the observed improvements of the proposed schemes are due to their higher-order convergence and favorable global behavior, rather than unequal initialization or stopping rules (Figure 3 and Figure 4).
Figure 3.
Numerical outcomes for the MSR obtained in Experiment 1 with .
Figure 4.
Computational outcomes for the MSR obtained in Experiment 1 with .
In Table 2, SCH denotes the Schur-based direct solver for the principal MSR. Since SCH is not an iterative method, it has no iteration count and is not governed by the stopping criterion (46). Therefore, for SCH we report the relative square root residual
where U is the computed approximation to . We also computed the inverse-consistency residual
where Z denotes the corresponding approximation to . For the case , the Schur-based computation gave
The results show that SCH provides a highly accurate direct reference solver. At the same time, NEM remains competitive among the iterative methods and reaches a final stopping quantity of order . The accelerated version ANEM requires the smallest number of iterations among the tested iterative schemes. Moreover, unlike a direct Schur-based computation, the proposed sign-function framework naturally produces approximations to both and through the block identity (35).
Table 2.
Comparison of the iterative schemes and a Schur-based direct solver for Example 1 with and . For the iterative schemes, the last column reports the stopping quantity in (46); for the Schur-based direct solver, it reports the relative square root residual .
The computational results obtained from this benchmark are compared with those produced by the Padé-based competitors, namely PD1 and its reciprocal version PD2, which have the same theoretical convergence order as the proposed method. In addition, Table 2 includes a Schur-based direct solver, denoted by SCH, for the largest tested dimension . The results show that NEM is competitive among the fourth-order iterative schemes and reaches a smaller final stopping quantity than the Padé-based competitors in this experiment. The accelerated version ANEM reduces the number of iterations, while SCH provides an accurate direct reference solution. It should be noted that SCH is not an iterative sign-function method and therefore has no iteration count associated with (46). These observations confirm that the proposed method is effective among iterative sign-based and square-root-based solvers, while the Schur-based computation validates the accuracy of the obtained MSR.
It is also important to note that NEM, despite having the same fourth-order convergence as PD1 and PD2, reaches convergence with fewer iterations in the reported tests. This directly reduces the total number of matrix–matrix products and the number of evaluations of the stopping criterion in (46). As a result, NEM is not only computationally efficient but also attractive for practical large-scale computations where the overall cost is a major concern (Figure 5 and Figure 6).
Figure 5.
Numerical outcomes for the MSR obtained in Experiment 1 with .
Figure 6.
Numerical outcomes for the MSR obtained in Experiment 1 with .
Example 2.
We consider three additional matrix classes with different spectral properties. The first test matrix is the regularized Hilbert matrix
which is a classical SPD test matrix. The second test matrix is the complex non-Hermitian matrix
where
The third test matrix is a nearly singular SPD matrix defined by
where
and is the discrete sine transform matrix
The matrix is SPD and has a small eigenvalue equal to η, so it provides a controlled near-singular test.
For all three matrices in Example 2, we take and apply NEM and ANEM with the same tolerance . In addition to the stopping quantity in (46), we report the square root residual
and the inverse-consistency residual
The numerical results are shown in Table 3.
Table 3.
Performance of NEM and ANEM for the additional SPD, complex, and nearly singular matrices in Example 2 with and .
It should be emphasized that the stopping quantity and the square root residual measure different aspects of the computation. For well-conditioned matrices, these quantities usually decrease consistently. However, for nearly singular or highly ill-conditioned matrices, such as , the difference between two consecutive iterates may reach the level of machine precision before the residual decreases to the same order. This explains why, for , the value of is around , whereas remains around . The residual is still below the prescribed tolerance , but the gap indicates the expected sensitivity of the square root computation near singularity.
The inverse-consistency residuals corresponding to Table 3 are
| Matrix | Method | Rinv |
| M1 | NEM | 1.00 × 10−14 |
| M1 | ANEM | 7.53 × 10−15 |
| M2 | NEM | 7.17 × 10−16 |
| M2 | ANEM | 4.69 × 10−16 |
| M3 | NEM | 6.15 × 10−13 |
| M3 | ANEM | 8.62 × 10−13 |
- These results indicate that the proposed iteration remains effective for standard SPD matrices, complex non-Hermitian matrices whose spectra avoid the negative real axis, and nearly singular SPD matrices. The results for also show the expected sensitivity of the square root residual when the smallest eigenvalue is close to zero. Although the method satisfies the prescribed iteration-difference stopping criterion and remains below , the gap between and shows that, for nearly singular matrices, a residual-based check is useful in addition to the standard iteration-based stopping rule.
Example 3.
To further examine the effect of non-normality, we also test the proposed method on a Jordan-type matrix
where is the nilpotent shift matrix
The matrix has the single eigenvalue 4, but it is highly non-normal and defective. Hence, although its spectrum is safely contained in the positive real axis and the principal MSR is well defined, this example is useful for detecting possible transient growth in the early iterations of a rational matrix iteration.
Table 4 reports the iteration history of NEM and ANEM for Example 3. Here, denotes the sign iteration applied to the block matrix in (35). The initial value satisfies
Thus, the column is included to monitor whether the iteration produces a transient norm amplification.
Table 4.
Iteration history of NEM and ANEM for the highly non-normal Jordan-type matrix , , in Example 3.
The results in Table 4 show that both NEM and ANEM converge within three iterations for this defective non-normal matrix. Moreover, the norm of the sign iterate does not exhibit transient growth: starting from , it remains below throughout the computation.
5. Conclusions
The computation of the MSR and its inverse is important in both numerical analysis and applications, particularly for symmetric positive definite matrices where square roots and inverse square roots arise naturally. A classical example is the numerical treatment of second-order matrix differential equations, such as the model given in Equation (3). In this paper, we proposed and analyzed a fourth-order iterative method for the accurate and efficient computation of both the MSR and the inverse square root. The scheme was derived from a stable iteration for the matrix sign function. Its convergence properties were investigated, and the associated scaling strategy was discussed in detail. Numerical experiments, including comparisons with classical iterations, Padé-type schemes, recent sign-function-based competitors, and a Schur-based direct solver, were then presented to confirm the theoretical results and to demonstrate the robustness and computational competitiveness of the proposed approach. For applications requiring very high accuracy on ill-conditioned or nearly singular matrices, it is advisable to use a combined stopping rule that monitors both the iteration difference and the residual quantity , rather than relying only on the difference between successive iterates. Based on the findings of this study, future work may consider extending the present iterative framework to other matrix functions, including matrix pth roots and the matrix exponential, while maintaining high-order convergence and numerical stability.
Funding
Ongoing Research Funding program, (ORF-2026-210), King Saud University, Riyadh, Saudi Arabia.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
No new data were created or analyzed in this study.
Acknowledgments
We are grateful to the comments and suggestions of all three referees (in particular referee 3), which helped improve the reliability and readability of this manuscript.
Conflicts of Interest
The author declares no conflicts of interest.
References
- Higham, N.J. Functions of Matrices: Theory and Computation; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2008. [Google Scholar]
- Salehi, S.; Lotfi, T. A globally convergent numerical method with fourth order for computing the matrix sign. Math. Methods Appl. Sci. 2025, 48, 7460–7468. [Google Scholar]
- Feng, Y.; Othman, A.Z. An accelerated iterative method to find the sign of a nonsingular matrix with quartical convergence. Iran. J. Sci. 2023, 47, 1359–1366. [Google Scholar] [CrossRef] [Scilit]
- Dehghani-Madiseh, M. On the solution of parameterized Sylvester matrix equations. J. Math. Model. 2022, 10, 535–553. [Google Scholar]
- Zaka Ullah, M.; Muaysh Alaslani, S.; Othman Mallawi, F.; Ahmad, F.; Shateyi, S.; Asma, M. A fast and efficient Newton-type iterative scheme to find the sign of a matrix. AIMS Math. 2023, 8, 19264–19274. [Google Scholar] [CrossRef] [Scilit]
- Dooren, P.V.; Bhattacharyya, S.P.; Chan, R.H.; Olshevsky, V.; Routray, A. (Eds.) Numerical Linear Algebra in Signals, Systems and Control; Lecture Notes in Electrical Engineering; Springer: Dordrecht, The Netherlands, 2011; Volume 80. [Google Scholar]
- Company, R.; Egorova, V.N.; Jódar, L.; Soleymani, F. A local radial basis function method for high–dimensional American option pricing problems. Math. Model. Anal. 2018, 23, 117–138. [Google Scholar]
- Kessy, A.; Lewin, A.; Strimmer, K. Optimal whitening and decorrelation. Am. Stat. 2018, 72, 309–314. [Google Scholar] [CrossRef] [Scilit]
- Nielsen, M.A.; Chuang, I.L. Quantum Computation and Quantum Information; Cambridge University Press: Cambridge, UK, 2010. [Google Scholar]
- Higham, N.J. Newton’s method for the matrix square root. Math. Comput. 1986, 46, 537–549. [Google Scholar] [CrossRef] [Scilit]
- Cross, G.W.; Lancaster, P. Square roots of complex matrices. Linear Multilinear Algebra 1974, 1, 289–293. [Google Scholar] [CrossRef] [Scilit]
- Soleymani, F.; Shateyi, S.; Haghani, F.K. A numerical method for computing the principal square root of a matrix. Abstr. Appl. Anal. 2014, 2014, 525087. [Google Scholar] [CrossRef] [Scilit]
- Soleymani, F.; Stanimirović, P.S.; Stojanović, I. A novel iterative method for polar decomposition and matrix sign function. Discret. Dyn. Nat. Soc. 2015, 2015, 649423. [Google Scholar] [CrossRef] [Scilit]
- Torkashvand, V. A two-step method adaptive with memory with eighth-order for solving nonlinear equations and its dynamic. Comput. Methods Differ. Equ. 2022, 10, 1007–1026. [Google Scholar]
- Khosravi Dehdezi, E.; Karimi, S. A fast and efficient Newton-Shultz-type iterative method for computing inverse and Moore-Penrose inverse of tensors. J. Math. Model. 2021, 9, 645–664. [Google Scholar]
- Traub, J.F. Iterative Methods for the Solution of Equations; Prentice-Hall: New York, NY, USA, 1964. [Google Scholar]
- Soleymani, F. Two novel classes of two-step optimal methods for all the zeros in an interval. Afr. Mat. 2014, 25, 307–321. [Google Scholar]
- Ivaz, K.; Asadpour Fazlallahi, M. Solving free boundary problem for an initial cell layer in multispecies biofilm formation by Newton-Raphson method. Comput. Methods Differ. Equ. 2021, 9, 899–907. [Google Scholar] [CrossRef] [Scilit]
- Soleymani, F.; Haghani, F.K.; Shateyi, S. Several numerical methods for computing unitary polar factor of a matrix. Adv. Differ. Equ. 2016, 2016, 4. [Google Scholar] [CrossRef] [Scilit]
- Denman, E.D.; Beavers, A.N. The matrix sign function and computations in systems. Appl. Math. Comput. 1976, 2, 63–94. [Google Scholar] [CrossRef] [Scilit]
- Meini, B. The Matrix Square Root from a New Functional Perspective: Theoretical Results and Computational Issues; Technical Report 1455; Dipartimento di Matematica, Università di Pisa: Pisa, Italy, 2003. [Google Scholar]
- Kenney, C.S.; Laub, A.J. Rational iterative methods for the matrix sign function. SIAM J. Matrix Anal. Appl. 1991, 12, 273–291. [Google Scholar] [CrossRef] [Scilit]
- Jung, D.; Chun, C. A general approach for improving the Padé iterations for the matrix sign function. J. Comput. Appl. Math. 2024, 436, 115348. [Google Scholar]
- Sharma, P.; Kansal, M. An iterative formulation to compute the matrix sign function and its application in evaluating the geometric mean of Hermitian positive definite matrices. Mediterr. J. Math. 2025, 22, 39. [Google Scholar] [CrossRef] [Scilit]
- Rani, L.; Kansal, M. Numerically stable iterative methods for computing matrix sign function. Math. Meth. Appl. Sci. 2023, 46, 8596–8617. [Google Scholar] [CrossRef] [Scilit]
- Getz, C.; Helmstedt, J. Graphics with Mathematica Fractals, Julia Sets, Patterns and Natural Forms; Elsevier: Amsterdam, The Netherlands, 2004. [Google Scholar]
- Sharma, P.; Kansal, M. Extraction of deflating subspaces using disk function of a matrix pencil via matrix sign function with application in generalized eigenvalue problem. J. Comput. Appl. Math. 2024, 442, 115730. [Google Scholar]
- Golzarpoor, J.; Ahmed, D.; Shateyi, S. Constructing a matrix mid-point iterative method for matrix square roots and applications. Mathematics 2022, 10, 2200. [Google Scholar] [CrossRef] [Scilit]
- Abell, M.L.; Braselton, J.P. Mathematica by Example, 5th ed.; Academic Press: Amsterdam, The Netherlands, 2017. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.





