Abstract
Transform-based tensor algebras induced by invertible linear transforms provide a unified framework for tensor operations and spectral analysis. This paper investigates how the choice of a unitary transform affects the quantitative tightness of classical operator inequalities. We first formulate a transform-domain transfer principle for matrix trace inequalities and examine its consequences for the Golden–Thompson, Jensen-type, Klein, and Lieb inequalities. We then study the Golden–Thompson defect through its exact slice-wise decomposition. Under bounded spectral assumptions, we establish an upper estimate in terms of squared transform-domain commutators and a matching-order lower estimate for an explicit Pauli-matrix family. We further establish qualitative transform sensitivity: explicit separation results for real orthogonal transforms, including a DFT–DCT separation at . Finally, we investigate the non-universality of transform selection and formulate commutator-energy minimization as an operator-aware surrogate objective over the orthogonal group. The framework separates algebraic invariance from transform-dependent inequality tightness without assuming general equivalence between the defect and commutator-energy objectives.
Keywords:
transform-based tensor algebra; ⋆M-product; Golden–Thompson inequality; operator-inequality defect; noncommutativity; transform selection MSC:
47A63; 15A27; 15A69
1. Introduction
Tensor algebra based on transform-induced products has become a central tool in modern multilinear analysis [1,2]. The -product framework of Kernfeld, Kilmer, and Aeron [3] defines a tensor–tensor product for any fixed invertible transform M, and the subsequent -algebra developed by Kilmer et al. [4] provides its algebraic and spectral foundations. The operator-theoretic interpretation of third-order tensors under the t-product was developed in [5]. When M is the discrete Fourier transform, this reduces to the classical t-product of Kilmer and Martin [6]. In this study, we specialize to unitary transforms and study operator inequalities within this established algebra. This flexibility has led to a wide range of applications [7,8], including tensor completion, robust PCA, and signal processing, where different unitary transforms induce different notions of structure and sparsity.
A fundamental feature of these frameworks is that different choices of lead to algebraically isomorphic tensor algebras. Consequently, the unitary transform is often viewed as a change in basis that does not alter intrinsic properties. However, this viewpoint overlooks an important phenomenon:
(Transform-dependent noncommutativity) The choice of transform Φ defines a coordinate system in which noncommutativity is measured, and different unitary transforms reveal fundamentally different commutative structures.
This observation suggests that while algebraic properties may be invariant, quantitative behavior can depend strongly on . The goal of this paper is to develop a systematic theory of this phenomenon in the context of classical operator inequalities.
Classical operator inequalities for matrices—including the Golden–Thompson inequality [9,10] and related Jensen-, Klein-, and Lieb-type inequalities [11]—play a foundational role in matrix analysis and operator theory. Related inequalities for t-product tensors have been studied in [12,13]. Their significance lies not only in their validity, but also in how their defect (slack) reflects noncommutativity. A natural question arises in the tensor setting: Does the choice of unitary transform Φ affect operator inequalities, or is it merely a change of basis?
At the algebraic level, the answer is straightforward: operator inequalities remain valid for all with exactly the same constants as in the matrix case. The algebraic structure of the algebra is already well understood [3,4]. Our starting point is the observation that this algebraic invariance conceals a deeper phenomenon: Algebraic invariance does not imply quantitative invariance.
While operator inequalities remain valid under all unitary transforms, their defect depends explicitly on transform-domain noncommutativity. For two tensors of the same size, we write for the tensor whose transform-domain lifting is the sum of the corresponding liftings:
Since the transform is linear, this operation coincides with ordinary tensor addition. To formalize this phenomenon, we introduce the -dependent Golden–Thompson defect
where are -Hermitian tensors whose transformed slices and are Hermitian for (see Definition 4), and are the -trace and -exponential maps (see Definitions 2 and 3), and is the -product between two tensors (see Definition 1). The quantity measures the failure of exact commutativity in the transform-based tensor algebra and quantifies the deviation between multiplicative and additive spectral propagation under the -exponential map. Under a bounded spectral-domain assumption, we show that this defect is quantitatively controlled by the aggregate transform-domain commutator energy:
A central consequence of this viewpoint is that no transform is universally optimal. While certain transforms, such as the discrete Fourier transform, may yield vanishing defect for specific tensor pairs, other transforms, such as the discrete cosine transform, may produce significantly smaller defects for different tensor configurations. Thus, optimal transform selection is inherently data-dependent. In this sense, the choice of is not merely a change of basis, but rather a choice of spectral coordinate system that determines how commutativity is evaluated in the transform domain.
The main contributions of this paper are summarized as follows:
- (Established foundation) We work within the transform-based tensor algebra of Kernfeld–Kilmer–Aeron [3] and its -algebra formulation [4], specialized to unitary transforms .
- (Operator-inequality transfer principle) Classical trace inequalities, including Golden–Thompson, Jensen, Klein, and Lieb, transfer to the transform-based tensor algebra with the same constants as in the matrix case.
- (Defect characterization) Under a bounded spectral-domain assumption, the Golden–Thompson defect is quantitatively controlled by the transform-domain commutator energy:
- (Transform sensitivity) The Golden–Thompson defect depends nontrivially on the choice of the unitary transform . For certain tensor pairs, choosing as the discrete Fourier transform (DFT) yields exact slice-wise commutativity in the transform domain, providingIn contrast, choosing as the discrete cosine transform (DCT) may produce significant transform-domain noncommutativity, leading to a strictly positive defect in suitable regimes. This demonstrates that transform selection fundamentally affects the geometry of noncommutativity in the transform-based tensor algebra.
- (Non-universality and operator-aware transform selection) No unitary transform minimizes the Golden–Thompson defect for all tensor pairs. Optimal transforms are necessarily data-dependent. Transform selection can be formulated as minimizing transform-domain noncommutativity over the orthogonal group, thereby connecting the problem to approximate joint diagonalization of tensor slices.
These results establish that induces a nontrivial geometry of inequality tightness, governed by transform-dependent noncommutativity. To the best of our knowledge, this is the first work that separates algebraic invariance from quantitative behavior in transform-based tensor algebras.
The organization of this paper is as follows. Section 2 introduces the transform-based tensor algebra and notation. Section 3 establishes the operator-inequality transfer principle. Section 4 develops the transform-sensitive defect theory, including quantitative bounds and separation results. Section 5 investigates optimization formulations for operator-aware transform selection. Section 6 contains concluding remarks and discusses broader implications and connections to numerical linear algebra and operator theory.
2. The Transform-Based Tensor Algebra
This section recalls the transform-based tensor algebra that underlies the operator-inequality analysis in the remainder of the paper. The tensor product used here is the established -product of Kernfeld, Kilmer, and Aeron [3] and its -algebra formulation [4], specialized to unitary transforms . We denote the resulting product by and refer to it as the -product, or simply the -product when the transform is clear from context. We then recall the associated block-diagonal representation and the basic operations—trace, exponential, and logarithm—that will be used to state and analyze operator inequalities in later sections.
2.1. Definition of the -Product and Basic Operations
Let . For a unitary transform , define the transformed tensor by applying to each tube (i.e., each third-mode fiber) of . Denote by the i-th frontal slice of . The associated block-diagonal matrix is defined as
Definition 1
(-product, following [3,4]). For and , the -product is defined by
where is the block-diagonal matrix constructed from the transformed tensor in the same manner as above. This is the -product of [3,4] with .
Remark 1.
When Φ is the discrete Fourier transform (DFT) matrix, the -product reduces to the conventional t-product of Kilmer and Martin [6]. More generally, for an invertible transform M, the construction above coincides with the transform-based tensor–tensor product of [3].
2.2. -Trace, -Exponential, and -Logarithm
Definition 2
(-trace). Let . The Φ-trace of is defined by
where denotes the standard matrix trace.
Definition 3
(-exponential and -logarithm). Let be Φ-Hermitian. The Φ-exponential and Φ-logarithm are defined via the block-diagonal lifting as
where the functions and are applied blockwise to , i.e., to each diagonal block .
Here, denotes the inverse transform applied to each mode-3 fiber, i.e., the inverse of the map . It does not denote ordinary matrix multiplication of with the block-diagonal matrix.
2.3. -Hermitian Structure, Commutator, and Spectral Mapping
Definition 4
(-Hermitian). Let . We say that is Φ-Hermitian if its block-diagonal lifting is Hermitian, i.e.,
Equivalently, each transformed frontal slice is Hermitian for all .
Definition 5
(-commutator). Let be tensors of compatible sizes. The Φ-commutator is defined by
where the right-hand side is the ordinary matrix commutator.
Lemma 1
(Spectral mapping). Let be Φ-Hermitian, and let f be an analytic function defined on an open set containing the spectrum of . Then,
where is applied blockwise to each diagonal block. This is the standard functional calculus in the transform-domain representation of the algebra [3,4].
Proof.
Since is -Hermitian, the matrix is Hermitian and hence unitarily diagonalizable. Thus, there exists a unitary matrix U such that
where is diagonal containing the eigenvalues of .
Using the standard functional calculus for Hermitian matrices,
where is obtained by applying f to each diagonal entry.
By definition of the -functional calculus (cf. Section 2.2),
which establishes the claim. □
Remark 2.
The Φ-Hermitian condition is essential for the spectral mapping lemma, as it guarantees that is unitarily diagonalizable with real eigenvalues. For non-Hermitian tensors, the exponential and logarithm remain well-defined via the blockwise matrix exponential and logarithm, but the spectral interpretation (e.g., eigenvalue mapping) does not hold in general.
3. An Operator-Inequality Transfer Principle
This section records a transfer principle for classical operator inequalities in the transform-based tensor algebra. The purpose of this section is two-fold. First, we recall that the standard trace inequalities—including Golden–Thompson, Jensen, Klein, and Lieb—transfer to the transform-based tensor algebra with the same constants as in the matrix case. Second, we emphasize that this transfer is a direct consequence of the established transform-domain representation of the algebra [3,4]; it is therefore not the main contribution of this study. The main contribution, developed in Section 4, concerns the quantitative behavior of the associated defect under a change of transform.
3.1. Transfer Principle
The following transfer principle separates the algebraic validity of a matrix inequality from its quantitative behavior under a change in transform. Its purpose is to identify which conclusions follow directly from the established block-diagonal representation before examining the transform-dependent defect in Section 4.
Theorem 1
(Operator-inequality transfer principle). Let be a trace or functional inequality that is preserved under finite direct sums of matrices. More precisely, assume that for all Hermitian matrices of compatible sizes, the inequality holds, and that the same inequality holds for finite direct sums
whenever for each i.
Then, for every unitary transform , the corresponding inequality holds in the transform-based tensor algebra slice-wise. In particular, if are Φ-Hermitian tensors, then
where denotes the Φ-lift of obtained by replacing matrix operations with their Φ-counterparts.
Proof.
Using Proposition 1, the transform-based tensor algebra is isomorphic to the block-diagonal matrix algebra
Under this isomorphism, every -Hermitian tensor corresponds to a block-diagonal Hermitian matrix:
Since the inequality is preserved under finite direct sums, it holds blockwise for each slice tuple , : applying to the direct sum and using the direct-sum preservation yields . For trace inequalities, the trace of a block-diagonal matrix is the sum of the traces of its blocks, so this blockwise inequality is equivalent to , which is exactly . □
Because the block-diagonal functional calculus acts independently on each transformed slice, the matrix inequality applies to every block. For trace inequalities, the block contributions are additive. Therefore, summing the valid slice-wise inequalities establishes the tensor trace inequality:
This argument uses only the algebraic representation and the direct-sum property; it does not imply that the numerical slack of the inequality is invariant under changes of the transform.
Remark 3.
The transfer principle is a direct consequence of the standard transform-domain representation of the algebra [3,4]. Its role here is not to establish new inequalities, but to fix the algebraic setting in which the transform-dependent defect is analyzed in Section 4.
3.2. Corollaries: Golden–Thompson, Jensen, Klein, and Lieb
We now record the four classical inequalities as corollaries of Theorem 1. Throughout, denotes the -sum, i.e.,
Corollary 1
(-Golden–Thompson inequality). Let be Φ-Hermitian. Then,
Proof.
Apply Theorem 1 to the classical Golden–Thompson inequality,
which holds for all Hermitian matrices and is preserved under finite direct sums. Replacing A and B by the block-diagonal lifts and yields the claim. □
Corollary 2
(-Jensen inequality). Let be a convex function with . If is Φ-Hermitian, then
In the scalar case , the inequality reduces to for , which follows from convexity and . No normalization by is involved, and the previous counterexample with is excluded by the hypothesis .
Proof.
Apply Theorem 1 to the classical Jensen trace inequality for Hermitian A and convex with , which is preserved under finite direct sums. Replacing A by the block-diagonal lift yields . Since , the claim follows. □
Corollary 3
(-Klein inequality). Let ϕ be a convex function. If are Φ-Hermitian, then
Proof.
Apply Theorem 1 to the classical Klein inequality for Hermitian matrices. □
Corollary 4
(-Lieb concavity). The function
is jointly concave for and . In the scalar case , the map reduces to on . This map is not jointly concave in the naive sense, but the classical Lieb theorem is stated for the equivalent reformulation with , which is jointly concave; the present statement follows this standard formulation.
Proof.
Apply Theorem 1 to Lieb’s classical joint concavity theorem for positive definite matrices, which states that is jointly concave on the cone of positive definite matrices (equivalently, is jointly concave for ). Replacing with the block-diagonal lifts and using yields the claim. □
Remark 4.
Corollaries 1–4 show that the classical matrix trace inequalities transfer to transform-based tensor algebra with the same constants as in the matrix setting, independent of the choice of unitary transform Φ. This invariance follows from the transform-domain representation of the algebra [3,4]. However, as we shall see in Section 4, the quantitative tightness of these inequalities—specifically the Golden–Thompson defect—is not invariant and depends critically on the choice of Φ.
3.3. Background: Transform-Domain Representation
For completeness, we recall the transform-domain representation that underlies Theorem 1. This representation is standard in the -algebra literature [3,4]; we state it here only to fix notation and to make the subsequent defect analysis self-contained.
Proposition 1
(Transform-domain representation, cf. [3,4]). Let
denote the transform-based tensor algebra associated with the unitary transform Φ. Then, the mapping
is an algebra isomorphism. That is,
- 1.
- ,
- 2.
- is bijective.
Proof.
The map is linear because the mode-3 transform and block-diagonal assembly are linear.
By the definition of the -product, , so preserves multiplication.
If , every transformed frontal slice of vanishes; since is invertible, , proving injectivity.
Conversely, for any block-diagonal matrix , form a transformed tensor with frontal slices and apply the inverse mode-3 transform. The resulting tensor satisfies ; hence, is surjective.
Therefore, is an algebra isomorphism. □
Remark 5
(Limits of the representation). The representation preserves algebraic structure and functional calculus, which explains the transfer results above. However, it does not preserve all quantitative properties of interest. In particular, the tightness of the Golden–Thompson inequality—measured by the defect —depends critically on the choice of Φ. This sensitivity arises because the representation, while preserving the product, does not preserve the commutativity structure of the tensor slices in the transform domain. Different transforms Φ reveal different levels of noncommutativity, leading to transform-dependent defect magnitudes. We analyze this sensitivity in Section 4.
4. Transform-Dependent Golden–Thompson Defect
Having fixed the algebraic setting in Section 3, we now isolate the quantitative object whose transform dependence is the subject of this paper. The section proceeds in three steps: the slice-wise reduction in the defect (Lemma 2), the bounded-spectral upper and lower estimates (Theorem 2), and the qualitative separation results (Theorems 3 and 4).
4.1. Golden–Thompson Defect
The classical Golden–Thompson inequality is tight when the two matrices commute. In the transform-based tensor setting, the gap between the two sides of the inequality quantifies the effect of noncommutativity in the transform domain. This gap is the central object of our sensitivity analysis.
Definition 6
(Golden–Thompson defect). Let be Φ-Hermitian tensors. The Golden–Thompson defect is defined by
Using Corollary 1, we have
Remark 6
(Role of the defect). The defect is the natural measure of inequality tightness for three reasons:
- 1.
- It vanishes exactly when and commute in the transform domain, i.e., .
- 2.
- It is quantitatively controlled by the transform-domain commutator.
- 3.
- It is sensitive to the choice of Φ, making it the right objective for operator-aware transform selection.
4.2. Main Theorem: Transform-Sensitive Defect
We now formalize the central phenomenon of this work: while operator inequalities in the transform-based tensor algebra transfer with the same constants as in the matrix case, their defect exhibits quantitative dependence on transform-domain noncommutativity.
Lemma 2
(Slice-wise reduction of the defect). Let be Φ-Hermitian tensors. Under the transform-domain representation of Proposition 1, the Golden–Thompson defect decomposes as a sum of slice-wise classical defects:
where and are Hermitian matrices.
Proof.
Using the definitions of , , , and , and the representation from Proposition 1,
Since and are block-diagonal with diagonal blocks and , the trace decomposes as a sum over blocks. The exponential of a block-diagonal matrix is block-diagonal with exponentials of each block. Hence,
The Hermiticity of and follows from the -Hermitian assumption. This completes the proof. □
Theorem 2
(Transform-sensitive defect under bounded spectral domain). Let be Φ-Hermitian tensors, and assume that there exists , such that
Then, the following statements hold.
- (i)
- (Upper bound) There exists a constant , depending only on R, such that
- (ii)
- (Matching-order lower bound on an explicit family) For every there exist and a one-parameter family in the bounded spectral class, such thatfor some . This lower estimate is asserted only for the constructed family.
- (iii)
- (Transform sensitivity) There exist tensors and unitary transforms , such that
- (iv)
- (Vanishing condition) Ifthen
Consequently, on the bounded spectral class , the defect satisfies the upper bound in (i) for all admissible tensors, and the lower bound in (ii) on the one-parameter family constructed in the proof of (ii). For this family, the two-sided estimate
holds on the explicit family of part (ii). A general lower bound valid for all tensors in the bounded spectral class is not claimed; see Remark 7.
Proof.
Using Lemma 2, we obtain the slice-wise decomposition
where
is the classical Golden–Thompson defect for Hermitian matrices, and , .
Part (i): Upper bound. For Hermitian matrices with , classical quantitative versions of the Golden–Thompson inequality (see, e.g., [14]) provide a constant of , depending only on R, such that
Applying this to each slice pair and summing over yields
which establishes part (i).
Part (ii): Lower bound. For every transformed slice, choose , , where
Since and ,
so
Taking traces and using , , ,
Since is Hermitian with eigenvalues ,
Hence,
Moreover, and , so . Therefore,
For sufficiently small positive , there exists , such that . Summing over yields the lower bound for the constructed family.
Part (iii): Transform sensitivity. Let and . The qualitative separation is established in Theorems 3 and 4 below. In particular, Theorem 4 constructs tensors , such that all slices commute in the DFT domain and hence , while the DCT domain produces a strictly positive defect, i.e., . The continuity of follows from the facts:
- and depend linearly on ;
- the matrix exponential and trace are continuous;
- the unitary group is compact.
Thus, the mapping is continuous and therefore locally Lipschitz on compact subsets of .
Part (iv): Vanishing condition. If for all , then each pair consists of commuting Hermitian matrices. Commuting Hermitian matrices are simultaneously diagonalizable, which implies
Hence, for each . Summing over and applying Lemma 2 yields .
This completes the proof of Theorem 2. □
Remark 7
(Scope of the lower bound). Part (ii) establishes the lower bound only on the explicitly constructed one-parameter family. All subsequent statements that invoke a two-sided estimate are to be read as restricted to this family, or are reformulated as surrogate statements in Section 5.
Remark 8.
The constants and in Theorem 2 depend only on the spectral bound R, not on the tensor dimensions n and p or on the specific choice of Φ. This bounded spectral-domain formulation avoids the use of a universal constant, which would be inconsistent with the exponential scaling of the Golden–Thompson defect under rescaling , .
Remark 9.
On the bounded spectral class of Theorem 2, defines a non-negative, transform-dependent functional on the admissible transform space, whose magnitude is bounded above by the squared commutator energy under the bounded spectral assumption of Theorem 2(i). This endows the unitary group with a noncommutativity geometry; is not asserted to be a quadratic functional of Φ.
4.3. Qualitative Transform Separation: DFT vs. DCT
We now construct an explicit example showing that the Golden–Thompson defect can differ dramatically between two standard transforms. This example demonstrates that algebraic invariance does not imply quantitative invariance.
Theorem 3
(Explicit separation for real orthogonal transforms). Let and let be real orthogonal transforms, such that
is not a signed permutation matrix. Then, there exist tensors (with ) that are both -Hermitian and -Hermitian and satisfy
Proof.
Step 1: A row of U with two nonzero entries. Since and U is not a signed permutation matrix, U has a row containing at least two nonzero entries. Indeed, if every row of U had exactly one nonzero entry, then, since each row of an orthogonal matrix has unit Euclidean norm, that entry would have modulus 1; the rows would then be distinct standard basis vectors, so U would be a signed permutation matrix, contradicting the hypothesis. Hence, there exist a row index r and distinct column indices , such that and .
Step 2: Choice of noncommuting Hermitian matrices. Let
embedded in the upper-left block of an matrix and zero-padded elsewhere. Then, are real symmetric and
so .
Step 3: Construction of the -domain slices. Choose (e.g., ). Define frontal slices and for by
and for all other .
Define the physical tensors by the inverse mode-3 transform:
Because is real orthogonal, is real, so are real tensors.
Step 4: -Hermiticity and -Hermiticity. Every slice and is either 0, , , or , and hence, real symmetric. Therefore, and are block-diagonal with real symmetric blocks, and hence, Hermitian; this is exactly -Hermiticity.
For -Hermiticity, we use the slice-wise mixing formula. For every ,
Since U is real and every and is real symmetric, each transformed slice and is a real linear combination of real symmetric matrices, hence real symmetric. Therefore, are -Hermitian.
Step 5: . For every , the pair is one of
so the two matrices are scalar multiples of a common matrix (or both zero) and, therefore, commute the following: for all . Using Theorem 2(iv), .
Step 6: A nonzero commutator in the domain. Set and . For the distinguished row r, only and contribute:
Their commutator is
Since , , , and , we obtain .
Step 7: Strict positivity of . Using Lemma 2,
where is the classical Golden–Thompson defect for Hermitian matrices. Each summand is non-negative using the Golden–Thompson inequality. At , the pair is Hermitian (by Step 4) and noncommuting (by Step 6); for Hermitian matrices, equality in the Golden–Thompson inequality holds if and only if the matrices commute; hence, . Therefore,
This completes the proof. □
Theorem 4
(Explicit DFT–DCT separation). For , there exist real tensors whose physical frontal slices are symmetric, such that
Proof.
Let and , i.e.,
Using zero-based frequency indices, prescribe the DFT-domain slices by
These arrays satisfy the conjugate-symmetry conditions and (for ), so their inverse DFT yields real symmetric physical frontal slices.
Consequently,
All DCT-domain slices are real symmetric because they are real linear combinations of the real symmetric physical frontal slices. The strict equality condition in the Golden–Thompson inequality therefore yields
All remaining slice defects are non-negative. Using Lemma 2,
This completes the proof. □
Remark 10
(Scope of the DFT–DCT construction). Theorem 4 presents an explicit analytical witness for under the orthonormal DFT and DCT-II conventions. It shows that the specific real-symmetric Pauli construction of Theorem 3 is not the only admissible route: using conjugate-paired DFT-domain slices allows the complex mixing coefficients to combine into real symmetric DCT-domain slices while preserving noncommutativity. Whether the construction extends to all p, or to other transform pairs, remains open. In particular, for general p the DCT-domain slices are obtained from the DFT-domain slices via the mixing matrix , and the individual terms in the resulting commutator can in principle cancel; the explicit computation in Appendix A rules out such cancellation only for . The general-orthogonal construction of Theorem 3 avoids this issue by using a single row of U with exactly two nonzero entries, but it does not specialize to the DFT–DCT pair. A general-p DFT–DCT qualitative separation, or a general non-cancellation theorem for , is left open; the conditional quantitative statement in Theorem 5 makes the required non-cancellation property an explicit hypothesis.
For the construction of Theorem 4, the DCT-domain slice pair satisfies and for a suitable R, so the non-degeneracy hypothesis of Theorem 5 is satisfied with and .
Remark 11
(On quantitative separation). A stronger quantitative separation of the form requires additional structural assumptions on the mixing matrix , such as a non-cancellation property of its entries across opposite-parity indices. We state such a quantitative result conditionally in Theorem 5 below; verifying the required non-cancellation property for specific transform pairs is left as a separate question.
Theorem 5
(Conditional quantitative separation). Consider a sequence of tensor pairs with transformed slices of fixed matrix dimension n, and two unitary transforms , such that are both -Hermitian and -Hermitian. Suppose that
Assume that there exist constants , , and , all independent of p, and a subset with such that for every ,
Then, there exist constants and , independent of p, such that
and hence, .
Proof.
Step 1: Uniform positivity on the compact set. Let
where is the space of Hermitian matrices. The set is closed and bounded, and hence compact. The map
is continuous on . For Hermitian matrices, the Golden–Thompson defect is non-negative, and it vanishes if and only if . Since on , we have for every . By compactness,
Step 2: Linear lower bound. Since are -Hermitian, Lemma 2 yields
Each summand is non-negative. For , the corresponding slice pair belongs to , so . Hence,
Setting completes the proof.
Remark on the role of the hypothesis . This hypothesis is used only to ensure that the separation is nontrivial, i.e., that achieves zero defect while is strictly suboptimal. The linear lower bound itself depends only on the -domain non-degeneracy and on the -Hermiticity of . □
Remark 12
(Failure of the hypotheses of Theorems 5 and 6). The hypothesis with independent of p is essential and can fail. For instance, take and with as . Then, the commutator norm equals , so no uniform exists, and the compactness argument of Theorem 5 cannot be applied. In this regime, one can only conclude , not a linear-in-p lower bound.
The same construction illustrates the failure of the hypothesis of Theorem 6 (dimension-preserving embedding). That theorem requires a pair that is -Hermitian and -Hermitian and satisfies , . If the relative transform is a signed permutation matrix, then the -domain slices are obtained from the -domain slices by a signed permutation, so commutativity in one domain is equivalent to commutativity in the other; consequently, no such pair exists, and the embedding theorem cannot be applied. This is precisely the signed-permutation exception that appears in the hypotheses of Theorems 3 and 7.
Theorem 6
(Dimension-preserving embedding). Let be unitary transforms. Suppose a pair is both -Hermitian and -Hermitian and satisfies
Then, for every , there exist tensors with the same two defect values.
Proof.
Embed each physical frontal slice into the upper-left block:
Because the transforms act only along the third mode, this direct-sum structure is preserved in each transform domain. For every transformed slice,
and similarly for . Hence,
The additional terms cancel in the defect, so for . □
Remark 13.
Combining Theorem 4 with Theorem 6 yields an explicit DFT–DCT separation in any matrix dimension .
4.4. Numerical Illustration
We provide a numerical illustration of the transform sensitivity predicted by the theory. Two distinct objects are involved, and we keep them separate throughout:
- (i)
- the explicit analytical witness of Theorem 4, which establishes the existence of a strict separation between DFT and DCT;
- (ii)
- a family of commuting DFT-domain slices parametrized by the tensor depth p, used only to visualize the empirical trend of the DCT defect as p grows.
The numerical experiment in (ii) is not the witness of Theorem 4; it is a separate construction whose purpose is to illustrate the qualitative phenomenon, not to verify the non-degeneracy hypothesis of Theorem 5 for all p.
The analytical witness. For the construction of Theorem 4, the DFT-domain slices are
with and . The DCT-domain slice pair at is
so , and hence, , while . This is a single, analytically verified data point at ; it is not a curve in p.
The numerical family used in Figure 1. To visualize the dependence of the defect on the tensor depth, we use a separate family of commuting DFT-domain slices, parametrized by , in which each slice pair consists of scalar multiples of a single Pauli matrix (alternating between and across the frequency index). Using Theorem 2(iv), this construction yields up to numerical precision. Evaluating the same tensors under the DCT transform produces a strictly positive defect, consistent with the qualitative separation underlying Theorem 4.
Figure 1.
Transform separation under different spectral bases. The Golden–Thompson defect is plotted as a function of the tensor depth p for the DFT and DCT transforms. The DFT construction yields defects at the level of numerical precision, while the DCT transform produces a strictly positive defect that grows approximately linearly with p. The dashed line is the linear fit discussed in the text; it is almost indistinguishable from, and essentially overlaps with, the DCT defect curve over the displayed range of p, confirming that the empirical growth is approximately linear. This figure is a numerical illustration of the qualitative separation underlying Theorem 4; it is not the explicit witness of that theorem, and the fitted line is empirical and does not by itself establish a quantitative lower bound.
Figure 1 plots as a function of the tensor depth p for the DFT and DCT transforms. The DFT construction yields defects at the level of numerical precision, reflecting exact slice-wise commutativity in the Fourier domain. In contrast, the DCT transform produces a strictly positive defect that grows approximately linearly with p. A linear fit yields
This empirical trend is consistent with the qualitative separation underlying Theorem 4; it does not verify the non-degeneracy hypothesis of Theorem 5 for all p, nor does it assert a dimension-independent quantitative lower bound. It confirms only that the inequality itself transfers to the tensor setting (Corollary 1), while its quantitative tightness depends strongly on the choice of transform.
5. Operator-Aware Transform Selection
The separation results above show that a transform (e.g., DFT) can outperform another (e.g., DCT) for specific tensor pairs. This raises a fundamental question: can one identify a transform that minimizes the defect uniformly over all tensor pairs? As we show below, the answer is negative (Theorem 7), and this motivates the operator-aware formulation over (Definition 7 and Corollary 5), together with the Riemannian gradient scheme (Algorithm 1).
| Algorithm 1: Riemannian gradient scheme for operator-aware transform selection |
![]() |
The answer is negative. Transform optimality is not globally ordered: different transforms can be optimal for different data. In other words, the choice of is inherently data-dependent rather than universally optimal. The following theorem formalizes this non-universality.
Theorem 7
(Transform non-universality). Let be two distinct orthogonal transforms, such that is not a signed permutation matrix. Then, the following statements hold:
- 1.
- There exist tensors that are both -Hermitian and -Hermitian, such that
- 2.
- There exist tensors that are both -Hermitian and -Hermitian, such that
In particular, no single orthogonal transform is universally optimal; the optimal transform depends on the joint structure of the tensor pair.
Proof.
We prove the two statements separately.
Part 1: optimal, suboptimal. Let . Since U is not a signed permutation matrix, there exists at least one row of U containing two nonzero entries. Fix such a row index r, and choose two column indices with and .
Let be two Hermitian matrices that do not commute, i.e., . A concrete choice is the Pauli matrices and embedded in the upper-left block, with zeros elsewhere. This ensures that the tensors are -Hermitian for any real orthogonal , because the zero padding preserves Hermiticity under real linear combinations.
Construct tensors by specifying their -domain frontal slices as follows. Set all slices to zero except:
where is a scalar with (e.g., ). All other slices are set to the zero matrix.
Since and are real orthogonal, and the constructed -domain slices are Hermitian (they are either , , or zero), the resulting physical tensors are both -Hermitian and -Hermitian. This follows because the inverse transforms and are also real, so Hermiticity is preserved under real linear combinations.
Now, we study the defect under . For every slice index , the pair consists of scalar multiples of the same Hermitian matrix (or both are zero). Hence they commute:
Using Theorem 2(iv), commuting slices imply vanishing defect:
For the defect under , the -domain slices are obtained by mixing the -domain slices via the matrix :
For the distinguished row index r, only columns j and k contribute nonzero terms (all other slices are zero). Therefore,
Their commutator is
since , , and .
Because this slice has a nonzero commutator, the classical Golden–Thompson defect for this slice pair is strictly positive. Using the slice-wise decomposition (Lemma 2) and the fact that the defect sums over slices with non-negative contributions, we obtain
Part 2: optimal, suboptimal. The second statement follows by symmetry. Consider the matrix . Since U is not a signed permutation matrix, is also not a signed permutation matrix. Hence, the same construction applied with the roles of and exchanged yields tensors , such that
This completes the proof. □
Remark 14
(Data-dependent optimality). Theorem 7 establishes that no fixed transform is universally optimal; the optimal depends on the joint commutativity structure of . This justifies the adaptive optimization framework in Section 5, where the transform is selected from data rather than prescribed a priori.
Remark 15
(Relation to representation-oriented transform learning). The transform-selection problem considered here differs from representation-oriented transform learning, such as the matrix-mimetic algebra optimization of Newman and Keegan [15]. In [15], the transform is chosen to optimize representation, compression, or approximation properties of the algebra. In contrast, our objective is operator-aware: we select Φ to minimize transform-domain noncommutativity,
Hence, this improves the tightness of operator inequalities for a given tensor pair .
5.1. Operator-Aware Transform Selection
Theorem 2 shows that, under a bounded spectral-domain assumption, the defect is quantitatively controlled by transform-domain noncommutativity. This naturally leads to an optimization problem over the orthogonal group, where the goal is to select a transform that minimizes the defect and hence reduces noncommutativity in the transformed domain. This reveals that transform selection is equivalent to searching for a coordinate system that minimizes noncommutative interaction.
We restrict to real orthogonal transforms for two reasons. First, for real tensors whose frontal slices are symmetric, and for real orthogonal transforms, the transformed slices remain symmetric. This ensures that the optimization domain is well-defined and that -Hermiticity is preserved along the optimization path. Second, the orthogonal group is compact and admits standard Riemannian optimization techniques. The complex unitary case is discussed in Section 6.
Definition 7
(Admissible transform selection). Let have symmetric frontal slices. Define the defect objective and the commutator-energy surrogate on . The optimal defect problem is ; the surrogate problem is . These are distinct unless an additional theorem relates their minimizers.
Example 1
(Hermiticity is automatic in the real symmetric setting). If have symmetric frontal slices and is real orthogonal, then each transformed slice is a real linear combination of symmetric matrices, and hence real symmetric. Thus, are Φ-Hermitian for every .
Theorem 8
(Existence and zero-defect optimality). Let satisfy the assumptions of Definition 7. Then,
- (i)
- Both D and J attain global minima on .
- (ii)
- If for some , then , and is a global minimizer of both objectives.
- (iii)
- If and equality in the Golden–Thompson inequality is characterized by commutativity for every transformed slice, then .
- (iv)
- No equality of the complete minimizer sets is claimed when their minimum values are strictly positive.
Proof.
(i) Existence. The transformed slices depend continuously on , and matrix exponentiation, trace, and commutator operations are continuous. Consequently, D and J are continuous on the compact group , and both attain their minima.
(ii) Zero-defect optimality. If , every transformed slice pair commutes. The Golden–Thompson defect vanishes slice-wise, so . Non-negativity of both objectives establishes global optimality.
(iii) Converse under equality characterization. If , all non-negative slice-wise defects vanish. Under the Golden–Thompson equality characterization, each transformed slice pair commutes; hence, .
(iv) This is a statement of scope and requires no proof. □
Corollary 5
(Commutator energy as a surrogate objective). Let satisfy the bounded spectral assumption of Theorem 2, and define
Then, the following statements hold:
- (i)
- (Existence) Both D and J attain global minima on ; see Theorem 8(i).
- (ii)
- (Upper surrogate bound) There exists , depending only on the spectral bound R, such thaton the bounded spectral class. Consequently, for every ,Thus, J is an upper surrogate for D on this class, and minimizing J controls D up to the constant .
- (iii)
- (Matching lower bound on the explicit family at the fixed transform of Theorem 2(ii)) Let be the one-parameter Pauli family constructed in the proof of Theorem 2(ii), and let denote the transform with respect to which this family is constructed. By Theorem 2(ii) and Remark 7, there exists , depending only on R, such thatNo lower bound of the form is asserted for all ; establishing such a uniform-in-transform lower bound would require proving , which is not attempted here. No comparable lower bound is asserted for general tensors in the bounded spectral class; see Remark 7.
- (iv)
- (Zero-defect case) If , then using Theorem 8(ii), every minimizer of J satisfies , so is also a global minimizer of D, and the minimizer sets coincide at the zero level. This is the only regime in which an exact (not merely constant-factor) identification of minimizers is asserted.
- (v)
- (Scope and interpretation) When , statement (ii) provides an upper surrogate bound on the bounded spectral class, and statement (iii) provides a two-sided constant-factor comparison only at the fixed transform of Theorem 2(ii) and on the explicit Pauli family constructed there. No equality of the full minimizer sets and is claimed in this regime; cf. Theorem 8(iv). Accordingly, minimizing is analogous to finding an orthogonal transform that makes the transformed slices as commuting as possible, and J is to be regarded as a surrogate for D rather than as an equivalent objective. A precise equivalence with a standard approximate joint diagonalization criterion would require an additional theorem; we therefore present this connection as motivation rather than as an identity.
Proof.
(i) This is Theorem 8(i); it is restated here only to fix notation for subsequent items.
(ii) Using Theorem 2(i), on the bounded spectral class there exists , depending only on R, such that for all admissible . Let , which exists by (i). Then,
This is the asserted upper surrogate bound.
(iii) Using Theorem 2(ii) and Remark 7, on the one-parameter Pauli family , at the fixed transform of Theorem 2(ii), there exists , depending only on R, such that . At this fixed , the upper bound of (ii) also holds, so
No statement is made about or .
(iv) If , then any minimizer of J satisfies , so every transformed slice pair commutes. By Theorem 2(iv), ; since by Corollary 1, is a global minimizer of D. Conversely, if and the Golden–Thompson equality characterization applies slice-wise, then by Theorem 8(iii), so is a global minimizer of J. Hence the two minimizer sets agree at the zero level.
(v) This item records the scope of (ii)–(iv) and the intended interpretation of J as a surrogate; it requires no proof, and the assertions about the absence of a general minimizer-set identity are exactly those of Theorem 8(iv). □
Remark 16
(Conditional uniform surrogate guarantee). If, in addition to the assumptions of Corollary 5, a uniform estimate holds on all of with a constant C independent of Φ (for instance, if the bounded spectral assumption is strengthened to hold uniformly in Φ), then any minimizer of J satisfies
and in the zero case , this makes a global minimizer of D as well. No such uniform estimate is claimed here beyond the bounded spectral class of Theorem 2(i); see Remark 7.
Remark 17
(Geometric interpretation). The optimization problem seeks a coordinate system (via the orthogonal transform Φ) in which the transformed frontal slices and are as close as possible to commuting. This is analogous to finding a basis that approximately simultaneously diagonalizes a family of matrices. When exact simultaneous diagonalization is possible, the defect becomes zero, and the Golden–Thompson inequality is tight.
Remark 18
(Connection to transform separation). The strict separation example (DFT vs. DCT) demonstrates that the choice of Φ matters: for the same tensors , one transform may yield a vanishing defect while another yields a strictly positive defect. This shows that the optimal transform problem is nontrivial and that solving it can lead to substantial improvements.
5.2. Computing the Optimal Transform: Riemannian Gradient Flow
We consider the nonconvex optimization problem:
where is the orthogonal group. Using Theorem 2, under the bounded spectral-domain assumption, the defect is quantitatively controlled by transform-domain noncommutativity.
To obtain a smooth objective suitable for gradient-based optimization, we consider the squared surrogate
Here, acts as an orthogonal mixing operator along the third (tube) mode. Concretely, for any tensor with frontal slices , the transformed slices are provided by
Thus, mixes the frontal slices linearly along the third dimension; it is not a similarity transform within each slice but an orthogonal combination of whole slices.
In the Riemannian formulation, we equip with the canonical Riemannian metric induced by the Frobenius inner product
The tangent space at is
where is the Lie algebra of skew-symmetric matrices.
Let denote the Euclidean gradient of J with respect to . The Riemannian gradient is obtained by projecting onto the tangent space:
A first-order gradient flow update along the negative Riemannian gradient direction is provided by
where is a step size.
Since may not be orthogonal, we project it back to using a retraction . For example, the polar retraction is yielded by
which maps any invertible matrix to the nearest orthogonal matrix in the Frobenius norm. The complete update is
Under standard assumptions on the step size, the Riemannian gradient descent scheme converges to a stationary point of J; see [16,17] for details. We summarize the resulting Riemannian gradient scheme below.
Example 2
(One iteration on a tensor). Take , , , , and the tensor pair from Theorem 4. The Euclidean gradient is computed by automatic differentiation through the mixing formula and the commutator, and the polar retraction is used. Numerically, and one Riemannian gradient step yield ; the values , , and are reported in Table 1 (double-precision arithmetic).
Table 1.
One iteration of Algorithm 1 on the tensor pair of Theorem 4 (, ).
Proposition 2
(Stationary accumulation-point property). Assume that J is continuously differentiable and that its Riemannian gradient is Lipschitz continuous with constant on . Then, for sufficiently small step size , the iteration generated by Algorithm 1 satisfies , and every accumulation point of is a stationary point of J on , i.e., . No iterate convergence is asserted without additional second-order sufficient conditions.
Proof.
The update is a Riemannian gradient step on . The retraction is a first-order approximation of the exponential map and preserves feasibility. Using standard results from Riemannian optimization [16], the Lipschitz continuity of the Riemannian gradient implies a sufficient decrease condition:
for sufficiently small . Summing this inequality over k yields
hence . By continuity of the Riemannian gradient, any accumulation point satisfies , i.e., is a stationary point. Iterate convergence to a single stationary point would require an additional second-order sufficient condition (e.g., nondegeneracy of the Hessian at ), which is not assumed here. □
Remark 19
(Computational complexity). Each iteration of Algorithm 1 requires the following:
- operations for the dense mode-3 transform mixing (or when Φ is DFT/DCT and implemented by a fast transform);
- operations to evaluate the p commutators of matrices;
- operations for the retraction (QR or polar decomposition).
The overall complexity per iteration is , which is acceptable for moderate n and p (e.g., , ).
Remark 20
(Initialization strategies). The choice of initial transform can affect convergence speed and the quality of the final solution. Natural initializations include the following:
- DFT or DCT (standard choices in the tensor literature);
- the identity transform (baseline);
- a data-dependent transform (e.g., SVD of the unfolded tensor).
In practice, we observe that Algorithm 1 consistently reduces regardless of initialization.
Remark 21
(Connection to the commuting case). The algorithm seeks a transform Φ that minimizes transform-domain noncommutativity. If a transform exists that renders all slices commuting, i.e.,
then using Theorem 8(iii), so is a global minimizer of J and of D. However, since J is nonconvex on , Riemannian gradient descent from an arbitrary initialization is not guaranteed to reach ; it is only guaranteed to reach a stationary point (Proposition 2).
5.3. Numerical Illustration of Operator-Aware Transform Selection
We now demonstrate numerically that standard transforms such as DFT and DCT are not necessarily optimal. For a fixed tensor dimension , we consider a tensor pair for which the DFT transform yields a small but nonzero defect. We then compute an optimized transform using the Riemannian gradient descent scheme in Algorithm 1.
Using Corollary 5(ii), minimizing is controlled from above by the commutator energy
which is the objective optimized by Algorithm 1.
The results in Table 2 reveal several key observations. The DCT transform produces a large defect, indicating strong noncommutativity induced by transform-domain mixing. The DFT transform significantly reduces the defect but does not eliminate it. The optimized transform further reduces the defect by approximately one order of magnitude compared to DFT and by several orders of magnitude compared to DCT. In particular, we observe that
demonstrating that operator-aware transform selection can outperform both standard transforms.
Table 2.
Golden–Thompson defect for different transforms (, ). The optimized transform is obtained by minimizing transform-domain noncommutativity, not representation error. It achieves a defect strictly smaller than both DFT and DCT, illustrating operator-aware transform selection.
This example illustrates both aspects of the theory. First, Figure 1 confirms the transform sensitivity predicted by Theorem 2(iii), showing that different transforms can yield dramatically different defect magnitudes. Second, Table 2 demonstrates that no fixed transform is universally optimal. Even when a standard transform (such as DFT) performs well, the optimization framework can identify a superior transform tailored to the specific tensor pair. The substantial reduction in defect achieved by highlights the practical value of the Riemannian optimization approach. This provides a concrete numerical validation of the data-dependent optimality principle established in Theorem 7 and supports the optimization framework developed in Section 5.1.
6. Discussion and Conclusions
This study separates algebraic invariance from quantitative behavior in transform-based tensor algebras. While all unitary transforms induce algebraically isomorphic tensor algebras via the standard transform-domain representation of the framework [3,4], the Golden–Thompson defect shows that inequality tightness depends intrinsically on the transform. The transform is therefore not merely a computational device, but a coordinate system in which commutativity—and hence inequality tightness—is measured.
- Transform as geometry.
The mapping preserves algebraic operations but alters commutativity. Different transforms induce different commutator structures, endowing tensor operators with a transform-dependent noncommutativity geometry. This geometry is encoded in the defect and in its associated commutator-energy form
In this sense, the choice of defines a coordinate system on the space of tensor slices, and the defect measures how far the tensor pair is from being simultaneously diagonalizable in that coordinate system.
- Joint diagonalization connection.
Under the bounded spectral-domain assumption of Theorem 2, minimizing is controlled, up to constants depending only on the spectral bound R, by the commutator energy
in the sense of Corollary 5(ii)–(iii): the upper bound holds pointwise in on the bounded spectral class, while the lower bound holds at the fixed transform of Theorem 2(ii) and on the explicit Pauli family constructed there. This is analogous to seeking a transform that makes the transformed slices as commuting as possible. This aligns with approximate joint diagonalization, where the optimal transform selects a coordinate system maximizing operator compatibility. The operator-aware transform selection problem of Section 5 can therefore be viewed as a structured approximate joint diagonalization problem on the orthogonal group.
- Implications for numerical linear algebra and operator theory.
The defect provides a quantitative measure of noncommutativity. Thus, transform selection becomes a principled tool for improving spectral stability and reducing operator interaction, complementing classical rank- and sparsity-based criteria. More broadly, influences both the representation of the data and the operator-level behavior of the resulting algebra, linking algebraic modeling with analytical performance. This connects the present study to several themes in numerical linear algebra and operator theory, including simultaneous diagonalization, spectral stability of tensor operators, and the quantitative analysis of trace inequalities.
- No free transform principle.
Transform selection is not merely a change of basis. Although the transform-based tensor algebra is algebraically invariant under a change of unitary transform, quantitative behavior is transform-dependent. Using Theorem 7, no transform is universally optimal: for any two orthogonal transforms whose relative transform is not a signed permutation matrix, there exist tensor pairs for which each transform is strictly better than the other. (For signed-permutation relatives, the two transforms differ only by a signed permutation of slices, and the strict separation argument of Theorem 7 does not apply.)
Each transform defines a coordinate system in which commutativity is evaluated, and optimality is inherently data-dependent. This parallels “no free lunch” principles: no single basis simultaneously diagonalizes all operators. Consequently, the transform must be selected adaptively, motivating the operator-aware optimization framework in Section 5.
- Conclusion and Future Directions
In summary, this work shows that algebraic invariance in transform-based tensor algebras does not imply quantitative invariance of operator inequalities. The Golden–Thompson defect provides a transform-dependent measure of inequality tightness, controlled from above by transform-domain noncommutativity under a bounded spectral-domain assumption, and controlled from below on the explicit Pauli family of Theorem 2(ii) at the fixed transform constructed there. The defect is sensitive to the choice of transform; no transform is universally optimal (the optimal transform depends on the joint structure of the tensor pair), and operator-aware transform selection can be formulated as an optimization problem over the orthogonal group. These results establish a nontrivial transform-dependent structure of inequality tightness in transform-based tensor algebras and open several concrete directions, summarized below.
Several questions remain open. First, a general lower bound for valid for all tensors in the bounded spectral class, beyond the explicit one-parameter Pauli family of Theorem 2(ii), is not established. Second, the DFT–DCT construction of Theorem 4 is established for under the orthonormal DFT and DCT-II conventions; extending it to general p and to other transform pairs remains open. Third, the relationship between commutator-energy minimization and approximate joint diagonalization deserves a separate quantitative analysis. Fourth, operator-aware transform selection may be extended to constrained unitary optimization and to additional matrix inequalities.
Author Contributions
Conceptualization, S.-Y.C. and M.K.N.; Methodology, S.-Y.C.; Software, S.-Y.C.; Validation, S.-Y.C.; Formal analysis, S.-Y.C.; Investigation, S.-Y.C.; Resources, S.-Y.C.; Data curation, S.-Y.C.; Writing—original draft, S.-Y.C. and M.K.N.; Writing—review and editing, S.-Y.C. and M.K.N.; Project administration, S.-Y.C. All authors have read and agreed to the published version of the manuscript.
Funding
M. Ng’s research is supported by the GDSTC: Guangdong and Hong Kong Universities “1 + 1 + 1” Joint Research Collaboration Scheme JRCS-25-26-MATH-01, National Key Research and Development Program of China under Grant 2024YFE0202900, RGC GRF 12300125, and ITF Funding PRP/104/24FX.
Data Availability Statement
The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding authors.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A. Explicit DFT–DCT Mixing at p = 4
We use the orthonormal DFT
and the orthonormal DCT-II
Set . A direct computation yields
The construction of Theorem 4 uses the second row : the conjugate pair acts on the DFT-domain slices at and (both equal to ), while the entry acts on the slice at (equal to ). Since , the slice at does not contribute. Hence,
and
References
- Zhang, X.; Ng, M.K. Sparse nonnegative tensor factorization and completion with noisy observations. IEEE Trans. Inf. Theory 2022, 68, 2551–2572. [Google Scholar] [CrossRef] [Scilit]
- Song, G.J.; Ng, M.K.; Zhang, X. Tensor completion by multi-rank via unitary transformation. Appl. Comput. Harmon. Anal. 2023, 65, 348–373. [Google Scholar] [CrossRef] [Scilit]
- Kernfeld, E.; Kilmer, M.; Aeron, S. Tensor–tensor products with invertible linear transforms. Linear Algebra Appl. 2015, 485, 545–570. [Google Scholar] [CrossRef] [Scilit]
- Kilmer, M.E.; Horesh, L.; Avron, L.; Newman, E. Tensor-tensor algebra for optimal representation and compression. Proc. Natl. Acad. Sci. USA 2021, 118, e2015851118. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kilmer, M.E.; Braman, K.; Hao, N.; Hoover, R.C. Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J. Matrix Anal. Appl. 2013, 34, 148–172. [Google Scholar] [CrossRef] [Scilit]
- Kilmer, M.E.; Martin, C.D. Factorization strategies for third-order tensors. Linear Algebra Appl. 2011, 435, 641–658. [Google Scholar] [CrossRef] [Scilit]
- Lu, C.; Feng, J.; Chen, Y.; Liu, W.; Lin, Z.; Yan, S. Tensor robust principal component analysis with a new tensor nuclear norm. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 925–938. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Song, G.; Ng, M.K.; Zhang, X. Robust tensor completion using transformed tensor singular value decomposition. Numer. Linear Algebra Appl. 2020, 27, e2299. [Google Scholar] [CrossRef] [Scilit]
- Golden, S. Lower bounds for the Helmholtz function. Phys. Rev. 1965, 137, B1127–B1128. [Google Scholar] [CrossRef] [Scilit]
- Thompson, C.J. Inequality with applications in statistical mechanics. J. Math. Phys. 1965, 6, 1812–1813. [Google Scholar] [CrossRef] [Scilit]
- Lieb, E.H. Convex trace functions and the Wigner–Yanase–Dyson conjecture. In Les Rencontres Physiciens-Mathématiciens de Strasbourg–RCP25; Springer: Berlin/Heidelberg, Germany, 1973; Volume 19, p. 35. [Google Scholar]
- Chang, S.-Y.; Wei, Y. T-product tensors—Part II: Tail bounds for sums of random t-product tensors. arXiv 2021, arXiv:2107.06224. [Google Scholar]
- Chang, S.-Y.; Wei, Y. T-square tensors—Part I: Inequalities. Comput. Appl. Math. 2022, 41, 62. [Google Scholar] [CrossRef] [Scilit]
- Hiai, F.; Petz, D. Introduction to Matrix Analysis and Applications; Springer: Cham, Switzerland, 2014. [Google Scholar]
- Newman, E.; Keegan, K. Optimal matrix-mimetic tensor algebras via variable projection. SIAM J. Matrix Anal. Appl. 2025, 46, 1764–1790. [Google Scholar] [CrossRef] [Scilit]
- Absil, P.-A.; Mahony, R.; Sepulchre, R. Optimization Algorithms on Matrix Manifolds; Princeton University Press: Princeton, NJ, USA, 2008. [Google Scholar]
- Edelman, A.; Arias, T.A.; Smith, S.T. The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Anal. Appl. 1998, 20, 303–353. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.

