1. Introduction
Synthetic aperture radar (SAR), with its all-day, all-weather Earth-observation capability, has been widely used in terrain mapping, disaster monitoring, ocean remote sensing, and military reconnaissance [
1,
2,
3]. As Earth-observation missions demand ever wider swaths and higher resolutions, conventional SAR systems face an inherent trade-off between swath width and azimuth resolution [
4]. Multiple-input multiple-output SAR (MIMO-SAR) can effectively increase the number of equivalent phase centers by transmitting mutually orthogonal waveforms, thereby improving azimuth resolution without sacrificing swath width [
5,
6]. In MIMO-SAR systems, the orthogonality of the waveform set has a direct impact on image quality: the auto-correlation sidelobe level affects the range point spread function (PSF), while cross-correlation components introduce inter-channel interference that is equivalent to azimuth ambiguity, severely degrading image contrast and the detectability of weak targets [
7,
8,
9,
10]. The design of orthogonal waveform sets with low auto-correlation sidelobes and low cross-correlation sidelobes is therefore a fundamental problem in MIMO-SAR signal processing.
Two key metrics characterize waveform orthogonality: the integrated sidelobe level (ISL) and the peak sidelobe level (PSL). The PSL directly reflects the worst sidelobe interference in SAR images and determines the extent to which strong scatterers mask nearby weak targets; it is therefore the constraint of primary engineering interest [
11,
12]. Early studies focused mainly on ISL minimization because of its tractable quadratic structure. Methods such as Cyclic Algorithm New (CAN) [
13,
14], majorization–minimization (MM) [
15,
16], alternating direction method of multipliers (ADMM) [
17], and deep unfolding networks [
18] can approach the theoretical lower bound on the ISL. However, low-ISL waveforms may still exhibit a high PSL, which compromises the detection of weak targets.
To suppress the PSL, several studies optimize it directly. The MM-based PSL minimizer constructs a surrogate function for the PSL and solves it efficiently using the fast Fourier transform (FFT), achieving monotonic descent [
19].
The minimax method based on a primal–dual framework and the Proximal Minimax Method (PMM) embed the
-norm constraint directly into the augmented Lagrangian, providing strong PSL suppression [
20,
21]. Other works combine alternating minimization with a Lagrangian dual lower bound [
22]. These methods, however, perform high-dimensional matrix operations at every iteration, which incur substantial computational overhead when the number of waveforms
M and the code length
N are large, limiting their applicability in large-scale scenarios.
Another common approach is to construct a joint objective by linearly combining PSL and ISL with appropriate weights. Examples include the coordinate-descent framework [
23], the weighted-ISL MM method [
24], WeBEST-v [
25], a vectorized block-coordinate descent method based on Block Successive Upper-bound Minimization (BSUM) with an
-norm surrogate, the joint MM–ADMM framework [
26], and the Block Iterative Shrinkage-Thresholding (BiST) algorithm based on block-coordinate descent [
27].
All of these methods strike a flexible compromise between PSL and ISL by tuning the weighting coefficients. The Con method, which uses a residual network to perform weighted unsupervised optimization of PSL and ISL, also yields relatively low PSL values [
28]. A common drawback of these approaches is that the weights must be re-tuned for each waveform size without theoretical guidance, and the weighted formulation itself does not address the non-differentiability of the PSL.
A widely adopted route to differentiability is to introduce an
-norm: with
, the objective reduces to the ISL, while, as
, it approaches the PSL. Representative algorithms include the
p-MM method, which successively solves low-order surrogate subproblems within an MM framework to approximate PSL minimization [
29], and WeBEST-v, which performs vectorized block-coordinate descent based on BSUM [
25]. Riemannian manifold approaches model the problem on the complex circular-product manifold and directly optimize the
-norm via trust-region methods [
30,
31].
-norm-based algorithms have also been extended to Doppler-tolerant scenarios [
32], to a unified analysis of high-order norms [
33], and to the joint design of waveforms and mismatched filters [
34]. A common drawback of these methods is their strong dependence on the choice of
p: different algorithms exhibit different sensitivities to
p. If
p is too small, the objective degenerates toward the ISL, and peak suppression is insufficient; if
p is too large, high-order exponentiation causes gradient explosion or numerical overflow. Moreover, the optimal
p varies with the waveform size and must be re-tuned in each case, which limits their practical applicability across different waveform sizes.
Some existing methods approximate the non-differentiable maximum operator with a smooth surrogate so that it can be incorporated directly into a gradient-based framework. One approach uses the log-sum-exp (LSE) function to smoothly approximate the PSL and combines it with the Adam optimizer, with good empirical results [
35]. An iterative neural network method based on the Mellowmax operator likewise provides a smooth approximation of the PSL and obtains low PSL values [
36]. The two smoothing functions belong to the same family and are mathematically equivalent. Such methods scale well to large problems, but they suffer from two structural shortcomings. First, the smoothing parameter has to be tuned manually; in the LSE, for example, too small a
t causes gradient oscillations, whereas too large a
t degrades the approximation accuracy. Second, when the total number of sidelobes reaches hundreds of thousands, the accumulated gradient contribution from a vast number of low-energy sidelobes—henceforth termed
gradient noise—masks the gradient signal of the high-energy sidelobes, slowing convergence and preventing further reduction in the PSL.
In summary, in pursuit of a differentiable surrogate for the PSL that is amenable to optimization, the global power weighting of the -norm, the softmax-style soft weighting of the LSE, and linear weighted combinations all distribute the weights across all sidelobes. To further reduce the PSL, however, the optimization weight should be concentrated on the high-energy sidelobes, with the ideal weight on low-energy sidelobes being exactly zero—in other words, the weights should be sparse. An ideal PSL objective should therefore satisfy the following four properties simultaneously: (1) focus only on high-energy sidelobes so as to effectively reduce the PSL; (2) impose strict truncation on low-energy sidelobes to suppress the gradient noise they would otherwise inject; (3) maintain differentiability with respect to the phase parameters to support efficient gradient-based optimization; and (4) adapt well to different waveform sizes without the need for loss-function hyperparameter tuning.
Motivated by these requirements, this paper proposes a loss function based on the 1.5-entmax sparse transform [
37] as a sidelobe weighting function. While remaining differentiable, the proposed loss adaptively concentrates the optimization on the high-energy sidelobes and strictly truncates low-energy sidelobes, preventing them from accumulating gradient noise. To avoid the construction of surrogate functions and the heavy computations involved in conventional algorithms, we develop an optimization framework that leverages GPU-accelerated automatic differentiation and a custom analytical-gradient operator to minimize the proposed loss efficiently. The main contributions of this paper are summarized as follows:
The 1.5-entmax function is introduced into MIMO-SAR waveform design. By exploiting the sparsity of its output, the optimization automatically focuses on high-energy sidelobes and strictly truncates low-energy ones. This eliminates gradient noise at its source, removing the perturbation that arises in existing smooth approximations where all sidelobes participate in the gradient, and yields lower PSL values.
To address the inherent scale sensitivity of the 1.5-entmax function, a normalization preprocessing step based on the theoretical upper bound of the sidelobe is introduced. This allows the truncation threshold to adapt automatically to the relative distribution of sidelobes. A rigorous proof of differentiability and a closed-form analytical gradient are also provided, which together facilitate efficient and stable convergence.
The proposed loss function is embedded into a deep learning optimization framework that combines GPU-accelerated automatic differentiation with a custom analytical-gradient operator. For the sparse-truncation step, an analytical Jacobian operator that bypasses the computation-graph expansion of automatic differentiation is constructed, keeping the per-iteration complexity at .
Extensive simulation experiments confirm that the proposed method attains state-of-the-art PSL values for all waveform sizes considered and consistently approaches the Levenshtein lower bound. In large-scale scenarios, it achieves a speedup of approximately two orders of magnitude over existing state-of-the-art methods, demonstrating its potential for online waveform design.
The remainder of this paper is organized as follows:
Section 2 establishes the signal model and defines the performance metrics.
Section 3 details the design and theoretical analysis of the proposed loss function.
Section 4 describes the deep learning-based optimization framework.
Section 5 presents simulation experiments under various scenarios and compares the proposed method with representative baselines.
Section 7 concludes the paper and discusses directions for future work.
3. Design and Differentiability Analysis of the Loss Function
To address the non-differentiability of the
noted at the end of
Section 2 and the gradient-noise issue raised in
Section 1, this section constructs a loss function based on the 1.5-entmax transform. We first analyze the properties of the entmax transform and discuss the choice of the parameter
. We then identify the issues caused by its scale sensitivity and present a remedy. On this basis, the loss function is defined, and a rigorous proof of differentiability together with a closed-form expression for the analytical gradient is provided.
3.1. Entmax Transform and Parameter Selection
Smoothing the PSL essentially balances the sidelobe weights between PSL and ISL. The LSE and Mellowmax operators currently used for smoothing adopt a softmax-style weight distribution. Although this makes the PSL differentiable, it also assigns positive weights to low-energy sidelobes and thereby introduces gradient noise. Ideally, the weights should also be sparse, so that the weights of low-energy sidelobes are exactly zero and only the high-energy sidelobes have nonzero weights.
Peters et al. [
37] unified the softmax function used for smoothing and the sparsemax function used in sparse attention into the
-entmax family. Entmax can be both differentiable and sparse, so we adopt it to address the differentiability and gradient-noise issues simultaneously. The
-entmax is the solution of a convex optimization problem regularized by Tsallis
-entropy:
where
is the
K-dimensional probability simplex,
is the input vector, and the Tsallis
-entropy is defined as
Forming the Lagrangian of this problem and solving the Karush–Kuhn–Tucker (KKT) conditions yield a unified closed-form expression for the optimal solution:
where
is the positive-part operator and the threshold
is uniquely determined by the normalization constraint
. The parameter
is a real number greater than one, and its value controls the sparsity and differentiability of the output. To avoid hardware-inefficient fractional root extractions during repeated evaluations of Equation (
12), we restrict
to be a positive integer
q, giving
. The value
yields the largest such
, namely,
, and Equation (
12) simplifies to
Three representative cases arise within the range .
When , we recover the softmax function, whose output is strictly positive in every component; low-energy sidelobes always receive nonzero weights, so the output is not sparse, although it is smooth.
When , we recover the sparsemax function, which simplifies to the linear truncation . The weights of sidelobes below the threshold are zero, yielding strong sparsity, but the function is not differentiable at the truncation point .
When , the -entmax is both sparse and differentiable: larger yields stronger sparsity, while smaller yields a smoother profile. The choice is the largest value that avoids root-extraction operations.
This choice filters out gradient noise effectively while maintaining moderate sparsity, avoiding the loss of critical information that overly aggressive truncation would entail.
Figure 1 shows the normalized gradient weights as a function of the sidelobe magnitude for the three values of
. As can be seen, softmax still assigns nonzero weights in the low-energy region, sparsemax is non-differentiable at the threshold, and 1.5-entmax achieves both strict truncation and smoothness at the boundary.
Considering sparsity, differentiability, gradient noise, and computational complexity together, we build the loss function around the 1.5-entmax transform.
3.2. Scale Sensitivity and Normalization Preprocessing
Although the 1.5-entmax transform produces sparse weights, it is highly sensitive to the overall scale of the input vector. Let
denote the sidelobe vector and
the weights produced by 1.5-entmax, with
where the threshold
is uniquely determined by
. If the input is rescaled by a factor
a (
,
), so that
, the new threshold
must satisfy
Setting
would make the left-hand side of Equation (
15) equal to
, so the equality cannot hold; hence
. This means that the magnitude and the threshold are not affected in the same way by rescaling, so the distribution of
generally differs in shape from the original
. In other words, 1.5-entmax is not scale-invariant: proportionally rescaled inputs produce different weight allocations.
When
M is fixed but
N varies, two sets of sidelobes may have the same relative proportions but different absolute magnitudes. To illustrate the effect of scale sensitivity, consider the two similar sidelobe distributions
and
: the relative proportions are identical, but the absolute magnitudes differ by a factor of ten. After applying the 1.5-entmax transform, Equation (
14) produces different thresholds
and
and different weight distributions
and
(see
Figure 2, where the upper panel shows the magnitudes and the lower panel shows the corresponding weights). For
, with the larger magnitudes, the threshold rises, the support shrinks, and almost all of the weight concentrates on the single largest sidelobe—a behavior that does not match the actual sidelobe distribution. For
, with smaller overall magnitudes, the threshold drops, the support enlarges, and the weights are more dispersed. Ideally, weight allocation should depend only on the relative sizes of the sidelobes and should not be perturbed by their absolute magnitudes.
To resolve this issue, we normalize all sidelobe magnitudes by their theoretical upper bound before applying the 1.5-entmax transform. For constant-modulus phase-coded waveforms, the Cauchy–Schwarz inequality yields
where equality holds if and only if
and
(i.e., the two sequences are identical up to a constant phase). Hence
N is a valid upper bound for all sidelobe magnitudes. Define the normalized magnitude
Because
and
share the same relative proportions, they map to the same normalized vector
. Applying the 1.5-entmax transform to
yields the weight distribution
shown in red in
Figure 2. The normalized weight distribution is more reasonable, and lower sidelobes are also truncated. Once normalized, all sidelobe magnitudes are confined to the unit interval
; the absolute-magnitude information is removed, and the dynamic threshold
is determined solely by the relative sizes of the sidelobes, eliminating the influence of scale on weight allocation.
3.3. Loss Function and Threshold Computation
Feeding the normalized magnitudes
into the 1.5-entmax transform yields the sparse weight vector
, where
is the total number of sidelobes (including the nonzero-delay terms of the
M auto-correlations and the
cross-correlation pairs). With
as coefficients, the loss function is defined as
where the index
k is a flattened linear index of the triple
, and
k and
are in one-to-one correspondence. This expression can equivalently be interpreted as the weighted expectation of the sidelobe powers under the sparse weights
. It has three key properties:
Adaptive focusing. The weights are not fixed but are determined automatically by 1.5-entmax from the sidelobe distribution at each iteration. Higher-energy sidelobes receive larger weights and therefore stronger gradients.
Strict truncation. Sidelobes outside the support (written when is treated as a free variable, as in the Newton iteration below) have weights that are exactly zero, which prevents gradient noise from accumulating and ensures that the descent direction is not perturbed by noise in the later stages of training.
No loss-function hyperparameters. The dynamic threshold is determined entirely by the sidelobe distribution through the normalization constraint, so the loss function itself introduces no hyperparameters. The Adam optimizer retains standard learning-rate parameters that are common to all gradient-based methods and do not require task-specific tuning.
The threshold
is computed as follows: Setting
in Equation (
12), the threshold
must satisfy the normalization equation
This equation does not admit a closed-form solution;
is implicitly determined by the current sidelobe distribution
. The function
is a piecewise-quadratic, monotonically decreasing convex function of
; on the interior of each quadratic piece,
. The equation therefore has a unique solution, and Newton’s method enjoys fast local convergence. The Newton iteration is
where the support
is updated dynamically with
. With
from the previous outer iteration as a warm start, three to five Newton steps typically suffice in practice to reach an accuracy of
. The residual threshold error
from Newton’s method has a benign and bounded effect on the gradient. Since
enters the gradient only through the smooth weights
and the support membership
, the induced gradient error is first-order in
. Because
is convex and piecewise quadratic, Newton’s method converges quadratically from the warm start
, so three–five steps already yield
. Furthermore,
is re-solved independently at every outer iteration, preventing error accumulation; as training converges, the warm start self-tightens, automatically reducing the residual in precisely the late phase where gradient fidelity matters the most.
3.4. Differentiability Proof and Analytical Gradient
For clarity, let
v denote the chip index throughout this section, distinguishing it from the delay variable
. Throughout this section, the linear index
k and the triple
are used interchangeably via the bijection defined in
Section 3.3.
For derivatives of a real-valued function with respect to a complex variable, we adopt the Wirtinger calculus [
40]. The gradient of
with respect to the phase vector
of the
u-th waveform can be expressed as
where ⊙ denotes the Hadamard (element-wise) product. By the chain rule,
expands as
Step 1: Derivative of with respect to the sidelobe power . Applying the product rule to
in Equation (
19) gives
where
is the index set of all sidelobes, and
are summation indices running over all waveform pairs and delays (analogous to
). In the second term,
depends on
only implicitly, through
. Differentiating
directly gives
. By Proposition 1 of Peters et al. [
37], the elements of the Jacobian of 1.5-entmax with respect to its input
are
where
is the Kronecker delta and
is the indicator function.
We substitute these two parts into the summation in Equation (
24) and separate the term with
via
. By factoring out
and defining the auxiliary quantities
and
, we obtain the effective gradient coefficient
In Equation (
26), the first term is the direct penalty imposed by the loss on the sidelobe
, whereas the second term reflects the indirect effect on the remaining sidelobes through the weight redistribution enforced by the entmax normalization
as the magnitude of this sidelobe varies. The second term contains the factor
, which appears to diverge as
. Two observations show that this apparent singularity is never realized.
First, the singular point never lies in the support. The factor above is always multiplied by the support indicator , and membership in the support requires ; equivalently, . Hence every in-support sidelobe is bounded away from the origin, while any vanishing sidelobe satisfies and is therefore excluded, giving and . Consequently the quotient is never formed, and the singular point contributes nothing to the gradient, consistent with the strict-truncation mechanism.
Second, the coefficient is continuous across the support boundary. At , letting drives , while keeps the denominator bounded away from zero and leaves B and finite. The singular factor therefore tends to zero and , in agreement with the value attained outside the support, so two-sided continuity holds.
With the singular point excluded from the support and the coefficient continuous at the boundary,
is finite and continuous on all of
. Returning to the definition of differentiability,
depends on
only through the powers
, which are trigonometric polynomials and hence smooth, and the chain rule in (
23) composes them with the finite, continuous coefficients
. The resulting gradient in (
39) therefore exists at every point, which establishes that
is differentiable everywhere on
.
Step 2: Derivative of with respect to the waveform . Three cases arise according to the relation between
u and the waveform indices
:
By substituting these expressions together with the coefficients
into the chain rule in (
23) and isolating the diagonal term
, we obtain
In the term
we recognize the form of (
27) with
and in
the form of (28) with
. Absorbing these two pieces into the corresponding sums extends the index ranges from
and
to
and
, respectively. Consequently,
Renaming the dummy index
j to
i in the first summation rewrites (
31) as
We now show that the two summations in (
32) are identical. From the definition of cross-correlation (
5), the change of variable
gives the conjugate symmetry
Because conjugate-symmetric lags have equal magnitude,
, they receive identical 1.5-entmax weights and hence identical gradient coefficients; together with (
33), this yields
. Apply the change of variable
to the second summation in (
32):
Using
and
(the latter follows from (
33) with
,
and
), the right-hand side becomes
, which is precisely the first summation in (
32). Therefore
To cast (
35) into a correlation that can be accelerated by the FFT, define the
-dimensional auxiliary vector
Since
is real—it is the derivative of the real-valued
with respect to the real quantity
, and every factor in (
26) is real—we have
. Substituting this relation into (
35) gives
Now we introduce the
-dimensional vector
so that the inner sum over
is exactly
. Hence
where
denotes the
N-dimensional subvector obtained by evaluating
at the chip indices
(these correspond to positions
N through
in the zero-padded
-element array, with the zero-lag at the
N-th position under 1-based indexing). Substituting (
38) into the Wirtinger relation in (
22) yields the final analytical expression for the phase gradient,
Equation (
37) is a correlation between
and
and can be evaluated efficiently via FFTs; the overall gradient computation has complexity
.
The two-step derivation above shows that the loss function
is differentiable everywhere on
, and its analytical gradient is given by Equation (
39).
5. Simulation Results
This section validates the proposed method through systematic simulations. We first describe the experimental setup and baselines and then analyze convergence behavior and the dynamic-threshold mechanism. We subsequently evaluate PSL performance across varying code lengths and numbers of waveforms, followed by a complexity and scalability comparison. Finally, we demonstrate adaptability under ultra-large-scale configurations.
5.1. Simulation Setup
All experiments were run on a unified platform: an AMD Ryzen 7 5800H central processing unit (CPU) (Advanced Micro Devices, Inc., Santa Clara, CA, USA) with an NVIDIA GeForce GTX 1650 (4 GB GDDR6) GPU (NVIDIA Corporation, Santa Clara, CA, USA). The proposed method, GD-based, and Con ran on the GPU, with software based on Python 3.10.9 and PyTorch 2.0.1. The remaining MATLAB-based baselines ran on the CPU using MATLAB R2021a (MathWorks, Natick, MA, USA). To compare algorithmic efficiency independently of the execution platform, we additionally implemented a CPU version of the proposed method in MATLAB. In this version, the forward pass, the analytical gradient (Equation (
39)), and the Adam optimizer were all coded manually—without the automatic differentiation of the deep learning framework—while every algorithmic step (the 1.5-entmax loss, magnitude normalization, the Newton solve for
, and the analytical Jacobian) was kept identical to the GPU version.
Five representative algorithms were selected as baselines, covering three technical approaches—conventional numerical optimization, deep learning, and Riemannian manifold optimization:
Con [
28]: An unsupervised optimization method based on a residual neural network that minimizes a weighted combination of PSL and ISL, with weights
,
, and
and learning rate
.
p-MM [
29]: An MM-framework method based on the
-norm metric that approximates PSL minimization by successively solving low-order surrogate subproblems, with
.
RTR-MPSL [
31,
42]: A Riemannian trust-region method that minimizes the
-norm (
) on the complex constant-modulus product manifold, with initial trust-region radius
and
.
WeBEST-v [
25,
43]: A vectorized block-coordinate descent method based on BSUM with an
-norm surrogate (
) and backtracking line-search parameters
(step-size factor) and
(reduction factor).
GD-based [
35,
44]: A gradient-descent method that smooths the PSL via the log-sum-exp function and applies the Adam optimizer, with smoothing parameter
and initial learning rate
.
To ensure a fair comparison, all methods used a maximum of iterations and the same initial values, namely, uniformly distributed random phases . Each parameter configuration was run independently 10 times, and the averaged results are reported.
The normalized peak sidelobe level (PSL) is used as the main performance metric and is expressed in decibels (dB). Let
denote the largest sidelobe magnitude, corresponding to the metric defined in Equation (
8) of
Section 2. All reported PSL values are normalized by the zero-delay matched-filter peak
N and expressed in decibels as
where the magnitude form
and the equivalent power form
coincide. The Welch and Levenshtein bounds reported below are converted into decibels through the same normalization. The Welch lower bound [
45] provides general lower bounds on the PSL and ISL,
Liu et al. [
46] proposed a new weighting vector on the basis of the Levenshtein bound [
47], extending its validity to polyphase constant-modulus waveform sets. The resulting lower bound on the
is given by
where
is an integer-valued free variable. For given
, the tightest lower bound is obtained by treating
as a continuous variable, differentiating the right-hand side of (
54) with respect to
, and rounding the resulting critical point to the nearest feasible integer. Since the Levenshtein bound is generally tighter than the Welch bound, it serves as the primary benchmark for assessing waveform-design performance throughout this paper.
5.2. Convergence Behavior and Dynamic-Threshold Mechanism
We adopted the typical configuration
,
, with uniformly distributed random initial phases, and performed 100 independent training runs to verify the convergence behavior and stability of the proposed method.
Figure 4 shows the loss and PSL convergence curves from the 100 independent runs, while
Figure 5 shows the evolution of the dynamic threshold
and the support fraction
(where
denotes the cardinality of the support set
) during training. As
Figure 4 shows, the PSL convergence exhibited two distinct stages. During the first 100 epochs, the PSL dropped rapidly from about
dB to about
dB; thereafter, it entered a slow fine-tuning phase, with the final mean stabilizing at
dB. The standard deviation across the 100 independent runs was only
dB. The mean loss curve and the individual loss curves in
Figure 4 are tightly concentrated and almost overlap, indicating that the proposed method shows little sensitivity to random initializations. The loss curves were smooth, reflecting the efficient convergence afforded by differentiability and the absence of training oscillations. Overall, the loss and PSL curves exhibited highly consistent trends; in the later stage the PSL continued to decrease even as the loss curve flattened, because by then many sidelobes already lay close to the peak, the peak sidelobe accounted for only a small fraction of the total weight, and its individual influence on the loss was correspondingly small.
Figure 5 reveals the evolution of the dynamic threshold and the sparsity of the support, which moved in opposite directions. During the first 100 epochs, the support fraction
stabilized at about
, and the dynamic threshold
completed its scale adjustment over the same period. After that, although the support size no longer changed significantly, the weight vector
continued to be redistributed within the support, always assigning larger weights to those sidelobes with the highest current energy and driving the PSL toward the theoretical lower bound. Notably, the rapid descent during the first 100 epochs accounted for only a small fraction of the total training time but already realized about
of the overall PSL improvement, owing to the differentiability of the proposed loss, which enabled accurate and rapid descent along the analytical gradient. Compared with the GD-based method, the proposed method reached a lower PSL because the loss function activated only about half of the sidelobes, suppressing the accumulated gradient contribution from low-energy sidelobes; in contrast, the LSE function assigns nonzero weights to all sidelobes, so all of them participate in the gradient and the accumulated noise constantly perturbs the gradient direction of the high-energy sidelobes.
5.3. Robustness to Initialization
To examine the effect of different initializations, we adopted the simulation setup of
Section 5.1 (with
iterations) and replaced the random-phase initialization with five structured schemes, comparing the final PSL. We performed 20 independent runs per configuration and report the average PSL in
Table 1.
The five schemes, spanning the random, quantized, chaotic, and polyphase-code families, are defined as follows: Random phase (the baseline of all preceding experiments) draws each chip phase independently from a uniform distribution, . Eight-bit quantized random phase draws each chip phase uniformly from 256 discrete levels, with . Logistic chaotic map generates each phase via the logistic recursion with , producing a deterministic yet aperiodic and ergodic sequence. Zadoff–Chu (ZC) sequence, a polyphase code with perfect periodic auto-correlation, is given for the code lengths considered (powers of two) by with . P4 polyphase code generates the M waveforms from a common base code modulated by a waveform-dependent linear phase ramp, , where , so that the waveforms differ only by a deterministic linear phase progression and are not mutually independent.
Two main observations can be drawn from
Table 1. First, the random, 8-bit quantized, Logistic, and ZC initializations all converged to virtually the same PSL, with a maximum spread below
dB for every configuration despite their markedly different structural origins. The algorithm is thus insensitive to the starting point as long as the initial waveforms are mutually uncorrelated; notably, the ZC sequence, despite its perfect auto-correlation, offers no measurable advantage over plain random phase. This confirms that the random-phase results reported earlier are not artifacts of a fortunate starting point and that the non-convex landscape does not trap the iterates in inferior minima. Second, the P4 initialization was the sole exception, converging to a PSL about
–
dB higher. Because its
M waveforms are merely linearly modulated copies of a single base code, the starting point lies in an almost flat region of the loss landscape with severely limited inter-waveform degrees of freedom; the descent therefore proceeded slowly and, within the fixed iteration budget, terminated at a higher PSL.
This behavior is explained by the limiting case of identical waveforms,
for all
i, in which every cross-correlation reduces to the common auto-correlation and the zero-delay cross-correlations attain the bound
. Substituting
and
into the analytical gradient in (
35) leaves only the real-scalar zero-delay terms, so by the Wirtinger relation in (
22), the phase gradient
vanishes identically. An all-identical initialization is thus a stationary point from which the algorithm cannot move, and the P4 case is a mild manifestation of the same mechanism: its waveforms are rigidly coupled rather than identical, so the gradient is small rather than exactly zero and convergence merely slows.
In summary, the proposed method does not require a specially designed starting point. Any initialization whose waveforms are mutually uncorrelated—random, quantized random, chaotic, or a decorrelated polyphase sequence—drives the PSL to essentially the same low value; only the degenerate case of highly correlated or identical waveforms, for which the phase gradient vanishes, needs to be avoided. Ensuring that the initial waveforms are mutually uncorrelated is therefore sufficient to guarantee convergence to a low PSL, confirming the robustness of the proposed method to initialization.
5.4. Doppler Tolerance Analysis
The proposed loss optimizes the zero-Doppler cut of the auto-/cross-ambiguity function, whereas Earth-observation MIMO-SAR systems operate under nonzero Doppler in practice. We therefore assessed the robustness of the optimized waveform set to an uncompensated Doppler shift. With the matched filters fixed at the zero-Doppler references
(
), every echo
is modulated by a common Doppler ramp
, so that the Doppler-dependent cross-ambiguity function becomes
where
is the delay lag,
is the normalized Doppler frequency per chip,
is the Doppler frequency,
is the chip duration,
N is the code length, and
is the total pulse duration. The normalized phase walk accumulated over the whole pulse is
. All sidelobe magnitudes are normalized by the zero-Doppler matched-filter peak
N, so that the curves are referenced to the ideal zero-Doppler gain. Since the chip-rate bandwidth
(tens to hundreds of MHz) greatly exceeds the intra-pulse Doppler frequency
(at most a few kHz), we have
, and
amounts to only a small fraction of a cycle in practice, typically satisfying
. We therefore swept
, which already covers far beyond the operational range.
As shown in
Figure 6, at
, the global PSL equaled
dB, coinciding with the value obtained in
Section 5.2 and thereby cross-validating the evaluation; the global PSL curve overlapped the cross-correlation PSL throughout the entire sweep range, indicating that for
, the worst sidelobe is governed by the cross-correlation terms, as expected from the large number of cross pairs. Furthermore, the PSL degraded smoothly and monotonically with Doppler, without any abrupt collapse: within the operationally relevant range
, the global PSL rose by only about
dB (to
dB), while the mainlobe loss stayed below
dB, so the orthogonality of the set was essentially preserved; even at the extreme
, the global PSL remained at
dB. In summary, the optimized waveform set exhibits good robustness to uncompensated Doppler over the practically relevant operating range.
5.5. Robustness to Phase Quantization
The signal model in
Section 2 assumes a continuous phase
, whereas a practical MIMO-SAR transmitter realizes the phase through a digital phase shifter with finite resolution. We denote the quantization bit-width by
b. A
b-bit phase shifter provides
uniformly spaced phase states with spacing
. Rounding each optimized phase to the nearest available state gives
where
is the floor operator and
is the quantized phase; the resulting rounding error is confined to
.
To assess the practical impact of this quantization on waveform performance, we applied Equation (
56) to the continuous-phase optimum obtained in
Section 5.3 and re-evaluated the PSL for
under four representative configurations
. The results are summarized in
Table 2, where
denotes the increase in PSL relative to the continuous-phase baseline.
As shown in
Table 2, the PSL degraded monotonically as the quantization resolution
b decreased, but the degradation was bounded and controllable: at the coarsest resolution
, the loss was about
–
dB; increasing
b to 6 already reduced the degradation to about
–
dB; and at
, the degradation dropped further to about
–
dB, essentially matching the continuous-phase result. This trend was consistent across all four
configurations and shrank smoothly as
b increased. Overall, a commercially common 6-bit phase shifter is sufficient to achieve satisfactory performance, while moving to 8-bit resolution further limits the degradation to within
dB, yielding an even lower PSL; these results confirm that the proposed continuous-phase design can be directly deployed on practical quantized hardware, with the required resolution selected according to the desired performance–cost trade-off.
5.6. Comparison with Other Methods
5.6.1. Adaptability Across Code Lengths
With
fixed and
, we systematically evaluated the PSL performance of each method. The results are shown in
Figure 7.
The PSL of all methods decreased monotonically with N, in agreement with the trend of the Levenshtein bound. The proposed method achieved the lowest PSL at every code length. For , for example, the PSL of 1.5-entmax reached dB, which was dB lower than RTR-MPSL, dB lower than WeBEST-v, dB lower than Con, and dB lower than p-MM. It was only dB above the Levenshtein bound, making it the closest result to the theoretical limit in this comparison.
The performance of Con degraded noticeably for
, primarily because its fixed weight ratio cannot adapt to the sidelobe distribution as it changes with
N, and because the number of parameters in the residual network grows rapidly with
M and
N so that a fixed network architecture cannot readily accommodate larger waveform dimensions.
p-MM was the weakest at every code length, mainly because the numerical instability introduced by the large
p-value continues to worsen as the total number of sidelobes grows [
29]. The advantage of 1.5-entmax over GD-based grew monotonically with
N, primarily because the total number of sidelobes increases at the rate of
, so the gradient noise accumulated by LSE becomes more pronounced, while the strict-truncation mechanism of 1.5-entmax prevents this from accumulating with scale.
5.6.2. Adaptability Across Numbers of Waveforms
To compare adaptability with respect to the number of waveforms, we fixed
, and let
. The performance of each method under different numbers of waveforms is shown in
Figure 8.
The PSL of all methods increased monotonically with
M, again in agreement with the trend of the Levenshtein bound: the number of cross-correlation components grows at rate
, and the optimization becomes correspondingly more difficult. Further, 1.5-entmax achieved the lowest PSL for every value of
M from 2 to 12, and its margin over GD-based grew monotonically with
M (from
dB at
to
dB at
). This trend corroborates the analysis with respect to
N in
Section 5.6: regardless of whether the total number of sidelobes increases through larger
N or larger
M, the cumulative effect of LSE gradient noise is amplified, and the sparse-truncation advantage of 1.5-entmax grows accordingly.
The 1.5-entmax curve was smooth across the entire range of M, while WeBEST-v and RTR-MPSL displayed local fluctuations that reflected their sensitivity to initialization and step size. The gap between p-MM and 1.5-entmax widened from about 3 dB at to about 5 dB at , indicating that the numerical instability introduced by the large p-value worsened further in high-dimensional cross-correlation scenarios.
5.7. Computational Complexity and Scalability
Table 3 summarizes the per-iteration computational complexity, execution platform, and loss-function hyperparameters of the compared methods, and
Table 4 reports the time each method requires to reach the target PSL. The proposed method, GD-based, and
p-MM share the same theoretical complexity of
, yet the proposed method is far faster in practice—even on the same CPU platform. On equal footing with the CPU baselines, the CPU version of 1.5-entmax reaches every target PSL in at most
s for
up to
and in
s at
; by contrast, RTR-MPSL and WeBEST-v already require
s and
s respectively at
and fail to converge within two hours at
, while
p-MM exceeds the budget from
onward. Two factors explain this gap. First, only the in-support sidelobes participate in the effective gradient at each iteration, so the actual cost is well below that of the dense GD-based gradient. Second, the sparse, noise-free gradient lets each iteration focus on the high-energy-sidelobe subset, sharply reducing the iteration count: at
, the proposed method converges within about 100 epochs, whereas GD-based needs more than 3000 epochs.
The per-iteration cost of RTR-MPSL is dominated by the term under our simulation parameters: at and , it reaches the order of , so the method does not converge within two hours on the CPU. p-MM has the same order as the proposed method but runs on the CPU and requires a very large number of iterations, with the numerical instability of large p further hindering convergence as N or M grows. The complexity of WeBEST-v carries the backtracking-step factor , and under the combined pressure of sequential CPU execution and a huge number of sidelobes, its runtime already reached 92 s at , , becoming infeasible at larger scales.
We next consider medium-to-large-scale configurations by increasing
M from 4 to 10 while varying
. The total number of sidelobes grows by a factor of about three relative to the
case. At this scale, both
p-MM and Con failed to reach an acceptable PSL target within 2 h when
.
Figure 9 compares the remaining methods: GD-based, RTR-MPSL, WeBEST-v, and 1.5-entmax.
It can be seen that 1.5-entmax outperformed the other methods at every code length. For
, for instance, 1.5-entmax reached
dB, which was
dB lower than GD-based (
dB) and
dB lower than RTR-MPSL (
dB) and was
dB above the Levenshtein bound. Comparing these results with those for
,
in
Section 5.6, we see that the advantage of 1.5-entmax over GD-based grew with
M, again confirming the structural advantage of the sparse-truncation mechanism in scenarios with a rapidly increasing number of sidelobes.
5.8. Adaptability Under Ultra-Large-Scale Configurations
Figure 10 and
Figure 11 show the auto-correlation and cross-correlation envelopes (in dB) of the waveforms designed under the ultra-large-scale configuration
.
Each envelope is defined as the maximum magnitude across waveform pairs at each delay:
All sidelobes were suppressed below dB, and the envelopes were highly uniform. Under the ultra-large-scale configuration , the total number of sidelobes K exceeds . At this scale, the per-iteration cost of RTR-MPSL is , so the method does not converge within 2 h on the CPU. WeBEST-v is likewise infeasible, owing to its CPU-sequential backtracking line search. p-MM fails because of the large number of iterations required on the CPU, compounded by the numerical instability introduced by large p. GD-based did complete the optimization on the GPU but took about 1700 s. On the same GPU, the proposed 1.5-entmax method reached the dB target in only s—a speedup over GD-based. The CPU version of the proposed method reached the same target in s, so that even without GPU parallelism, it was about faster than the GPU-based GD-based baseline, with the GPU providing a further reduction.
The proposed method handles such large-scale problems efficiently for three main reasons: (i) the 1.5-entmax transform is both sparse and differentiable, ensuring fast and accurate gradient descent at a per-iteration complexity of only ; (ii) the entire loss computation consists of regular tensor operations that map naturally onto GPU parallelism; and (iii) the analytical Jacobian bypasses the inner Newton iteration, so the memory footprint of the computation graph does not grow with the number of Newton steps. These results demonstrate the engineering viability of the proposed method for next-generation large-scale MIMO-SAR systems.
5.9. Ablation Study
To quantify the contribution of each design component, we conducted a component-wise ablation study targeting four core elements: (1) the 1.5-entmax sparse weighting transform; (2) the normalization preprocessing; (3) the analytical Jacobian operator; and (4) GPU-parallel acceleration. In each ablation variant, a single component was removed or replaced while all other settings remained identical to the complete method. Experiments were performed on the same five waveform sizes
as in
Section 5, each trained for
iterations. Two metrics were recorded: the final PSL (after
iterations) and the time to target
(the time required to reach the target PSL; “—” indicates that the target was not reached within
iterations). The target PSL for each configuration followed the values used in
Table 4.
The four ablation variants are defined as follows:
Without 1.5-entmax. The 1.5-entmax transform is replaced by the softmax () from the same family; the weighted-loss structure is otherwise unchanged.
Without normalization. The normalization of sidelobe magnitudes by the theoretical upper bound N is removed; raw magnitudes are fed directly into the transform, isolating the effect of normalization on the adaptive threshold .
Without analytical Jacobian. The complete loss and normalization are retained, but the back-propagation through the entmax step uses automatic differentiation of the Newton iteration that solves for instead of the analytical Jacobian.
Without GPU acceleration. The CPU implementation of the proposed method introduced in
Section 5.1 is used here, executing the identical algorithm in MATLAB without GPU parallelism. Because the analytical gradient is evaluated from the same closed-form expression in both versions, their difference in runtime reflects the GPU parallelism rather than any change in the optimization itself.
Contribution of 1.5-entmax to suppression quality. Replacing the 1.5-entmax transform with softmax increased the final PSL across all configurations: by
dB for
,
dB for
,
dB for
,
dB for
, and
dB for
, where the target could not be reached within
iterations. The degradation grew monotonically with the total number of sidelobes
K, consistent with the analysis in
Section 3; as
K increases, the gradient noise accumulated by the non-sparse softmax weighting becomes more pronounced, whereas the strict truncation of 1.5-entmax prevents this accumulation.
Contribution of normalization. Removing normalization degraded both the final PSL and convergence speed. The PSL worsened by – dB, with the degradation intensifying as N grew. More notably, the time to target increased sharply: at , it rose from below 1 s to s for and s for , and for , the target could not be reached. Without normalization, the transform operates on raw magnitudes spanning ; a larger N perturbs the dynamic threshold more strongly, moving it away from its ideal value. Normalizing by N makes the threshold depend only on the relative sizes of the sidelobes, confirming the necessity of this preprocessing step.
Contribution of the analytical Jacobian operator. Replacing the analytical Jacobian with automatic differentiation of the Newton iteration yielded a nearly identical final PSL, verifying the mathematical equivalence of the two approaches. As an independent check on the correctness of the analytical gradient itself, we compared Equation (
39) against a central finite-difference reference and against automatic differentiation on small random instances (
,
). The maximum relative error was below
, confirming that the closed-form gradient is implemented correctly; the “without analytical Jacobian”variant below then isolates its computational benefit at equal accuracy. The difference lies in computational overhead. On larger-scale configurations, the automatic-differentiation variant took about
–
longer than the complete method, confirming that the analytical Jacobian improves computational efficiency by avoiding the expansion of the computation graph over the Newton steps.
Contribution of GPU acceleration. Running the same algorithm on the CPU produced a nearly identical PSL, with the benefit of GPU acceleration emerging as the problem scale increased. On small-scale configurations, the CPU implementation was faster because of the overhead of transferring data from the CPU to the GPU in the GPU version; as grew, the parallelism of the GPU gradually dominated. At , the GPU reduced the time to target from s to s, which validates the acceleration advantage of the proposed framework for large-scale real-time MIMO-SAR waveform design.
6. Discussion
The experiments point to a single underlying reason for the consistent advantage of the proposed loss. The PSL is the maximum over
sidelobes, yet it is governed by only the few highest-energy ones, so its active set is a vanishingly small fraction of all sidelobes. Smooth surrogates such as LSE spread gradient mass over the entire set, diluting the signal of the decisive sidelobes by a factor that grows with
K. This is why the margin over the GD-based baseline widens monotonically with both
N and
M (
Figure 7,
Figure 8 and
Figure 9) and why the softmax ablation degrades in proportion to
K: the dilution, and not any incidental numerical effect, is the mechanism. By truncating the support, 1.5-entmax aligns the gradient’s support with the objective’s active set—the natural matching between optimizer and objective for a max-type criterion.
Normalization is the second indispensable ingredient. Without it, the scale sensitivity of 1.5-entmax couples the dynamic threshold to the absolute sidelobe magnitude, which itself varies with N; the ablation shows that this coupling not only raises the final PSL but, more severely, slows convergence by one to two orders of magnitude at large N. Normalizing by the Cauchy–Schwarz upper bound N confines all inputs to and makes depend only on the relative sidelobe distribution, which is what allows a single, untuned loss to operate across waveform sizes differing by orders of magnitude.
Several limitations remain. First, is motivated by differentiability and the avoidance of fractional root extractions rather than by a proof of optimality, and the optimal within remains open. Second, the present formulation addresses only constant-modulus phase-coded waveforms under the single PSL metric, without practical constraints such as spectral shaping or the joint design of transmit waveforms and mismatched receive filters. These limitations delineate the scope of the reported gains and motivate the extensions below.
7. Conclusions
This paper addressed the non-differentiability and gradient-noise problems of direct PSL minimization in MIMO-SAR orthogonal waveform design. We proposed a loss function built on the 1.5-entmax sparse transform that is simultaneously differentiable and sparse: it concentrates the gradient on the high-energy sidelobes that determine the PSL while strictly truncating the low-energy ones to remove their gradient noise. A normalization step based on the Cauchy–Schwarz upper bound eliminates the transform’s scale sensitivity and makes its dynamic threshold adapt automatically across waveform sizes, so that no loss-function hyperparameter requires tuning. We derived a closed-form analytical gradient and, through a custom analytical Jacobian operator, embedded the loss into a GPU-accelerated deep learning framework that treats the waveform phases as the only learnable parameters and keeps the per-iteration complexity at .
Extensive simulations showed that the method attains the lowest PSL across all evaluated waveform sizes, consistently approaching the Levenshtein bound, and remains robust to initialization, uncompensated Doppler, and phase quantization. In ultra-large-scale settings (, ), it reached the target PSL roughly two orders of magnitude faster than the existing state-of-the-art method on the same GPU and about an order of magnitude faster even in its CPU implementation, confirming that the gain is algorithmic rather than a mere consequence of hardware. These properties establish the method’s viability for real-time, online waveform synthesis in next-generation MIMO-SAR systems.
Future work will pursue a theoretical characterization of the optimal within and extend the framework to spectrally constrained waveforms, joint waveform–mismatched-filter design, and validation on real MIMO-SAR hardware.