The architecture of the proposed dual-domain conditional diffusion model is illustrated in
Figure 1. It consists of a diffusion backbone and a SAR conditional encoder. The diffusion backbone follows a U-Net encoder–decoder architecture and predicts the noise added to the optical image at diffusion timestep
t. In parallel, the conditional encoder extracts multi-scale structural and textural features from the SAR observation. These conditional features are injected into the corresponding resolution levels of the diffusion backbone through lateral connections, thereby providing scene-dependent guidance for noise prediction. Long skip connections between the encoder and decoder of the diffusion backbone preserve spatial information and facilitate the fusion of shallow structural details with deeper semantic features.
In the diffusion backbone, the noisy optical image
is first projected into a 128-channel feature space using a
convolution (Conv3). The backbone contains four resolution levels indexed by
, with spatial resolutions of
and channel dimensions of 128, 256, 384, and 512, respectively. Each encoder level contains two consecutively stacked residual blocks, denoted by
in
Figure 1, followed by downsampling except at the deepest level. The decoder follows the reverse multi-scale hierarchy and progressively upsamples the features while fusing them with the corresponding encoder features through skip connections. Each decoder level contains three consecutively stacked residual blocks, denoted by
, because an additional block is used to refine the fused decoder and skip-connected features. The two shallow resolution levels use SFHRB, whereas the two deeper and lower-resolution levels use SFHRBAtt. SFHRBAtt is the attention-enhanced variant of SFHRB and consists of an SFHRB followed by an AttnBlock. Self-attention is, therefore, applied only at the lower-resolution levels, where long-range dependencies can be modeled with lower memory consumption and computational cost. Finally, GroupNorm, Swish activation, and a
convolution are applied to generate the predicted noise
Z, which has the same spatial resolution and number of channels as
.
The SAR conditional encoder adopts the same four-level resolution hierarchy and channel configuration as the diffusion encoder. The SAR image
S is first projected into the feature space through a
convolution. At the two shallow resolution levels, the conditional features are extracted using AFFRB, whereas the two deeper levels employ AFFRBAtt. AFFRBAtt is the attention-enhanced variant of AFFRB and is composed of an AFFRB followed by an AttnBlock. Similar to the diffusion encoder, each resolution level contains two consecutively stacked blocks, denoted by
. The resulting conditional features are injected into the corresponding encoder and decoder stages of the diffusion backbone through lateral connections. Throughout
Figure 1, the notation
indicates that
N blocks of the specified type are consecutively stacked at the same spatial resolution and channel dimension.
3.1.1. SFHRB Module
To preserve local spatial textures while improving frequency-domain representation, we design SFHRB based on the standard diffusion residual block. As shown in
Figure 2, it contains a spatial convolution branch operating in the spatial domain and a parallel complex-valued convolution branch operating in the Fourier domain. The frequency branch is further modulated by the diffusion timestep embedding. Unlike pointwise spectral weighting, which processes frequency locations independently [
14,
20], the complex-valued convolution aggregates neighboring frequencies across multiple channels, enabling local cross-frequency and cross-channel modeling.
Given the input feature map
, where
B denotes the batch size,
is the number of input channels, and
represents the spatial resolution, we further consider the timestep embedding vector
and the SAR conditional feature
. The spatial-domain branch applies normalization, nonlinear activation, and a 3 × 3 convolution to capture local spatial context,
where
denotes group normalization (GroupNorm),
denotes the Swish activation function (Swish), and
denotes a 3 × 3 convolution.
In parallel, the frequency-domain branch first applies a fast Fourier transform (FFT) to the normalized input features to obtain a complex spectral representation,
where
denotes FFT, and
denotes the frequency-domain coordinates.
During the forward diffusion process, the intensity of injected random noise varies across timesteps, causing the statistical properties of features in the frequency domain to change accordingly. To adapt to the timestep-dependent spectral distribution and enable adaptive spectral recalibration, the timestep embedding vector
t is linearly projected into a complex-valued modulation vector, which is used to modulate the input and output channels of the spectral features,
where
is the number of output channels.
First, complex-valued channel modulation is applied to the input spectral features, i.e., each channel of each sample is multiplied by a complex-valued scaling factor shared across spatial locations, thereby recalibrating the spectral response of each channel,
where ⊙ denotes element-wise product.
Then, a complex-valued convolution is performed in the frequency domain,
where
denotes the two-dimensional discrete convolution with respect to the frequency-domain coordinates
, and
is the complex-valued convolution kernel that connects the input channel
to the output channel
(with a kernel size of 3 × 3 in this work).
Subsequently, complex-valued channel modulation is applied again to the output spectral features,
Finally, an inverse FFT (IFFT) is applied to return to the spatial domain, and the real part is taken as the output of the frequency-domain branch,
where
denotes IFFT, and
denotes the real part.
Specifically, the timestep embedding
t is processed through a multilayer perceptron (MLP) to predict a per-channel scaling factor
and bias
:
In addition, the SAR image is used as a conditional feature and mapped to
via a 3 × 3 convolution, and then injected into the main branch with a learnable coefficient
,
The fused feature
is further refined through hybrid refinement, and then added to the original input feature
x via a skip connection to produce the final output,
3.1.2. AFFRB Module
As shown in
Figure 3, the Sentinel-1 GRD intensity image is decomposed into low-, middle-, and high-frequency components for visualization. Specifically, the centered Fourier spectrum is divided using two radial thresholds,
and
, and the corresponding components are reconstructed through inverse Fourier transform. The low-frequency component mainly retains the large-scale spatial layout, overall object outlines, and slowly varying background. In contrast, granular fluctuations and fine-scale textures become increasingly evident in the middle- and high-frequency components, indicating that these frequency ranges are more sensitive to speckle-related variations. Nevertheless, structurally relevant information, including sharp boundaries, strong gradients, and point-like scatterers, is also present in these frequency ranges. Therefore, directly suppressing the middle- or high-frequency components may remove both noise-related fluctuations and useful structural details. The fixed frequency decomposition shown in
Figure 3 is used only for visualization and is not explicitly employed in the proposed network.
This observation motivates an adaptive frequency-domain feature recalibration strategy that selectively attenuates noise-dominated responses while preserving structurally informative frequency components. To implement this strategy, we propose a frequency-domain adaptive attention module, termed FreqAttn, and embed it into the residual blocks of the SAR conditional encoder to form AFFRB. Rather than dividing the feature spectrum into predefined frequency bands, FreqAttn predicts a continuous, input-dependent gain for each feature channel and frequency location. The detailed architecture of AFFRB is illustrated in
Figure 4.
Given the intermediate feature
obtained after the first convolution, FreqAttn first applies an FFT to it and performs spectrum centering,
where
denotes the spectrum centering operation.
Then, the magnitude and phase are extracted from
to construct a joint feature,
where
denotes the magnitude and
denotes the phase. To avoid representation ambiguity and numerical instability caused by the phase discontinuity at
, we apply a trigonometric encoding to the phase and use
and
as its representation.
The resulting joint feature
Z is then fed into a bottleneck network composed of two consecutive 1 × 1 convolutions, which maps it to frequency-domain gain with the same number of channels as the original spectrum features
,
where
denotes the sigmoid function. To avoid amplifying noise and reduce the risk of numerical instability, we constrain the frequency-domain gain
L to the range
, so that it only attenuates rather than amplifies.
The gain
L is used to multiplicatively modulate the spectral features on a per-channel and per-frequency basis, adjusting only the magnitude distribution while keeping the phase unchanged,
Finally, the filtered spectrum is mapped back to the spatial domain via inverse centering and an IFFT, and its real part is taken as the output of FreqAttn,
3.1.3. Auxiliary Modules
The other basic modules in the diffusion model are illustrated in
Figure 5. The residual block (ResBlock in
Figure 5a) consists of two convolutional layers, each followed by group normalization (GroupNorm) and a Swish activation. The diffusion timestep
t is projected by an MLP and injected into the block to modulate and integrate information across different diffusion stages. The last convolution is zero-initialized to improve convergence stability and accelerate convergence in large-scale training [
21,
22]. The attention block (AttenBlock in
Figure 5b) adopts a self-attention mechanism, where the correlation weights between the query (
q) and key (
k) are computed via softmax and applied to the value (
v) for adaptive feature aggregation, thereby enhancing the modeling of long-range dependencies and improving spatial representations.
At the deeper, lower-resolution stages of the diffusion backbone, SFHRBAtt, shown in
Figure 5c, applies an AttnBlock after SFHRB to incorporate long-range dependencies into the spatial-frequency representation. At the bottleneck between the encoder and decoder, MidBlock, shown in
Figure 5d, sequentially stacks a ResBlock, an AttnBlock, and another ResBlock to refine the feature representation and capture global context. Similarly, at the deeper stages of the SAR conditional encoder, AFFRBAtt, shown in
Figure 5e, applies self-attention after AFFRB, allowing long-range structural relationships to be modeled on top of the adaptively recalibrated frequency-domain features.