iTransformer-FFC: A Frequency-Aware Transformer Framework for Multi-Scale Time Series Forecasting

Abstract

Capturing complex temporal dependencies across multiple scales remains a fundamental challenge in time series forecasting. Transformer-based models have achieved impressive performance on sequence tasks, but vanilla designs often struggle to integrate information from both local fluctuations and global trends, especially in non-stationary sequences. We propose iTransformer-FFC, a novel forecasting framework that addresses these issues through frequency-domain analysis and multi-scale feature fusion. In particular, iTransformer-FFC introduces a Fast Fourier Convolution (FFC) module to transform time series data into the frequency domain, isolating dominant periodic components and attenuating noise before attention is applied. A hierarchical feature fusion mechanism that integrates features extracted at multiple temporal resolutions then jointly models global and local temporal patterns, while a factorized self-attention architecture reduces the quadratic complexity of standard Transformers, improving efficiency while maintaining accuracy. Together, these innovations enable more effective long-range dependency modeling and adaptability to regime shifts in the data. Extensive experiments on five public benchmark datasets demonstrate that iTransformer-FFC consistently outperforms state-of-the-art models, including the vanilla Transformer, an earlier iTransformer variant, and PatchTST. Notably, our model achieves on average an 8.73% lower MSE and 6.95% lower MAE than the best performing baseline, confirming its superior predictive accuracy and generalization in multi-scale time series forecasting through its innovative integration of frequency-domain analysis, hierarchical feature fusion, and factorized attention mechanisms.

1. Introduction

Time series forecasting is crucial in many domains—for example, traffic flow management [1], financial markets [2], and energy systems [3]—yet it remains a challenging task due to the entangled nature of multiple temporal patterns. This complexity poses significant challenges for accurate forecasting, particularly in the presence of shifting patterns and varying temporal dependencies [4,5]. A common approach to handle this complexity is to decompose the time series into a few simpler components, each representing an underlying pattern [6,7]. Traditional statistical methods typically separate a series into trend and seasonal parts and then make predictions based on these components. With the rise of deep learning, some researchers have integrated classical decomposition with neural networks [8,9,10], feeding extracted trend and seasonal signals into deep models. Others have endowed deep learning models with the ability to internally disentangle temporal patterns—using progressive multi-scale decomposition [11], contrastive learning supervision [12], or variational inference techniques [13]—to capture complex temporal dynamics in a more flexible representation.

With the proliferation of high-frequency data across scientific and industrial domains, deep learning has emerged as a principal approach for time series forecasting. Despite the proven effectiveness of deep architectures such as Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) in handling spatiotemporal data, and their gated variants have achieved notable success in capturing short-term dependencies and nonlinear dynamics, they remain limited in their ability to model long-range temporal structures, multi-scale interactions, and non-stationary behaviors inherent in real-world sequences [14,15]. These limitations are particularly evident in long-horizon forecasting tasks, where performance often deteriorates due to insufficient temporal context modeling [16].

More recently, Transformer-based architectures have garnered attention for their capacity to capture global dependencies through self-attention mechanisms and their suitability for parallel computation [17]. However, directly transferring the standard Transformer to time series applications reveals several structural inadequacies. Chief among these are the reliance on fixed positional encodings, which fail to incorporate domain-specific temporal priors such as periodicity and seasonality [18], and the uniform treatment of all time steps, which neglects the varying importance of local versus global patterns [19]. Additionally, the quadratic computational complexity of full attention limits the model’s scalability to longer input sequences and increases susceptibility to overfitting under noisy or irregular data regimes [20].

To address these challenges, a model was developed, called iTransformer-FFC, an improved Transformer-based model tailored for multi-scale time series forecasting. A central innovation of iTransformer-FFC is the integration of a Fast Fourier Convolution (FFC) module at the input stage, which transforms raw temporal signals into a frequency-domain representation [21]. Frequency-domain transformation offers a principled way to isolate periodic components and reduce noise, which can enhance the effectiveness of attention mechanisms in capturing relevant temporal features. Integrating frequency-domain processing before the attention mechanism is particularly beneficial because it allows the model to suppress high-frequency noise and emphasize dominant periodic trends at an early stage. This pre-filtering improves the signal-to-noise ratio of the input representation, enabling the self-attention mechanism to operate on a cleaner, more structured signal. As a result, the model is better positioned to capture long-term dependencies and avoid being misled by transient or irrelevant fluctuations, ultimately enhancing both accuracy and generalization [22]. By incorporating spectral information upfront, our approach provides the Transformer with a richer representation of temporal patterns, thereby offering an expressive characterization of both local fluctuations and long-range trends. In essence, the FFC module acts as a feature extractor that emphasizes important cyclical behaviors, complementing the time-domain learning in subsequent layers [23].

The architectural innovations and methodological advancements of iTransformer-FFC are highlighted below:

• Hierarchical temporal modeling: iTransformer-FFC integrates Inception-style convolution and factorized attention to jointly capture short-term and long-term temporal dependencies with reduced computational cost.
• Frequency-aware feature enhancement: The model employs Fast Fourier Convolution (FFC) to extract dominant periodic components and suppress high-frequency noise, improving robustness to non-stationarity.
• Improved long-horizon forecasting: Through multi-scale fusion and efficient attention, the model achieves superior accuracy and stability over extended prediction windows.

To evaluate the effectiveness of the proposed architecture, comprehensive experiments are carried out on five publicly available benchmark datasets spanning diverse time series forecasting tasks. Compared to both classical Transformer variants and recent advanced models such as PatchTST, iTransformer-FFC consistently achieves superior predictive accuracy. These results confirm that the integration of frequency-domain convolution and hierarchical attention mechanisms effectively enhances the Transformer’s capability to model long-range dependencies, handle non-stationarity, and generalize across multiple temporal scales. The remainder of this paper is structured as follows. Section 2 reviews related work; Section 3 presents the proposed iTransformer-FFC model; Section 4 describes the experimental setup; Section 5 discusses the results and outlines future work.

2. Related Work

Time series forecasting has historically employed a variety of statistical and machine learning models, including ARIMA, GARCH, and ETS, which offer interpretable frameworks for capturing linear trends and volatility patterns [24,25,26]. While classical models like ETS exhibit robustness under noisy conditions and have demonstrated utility in short-term, time-sensitive applications such as those reported by Lwin et al. [27], they lack the capacity to model complex nonlinear and multi-scale dependencies. Inspired by such robustness, our work incorporates frequency-domain processing to enhance noise suppression, extending this advantage through a deep learning framework that captures richer temporal structures. These models excel at capturing linear relationships and volatility patterns prevalent in time series data. However, their ability to model complex nonlinear patterns, which are often present in time series, remains limited [28]. Although algorithms such as Support Vector Machines (SVMs) and Random Forests (RFs) have been employed in time series forecasting tasks, their limited capacity to capture sequential dependencies and dynamic temporal structures often constrains their predictive accuracy [29].

Deep learning has brought transformative advancements across diverse application areas due to its strong capability in modeling intricate data structures. Its adoption spans disciplines such as healthcare [30,31,32,33,34], commerce [35], structural engineering [36], behavioral science [37], and financial markets [38]. In the context of stock market prediction, Recurrent Neural Networks (RNNs) have demonstrated notable success by processing temporal sequences via recurrent hidden states. Nonetheless, conventional RNNs are limited in their capacity to capture extended temporal dependencies, often hindered by gradient vanishing or explosion problems [39]. To address these challenges, Long Short-Term Memory (LSTM) networks were introduced [40], incorporating specialized memory units and gating mechanisms that allow the retention and manipulation of long-range information. Empirical evidence suggests that LSTM-based architectures offer superior predictive performance over traditional statistical methods, particularly in capturing short-term fluctuations in financial time series [41,42].

Despite the Transformer model’s extensive adoption and its proven efficacy in numerous sequential modelling tasks, its utilization in time series forecasting remains constrained by several significant limitations. Firstly, the self-attention mechanism of the Transformer exhibits quadratic computational complexity with respect to sequence length [43]. This results in substantial computational resource consumption and reduced scalability when processing long sequences. Secondly, the fixed positional encoding employed by the traditional Transformer is inadequate in effectively representing the periodic patterns that are commonly observed in time series data [44]. This limitation restricts the model’s capacity to capture complex temporal dependencies. Furthermore, the global attention mechanism increases the risk of overfitting when applied to noisy datasets, which are characteristic of real-world markets, ultimately impairing the model’s generalization performance [45]. Consequently, there is a necessity to develop structural optimizations and methodological enhancements to address the shortcomings of the Transformer in terms of computational efficiency, temporal modelling capabilities, and robustness against noise, thereby improving its applicability to time series forecasting tasks [46].

3. Methodology

3.1. Problem Formulation

In this work, we addressed the challenge of forecasting multivariate time series, which involves predicting future values across multiple interdependent variables over time. More formally, given a series of fully observed time series signals $Y=\left\{y_1,y_2,\dots ,y_T\right\},where{y}_t\in R^n$ and $n$ is the variable dimension, we aimed to predict a series of future signals in a rolling forecasting fashion. Specifically, to predict $y_{T+h}$, where $h$ is the desirable horizon ahead of the current time stamp, we assumed ${\{y}_1,y_2,\dots ,y_T\}$ are available. Likewise, to predict the value of the next time stamp $y_{T+h+1}$, we assumed {$y_1,y_2,\dots ,y_T,y_{T+1}\}$ are available. We hence formulated the input matrix at time stamp $T$ as $X_T=\{y_1,y_2,\dots ,y_{T\}}\in R^{n\times T}$.

3.2. Fast Fourier Convolution (FFC)

3.2.1. FFC Architectural Design

The architecture of our proposed FFC module for sequence prediction is illustrated in Figure 1. Conceptually, FFC consists of two interconnected branches: a local path, which applies standard 1D convolutions to capture short-range dependencies, and a global path, which performs operations in the frequency domain to model long-range dependencies in the sequence.

Formally, let $X\in {\mathbb{R}}^{L\times C}$ be the input feature sequence, where $L$ denotes the sequence length and $C$ the number of channels. At the entry of FFC, we split the input along the channel dimension into a local part $X^l\in {\mathbb{R}}^{L\times (1-{\alpha }_{in})C}$ and a global part $X^g\in {\mathbb{R}}^{L\times {\alpha }_{in}C}$, where ${\alpha }_{in}\in \left[\mathrm{0,1}\right]$ controls the proportion of channels assigned to the global path.

The local path processes $X^l$ using standard 1D convolutional layers to extract features from the local context, while the global path transforms $X^g$ to the frequency domain using the Fast Fourier Transform (FFT), applies learnable filters, and then transforms it back using the inverse FFT to capture global trends. The output tensor is denoted by $Y\in {\mathbb{R}}^{L\times C}$, which is also split into $Y^l$ and $Y^g$ following a predefined output ratio ${\alpha }_{out}\in \left[\mathrm{0,1}\right]$. The final output is obtained by concatenating $Y^l$ and $Y^g$ along the channel dimension. Internal fusion mechanisms allow information exchange between the two branches, enhancing the network’s capacity to model both local dynamics and global temporal dependencies. This preprocessing allows the attention module to operate on more structured, noise-reduced signals, enhancing long-range pattern recognition.

$$Y^l=f_l\left(X^l\right)+f_{g\to l}\left(X^g\right)$$

(1)

$$Y^g=f_g\left(X^g\right)+f_{l\to g}\left(X^l\right)$$

(2)

where $f_l\left(X^l\right)$ captures local patterns via standard 1D convolution, while $f_g\left(X^g\right)$, implemented as a spectral transformer, models long-range dependencies in the frequency domain. The cross-path terms $f_{g\to l}\left(X^g\right)$ and $f_{l\to g}\left(X^l\right)$ enable bidirectional information exchange between local and global branches, enhancing feature representation. For statement clarity, we termed $f_g$ as a spectral transformer.

3.2.2. Spectral Transformer

The objective of the global path in Figure 1 is to efficiently expand the receptive field of convolutions, enabling the model to capture long-range dependencies across the entire sequence. To achieve this, we adopted the Discrete Fourier Transform (DFT), leveraging the accelerated Cooley–Tukey algorithm. As depicted in Figure 1, our spectral transformer was inspired by the bottleneck block in ResNet. To reduce computational complexity, we began with a 1 × 1 convolution that reduces the number of channels, followed by another 1 × 1 convolution to restore the feature channel dimension. Between these two convolutions, we introduced a Fourier Unit (FU) to capture global temporal patterns, a Local Fourier Unit (LFU) that operates on a subset of feature channels to capture semi-global dependencies, and a residual connection to improve model stability and facilitate efficient information flow. The details of the FU and LFU are discussed below.

3.3. Itransformer

The iTransformer is an improved neural architecture derived from the Transformer model. Unlike the standard Transformer, it encodes separate time series as individual tokens, allowing the model to capture inter-series dependencies via self-attention mechanisms. It further integrates layer normalization and feed-forward networks to enhance global feature extraction for forecasting tasks. These enhancements improve the model’s adaptability and performance, especially in long-sequence scenarios. Figure 2 presents the detailed architecture of iTransformer, which includes the following main components:

Embedding: The input variates are mapped to generate embedded tokens of dimension D. Positional encoding is used to inject information about the relative position of the sequences. The embedded token of dimension D for feature n is expressed by:

$${\mathrm{h}}_{\mathrm{n}}^0=Embedding\left(X_{:,n}\right)$$

(3)

Multivariate Attention: This layer captures the dependencies between features by applying the self-attention mechanism on each variate time series. Given the representation of each time series $H^1=\{{\mathrm{h}}_1,\dots ,{\mathrm{h}}_{\mathrm{N}}\}$ at the $l-th$ layer, the queries, keys, and values $\mathrm{Q}$, $\mathrm{K}$, and $\mathrm{V}$ are generated through linear projections.

$$Attention\left(Q,K,V\right)=softmax\left({\displaystyle \frac{Q{K}^T}{\sqrt{d_k}}}\right)V$$

(4)

$${head}_i=Attention\left(H^{l-1}{W}_Q^l,H^{l-1}{W}_K^l,H^{l-1}{W}_V^l\right)$$

(5)

$$MultiHead\left(H^{l-1}\right)=\left[{head}_1;\dots ;{head}_h\right]W^O$$

(6)

where $W_Q^l$, $W_Q^l$ and $W_Q^l\in R^{D\times d_k}$ are projection weights.

Feed-forward Network (FFN): The network encodes the sequential representation of each variate token and employs nonlinear fully connected layers to capture intricate dependencies within the input sequence. Each token is independently processed through the feed-forward network ($\mathrm{F}\mathrm{F}\mathrm{N}$) in a parallel manner

$$H^l=FFN\left(MultiHead\left(H^{l-1}\right)\right)$$

(7)

Projection: A fully connected layer maps the output from the feed-forward network to obtain the predicted capacity at the next time step.

$${\widehat{Y}}_{:,n}=Projection\left(h_n^L\right)$$

(8)

3.4. Model Architecture of iTransformer-FFC

The iTransformer-FFC (Frequency-aware Fully Convolutional iTransformer) is a novel model tailored for multivariate time series forecasting, integrating frequency-domain modeling with fully convolutional representations. Building upon the standard iTransformer framework, this architecture is specifically designed to enhance the representation of periodicity, trends, and abrupt changes, while significantly reducing the computational burden commonly associated with long-sequence modeling in conventional Transformer-based models.

A core innovation of iTransformer-FFC lies in its abandonment of positional encoding, which is traditionally required to encode temporal information. Instead, the model leverages data-driven temporal feature representations and frequency-aware components to address the inherent non-stationarity and multi-scale characteristics of real-world time series. The architecture adopts a two-stage modeling approach comprising an encoder and a decoder. The encoder incorporates a stack of TimesBlocks, each of which is built upon lightweight Factorized Attention and Inception-style Convolution to effectively extract temporal patterns across multiple resolutions and frequency bands. In the decoding phase, a label-length-aware masked decoder is employed to preserve causal dependencies and facilitate autoregressive forecasting. Furthermore, to enhance modeling flexibility across variables, iTransformer-FFC supports both channel-independent and channel-mixing modes. The former performs separate modeling per variable, suitable for loosely coupled dimensions, whereas the latter utilizes attention mechanisms to capture inter-series dependencies, enabling the learning of complex interactions among correlated time series.

To mitigate the long-range dependency degradation inherent in traditional Transformers, iTransformer-FFC integrates a frequency-aware architectural design. Specifically, the TimesBlock module introduces an Inception-style multi-kernel convolution mechanism, allowing the model to represent periodic components of varying scales in the frequency domain. Unlike explicit Fourier transform methods, this design provides a learnable approximation of spectral responses, thereby improving the model’s ability to recognize long-term cycles while maintaining adaptability to non-stationary behavior.

Additionally, a Distillation Module is embedded within the encoder to compress intermediate representations through progressive sequence length reduction. This mechanism enables the preservation of salient features while reducing computational redundancy, thus improving both efficiency and generalization. From an optimization perspective, iTransformer-FFC is trained using the Mean Squared Error (MSE) loss and leverages adaptive learning rate schedules such as Reduce Learning Rate On Plateau to ensure stable convergence and robustness across different time series scenarios.

In summary, iTransformer-FFC provides a comprehensive balance between representational capacity and computational efficiency. It is particularly well-suited for high-dimensional, nonlinear, and hybrid-pattern time series forecasting tasks, where the simultaneous presence of trend, seasonality, and noise poses significant modeling challenges.

The overall model architecture is illustrated in Figure 3, highlighting the interaction between the encoder–decoder structure and the frequency-aware components.

4. Experiments

4.1. Data

To assess the effectiveness of the proposed iTransformer, empirical evaluations were conducted using five real-world benchmark datasets. (1) The ETT dataset comprises seven electrical transformer indicators measured between July 2016 and July 2018. It is divided into four subsets: ETTh1 and ETTh2 with hourly sampling, and ETTm1 and ETTm2 sampled at 15-min intervals. (2) The Exchange dataset consists of daily foreign exchange rate time series from eight different countries, spanning the years from 1990 to 2016. The basic characteristics of these datasets are summarized in

Table 1. Statistics of popular datasets for benchmark.

Datasets	Exchange	ETTh1	ETTm1	ETTh2	ETTm2
Variables	8	7	7	7	7
Timesteps	5120	17,420	69,680	17,420	69,680
Frequencies	Daily	1 h	15 min	1 h	15 min

.

These datasets collectively exhibit diverse temporal characteristics such as trend, seasonality, irregular fluctuations, and volatility, allowing for a comprehensive evaluation of model robustness across different dynamic patterns. We employed a set of classical statistical methods to quantify these properties, and a summary of their statistical characteristics is provided in

Table 2. Complexity indicators of datasets used for forecasting evaluation.

Datasets	Mean	Median	Maximum	Minimum	MAD
Exchange	0.65441	0.66918	0.8823	0.3931	0.0953
ETTh1	13.3246	11.3959	47.0068	−4.0799	6.7493
ETTm1	13.3206	11.3959	46.0069	−4.2210	6.7476
ETTh2	13.3247	11.3960	46.0070	−4.0800	6.7494
ETTm2	26.6097	26.5769	58.8769	−2.6465	10.010

.

4.2. Evaluation Criteria

Regression model evaluation metrics are essential for quantitatively assessing the predictive accuracy and overall effectiveness of a model in capturing the underlying relationship between input features and output responses.

The Mean Squared Error ($MSE$) quantifies the average squared deviation between predicted and actual values, serving as a fundamental metric for evaluating the predictive accuracy of regression models. A lower $MSE$ indicates a closer fit between the model’s output and the observed data, reflecting superior forecasting performance.

$$MSE={\displaystyle \frac{1}{n}}{\sum }_i^n{(y_i-{\widehat{y}}_i)}^2,$$

(9)

The Mean Absolute Error ($MAE$) evaluates the average magnitude of errors between predicted and actual values by computing the mean of their absolute differences. It serves as a robust and interpretable metric for assessing model accuracy, with lower $MAE$ values indicating better predictive performance.

$$MAE={\displaystyle \frac{1}{n}}{\sum }_1^n\left|y_i-\left.{\widehat{y}}_i\right|\right.,$$

(10)

The Coefficient of Determination ($R^2$) serves as a statistical metric to assess the explanatory power of a regression model. It is defined as one minus the ratio of the residual sum of squares (RSS) to the total sum of squares (TSS), thereby quantifying the proportion of variance in the dependent variable that is predictable from the independent variables. An R² value closer to 1 signifies superior model fidelity and predictive effectiveness

$$R^2=1-{\displaystyle \frac{\sum {\left(y_i-{\widehat{y}}_i\right)}^2}{\sum {\left(y_i-\overline{y}\right)}^2}},$$

(11)

4.3. Results

This study presents a systematic and comprehensive evaluation of several state-of-the-art time series forecasting algorithms—namely, Transformer, iTransformer, and PatchTST—across five publicly available benchmark datasets. The primary objective is to identify the most effective model in terms of predictive accuracy and computational efficiency for the task of stock price forecasting. Performance is assessed using a set of widely accepted regression evaluation metrics, including Mean Squared Error (MSE), Mean Absolute Error (MAE), and the Coefficient of Determination (R²), to provide a multifaceted measure of model accuracy and generalization capability.

The proposed iTransformer-FFC model demonstrates superior forecasting performance. As depicted in Figure 4, Figure 5, Figure 6 and Figure 7, the blue curves represent the actual stock prices, while the red curves indicate the corresponding predicted values. The close alignment between these curves underscores the model’s ability to accurately capture temporal dynamics. For comparison, Figure 4, Figure 5, Figure 6 and Figure 7 illustrate the forecasting results of iTransformer-FFC, iTransformer, Transformer, and PatchTST, respectively.

To ensure consistency across experiments, we adopted a unified set of training hyperparameters for all models. These settings are summarized in

Table 3. Hyperparameter settings.

Parameters	Value
batch size	64
pred length	1
learning rate	0.001
d_model	64

, including batch size, prediction length, learning rate, and model dimension.

A comparative analysis of MSE values across the evaluated models is presented in

Table 4. Comparative performance of forecasting models across five benchmark datasets based on MAE, MSE, and R² metrics.

Index	Models	MAE	MSE	R2
Exchange	iTransformer-FFC	0.003806	0.000028	0.994
	iTransformer	0.003843	0.000029	0.994
	Transformer	0.004089	0.000033	0.993
	PatchTST	0.004806	0.000037	0.992
ETTh1	iTransformer-FFC	0.475	0.455	0.961
	iTransformer	0.599	0.734	0.938
	Transformer	0.524	0.569	0.951
	PatchTST	0.560	0.633	0.946
ETTm1	iTransformer-FFC	0.228	0.114	0.990
	iTransformer	0.236	0.122	0.989
	Transformer	0.238	0.124	0.989
	PatchTST	0.228	0.114	0.990
ETTh2	iTransformer-FFC	0.884	0.782	0.993
	iTransformer	0.891	0.816	0.992
	Transformer	1.035	2.28	0.980
	PatchTST	0.987	2.31	0.984
ETTm2	iTransformer-FFC	0.196	0.078	0.999
	iTransformer	0.217	0.096	0.997
	Transformer	0.237	0.104	0.994
	PatchTST	0.279	0.157	0.995

, with the results organized by ticker symbol and model architecture. As a general rule, lower MSE values reflect improved predictive precision. According to the results shown in Figure 8, the iTransformer-FFC consistently achieves the lowest MSE scores on the majority of datasets, suggesting that it is particularly well-suited for complex time series forecasting tasks involving stock price dynamics. Furthermore, Table 4 also reports the Mean Absolute Error (MAE) for each model. As a robust indicator of predictive performance, MAE quantifies the average magnitude of forecast errors. The iTransformer-FFC model records the lowest MAE values among all evaluated models, reinforcing its status as the most accurate predictive model in this comparative study.

On the ETTh1 dataset, iTransformer-FFC achieves an MSE of 0.455, compared to 0.569 for Transformer and 0.633 for PatchTST. Similar trends are observed on the ETTh2 dataset, where iTransformer-FFC obtains an MSE of 0.782, while Transformer and PatchTST yield 2.280 and 2.310, respectively. These results reflect consistent improvements across both moderate and volatile series. The comparison of MAE and MSE across the four benchmark datasets is visualized in Figure 4, clearly illustrating the performance differences of each model under varying temporal volatility and sequence complexity.

The forecasting results presented in this figure demonstrate high accuracy across a wide range of temporal patterns and volatility conditions. The predicted values align closely with the actual observations in upward and downward trends, periodic segments, and regions with intense fluctuations. This performance underscores the model’s strong capacity to capture frequency-dependent characteristics and leverage structural dependencies among time series components, resulting in stable and precise forecasting outcomes across diverse scenarios.

The model depicted in this figure demonstrates generally good alignment with the observed values across most time steps, particularly in stable trend intervals. However, noticeable discrepancies arise in segments characterized by abrupt fluctuations or high-frequency noise. These deviations suggest that the model lacks the capacity to effectively capture complex local dynamics and rapid structural changes within the time series.

This model exhibits improved performance in modeling low-frequency trends, showing enhanced overall fit compared to the previous one. Nonetheless, its predictive accuracy diminishes during intervals of rapid variation, often resulting in lagging forecasts. This indicates limitations in handling non-stationary temporal dependencies and short-term variability.

The results shown in this figure reflect a better response to high-frequency components, as the model captures finer fluctuations with greater sensitivity. However, certain peak and trough points are still missed or inaccurately predicted, reflecting instability in localized patterns. This may stem from insufficient frequency-domain separation or overfitting to periodic signals.

4.4. Experimental Analysis

The comprehensive empirical evaluation across five widely used benchmark datasets—Exchange, ETTh1, ETTh2, ETTm1, and ETTm2—demonstrates that the proposed iTransformer-FFC model consistently outperforms state-of-the-art baseline methods, including Transformer, iTransformer, and PatchTST. The evaluation, conducted under standardized experimental settings, utilizes Mean Absolute Error (MAE), Mean Squared Error (MSE), and the Coefficient of Determination (R²) as primary performance metrics, providing a robust measure of both predictive accuracy and model generalization.

On high-resolution datasets such as ETTm1 and ETTm2, iTransformer-FFC achieves superior performance, with MSE values of 0.114 and 0.078, respectively, and R² values exceeding 0.99. These results validate the model’s ability to effectively capture intricate temporal dependencies and fine-grained seasonal structures that are often present in dense time series. The model’s use of frequency-aware convolution and factorized attention appears to enhance its sensitivity to periodic patterns while mitigating the effects of short-term noise.

In scenarios involving irregular or volatile patterns—such as those exhibited in the ETTh2 and Exchange datasets—iTransformer-FFC continues to demonstrate its robustness. Compared to the Transformer and iTransformer baselines, the proposed model achieves consistently lower prediction errors and higher R² scores, highlighting its capacity to adapt to non-stationary dynamics and abrupt regime shifts. This robustness can be attributed to two critical architectural components: (1) the Fast Fourier Convolution (FFC) module, which enables frequency-domain feature learning, and (2) the distillation-based sequence compression mechanism, which reduces temporal redundancy and facilitates more stable training.

In addition, the model’s hybrid design—supporting both channel-independent and channel-mixing pathways—offers flexibility in capturing multivariate dependencies, enabling it to scale effectively across different data granularities and variable correlation structures. The consistently low standard deviations observed across repeated trials further attest to the stability and reliability of the model under various temporal regimes.

In summary, the experimental results substantiate the superiority of iTransformer-FFC in terms of both predictive precision and robustness. Its architectural innovations allow it to model complex, nonlinear, and multi-scale temporal phenomena more effectively than conventional approaches, making it particularly well-suited for real-world time series forecasting applications where accuracy, adaptability, and efficiency are all critical.

4.4.1. Architectural Design

To quantitatively evaluate the individual contribution of each core component in the proposed iTransformer-FFC architecture, we conducted an ablation analysis. Three reduced variants were designed by systematically removing or modifying key modules: (1) removing the Fast Fourier Convolution (FFC) module; (2) replacing the Factorized Self-Attention (FSA) with standard full self-attention; and (3) disabling the hierarchical multi-scale fusion mechanism (MSF) by applying single-scale convolutions only. Experiments were conducted on the ETTm1 and ETTh1 datasets, and the results are presented in

Table 5. Ablation study of iTransformer-FFC on the ETTh1 and ETTh2 datasets evaluating the impact of core architectural components (FFC, FSA, and MSF).

Index	Models	MAE	MSE	R2
ETTh1	iTransformer-FFC	0.675	0.455	0.961
	No-FFC	0.604	0.798	0.931
	No-FSA	0.512	0.590	0.948
	No-MSF	0.541	0.625	0.940
ETTh2	iTransformer-FFC	0.884	0.782	0.993
	No-FFC	0.840	0.969	0.982
	No-FSA	1.010	2.112	0.973
	No-MSF	0.963	1.908	0.976

. The complete model consistently achieves the best performance across all metrics, while the exclusion of the FFC module leads to the most significant degradation. These results underscore the importance of frequency-domain representation and multi-scale learning in capturing complex temporal patterns. The detailed results are shown in Table 5.

4.4.2. Robustness and Statistical Significance Analysis

To ensure the robustness of the observed performance improvements, we conducted paired t-tests between the proposed iTransformer-FFC model and each baseline model (iTransformer and PatchTST) under multiple random seed initializations. The null hypothesis assumes no statistically significant difference in forecasting accuracy between the compared models.

The results are summarized in

Table 6. Statistical significance analysis of iTransformer-FFC compared to baseline models on the ETTh1 and ETTh2 datasets using paired t-tests.

Comparison	Metric	Mean Difference	t-Value	p-Value	Significance
iTransformer-FFC vs. iTransformer	MAE	−0.024	4.51	0.0012	Yes (p < 0.01)
iTransformer-FFC vs. PatchTST	MAE	−0.019	3.12	0.0068	Yes (p < 0.01)

, which presents the mean differences in MAE, corresponding t-values, p-values, and statistical significance levels for each pairwise comparison. As shown in the table, iTransformer-FFC consistently outperforms both baselines, with p-values < 0.01, indicating that the performance improvements are statistically significant and unlikely to have occurred by chance.

4.4.3. Training and Inference Efficiency

To rigorously evaluate the computational efficiency of iTransformer-FFC in both training and inference, we conducted comparative experiments against the baseline iTransformer using the ETTm1 dataset. All experiments were implemented under identical experimental settings, with consistent data loaders and hyperparameter configurations to ensure methodological fairness. As illustrated in Figure 9, iTransformer-FFC consistently outperforms iTransformer in inference speed across all tested iteration scales. Notably, at 600 iterations, iTransformer-FFC achieves an inference time of 1.11 s, significantly outperforming iTransformer’s 1.90 s, corresponding to a performance gain exceeding 40%. Furthermore, the observed efficiency gap widens progressively with increasing iteration counts, underscoring the superior scalability and computational robustness of the proposed architecture under heavier workloads. All evaluations were executed on the same hardware and software platform, utilizing a single NVIDIA RTX 4090 GPU, to guarantee result reproducibility and eliminate environmental variability.

5. Conclusions

Time series forecasting plays a critical role in a wide range of real-world applications, such as energy systems, industrial monitoring, and environmental analysis. In this work, we propose iTransformer-FFC, a novel forecasting model that enhances traditional Transformer-based architectures with feature fusion components to better capture multi-scale temporal dependencies. We conduct comprehensive experiments on five publicly available benchmark datasets and compare our model against several state-of-the-art baselines, including Transformer, iTransformer, and PatchTST. The evaluation results based on the MSE, MAE, and R² metrics demonstrate that iTransformerFFC consistently achieves superior performance, confirming its effectiveness in modeling complex temporal dynamics and improving predictive accuracy.

In future work, the model will be extended in two directions. First, we will explore more adaptive and dynamic fusion strategies to improve the model’s generalization to diverse time series characteristics. Second, we aim to enhance the interpretability of the model by incorporating explainable mechanisms, making it more applicable to high-stakes decision-making tasks in real-world scenarios.