Skip to Content
You are currently on the new version of our website. Access the old version .
Applied SciencesApplied Sciences
  • Article
  • Open Access

8 July 2026

23 Pages

Optimizing-Time Series Imputation with Data Quality

,
,
and
1
Faculty of Science, Civil Aviation Flight University of China, Guanghan 618307, China
2
National Science Library (Chengdu), Chinese Academy of Sciences, Chengdu 610299, China
3
College of Computer Science, Sichuan University, Chengdu 610065, China
4
Data Recovery Key Laboratory of Sichuan Province, Neijiang 641100, China

Abstract

Missing values in time series are not uncommon due to system failures or external interference during data collection. A multitude of imputation algorithms have been proposed to infer these missing values. However, existing methods often overlook the difference in sample data quality within the dataset. Specifically, training imputation algorithms on low-quality samples can lead to the generation of poor-quality data, which adversely affects the performance of downstream models. To address this issue, we propose integrating a data quality evaluation with the imputation process. The workflow involves imputing missing values using an imputation algorithm, evaluating the data quality of each sample, and then removing low-quality samples. Our experimental results demonstrate the effectiveness of this approach on improving the performance of downstream model across four datasets, seven input algorithms, four quality assessment methods, and two types of machine learning tasks. Additionally, we convert time series data into complex networks and find that network features can effectively explain the data quality of individual samples.

1. Introduction

Time-series data are sequential records ordered chronologically to capture changes within a system. Common examples include traffic flow measurements [1], electrocardiogram (ECG) recordings [2] and air-quality-monitoring data [3]. In practical applications, various factors, such as sensor malfunctions and electromagnetic interference, can lead to missing data in time series [4,5]. This phenomenon presents significant challenges for machine learning models aiming to detect patterns within these sequences, consequently impacting the accuracy of downstream forecasting and classification tasks. As a result, time-series imputation has become a hot topic in time-series data mining [6].
Although existing imputation methods achieve satisfactory performance by exploiting mathematical properties, similarity features, and temporal dependencies within the data, they tend to neglect the intrinsic quality of individual samples. Empirical studies have shown that variations in sample quality exist across datasets, and that low-quality samples may negatively impact model training. For example, Huang et al. [7] investigated that the performance of time-series forecasting models can also be improved by reducing the influence of low-quality samples. It should be noted that the aforementioned discussions are based on data without missing values. Consequently, it is reasonable to expect that differences in data quality may also persist among time-series samples after missing values have been imputed. This is due to the fact that existing imputation methods cannot ensure the exact recovery of true values and may inadvertently alter the original contextual associations or temporal structures within the data during the reconstruction process, as illustrated in Figure 1. Therefore, we propose integrating the concept of data quality into time-series imputation algorithms and center our investigation around the following questions: (1) Do differences in data quality persist in time-series data after imputation? This forms the foundational premise of our work. (2) If such differences exist, can existing imputation methods be optimized? This constitutes the core objective of our research. (3) Can we further identify quantifiable features that distinguish low-quality from high-quality samples within the imputed data? Addressing this key focus may provide actionable insights for future improvements in imputation algorithms.
Figure 1. Example of how bad imputation samples result in a bigger loss.
In this paper, we first demonstrate that substantial variations in quality exist among imputed samples. Importantly, this observation does not undermine the validity of existing imputation models; rather, it highlights opportunities to further enhance their performance. Building on this insight, we propose a novel quality-aware imputation framework that integrates data imputation with quality assessment. The proposed approach comprises three key steps: (1) imputation phase: apply existing imputation algorithms to generate a complete datasets without missing values; (2) evaluation phase: calculate the quality score of each sample; and (3) filtering phase: filter out low-quality samples to produce a refined, high-quality imputed datasets. Unlike the imputation algorithm, the optimization in this paper is focused on the quality of the imputed datasets, that is, retaining high-quality samples and deleting low-quality ones, rather than optimizing the missing values of the samples. Finally, we explore the relationship between complex network features and sample quality. In summary, the main contributions of this paper are as follows:
  • We propose a novel method by integrating data quality evaluation algorithms and time-series imputation methods, thereby optimizing the quality of the imputed datasets.
  • We comprehensively evaluate the effectiveness of our method for downstream model through extensive experiments conducted across four datasets, seven imputation algorithms, four quality assessment techniques, and two types of machine learning tasks. Specifically, the experimental results show that the prediction mean absolute error (MAE) can be reduced by up to 38.73 % on the Italy Air-Quality dataset; the Area Under the Precision–Recall Curve (AUPRC) score can be increased by up to 118.41 % on the PhysioNet 2019 dataset.
  • We reveal a significant relationship between time-series data quality and complex network features, providing interpretable insights into the characteristics of low-quality samples through network-based analysis.

3. Methodology

3.1. Data Insight

Figure 2 illustrates the distribution of sample quality scores generated by various evaluation algorithms. Specifically, the first row of images in Figure 1 presents the statistical results of the quality scores of the datasets imputed by SAITS for the Italy Air-Quality datasets. The second row presents the statistical information on the PhysioNet 2012 datasets. For more information on the datasets, please refer to Section 4.1. From the experimental results, most distributions exhibit a distinct long-tail pattern, with the exception of the G-Shapley assessment results for the prediction task, which closely resemble a bell-shaped (Gaussian-like) distribution. These observations confirm the presence of quality differences among samples following the imputation process. This evidence strongly supports the central premise of this study: that data quality evaluation can be effectively utilized to enhance time-series imputation algorithms. Code is available at gitee (https://gitee.com/jimapp330/Imputation-withDataQuality.git (accessed on 1 July 2026)).
Figure 2. Illustration of quality difference.

3.2. Our Method

This paper proposes a novel approach to improving data imputation performance by optimizing data quality. Unlike traditional methods that focus on enhancing model architecture, we introduce an innovative framework that integrates imputation algorithms with a data quality evaluation module. Specifically, we present an “impute-evaluate-filter” strategy (as illustrated in Figure 3), which first performs data imputation and then filters the imputed samples based on quality metrics, thereby producing a high-quality imputed datasets. The proposed methodology consists of three core steps, which are described below.
Figure 3. Workflow of proposed method.

3.2.1. Imputation

First, we need to train an imputation model. In this paper, the imputation model can be selected from the-state-of-the-art deep-learning-based imputation models. In existing works, the training strategy is to first construct the time series without missing values into a dataset of missing values according to a certain missing ratio and missing pattern. Then, model learning is guided through reconstruction. The training process can be expressed as follows:
M t r a i n = T r a i n ( M 0 , D t r a i n ) ,
where M 0 is an imputation model with randomly initialized parameters, including but not limited to GPVAE, SSGAN, CSDI, GRU-D, TimesNet, StemGNN, and SAITS. M t r a i n corresponds to the trained model. D t r a i n is the train set.
Then, we use the trained model M t r a i n to perform imputation on missing values within the original datasets D o r i g i n a l :
D i m p u t a t i o n = I m p u t a t i o n ( M t r a i n , D o r i g i n a l ) ,
where D i m p u t a t i o n is the original datasets after imputation. Equations (1) and (2) capture the core computational flow of conventional imputation methods, which generate completed datasets for downstream applications. As mentioned before, we think current imputation may damage the contextual relationships or temporal structures within the original data during the recovery process. Therefore, we introduce additional sample evaluation and filtering steps to deal with this issues.

3.2.2. Evaluation

Data quality assessment algorithms aim to quantify the extent to which individual samples contribute positively or negatively to model learning. Within the framework of this paper, our objective is to first use the data quality evaluation algorithm to evaluate the imputed datasets D i m p u t a t i o n , enabling subsequent filtering of low-quality instances. The process is given as follows:
Q = E v a l u a t i o n ( D i m p u t a t i o n , A q u a l i t y ) .
The quality evaluation algorithm A q u a l i t y could select but not is limited to Grand, VoG, SGD-influence and G-Shapley. The fundamental operating principles of these selected algorithms are briefly outlined below:
(1)
Grand is defined as the expected value of the norm of the sample gradient [41]. Formally:
G r a n d t ( x , y ) = E w t ∥ g t ( x , y ) ∥ 2 ,
where the sample gradient at t-th training step, g t ( x , y ) = ∇ w t L ( p ( w t , x ) , y ) and t = 1 , … , T . w t is a vector representing the parameters of model at t-th training step. Loss function L ( · ) is defined as the prediction loss or classification loss. p ( w t , x ) is the output of model. y is the true value or label.
(2)
VoG is defined as the variance in Gradient [42]. More specifically, a sample’s quality is evaluated based on its variance in the gradient values. The samples that are challenging for the model to learn tend to exhibit larger gradient variance throughout training. S t can be defined as the gradient of the model parameters at t-th training step, and μ the average gradient over k training epochs; VoG can be calculated as follows:
V o G t = 1 k ∑ t = 1 k S t − μ 2 .
In Equation (5), V o G t is a vector; we convert it to a scalar and get the VoG score.
V o G ( x , y ) = 1 V o G t ∑ v ∈ V o G t v .
(3)
SGD-influence: Given a sample z j at step t, SGD-influence refers to the parameter difference θ − j [ t ] − θ [ t ]  [39]. If the sample z j is used at step π ( j ) , after T steps, SGD-influence can be estimated as follows:
θ − j [ T ] − θ [ T ] ≈ η π ( j ) | S π ( j ) | Z T − 1 Z T − 2 ⋯ Z π ( j ) + 1 g ( z j ; θ [ π ( j ) ] ) ,
where Z t = I − η t H [ t ] . H [ t ] is the Hessian matrix. I is the identity matrix. S π ( j ) denotes the set of sample indices used in the π ( j ) -th step, and η π ( j ) > 0 is the learning rate. The gradient of the loss function g ( z i ; θ [ t ] ) = ∇ θ L ( z i ; θ [ t ] ) . Direct calculation of the Hessian matrix H [ t ] is computationally expensive. Therefore, its approximate value can be obtained by calculating H [ t ] u [ t ] :
H [ t ] u [ t ] = 1 | S t | ∑ i ∈ S t ∇ θ u [ t ] , g ( z i ; θ [ t ] ) ,
where u [ t ] is the derivative of the model f for an x sample in the validated set.
(4)
G-Shapley. Data Shapley is proposed according to the Shapley value defined in game theory. G-Shapley is an approximation of Data Shapley based on the stochastic gradient descent algorithm [43]. Given the training datset D, Data Shapley refers to the sum of performance changing over all subsets of D not containing sample i. Its expression is given as follows:
ϕ i = C ∑ S ⊆ D − { i } V ( S ∪ { i } ) − V ( S ) n − 1 S ,
where C is an arbitrary constant. V(S) is the performance score of a model trained on data S. In common, we use the test dataset to obtain V(S). As shown in Equation (9), computing Data Shapley requires computing all the possible marginal contributions which is exponentially large in the train data size. In addition, for each S ⊆ D , computing V(S) involves learning a model on S. As a consequence, calculating the exact Shapley value is not tractable for real scenario. Gradient Shapley (G-Shapley) is a simple approximation for Data Shapley by training the model with only one pass through the training data. Assume the length of the training dataset is n, π t is a random permutation of training data at t-th test time, and θ 0 t denotes the random initialization parameters. For each sample j ∈ { 1 , ⋯ , n } in the training dataset, we implement the process as follows:
θ j t = θ j − 1 t − α ∇ θ L ( π t [ j ] ; θ j − 1 ) v j t = V ( θ j t ) ϕ π t [ j ] = t − 1 t ϕ π t − 1 [ j ] + 1 t ( v j t − v j t − 1 ) ,
where α represents the learning rate, v j t is the performance score of sample j at t-th test time, and v j t − v j − 1 t is the marginal contribution is the change in model’s performance.

3.2.3. Filtering

According to the quality score, we filter out poor-quality samples:
D f i l t e r = F i l t e r ( D i m p u t a t i o n , Q ) .
Specifically, we sort the samples in ascending order based on their quality score and delete the top-k lowest-quality samples, thereby obtaining the optimized imputed datasets  D f i l t e r .
Upon obtaining the filtered D f i l t e r , we use it to retrain a new model. Our experiments demonstrate that the optimized datasets significantly improve model performance in both prediction and classification tasks (see Section 4). Notably, our filtering strategy is exclusively applied to the training set, while the validation and test sets remain unmodified to ensure unbiased evaluation. The complete procedure is formalized in Algorithm 1.
Algorithm 1 Optimizing Time-Series Imputation with Data Quality
 Require: 
Train set D t r a i n , the imputation algorithm M
 Ensure: 
The optimized imputed datasets D f i l t e r
   1:
Train the imputation algorithm based on train set (see Equation (1))
   2:
Obtain imputed datasets D i m p u t a t i o n using imputation algorithm (see Equation (2))
   3:
Calculate sample quality score Q (see Equation (3))
   4:
Sort the samples in ascending order according to their quality score
   5:
Delete the top-k samples to obtain the optimized imputed datasets D f i l t e r (see Equation (11))
   6:
Return D f i l t e r

4. Experiments

4.1. Experimental Setup

Target: This section presents the experimental validation of the proposed framework, focusing on two key research questions: (1) Effectiveness validation: How effective is the proposed quality-aware imputation optimization method in enhancing performance on downstream tasks? (2) Relationship exploration: Are there characteristics that distinguish low-quality from high-quality samples in the imputed data?
Approach: For the first question, we compare the performance of downstream models trained on two types of imputed data: (1) the original training data repaired using imputation algorithms, and (2) the imputed data further refined through our quality-aware optimization procedure. Model performance is assessed on unmodified validation and test sets. In experiments, we employ seven distinct baseline imputation algorithms: three generation-based methods (GPVAE [17], SSGAN [44], CSDI [21]) and four prediction-based algorithms (GRUD [25], TimesNet [24], StemGNN [30] and SAITS [35]). For the data quality evaluation phase, we select four representative algorithms: Grand, VoG, SGD-influence, and G-Shapley. For the second question, the relationship between the sample quality and time-series features derived from complex networks is assessed.
Datasets: We conducted experiments on four datasets: Italy Air-Quality (https://archive.ics.uci.edu/dataset/360/air+quality (accessed on 1 July 2026)), ETT (https://github.com/zhouhaoyi/ETDataset (accessed on 1 July 2026)), PhysioNet 2012 (https://www.physionet.org/content/challenge-2012/1.0.0/ (accessed on 1 July 2026)), and PhysioNet 2019 (https://physionet.org/content/challenge-2019/1.0.0/ (accessed on 1 July 2026)). An overview of the datasets’ information is presented in Table 1. The Italy Air-Quality and ETT datasets are used for the prediction task. Since there are no missing values in these two datasets, in the experiment, we adopted three missing patterns (subsequence missing (abbreviated as s), point missing (abbreviated as p), and block missing (abbreviated as b)) along with different missing proportions to process the data. The PhysioNet 2012 and PhysioNet 2019 datasets are used for the classification task. Due to their naturally high missing data rates (approximately 80 % ), we do not introduce any additional missing values. For the prediction task, we utilize two widely adopted evaluation metrics: the Mean Absolute Error (MAE) and Mean Squared Error (MSE). For the classification task, we use accuracy, the F1 score and the Area Under the Precision–Recall Curve (AUPRC) [45] to evaluate model performance. As described in Algorithm 1, the data quality evaluation algorithm only involves D t r a i n , outputs D f i l t e r , and the downstream model training is conducted on the D f i l t e r , while downstream model testing uses the test datasets.
Table 1. Data information used in this work.

4.2. Performance on Prediction Task

A standard LSTM architecture is employed for the prediction task. Table 2, Table 3, Table 4 and Table 5 present the comparative prediction performance results. In the two tables, the “LSTM” row displays the prediction performance of LSTM on the imputed datasets (underline). Subsequent rows (“Grand,” “VoG,” “SGD-influence,” and “G-shapely”) show the prediction performance of LSTM retrained on the imputed datasets optimized by these quality evaluation algorithms. If the performance improves, the results are highlighted in bold.
Table 2. Italy Air-Quality datasets (part 1: GPVAE, SSGAN, and CSDI).
Table 3. Italy Air-Quality datasets (part 2: comparison of GRUD, TimesNet, StemGNN, and SAITS).
Table 4. ETT datasets (part 1: GPVAE, SSGAN, and CSDI).
Table 5. ETT dataset (part 2: GRUD, TimesNet, StemGNN, and SAITS).
By calculating the proportion of bolded table cells, it can be determined that the bolded cells in the Italy Air-Quality dataset (Table 2 and Table 3) account for 72.7 % , and in the ETT dataset (Table 4 and Table 5), the bolded cells account for 82.1 % . The results indicate that the proposed method substantially improves the predictive performance of LSTM models on the two datasets, regardless of the patterns of missing data. Notably, among the data quality evaluation algorithms, VoG, SGD-influence, and G-Shapley achieve significantly greater performance enhancements than Grand. Specifically, the combination of SGD-influence and TimesNet resulted in a 38.73 % reduction in MAE under the p ( 50 % ) missing pattern in Italy Air-Quality datasets. Due to the inherent instability of GAN, although SSGAN incorporates semi-supervised learning to enhance generalization performance, it still performs worse than CSDI and SAITS. CSDI is a state-of-the-art model in recent years, being more stable than traditional GAN and capable of generating higher-quality imputed values. SAITS is based on the self-attention mechanism and is adept at capturing long-range dependencies in time series. Additionally, from the perspective of missing patterns, all four evaluation algorithms exhibit significantly greater improvements in point-missing scenarios than in block-missing scenarios. Overall, these results confirm the proposed method’s effectiveness for prediction tasks.

4.3. Performance on Classification Task

In the classification experiments, we utilize the PhysioNet 2012 and PhysioNet 2019 datasets. The baseline model is the LSTM with attention module (LSTM-ATT). The experimental results are presented in Table 6, Table 7, Table 8 and Table 9. If the performance improves, the results are highlighted in bold. Baseline LSTM-ATT is underlined. It can be determined that the bolded cells in both of these two datasets account for 92.8 % . The results reveal that the LSTM-ATT model shows consistent performance improvement when processing imputed data optimized by the four quality assessment algorithms. Notably, the proposed method achieves stronger performance improvements in classification tasks compared to prediction tasks. Interestingly, unlike its performance in prediction tasks, the Grand algorithm achieves significant improvement in classification tasks. Especially when combined with the CSDI model on the PhysioNet 2019 datasets, the AUPRC of the LSTM-ATT model has increased by 118.41 % . SGD-influence and G-Shapley believe that what has a positive impact on model performance is important. VoG also strives to identify the “difficult” samples that the model finds hard to learn in order to enhance its generalization ability. It can be seen that all these three algorithms emphasize the effect of samples on the model. Grand evaluates samples by assessing the gradient norm of the initial model parameters. It performs well in classification tasks because the discrete nature of classification tasks enables the gradient norm to effectively distinguish the difficulty of samples. However, in prediction (regression) tasks, the judgment power of gradient norm in a continuous space fails, making Grand unable to provide effective guidance for sample selection.
Table 6. PhysioNet 2012 dataset (part 1: GPVAE, SSGAN, CSDI).
Table 7. PhysioNet 2012 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).
Table 8. PhysioNet 2019 dataset (part 1: GPVAE, SSGAN, CSDI).
Table 9. PhysioNet 2019 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).

4.4. The Impact of Hyperparameter k

Figure 4a and Figure 4b, respectively, shows the changes in MSE, MAE, Accuracy, F1 score, and AUPRC when k takes different values. Specifically, each indicator represents the average value of that indicator for each imputation model when the k value is the same. It can be seen that when k = 0.1 , the overall effect is the best. Since k represents the proportion of samples to be deleted, the experimental results show that deleting appropriate low-quality samples is beneficial for model learning. However, as the deletion proportion increases, the model performance actually deteriorates. In actual application, we recommend setting k to 0.1 by default. If the result is not satisfactory, adjustments can be made.
Figure 4. The changes in the indicator when k takes different values.

4.5. Computational Complexity

The sample quality assessment algorithm is an important component of the method presented in this paper. Therefore, this experimental analysis discusses its time complexity and execution time. As shown in Table 10, the time complexity of VoG and Grand is O ( 1 ) , which is independent of the number of samples; SGD-influence has a linear complexity of O ( n ) ; G-Shapley has the highest time complexity of O ( 2 n ) because it needs to calculate marginal contribution. Figure 5 also presents the approximate time required for each algorithm to assess a single sample individually. The statistical results are consistent with the analysis. The efficiency of G-Shapley is much lower than that of the other algorithms. It should be noted that in this method, sample quality assessment is independent of downstream model training. Therefore, in practical applications, sample quality can be evaluated offline, which can, to some extent, reduce the time cost of estimating sample quality.
Table 10. Time complexity comparison of data quality methods.
Figure 5. Evaluation time.

4.6. Understanding Imputed Data Quality

Figure 6 presents two types of samples from Italy Air-Quality datasets. The point-missing pattern marks the positions of missing entries, with a missing rate of 50 % . Each figure shows the original sample, the missing sample, and the marked missing area and imputed values. The sample (indicated by the dotted line) in Figure 6a has a lower quality (as evaluated by SGD-influence), and Figure 6b shows the high-quality sample (dotted line). In Figure 6a, the trend of the original sample is very gentle, and after interpolation, it shows certain fluctuations, but the gap between the imputed data and the original data is relatively large; in Figure 6b, the sample shows a certain regular pattern of change, and the imputed error of the missing data is lower than that in Figure 6a. However, such observations are difficult to understand or explain the characteristics of low-quality samples. Therefore, this chapter will explore the influencing factors of sample quality from different perspectives.
Figure 6. Sample visualization.

4.6.1. Relationship Between Sample Quality and Missing Rate

In this experiment, we aim to investigate whether a potential correlation exists between the original missing data rate of a sample and its data quality after imputation. It is important to note that this analysis focuses on the imputed data (i.e., data “repaired” by a specific imputation algorithm), not the original sequences containing missing values. Scatter plots depicting this relationship, along with their corresponding Pearson’s correlation coefficients, are generated for the Italy Air-Quality and PhysioNet 2012 datasets (presented in Figure 7a and Figure 7b, respectively). In experiment, the missing pattern of Italy Air-Quality datasets is point missing with a missing ratio of 10 % and imputed by TimesNet.
Figure 7. Scatter plot of sample score.
The results indicate that there is no significant linear correlation between the data quality of an imputed sample and the original missing data rate. This lack of strong correlation can be attributed to the following key reasons: The data quality evaluation algorithms employed in this study evaluate sample quality based on training loss and gradient information. As a result, these algorithms are more sensitive to the difficulty of learning underlying temporal relationships within sequences than to the rate of missing data. This implies that relying solely on missing data rates is insufficient for assessing sample quality. To further clarify the factors influencing variations in sample quality, the following subsection will analyze sample characteristics from the perspective of complex network theory.

4.6.2. Relationship Between Sample Quality and Complex Network Features

The transformation of time series into a complex network for analysis is an emerging technique, pioneered by early work [46]. More recent studies by Qi et al. [47], Cheng et al. [48], and Yang et al. [49] have further explored this approach for tasks including quantifying the complexity of user electricity consumption sequences, time-series classification, and predicting “sleeping beauty” coefficients in scientific publications. Building upon the methodology proposed by Silva et al. [50], this study converts each time-series sample into three distinct graph structures: the Natural Visibility Graph (NVG) [46], the Horizontal Visibility Graph (HVG) [51], and the Quantile Graph (QG) [52]. For each graph, five network features are computed: average degree ( k ¯ ), average path length ( d ¯ ), number of communities (S), average clustering coefficient ( C ¯ ) and modularity (Q). This yields a total of 15 network-derived features per time-series sample.
These network features possess inherent physical or structural interpretations, enabling a correlation analysis between the sample quality and these 15 features. For example, When evaluating sample quality using the SGD-influence algorithm, the strongest correlation (Pearson’s r = 0.716 ) is observed between sample quality and the number of communities (S) detected in its corresponding NVG (as depicted in Figure 8). For SGD-influence, a higher quality score indicates lower sample quality. Figure 9 illustrates the fitted relationship between the number of communities (S) and sample quality for this specific case. It can be seen that the low-quality samples (indicated by the green dots) are located in the direction with higher scores, while the high-quality samples are in the direction with lower scores. This positive correlation implies that an increase in the number of communities (S) is associated with a decline in sample quality. This relationship can be interpreted as follows: frequent structural changes within a time series, manifesting as an increased number of communities in its graph, may reflect greater temporal complexity. This increased complexity, in turn, can hinder models’ ability to capture underlying dependencies, thereby reducing sample quality (i.e., resulting in a higher SGD-influence score).
Figure 8. Correlation between sample quality and complex features in NVG graph.
Figure 9. Scatter plot of SGD-influence on Italy Air-Quality.
Scatter plots illustrating the strongest correlations between evaluation metrics and network features are shown in Figure 10. In the experiment, the Italy Air-Quality and ETT datasets are set with a missing ratio of 10 % and imputed by TimesNet. The results reveal that quality scores generated by different evaluation algorithms indeed exhibit strong correlations with various complex network characteristics. For example, the VoG algorithm shows a strong inverse correlation between data quality and network modularity (Q) for samples from the Italy Air-Quality dataset (see the second plot in Figure 10a); the Grand algorithm demonstrates a strong inverse correlation between data quality and average degree ( k ¯ ) in the corresponding graph for samples from the PhysioNet 2012 dataset (see the first plot in Figure 10c). These experimental results demonstrate that factors influencing sample quality can be effectively investigated through complex network analysis, offering a novel perspective for understanding data characteristics relevant to model training.
Figure 10. Scatter plot between sample quality and complex network features.

5. Conclusions

In this paper, we propose a methodology that integrates existing imputation algorithms with a subsequent data quality evaluation step to identify and remove low-quality imputed samples, thereby enhancing the performance of imputation algorithms in downstream tasks. Our approach is motivated by the common occurrence of low-quality samples in original time-series datasets. Training imputation models on such data can lead to the generation of poorly imputed samples, which can subsequently impair model training for downstream applications. Through a series of comprehensive experiments, we demonstrate the effectiveness of this approach. For example, MAE can be reduced by up to 38.73 % on the Italy Air-Quality dataset, while the AUPRC score can be increased by up to 118.41 % on the PhysioNet 2019 dataset. In addition, we also demonstrate the close relationship between data quality and complex-network-derived features of the time series.
However, we only discussed the effectiveness of the method under MCAR scenarios and did not start the experiment under MAR and MNAR. This is a limitation of this study. Furthermore, the method proposed in this paper does not utilize data quality to optimize the design of the imputation model instead of directly deleting some low-quality samples. Therefore, in the future, we will attempt to design an imputation model based on data quality feedback to directly generate high-quality imputed time series and conduct experiments in challenging scenarios such as MAR and MNAR.

Author Contributions

Conceptualization, F.H. and S.L.; methodology, F.H.; software, F.H. and S.L.; validation, F.H., S.L. and J.P.; formal analysis, F.H. and S.L.; investigation, F.H. and C.M.; resources, F.H.; data curation, S.L. and C.M.; writing—original draft preparation, F.H.; writing—review and editing, S.L.; visualization, S.L.; supervision, J.P.; project administration, J.P.; funding acquisition, F.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 12401682), the Sichuan Science and Technology Program (Grant No. 2025ZNSFSC0874), the Fundamental Research Funds for the Central Universities (25CAFUC04071), and the Open Research Fund Program of Data Recovery Key Laboratory of Sichuan Province (Grant No. DRN2407).

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Dataset link is provided in this manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Fang, W.; Zhuo, W.; Yan, J.; Song, Y.; Jiang, D.; Zhou, T. Attention meets long short-term memory: A deep learning network for traffic flow forecasting. Phys. A Stat. Mech. Its Appl. 2022, 587, 126485. [Google Scholar] [CrossRef] [Scilit]
  2. Zhang, W.; Yang, L.; Geng, S.; Hong, S. Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer. IEEE Trans. Neural Netw. Learn. Syst. 2024, 35, 16129–16138. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Liang, Y.; Xia, Y.; Ke, S.; Wang, Y.; Wen, Q.; Zhang, J.; Zheng, Y.; Zimmermann, R. Airformer: Predicting nationwide air quality in china with transformers. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2023; Volume 37, pp. 14329–14337. [Google Scholar]
  4. Du, W.; Wang, J.; Qian, L.; Yang, Y.; Liu, F.; Wang, Z.; Ibrahim, Z.; Liu, H.; Zhao, Z.; Zhou, Y.; et al. TSI-Bench: Benchmarking Time Series Imputation. arXiv 2024, arXiv:2406.12747. [Google Scholar]
  5. Wang, J.; Du, W.; Cao, W.; Zhang, K.; Wang, W.; Liang, Y.; Wen, Q. Deep Learning for Multivariate Time Series Imputation: A Survey. arXiv 2024, arXiv:2402.04059. [Google Scholar]
  6. Miao, X.; Wu, Y.; Chen, L.; Gao, Y.; Yin, J. An Experimental Survey of Missing Data Imputation Algorithms. IEEE Trans. Knowl. Data Eng. 2023, 35, 6630–6650. [Google Scholar] [CrossRef] [Scilit]
  7. Huang, F.; Wang, J.; Yi, P.; Peng, J.; Xiong, X.; Liu, Y. SCSQ: A sample cooperation optimization method with sample quality for recurrent neural networks. Inf. Sci. 2024, 674, 120730. [Google Scholar] [CrossRef] [Scilit]
  8. RUBIN, D.B. Inference and missing data. Biometrika 1976, 63, 581–592. [Google Scholar] [CrossRef]
  9. García-Laencina, P.J.; Sancho-Gómez, J.L.; Figueiras-Vidal, A.R. Pattern classification with missing data: A review. Neural Comput. Appl. 2010, 19, 263–282. [Google Scholar]
  10. Batista, G.E.A.P.A.; Monard, M.C. An analysis of four missing data treatment methods for supervised learning. Appl. Artif. Intell. 2003, 17, 519–533. [Google Scholar] [CrossRef] [Scilit]
  11. Twala, B.; Cartwright, M.; Shepperd, M. Comparison of various methods for handling incomplete data in software engineering databases. In Proceedings of the International Symposium on Empirical Software Engineering; IEEE: Piscataway, NJ, USA, 2005; pp. 234–239. [Google Scholar]
  12. Jerez, J.M.; Molina, I.; García-Laencina, P.J.; Alba, E.; Ribelles, N.; Martín, M.; Franco, L. Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artif. Intell. Med. 2010, 50, 105–115. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Hastie, T.; Mazumder, R.; Lee, J.; Zadeh, R. Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares. J. Mach. Learn. Res. 2014, 16, 3367–3402. [Google Scholar]
  14. Mazumder, R.; Hastie, T.; Tibshirani, R. Spectral Regularization Algorithms for Learning Large Incomplete Matrices. J. Mach. Learn. Res. JMLR 2010, 11, 2287–2322. [Google Scholar] [PubMed]
  15. Antonenko, E.; Carreño, A.; Read, J. Autoreplicative random forests with applications to missing value imputation. Mach. Learn. 2024, 113, 7617–7643. [Google Scholar] [CrossRef] [Scilit]
  16. McCoy, J.T.; Kroon, S.; Auret, L. Variational Autoencoders for Missing Data Imputation with Application to a Simulated Milling Circuit. IFAC-PapersOnLine 2018, 51, 141–146. [Google Scholar] [CrossRef] [Scilit]
  17. Fortuin, V.; Baranchuk, D.; Rätsch, G.; Mandt, S. Gp-vae: Deep probabilistic time series imputation. In Proceedings of the International Conference on Artificial Intelligence and Statistics; PMLR: New York, NY, USA, 2020; pp. 1651–1661. [Google Scholar]
  18. Mulyadi, A.W.; Jun, E.; Suk, H.I. Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Series. IEEE Trans. Cybern. 2022, 52, 9684–9694. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  19. Luo, Y.; Cai, X.; Zhang, Y.; Xu, J.; Yuan, X. Multivariate time series imputation with generative adversarial networks. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18; Curran Associates, Inc.: Red Hook, NY, USA, 2018; pp. 1603–1614. [Google Scholar]
  20. Luo, Y.; Zhang, Y.; Cai, X.; Yuan, X. E2GAN: End-to-End Generative Adversarial Network for Multivariate Time Series Imputation. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19; International Joint Conferences on Artificial Intelligence Organization: Macao, China, 2019; pp. 3094–3100. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  21. Tashiro, Y.; Song, J.; Song, Y.; Ermon, S. Csdi: Conditional score-based diffusion models for probabilistic time series imputation. Adv. Neural Inf. Process. Syst. 2021, 34, 24804–24816. [Google Scholar]
  22. Alcaraz, J.L.; Strodthoff, N. Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models. arXiv 2022, arXiv:2208.09399. [Google Scholar]
  23. Chen, Y.; Deng, W.; Fang, S.; Li, F.; Yang, N.T.; Zhang, Y.; Rasul, K.; Zhe, S.; Schneider, A.; Nevmyvaka, Y. Provably convergent Schrödinger bridge with applications to probabilistic time series imputation. In Proceedings of the International Conference on Machine Learning; PMLR: New York, NY, USA, 2023; pp. 4485–4513. [Google Scholar]
  24. Wu, H.; Hu, T.; Liu, Y.; Zhou, H.; Wang, J.; Long, M. TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis. In Proceedings of the International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2023. [Google Scholar]
  25. Che, Z.; Purushotham, S.; Cho, K.; Sontag, D.; Liu, Y. Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 2018, 8, 6085. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Cao, W.; Wang, D.; Li, J.; Zhou, H.; Li, Y.; Li, L. BRITS: Bidirectional recurrent imputation for time series. In Proceedings of the 32nd International Conference on Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2018; pp. 6776–6786. [Google Scholar]
  27. Yoon, J.; Zame, W.R.; van der Schaar, M. Estimating missing data in temporal data streams using multi-directional recurrent neural networks. IEEE Trans. Biomed. Eng. 2018, 66, 1477–1490. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. Bai, S.; Kolter, J.Z.; Koltun, V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv 2018, arXiv:1803.01271. [Google Scholar]
  29. Wang, H.; Peng, J.; Huang, F.; Wang, J.; Chen, J.; Xiao, Y. Micn: Multi-scale local and global context modeling for long-term series forecasting. In Proceedings of the Eleventh International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2023. [Google Scholar]
  30. Cao, D.; Wang, Y.; Duan, J.; Zhang, C.; Zhu, X.; Huang, C.; Tong, Y.; Xu, B.; Bai, J.; Tong, J.; et al. Spectral temporal graph neural network for multivariate time-series forecasting. Adv. Neural Inf. Process. Syst. 2020, 33, 17766–17778. [Google Scholar]
  31. Cini, A.; Marisca, I.; Alippi, C. Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks. In Proceedings of the International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2022. [Google Scholar]
  32. Marisca, I.; Cini, A.; Alippi, C. Learning to reconstruct missing data from spatiotemporal graphs with sparse observations. Adv. Neural Inf. Process. Syst. 2022, 35, 32069–32082. [Google Scholar] [CrossRef] [Scilit]
  33. Zhou, H.; Zhang, S.; Peng, J.; Zhang, S.; Li, J.; Xiong, H.; Zhang, W. Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2021. [Google Scholar]
  34. Bansal, P.; Deshpande, P.; Sarawagi, S. Missing value imputation on multidimensional time series. Proc. VLDB Endow. 2021, 14, 2533–2545. [Google Scholar] [CrossRef] [Scilit]
  35. Du, W.; Côté, D.; Liu, Y. Saits: Self-attention-based imputation for time series. Expert Syst. Appl. 2023, 219, 119619. [Google Scholar]
  36. Ng, A. A Chat with Andrew on MLOps: From Model-Centric to Data-Centric AI. Available online: https://www.youtube.com/watch?v=06-AZXmwHjo (accessed on 1 July 2026).
  37. Zhou, Y.; Tu, F.; Sha, K.; Ding, J.; Chen, H. A Survey on Data Quality Dimensions and Tools for Machine Learning Invited Paper. In Proceedings of the 2024 IEEE International Conference on Artificial Intelligence Testing (AITest); IEEE: Piscataway, NJ, USA, 2024; pp. 120–131. [Google Scholar] [CrossRef] [Scilit]
  38. Koh, P.W.; Liang, P. Understanding Black-Box Predictions via Influence Functions. In Proceedings of the 34th International Conference on Machine Learning, ICML’17; PMLR: New York, NY, USA, 2017; Volume 70, pp. 1885–1894. [Google Scholar]
  39. Hara, S.; Nitanda, A.; Maehara, T. Data cleansing for models trained with SGD. In Proceedings of the 33rd International Conference on Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2019. [Google Scholar]
  40. Jia, R.; Wu, F.; Sun, X.; Xu, J.; Dao, D.; Kailkhura, B.; Zhang, C.; Li, B.; Song, D. Scalability vs. Utility: Do We Have to Sacrifice One for the Other in Data Importance Quantification? In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Piscataway, NJ, USA, 2021; pp. 8235–8243. [Google Scholar]
  41. Paul, M.; Ganguli, S.; Dziugaite, G.K. Deep learning on a data diet: Finding important examples early in training. Adv. Neural Inf. Process. Syst. 2021, 34, 20596–20607. [Google Scholar]
  42. Agarwal, C.; D’souza, D.; Hooker, S. Estimating example difficulty using variance of gradients. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2022; pp. 10368–10378. [Google Scholar]
  43. Ghorbani, A.; Zou, J. Data shapley: Equitable valuation of data for machine learning. In Proceedings of the International Conference on Machine Learning; PMLR: New York, NY, USA, 2019; pp. 2242–2251. [Google Scholar]
  44. Miao, X.; Wu, Y.; Wang, J.; Gao, Y.; Mao, X.; Yin, J. Generative Semi-supervised Learning for Multivariate Time Series Imputation. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2021; Volume 35, pp. 8983–8991. [Google Scholar] [CrossRef] [Scilit]
  45. Boyd, K.; Eng, K.H.; Page, C.D. Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals. In Proceedings of the Machine Learning and Knowledge Discovery in Databases; Blockeel, H., Kersting, K., Nijssen, S., Železný, F., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 451–466. [Google Scholar]
  46. Lacasa, L.; Luque, B.; Ballesteros, F.; Luque, J.; Nuño, J.C. From time series to complex networks: The visibility graph. Proc. Natl. Acad. Sci. USA 2008, 105, 4972–4975. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  47. Qi, M.; Mei, L.; Li, Z.; Yan, L.; Wang, Z.; Ju, P. Revealing the Complexity of Load Fluctuations for Electricity Consumers Using MLP-HVG. In Proceedings of the 2023 IEEE Power and Energy Society General Meeting (PESGM); IEEE: Piscataway, NJ, USA, 2023; pp. 1–5. [Google Scholar] [CrossRef] [Scilit]
  48. Cheng, L.; Zhu, P.; Sun, W.; Han, Z.; Tang, K.; Cui, X. Time series classification by Euclidean distance-based visibility graph. Phys. A Stat. Mech. Its Appl. 2023, 625, 129010. [Google Scholar] [CrossRef] [Scilit]
  49. Yang, N.; Huang, F.; Zhao, S.; Li, S.; Hu, W. Predicting Sleeping Beauty Coefficients Based on ts2net Model. Data Anal. Knowl. Discov. 2024, 8, 72–82. [Google Scholar] [CrossRef]
  50. Silva, V.F.; Silva, M.E.; Ribeiro, P.; Silva, F. Novel features for time series analysis: A complex networks approach. Data Min. Knowl. Discov. 2022, 36, 1062–1101. [Google Scholar] [CrossRef] [Scilit]
  51. Luque, B.; Lacasa, L.; Ballesteros, F.; Luque, J. Horizontal visibility graphs: Exact results for random time series. Phys. Rev. E—Stat. Nonlinear Soft Matter Phys. 2009, 80, 046103. [Google Scholar] [CrossRef] [Scilit]
  52. Campanharo, A.S.; Sirer, M.I.; Malmgren, R.D.; Ramos, F.M.; Amaral, L.A.N. Duality between time series and networks. PLoS ONE 2011, 6, e23378. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.