Next Article in Journal
Event-Driven Highlight Generation in Football Broadcasts: A Context-Aware Temporal Framework for Six-Class Action Spotting
Previous Article in Journal
Semantic Integration and Automation of Cultural Heritage Risk Data: A CIDOC-CRM Workflow for Decision Support at the Territorial Scale
Previous Article in Special Issue
Hydrodynamic-Knowledge Fusion Paradigms for Soft Sensing of Spatial Sediment Distribution in Horizontal-Flow Sedimentation Tanks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimizing-Time Series Imputation with Data Quality

1
Faculty of Science, Civil Aviation Flight University of China, Guanghan 618307, China
2
National Science Library (Chengdu), Chinese Academy of Sciences, Chengdu 610299, China
3
College of Computer Science, Sichuan University, Chengdu 610065, China
4
Data Recovery Key Laboratory of Sichuan Province, Neijiang 641100, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(14), 6837; https://doi.org/10.3390/app16146837
Submission received: 24 February 2026 / Revised: 29 June 2026 / Accepted: 3 July 2026 / Published: 8 July 2026
(This article belongs to the Special Issue Applications of Data Science and Artificial Intelligence, 2nd Edition)

Abstract

Missing values in time series are not uncommon due to system failures or external interference during data collection. A multitude of imputation algorithms have been proposed to infer these missing values. However, existing methods often overlook the difference in sample data quality within the dataset. Specifically, training imputation algorithms on low-quality samples can lead to the generation of poor-quality data, which adversely affects the performance of downstream models. To address this issue, we propose integrating a data quality evaluation with the imputation process. The workflow involves imputing missing values using an imputation algorithm, evaluating the data quality of each sample, and then removing low-quality samples. Our experimental results demonstrate the effectiveness of this approach on improving the performance of downstream model across four datasets, seven input algorithms, four quality assessment methods, and two types of machine learning tasks. Additionally, we convert time series data into complex networks and find that network features can effectively explain the data quality of individual samples.

1. Introduction

Time-series data are sequential records ordered chronologically to capture changes within a system. Common examples include traffic flow measurements [1], electrocardiogram (ECG) recordings [2] and air-quality-monitoring data [3]. In practical applications, various factors, such as sensor malfunctions and electromagnetic interference, can lead to missing data in time series [4,5]. This phenomenon presents significant challenges for machine learning models aiming to detect patterns within these sequences, consequently impacting the accuracy of downstream forecasting and classification tasks. As a result, time-series imputation has become a hot topic in time-series data mining [6].
Although existing imputation methods achieve satisfactory performance by exploiting mathematical properties, similarity features, and temporal dependencies within the data, they tend to neglect the intrinsic quality of individual samples. Empirical studies have shown that variations in sample quality exist across datasets, and that low-quality samples may negatively impact model training. For example, Huang et al. [7] investigated that the performance of time-series forecasting models can also be improved by reducing the influence of low-quality samples. It should be noted that the aforementioned discussions are based on data without missing values. Consequently, it is reasonable to expect that differences in data quality may also persist among time-series samples after missing values have been imputed. This is due to the fact that existing imputation methods cannot ensure the exact recovery of true values and may inadvertently alter the original contextual associations or temporal structures within the data during the reconstruction process, as illustrated in Figure 1. Therefore, we propose integrating the concept of data quality into time-series imputation algorithms and center our investigation around the following questions: (1) Do differences in data quality persist in time-series data after imputation? This forms the foundational premise of our work. (2) If such differences exist, can existing imputation methods be optimized? This constitutes the core objective of our research. (3) Can we further identify quantifiable features that distinguish low-quality from high-quality samples within the imputed data? Addressing this key focus may provide actionable insights for future improvements in imputation algorithms.
In this paper, we first demonstrate that substantial variations in quality exist among imputed samples. Importantly, this observation does not undermine the validity of existing imputation models; rather, it highlights opportunities to further enhance their performance. Building on this insight, we propose a novel quality-aware imputation framework that integrates data imputation with quality assessment. The proposed approach comprises three key steps: (1) imputation phase: apply existing imputation algorithms to generate a complete datasets without missing values; (2) evaluation phase: calculate the quality score of each sample; and (3) filtering phase: filter out low-quality samples to produce a refined, high-quality imputed datasets. Unlike the imputation algorithm, the optimization in this paper is focused on the quality of the imputed datasets, that is, retaining high-quality samples and deleting low-quality ones, rather than optimizing the missing values of the samples. Finally, we explore the relationship between complex network features and sample quality. In summary, the main contributions of this paper are as follows:
  • We propose a novel method by integrating data quality evaluation algorithms and time-series imputation methods, thereby optimizing the quality of the imputed datasets.
  • We comprehensively evaluate the effectiveness of our method for downstream model through extensive experiments conducted across four datasets, seven imputation algorithms, four quality assessment techniques, and two types of machine learning tasks. Specifically, the experimental results show that the prediction mean absolute error (MAE) can be reduced by up to 38.73 % on the Italy Air-Quality dataset; the Area Under the Precision–Recall Curve (AUPRC) score can be increased by up to 118.41 % on the PhysioNet 2019 dataset.
  • We reveal a significant relationship between time-series data quality and complex network features, providing interpretable insights into the characteristics of low-quality samples through network-based analysis.

2. Related Work

2.1. Time-Series Imputation

2.1.1. Missing Data Mechanism

Time-series imputation refers to the process of estimating missing values in sequential data. Following Rubin’s theory [8], missing data patterns are categorized into three types: Missing Completely at Random (MCAR), where the occurrence of missing values is independent of both observed and unobserved data; Missing at Random (MAR), where missingness depends solely on observed data; and Missing Not at Random (MNAR), where missingness is influenced by both the missing and observed values. Each missing data mechanism requires distinct imputation strategies. Most existing research primarily focuses on MCAR scenarios, as fewer studies address the more complex MAR and MNAR cases. In this work, we also focus on imputation methods tailored for MCAR conditions.

2.1.2. Time-Series Imputation Methods

We begin with a concise overview of traditional approaches that employ statistical methods and machine learning algorithms, followed by an in-depth discussion of deep-learning-based techniques for time-series imputation.

Traditional Methods

These methods represent early research efforts in handling missing data. The simplest approaches involve using statistical measures such as the mean or mode for value replacement [6,9]. Regression prediction is also a commonly used method, which estimates missing values by establishing relationships between observed variables through regression equations. Another category of traditional methods relies on similarity measures, where missing values are inferred based on the similarity between data points. Common similarity metrics include Euclidean distance and cosine similarity. Representative methods in this category include: K-nearest Neighbor (KNN), which replaces missing values with the mean of the k most similar samples [10]; Hot Deck Imputation (HDI) [11], which adopts the value from the most similar sample for imputation; and Cold Deck Imputation (CDI) [12], which substitutes missing values with corresponding values from a similar sample in an external dataset. In addition, various machine learning algorithms have been adapted for imputation tasks, including Matrix Factorization [13], Expectation–Maximization [14], and Random Forest [15]. However, these methods do not adequately capture critical temporal characteristics in time-series data, such as periodicity and trend patterns, which limits their effectiveness in time-series imputation tasks.

Deep-Learning-Based Methods

Compared to traditional techniques, deep learning methods are better capable of capturing complex temporal dependencies in sequential data, thereby enabling more advanced imputation tasks such as segment-level and block-level missing patterns. In the following sections, we primarily review existing works from two distinct perspectives: generation-based and prediction-based approaches for time-series imputation.
Generation-based imputation utilizes deep generative networks to learn the underlying probability distribution from observed data and subsequently generates plausible values that align with this distribution for use as imputed results. This approach mainly relies on three categories of deep generative models: Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and Diffusion Models. (1) VAE-based methods impute missing values by generating plausible reconstructions through the decoder, based on latent distribution parameters learned by the encoder. For example, ref. [16] directly employed a VAE for missing value imputation. The GP-VAE [17] integrates Gaussian processes into the latent space of the VAE in order to better model temporal dependencies. In [18], the authors combined the VAE with a recurrent neural network and introduced an uncertainty attenuation factor to filter out generated samples with high variance. (2) GAN-based methods, originally developed for image generation, have been increasingly adapted for time-series imputation. For instance, GRU-GAN [19] performs imputation within a GAN framework, where both the generator and discriminator utilize RNNs equipped with attenuation factors to more effectively manage missing intervals. The End-to-End Generative Adversarial Network (E2GAN) [20] builds upon GRU-GAN by integrating a denoising module, which optimizes the inputs of generator. (3) Diffusion model-based methods are another popular architecture that have demonstrated promising performance in time-series imputation. The Conditional Score-based Diffusion model for Imputation (CSDI) [21] is a representative model in this category. It uses subsets of observed data as conditional information to guide the generation of missing segments. However, despite its effectiveness, the large parameter size of CSDI hinders its scalability when applied to complex multivariate time series. To address this limitation, researchers have proposed several improved variants, such as Structured State Space Diffusion (SSSD) [22] and Conditional Schrödinger Bridge methods for probabilistic time-series imputation (CSBI) [23].
Prediction-based imputation approaches leverage time-series forecasting models to estimate missing values. In 2023, TimesNet [24] integrated the tasks of prediction, classification, and imputation within a single model and achieved state-of-the-art performance. Inspired by TimesNet, the time-series prediction model can also be used for imputation. The process utilizes historical observations and missing patterns as input features for the model, while the predicted outputs are used to construct reconstructed sequences, in which the values at previously missing positions correspond to the imputed results. We review these methods based on their underlying neural architectures: (1) RNN-based methods: GRU-D [25] is a representative model in this field. It incorporates information about missing intervals as input features and introduces a decay mechanism into recurrent neural networks, enabling the model to effectively capture both temporal patterns and characteristics of missing data. Building upon GRU-D, researchers have proposed several improved approaches, such as Bidirectional Recurrent Imputation for Time Series (BRITS) [26] and Multi-directional Recurrent Neural Networks (M-RNNs) [27]. (2) CNN-based methods primarily employ convolutional neural network architectures specifically designed for time-series forecasting tasks. For example, Temporal Convolutional Networks (TCNs) [28], which is a class of classical convolutional networks, are widely used in time-series data mining. In addition, Multi-scale Isometric Convolution Network (MICN) [29] and TimesNet are also representative prediction models based on convolution, capable of performing the time-series imputation task. (3) GNN-based methods have demonstrated remarkable capability in capturing variable dependencies within multivariate time series. For time-series imputation, representative approaches include Spectral Temporal Graph Neural Network (StemGNN) [30] and Graph Recurrent Imputation Network (GRIN) [31], which integrate graph learning with the imputation process, as well as the Spatiotemporal Point Inference Network (SPIN) [32], which incorporates spectral graph convolution techniques to enhance modeling accuracy. (4) Transformer-based method: Following Informer’s breakthrough in time-series prediction [33], transformer architectures have become dominant in recent imputation research. Representative works include the Deep learning method for Missing Value Imputation (DeepMVI) [34], and Self-attention-based Imputation for Time Series (SAITS) [35]. DeepMVI integrates convolutional and transformer modules to achieve effective missing value imputation, while SAITS enhances the attention mechanism through diagonal masking to more accurately address missing patterns.
In summary, the exceptional nonlinear fitting capability of neural networks has given rise to a variety of deep-learning-based methods for time-series imputation, which have exhibited superior performance across multiple domains. However, this paper shows that their effectiveness can be further improved by incorporating a data quality evaluation module. In real-world scenarios, the collection of time-series data is frequently affected by electromagnetic interference, equipment malfunctions, and other factors that introduce noise. When such noisy observational data are used to train imputation models, the resulting estimates of missing values may be inaccurate, which can hinder the model’s ability to learn true temporal dependencies. To address this challenge, we propose augmenting imputation methods with a data quality evaluation module to filter low-quality samples in training data. The following section reviews relevant work in data quality evaluation.

2.2. Data Quality Evaluation

Data quality originally emerged in the fields of data management and data cleaning. In 2021, Andrew Ng [36] introduced the concept of “data-centric AI”, which highlights the critical role of data in AI systems. Zhou et al. [37] defined sample quality as the extent to which data meets specific requirements. So far, existing works have primarily addressed the “what if” question examining how the model behaves when it is not trained on or numerically influenced by a particular sample.
From the perspective of how data impact model performance, this paper reviews the following representative studies on data quality evaluation: (1) Influence function-based approach: In 2017, Koh et al. [38] proposed the influence function method, which estimates the change in model performance on the validation set when a particular training sample is upweighted or removed, using gradient information. This change was used as an indicator of the quality of this sample. Subsequently, Hara et al. [39] introduced an improved SGD-influence method that extends the influence function to non-convex objectives, such as deep neural networks, thereby broadening its applicability. (2) Shapley value-based method: The Shapley value was proposed by L. S. Shapley in 1953. It defines a member’s profit in cooperation as the average of the marginal contributions that he generates for all coalitions he participates in. Jia et al. [40] used it for data quality assessment, in which the k-nearest neighbor classifier was used as a surrogate model to calculate sample Shapley values. (3) Loss gradient-based methods, which directly quantify sample data quality based on the loss gradient of each sample, exhibit lower computational complexity compared to influence function and Shapley value-based approaches. Pual et al. [41] proposed a direct method named gradient normalization (Grand) to identify important samples by using the norm of the loss gradient computed for individual samples. Agarwal et al. [42] demonstrated that simpler samples tend to exhibit lower variance. Accordingly, they introduced a metric called gradient variance (VoG) to evaluate data quality.

3. Methodology

3.1. Data Insight

Figure 2 illustrates the distribution of sample quality scores generated by various evaluation algorithms. Specifically, the first row of images in Figure 1 presents the statistical results of the quality scores of the datasets imputed by SAITS for the Italy Air-Quality datasets. The second row presents the statistical information on the PhysioNet 2012 datasets. For more information on the datasets, please refer to Section 4.1. From the experimental results, most distributions exhibit a distinct long-tail pattern, with the exception of the G-Shapley assessment results for the prediction task, which closely resemble a bell-shaped (Gaussian-like) distribution. These observations confirm the presence of quality differences among samples following the imputation process. This evidence strongly supports the central premise of this study: that data quality evaluation can be effectively utilized to enhance time-series imputation algorithms. Code is available at gitee (https://gitee.com/jimapp330/Imputation-withDataQuality.git (accessed on 1 July 2026)).

3.2. Our Method

This paper proposes a novel approach to improving data imputation performance by optimizing data quality. Unlike traditional methods that focus on enhancing model architecture, we introduce an innovative framework that integrates imputation algorithms with a data quality evaluation module. Specifically, we present an “impute-evaluate-filter” strategy (as illustrated in Figure 3), which first performs data imputation and then filters the imputed samples based on quality metrics, thereby producing a high-quality imputed datasets. The proposed methodology consists of three core steps, which are described below.

3.2.1. Imputation

First, we need to train an imputation model. In this paper, the imputation model can be selected from the-state-of-the-art deep-learning-based imputation models. In existing works, the training strategy is to first construct the time series without missing values into a dataset of missing values according to a certain missing ratio and missing pattern. Then, model learning is guided through reconstruction. The training process can be expressed as follows:
M t r a i n = T r a i n ( M 0 , D t r a i n ) ,
where M 0 is an imputation model with randomly initialized parameters, including but not limited to GPVAE, SSGAN, CSDI, GRU-D, TimesNet, StemGNN, and SAITS. M t r a i n corresponds to the trained model. D t r a i n is the train set.
Then, we use the trained model M t r a i n to perform imputation on missing values within the original datasets D o r i g i n a l :
D i m p u t a t i o n = I m p u t a t i o n ( M t r a i n , D o r i g i n a l ) ,
where D i m p u t a t i o n is the original datasets after imputation. Equations (1) and (2) capture the core computational flow of conventional imputation methods, which generate completed datasets for downstream applications. As mentioned before, we think current imputation may damage the contextual relationships or temporal structures within the original data during the recovery process. Therefore, we introduce additional sample evaluation and filtering steps to deal with this issues.

3.2.2. Evaluation

Data quality assessment algorithms aim to quantify the extent to which individual samples contribute positively or negatively to model learning. Within the framework of this paper, our objective is to first use the data quality evaluation algorithm to evaluate the imputed datasets D i m p u t a t i o n , enabling subsequent filtering of low-quality instances. The process is given as follows:
Q = E v a l u a t i o n ( D i m p u t a t i o n , A q u a l i t y ) .
The quality evaluation algorithm A q u a l i t y could select but not is limited to Grand, VoG, SGD-influence and G-Shapley. The fundamental operating principles of these selected algorithms are briefly outlined below:
(1)
Grand is defined as the expected value of the norm of the sample gradient [41]. Formally:
G r a n d t ( x , y ) = E w t g t ( x , y ) 2 ,
where the sample gradient at t-th training step, g t ( x , y ) = w t L ( p ( w t , x ) , y ) and t = 1 , , T . w t is a vector representing the parameters of model at t-th training step. Loss function L ( · ) is defined as the prediction loss or classification loss. p ( w t , x ) is the output of model. y is the true value or label.
(2)
VoG is defined as the variance in Gradient [42]. More specifically, a sample’s quality is evaluated based on its variance in the gradient values. The samples that are challenging for the model to learn tend to exhibit larger gradient variance throughout training. S t can be defined as the gradient of the model parameters at t-th training step, and μ the average gradient over k training epochs; VoG can be calculated as follows:
V o G t = 1 k t = 1 k S t μ 2 .
In Equation (5), V o G t is a vector; we convert it to a scalar and get the VoG score.
V o G ( x , y ) = 1 V o G t v V o G t v .
(3)
SGD-influence: Given a sample z j at step t, SGD-influence refers to the parameter difference θ j [ t ] θ [ t ]  [39]. If the sample z j is used at step π ( j ) , after T steps, SGD-influence can be estimated as follows:
θ j [ T ] θ [ T ] η π ( j ) | S π ( j ) | Z T 1 Z T 2 Z π ( j ) + 1 g ( z j ; θ [ π ( j ) ] ) ,
where Z t = I η t H [ t ] . H [ t ] is the Hessian matrix. I is the identity matrix. S π ( j ) denotes the set of sample indices used in the π ( j ) -th step, and η π ( j ) > 0 is the learning rate. The gradient of the loss function g ( z i ; θ [ t ] ) = θ L ( z i ; θ [ t ] ) . Direct calculation of the Hessian matrix H [ t ] is computationally expensive. Therefore, its approximate value can be obtained by calculating H [ t ] u [ t ] :
H [ t ] u [ t ] = 1 | S t | i S t θ u [ t ] , g ( z i ; θ [ t ] ) ,
where u [ t ] is the derivative of the model f for an x sample in the validated set.
(4)
G-Shapley. Data Shapley is proposed according to the Shapley value defined in game theory. G-Shapley is an approximation of Data Shapley based on the stochastic gradient descent algorithm [43]. Given the training datset D, Data Shapley refers to the sum of performance changing over all subsets of D not containing sample i. Its expression is given as follows:
ϕ i = C S D { i } V ( S { i } ) V ( S ) n 1 S ,
where C is an arbitrary constant. V(S) is the performance score of a model trained on data S. In common, we use the test dataset to obtain V(S). As shown in Equation (9), computing Data Shapley requires computing all the possible marginal contributions which is exponentially large in the train data size. In addition, for each S D , computing V(S) involves learning a model on S. As a consequence, calculating the exact Shapley value is not tractable for real scenario. Gradient Shapley (G-Shapley) is a simple approximation for Data Shapley by training the model with only one pass through the training data. Assume the length of the training dataset is n, π t is a random permutation of training data at t-th test time, and θ 0 t denotes the random initialization parameters. For each sample j { 1 , , n } in the training dataset, we implement the process as follows:
θ j t = θ j 1 t α θ L ( π t [ j ] ; θ j 1 ) v j t = V ( θ j t ) ϕ π t [ j ] = t 1 t ϕ π t 1 [ j ] + 1 t ( v j t v j t 1 ) ,
where α represents the learning rate, v j t is the performance score of sample j at t-th test time, and v j t v j 1 t is the marginal contribution is the change in model’s performance.

3.2.3. Filtering

According to the quality score, we filter out poor-quality samples:
D f i l t e r = F i l t e r ( D i m p u t a t i o n , Q ) .
Specifically, we sort the samples in ascending order based on their quality score and delete the top-k lowest-quality samples, thereby obtaining the optimized imputed datasets  D f i l t e r .
Upon obtaining the filtered D f i l t e r , we use it to retrain a new model. Our experiments demonstrate that the optimized datasets significantly improve model performance in both prediction and classification tasks (see Section 4). Notably, our filtering strategy is exclusively applied to the training set, while the validation and test sets remain unmodified to ensure unbiased evaluation. The complete procedure is formalized in Algorithm 1.
Algorithm 1 Optimizing Time-Series Imputation with Data Quality
 Require: 
Train set D t r a i n , the imputation algorithm M
 Ensure: 
The optimized imputed datasets D f i l t e r
   1:
Train the imputation algorithm based on train set (see Equation (1))
   2:
Obtain imputed datasets D i m p u t a t i o n using imputation algorithm (see Equation (2))
   3:
Calculate sample quality score Q (see Equation (3))
   4:
Sort the samples in ascending order according to their quality score
   5:
Delete the top-k samples to obtain the optimized imputed datasets D f i l t e r (see Equation (11))
   6:
Return D f i l t e r

4. Experiments

4.1. Experimental Setup

Target: This section presents the experimental validation of the proposed framework, focusing on two key research questions: (1) Effectiveness validation: How effective is the proposed quality-aware imputation optimization method in enhancing performance on downstream tasks? (2) Relationship exploration: Are there characteristics that distinguish low-quality from high-quality samples in the imputed data?
Approach: For the first question, we compare the performance of downstream models trained on two types of imputed data: (1) the original training data repaired using imputation algorithms, and (2) the imputed data further refined through our quality-aware optimization procedure. Model performance is assessed on unmodified validation and test sets. In experiments, we employ seven distinct baseline imputation algorithms: three generation-based methods (GPVAE [17], SSGAN [44], CSDI [21]) and four prediction-based algorithms (GRUD [25], TimesNet [24], StemGNN [30] and SAITS [35]). For the data quality evaluation phase, we select four representative algorithms: Grand, VoG, SGD-influence, and G-Shapley. For the second question, the relationship between the sample quality and time-series features derived from complex networks is assessed.
Datasets: We conducted experiments on four datasets: Italy Air-Quality (https://archive.ics.uci.edu/dataset/360/air+quality (accessed on 1 July 2026)), ETT (https://github.com/zhouhaoyi/ETDataset (accessed on 1 July 2026)), PhysioNet 2012 (https://www.physionet.org/content/challenge-2012/1.0.0/ (accessed on 1 July 2026)), and PhysioNet 2019 (https://physionet.org/content/challenge-2019/1.0.0/ (accessed on 1 July 2026)). An overview of the datasets’ information is presented in Table 1. The Italy Air-Quality and ETT datasets are used for the prediction task. Since there are no missing values in these two datasets, in the experiment, we adopted three missing patterns (subsequence missing (abbreviated as s), point missing (abbreviated as p), and block missing (abbreviated as b)) along with different missing proportions to process the data. The PhysioNet 2012 and PhysioNet 2019 datasets are used for the classification task. Due to their naturally high missing data rates (approximately 80 % ), we do not introduce any additional missing values. For the prediction task, we utilize two widely adopted evaluation metrics: the Mean Absolute Error (MAE) and Mean Squared Error (MSE). For the classification task, we use accuracy, the F1 score and the Area Under the Precision–Recall Curve (AUPRC) [45] to evaluate model performance. As described in Algorithm 1, the data quality evaluation algorithm only involves D t r a i n , outputs D f i l t e r , and the downstream model training is conducted on the D f i l t e r , while downstream model testing uses the test datasets.

4.2. Performance on Prediction Task

A standard LSTM architecture is employed for the prediction task. Table 2, Table 3, Table 4 and Table 5 present the comparative prediction performance results. In the two tables, the “LSTM” row displays the prediction performance of LSTM on the imputed datasets (underline). Subsequent rows (“Grand,” “VoG,” “SGD-influence,” and “G-shapely”) show the prediction performance of LSTM retrained on the imputed datasets optimized by these quality evaluation algorithms. If the performance improves, the results are highlighted in bold.
By calculating the proportion of bolded table cells, it can be determined that the bolded cells in the Italy Air-Quality dataset (Table 2 and Table 3) account for 72.7 % , and in the ETT dataset (Table 4 and Table 5), the bolded cells account for 82.1 % . The results indicate that the proposed method substantially improves the predictive performance of LSTM models on the two datasets, regardless of the patterns of missing data. Notably, among the data quality evaluation algorithms, VoG, SGD-influence, and G-Shapley achieve significantly greater performance enhancements than Grand. Specifically, the combination of SGD-influence and TimesNet resulted in a 38.73 % reduction in MAE under the p ( 50 % ) missing pattern in Italy Air-Quality datasets. Due to the inherent instability of GAN, although SSGAN incorporates semi-supervised learning to enhance generalization performance, it still performs worse than CSDI and SAITS. CSDI is a state-of-the-art model in recent years, being more stable than traditional GAN and capable of generating higher-quality imputed values. SAITS is based on the self-attention mechanism and is adept at capturing long-range dependencies in time series. Additionally, from the perspective of missing patterns, all four evaluation algorithms exhibit significantly greater improvements in point-missing scenarios than in block-missing scenarios. Overall, these results confirm the proposed method’s effectiveness for prediction tasks.

4.3. Performance on Classification Task

In the classification experiments, we utilize the PhysioNet 2012 and PhysioNet 2019 datasets. The baseline model is the LSTM with attention module (LSTM-ATT). The experimental results are presented in Table 6, Table 7, Table 8 and Table 9. If the performance improves, the results are highlighted in bold. Baseline LSTM-ATT is underlined. It can be determined that the bolded cells in both of these two datasets account for 92.8 % . The results reveal that the LSTM-ATT model shows consistent performance improvement when processing imputed data optimized by the four quality assessment algorithms. Notably, the proposed method achieves stronger performance improvements in classification tasks compared to prediction tasks. Interestingly, unlike its performance in prediction tasks, the Grand algorithm achieves significant improvement in classification tasks. Especially when combined with the CSDI model on the PhysioNet 2019 datasets, the AUPRC of the LSTM-ATT model has increased by 118.41 % . SGD-influence and G-Shapley believe that what has a positive impact on model performance is important. VoG also strives to identify the “difficult” samples that the model finds hard to learn in order to enhance its generalization ability. It can be seen that all these three algorithms emphasize the effect of samples on the model. Grand evaluates samples by assessing the gradient norm of the initial model parameters. It performs well in classification tasks because the discrete nature of classification tasks enables the gradient norm to effectively distinguish the difficulty of samples. However, in prediction (regression) tasks, the judgment power of gradient norm in a continuous space fails, making Grand unable to provide effective guidance for sample selection.

4.4. The Impact of Hyperparameter k

Figure 4a and Figure 4b, respectively, shows the changes in MSE, MAE, Accuracy, F1 score, and AUPRC when k takes different values. Specifically, each indicator represents the average value of that indicator for each imputation model when the k value is the same. It can be seen that when k = 0.1 , the overall effect is the best. Since k represents the proportion of samples to be deleted, the experimental results show that deleting appropriate low-quality samples is beneficial for model learning. However, as the deletion proportion increases, the model performance actually deteriorates. In actual application, we recommend setting k to 0.1 by default. If the result is not satisfactory, adjustments can be made.

4.5. Computational Complexity

The sample quality assessment algorithm is an important component of the method presented in this paper. Therefore, this experimental analysis discusses its time complexity and execution time. As shown in Table 10, the time complexity of VoG and Grand is O ( 1 ) , which is independent of the number of samples; SGD-influence has a linear complexity of O ( n ) ; G-Shapley has the highest time complexity of O ( 2 n ) because it needs to calculate marginal contribution. Figure 5 also presents the approximate time required for each algorithm to assess a single sample individually. The statistical results are consistent with the analysis. The efficiency of G-Shapley is much lower than that of the other algorithms. It should be noted that in this method, sample quality assessment is independent of downstream model training. Therefore, in practical applications, sample quality can be evaluated offline, which can, to some extent, reduce the time cost of estimating sample quality.

4.6. Understanding Imputed Data Quality

Figure 6 presents two types of samples from Italy Air-Quality datasets. The point-missing pattern marks the positions of missing entries, with a missing rate of 50 % . Each figure shows the original sample, the missing sample, and the marked missing area and imputed values. The sample (indicated by the dotted line) in Figure 6a has a lower quality (as evaluated by SGD-influence), and Figure 6b shows the high-quality sample (dotted line). In Figure 6a, the trend of the original sample is very gentle, and after interpolation, it shows certain fluctuations, but the gap between the imputed data and the original data is relatively large; in Figure 6b, the sample shows a certain regular pattern of change, and the imputed error of the missing data is lower than that in Figure 6a. However, such observations are difficult to understand or explain the characteristics of low-quality samples. Therefore, this chapter will explore the influencing factors of sample quality from different perspectives.

4.6.1. Relationship Between Sample Quality and Missing Rate

In this experiment, we aim to investigate whether a potential correlation exists between the original missing data rate of a sample and its data quality after imputation. It is important to note that this analysis focuses on the imputed data (i.e., data “repaired” by a specific imputation algorithm), not the original sequences containing missing values. Scatter plots depicting this relationship, along with their corresponding Pearson’s correlation coefficients, are generated for the Italy Air-Quality and PhysioNet 2012 datasets (presented in Figure 7a and Figure 7b, respectively). In experiment, the missing pattern of Italy Air-Quality datasets is point missing with a missing ratio of 10 % and imputed by TimesNet.
The results indicate that there is no significant linear correlation between the data quality of an imputed sample and the original missing data rate. This lack of strong correlation can be attributed to the following key reasons: The data quality evaluation algorithms employed in this study evaluate sample quality based on training loss and gradient information. As a result, these algorithms are more sensitive to the difficulty of learning underlying temporal relationships within sequences than to the rate of missing data. This implies that relying solely on missing data rates is insufficient for assessing sample quality. To further clarify the factors influencing variations in sample quality, the following subsection will analyze sample characteristics from the perspective of complex network theory.

4.6.2. Relationship Between Sample Quality and Complex Network Features

The transformation of time series into a complex network for analysis is an emerging technique, pioneered by early work [46]. More recent studies by Qi et al. [47], Cheng et al. [48], and Yang et al. [49] have further explored this approach for tasks including quantifying the complexity of user electricity consumption sequences, time-series classification, and predicting “sleeping beauty” coefficients in scientific publications. Building upon the methodology proposed by Silva et al. [50], this study converts each time-series sample into three distinct graph structures: the Natural Visibility Graph (NVG) [46], the Horizontal Visibility Graph (HVG) [51], and the Quantile Graph (QG) [52]. For each graph, five network features are computed: average degree ( k ¯ ), average path length ( d ¯ ), number of communities (S), average clustering coefficient ( C ¯ ) and modularity (Q). This yields a total of 15 network-derived features per time-series sample.
These network features possess inherent physical or structural interpretations, enabling a correlation analysis between the sample quality and these 15 features. For example, When evaluating sample quality using the SGD-influence algorithm, the strongest correlation (Pearson’s r = 0.716 ) is observed between sample quality and the number of communities (S) detected in its corresponding NVG (as depicted in Figure 8). For SGD-influence, a higher quality score indicates lower sample quality. Figure 9 illustrates the fitted relationship between the number of communities (S) and sample quality for this specific case. It can be seen that the low-quality samples (indicated by the green dots) are located in the direction with higher scores, while the high-quality samples are in the direction with lower scores. This positive correlation implies that an increase in the number of communities (S) is associated with a decline in sample quality. This relationship can be interpreted as follows: frequent structural changes within a time series, manifesting as an increased number of communities in its graph, may reflect greater temporal complexity. This increased complexity, in turn, can hinder models’ ability to capture underlying dependencies, thereby reducing sample quality (i.e., resulting in a higher SGD-influence score).
Scatter plots illustrating the strongest correlations between evaluation metrics and network features are shown in Figure 10. In the experiment, the Italy Air-Quality and ETT datasets are set with a missing ratio of 10 % and imputed by TimesNet. The results reveal that quality scores generated by different evaluation algorithms indeed exhibit strong correlations with various complex network characteristics. For example, the VoG algorithm shows a strong inverse correlation between data quality and network modularity (Q) for samples from the Italy Air-Quality dataset (see the second plot in Figure 10a); the Grand algorithm demonstrates a strong inverse correlation between data quality and average degree ( k ¯ ) in the corresponding graph for samples from the PhysioNet 2012 dataset (see the first plot in Figure 10c). These experimental results demonstrate that factors influencing sample quality can be effectively investigated through complex network analysis, offering a novel perspective for understanding data characteristics relevant to model training.

5. Conclusions

In this paper, we propose a methodology that integrates existing imputation algorithms with a subsequent data quality evaluation step to identify and remove low-quality imputed samples, thereby enhancing the performance of imputation algorithms in downstream tasks. Our approach is motivated by the common occurrence of low-quality samples in original time-series datasets. Training imputation models on such data can lead to the generation of poorly imputed samples, which can subsequently impair model training for downstream applications. Through a series of comprehensive experiments, we demonstrate the effectiveness of this approach. For example, MAE can be reduced by up to 38.73 % on the Italy Air-Quality dataset, while the AUPRC score can be increased by up to 118.41 % on the PhysioNet 2019 dataset. In addition, we also demonstrate the close relationship between data quality and complex-network-derived features of the time series.
However, we only discussed the effectiveness of the method under MCAR scenarios and did not start the experiment under MAR and MNAR. This is a limitation of this study. Furthermore, the method proposed in this paper does not utilize data quality to optimize the design of the imputation model instead of directly deleting some low-quality samples. Therefore, in the future, we will attempt to design an imputation model based on data quality feedback to directly generate high-quality imputed time series and conduct experiments in challenging scenarios such as MAR and MNAR.

Author Contributions

Conceptualization, F.H. and S.L.; methodology, F.H.; software, F.H. and S.L.; validation, F.H., S.L. and J.P.; formal analysis, F.H. and S.L.; investigation, F.H. and C.M.; resources, F.H.; data curation, S.L. and C.M.; writing—original draft preparation, F.H.; writing—review and editing, S.L.; visualization, S.L.; supervision, J.P.; project administration, J.P.; funding acquisition, F.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 12401682), the Sichuan Science and Technology Program (Grant No. 2025ZNSFSC0874), the Fundamental Research Funds for the Central Universities (25CAFUC04071), and the Open Research Fund Program of Data Recovery Key Laboratory of Sichuan Province (Grant No. DRN2407).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Dataset link is provided in this manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Fang, W.; Zhuo, W.; Yan, J.; Song, Y.; Jiang, D.; Zhou, T. Attention meets long short-term memory: A deep learning network for traffic flow forecasting. Phys. A Stat. Mech. Its Appl. 2022, 587, 126485. [Google Scholar] [CrossRef]
  2. Zhang, W.; Yang, L.; Geng, S.; Hong, S. Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer. IEEE Trans. Neural Netw. Learn. Syst. 2024, 35, 16129–16138. [Google Scholar] [CrossRef] [PubMed]
  3. Liang, Y.; Xia, Y.; Ke, S.; Wang, Y.; Wen, Q.; Zhang, J.; Zheng, Y.; Zimmermann, R. Airformer: Predicting nationwide air quality in china with transformers. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2023; Volume 37, pp. 14329–14337. [Google Scholar]
  4. Du, W.; Wang, J.; Qian, L.; Yang, Y.; Liu, F.; Wang, Z.; Ibrahim, Z.; Liu, H.; Zhao, Z.; Zhou, Y.; et al. TSI-Bench: Benchmarking Time Series Imputation. arXiv 2024, arXiv:2406.12747. [Google Scholar]
  5. Wang, J.; Du, W.; Cao, W.; Zhang, K.; Wang, W.; Liang, Y.; Wen, Q. Deep Learning for Multivariate Time Series Imputation: A Survey. arXiv 2024, arXiv:2402.04059. [Google Scholar]
  6. Miao, X.; Wu, Y.; Chen, L.; Gao, Y.; Yin, J. An Experimental Survey of Missing Data Imputation Algorithms. IEEE Trans. Knowl. Data Eng. 2023, 35, 6630–6650. [Google Scholar] [CrossRef]
  7. Huang, F.; Wang, J.; Yi, P.; Peng, J.; Xiong, X.; Liu, Y. SCSQ: A sample cooperation optimization method with sample quality for recurrent neural networks. Inf. Sci. 2024, 674, 120730. [Google Scholar] [CrossRef]
  8. RUBIN, D.B. Inference and missing data. Biometrika 1976, 63, 581–592. [Google Scholar] [CrossRef]
  9. García-Laencina, P.J.; Sancho-Gómez, J.L.; Figueiras-Vidal, A.R. Pattern classification with missing data: A review. Neural Comput. Appl. 2010, 19, 263–282. [Google Scholar]
  10. Batista, G.E.A.P.A.; Monard, M.C. An analysis of four missing data treatment methods for supervised learning. Appl. Artif. Intell. 2003, 17, 519–533. [Google Scholar] [CrossRef]
  11. Twala, B.; Cartwright, M.; Shepperd, M. Comparison of various methods for handling incomplete data in software engineering databases. In Proceedings of the International Symposium on Empirical Software Engineering; IEEE: Piscataway, NJ, USA, 2005; pp. 234–239. [Google Scholar]
  12. Jerez, J.M.; Molina, I.; García-Laencina, P.J.; Alba, E.; Ribelles, N.; Martín, M.; Franco, L. Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artif. Intell. Med. 2010, 50, 105–115. [Google Scholar] [CrossRef] [PubMed]
  13. Hastie, T.; Mazumder, R.; Lee, J.; Zadeh, R. Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares. J. Mach. Learn. Res. 2014, 16, 3367–3402. [Google Scholar]
  14. Mazumder, R.; Hastie, T.; Tibshirani, R. Spectral Regularization Algorithms for Learning Large Incomplete Matrices. J. Mach. Learn. Res. JMLR 2010, 11, 2287–2322. [Google Scholar] [PubMed]
  15. Antonenko, E.; Carreño, A.; Read, J. Autoreplicative random forests with applications to missing value imputation. Mach. Learn. 2024, 113, 7617–7643. [Google Scholar] [CrossRef]
  16. McCoy, J.T.; Kroon, S.; Auret, L. Variational Autoencoders for Missing Data Imputation with Application to a Simulated Milling Circuit. IFAC-PapersOnLine 2018, 51, 141–146. [Google Scholar] [CrossRef]
  17. Fortuin, V.; Baranchuk, D.; Rätsch, G.; Mandt, S. Gp-vae: Deep probabilistic time series imputation. In Proceedings of the International Conference on Artificial Intelligence and Statistics; PMLR: New York, NY, USA, 2020; pp. 1651–1661. [Google Scholar]
  18. Mulyadi, A.W.; Jun, E.; Suk, H.I. Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Series. IEEE Trans. Cybern. 2022, 52, 9684–9694. [Google Scholar] [CrossRef] [PubMed]
  19. Luo, Y.; Cai, X.; Zhang, Y.; Xu, J.; Yuan, X. Multivariate time series imputation with generative adversarial networks. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18; Curran Associates, Inc.: Red Hook, NY, USA, 2018; pp. 1603–1614. [Google Scholar]
  20. Luo, Y.; Zhang, Y.; Cai, X.; Yuan, X. E2GAN: End-to-End Generative Adversarial Network for Multivariate Time Series Imputation. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19; International Joint Conferences on Artificial Intelligence Organization: Macao, China, 2019; pp. 3094–3100. [Google Scholar] [CrossRef] [PubMed]
  21. Tashiro, Y.; Song, J.; Song, Y.; Ermon, S. Csdi: Conditional score-based diffusion models for probabilistic time series imputation. Adv. Neural Inf. Process. Syst. 2021, 34, 24804–24816. [Google Scholar]
  22. Alcaraz, J.L.; Strodthoff, N. Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models. arXiv 2022, arXiv:2208.09399. [Google Scholar]
  23. Chen, Y.; Deng, W.; Fang, S.; Li, F.; Yang, N.T.; Zhang, Y.; Rasul, K.; Zhe, S.; Schneider, A.; Nevmyvaka, Y. Provably convergent Schrödinger bridge with applications to probabilistic time series imputation. In Proceedings of the International Conference on Machine Learning; PMLR: New York, NY, USA, 2023; pp. 4485–4513. [Google Scholar]
  24. Wu, H.; Hu, T.; Liu, Y.; Zhou, H.; Wang, J.; Long, M. TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis. In Proceedings of the International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2023. [Google Scholar]
  25. Che, Z.; Purushotham, S.; Cho, K.; Sontag, D.; Liu, Y. Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 2018, 8, 6085. [Google Scholar] [CrossRef] [PubMed]
  26. Cao, W.; Wang, D.; Li, J.; Zhou, H.; Li, Y.; Li, L. BRITS: Bidirectional recurrent imputation for time series. In Proceedings of the 32nd International Conference on Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2018; pp. 6776–6786. [Google Scholar]
  27. Yoon, J.; Zame, W.R.; van der Schaar, M. Estimating missing data in temporal data streams using multi-directional recurrent neural networks. IEEE Trans. Biomed. Eng. 2018, 66, 1477–1490. [Google Scholar] [CrossRef] [PubMed]
  28. Bai, S.; Kolter, J.Z.; Koltun, V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv 2018, arXiv:1803.01271. [Google Scholar]
  29. Wang, H.; Peng, J.; Huang, F.; Wang, J.; Chen, J.; Xiao, Y. Micn: Multi-scale local and global context modeling for long-term series forecasting. In Proceedings of the Eleventh International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2023. [Google Scholar]
  30. Cao, D.; Wang, Y.; Duan, J.; Zhang, C.; Zhu, X.; Huang, C.; Tong, Y.; Xu, B.; Bai, J.; Tong, J.; et al. Spectral temporal graph neural network for multivariate time-series forecasting. Adv. Neural Inf. Process. Syst. 2020, 33, 17766–17778. [Google Scholar]
  31. Cini, A.; Marisca, I.; Alippi, C. Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks. In Proceedings of the International Conference on Learning Representations; Curran Associates, Inc.: Red Hook, NY, USA, 2022. [Google Scholar]
  32. Marisca, I.; Cini, A.; Alippi, C. Learning to reconstruct missing data from spatiotemporal graphs with sparse observations. Adv. Neural Inf. Process. Syst. 2022, 35, 32069–32082. [Google Scholar] [CrossRef]
  33. Zhou, H.; Zhang, S.; Peng, J.; Zhang, S.; Li, J.; Xiong, H.; Zhang, W. Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2021. [Google Scholar]
  34. Bansal, P.; Deshpande, P.; Sarawagi, S. Missing value imputation on multidimensional time series. Proc. VLDB Endow. 2021, 14, 2533–2545. [Google Scholar] [CrossRef]
  35. Du, W.; Côté, D.; Liu, Y. Saits: Self-attention-based imputation for time series. Expert Syst. Appl. 2023, 219, 119619. [Google Scholar]
  36. Ng, A. A Chat with Andrew on MLOps: From Model-Centric to Data-Centric AI. Available online: https://www.youtube.com/watch?v=06-AZXmwHjo (accessed on 1 July 2026).
  37. Zhou, Y.; Tu, F.; Sha, K.; Ding, J.; Chen, H. A Survey on Data Quality Dimensions and Tools for Machine Learning Invited Paper. In Proceedings of the 2024 IEEE International Conference on Artificial Intelligence Testing (AITest); IEEE: Piscataway, NJ, USA, 2024; pp. 120–131. [Google Scholar] [CrossRef]
  38. Koh, P.W.; Liang, P. Understanding Black-Box Predictions via Influence Functions. In Proceedings of the 34th International Conference on Machine Learning, ICML’17; PMLR: New York, NY, USA, 2017; Volume 70, pp. 1885–1894. [Google Scholar]
  39. Hara, S.; Nitanda, A.; Maehara, T. Data cleansing for models trained with SGD. In Proceedings of the 33rd International Conference on Neural Information Processing Systems; Curran Associates, Inc.: Red Hook, NY, USA, 2019. [Google Scholar]
  40. Jia, R.; Wu, F.; Sun, X.; Xu, J.; Dao, D.; Kailkhura, B.; Zhang, C.; Li, B.; Song, D. Scalability vs. Utility: Do We Have to Sacrifice One for the Other in Data Importance Quantification? In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: Piscataway, NJ, USA, 2021; pp. 8235–8243. [Google Scholar]
  41. Paul, M.; Ganguli, S.; Dziugaite, G.K. Deep learning on a data diet: Finding important examples early in training. Adv. Neural Inf. Process. Syst. 2021, 34, 20596–20607. [Google Scholar]
  42. Agarwal, C.; D’souza, D.; Hooker, S. Estimating example difficulty using variance of gradients. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2022; pp. 10368–10378. [Google Scholar]
  43. Ghorbani, A.; Zou, J. Data shapley: Equitable valuation of data for machine learning. In Proceedings of the International Conference on Machine Learning; PMLR: New York, NY, USA, 2019; pp. 2242–2251. [Google Scholar]
  44. Miao, X.; Wu, Y.; Wang, J.; Gao, Y.; Mao, X.; Yin, J. Generative Semi-supervised Learning for Multivariate Time Series Imputation. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI: Washington, DC, USA, 2021; Volume 35, pp. 8983–8991. [Google Scholar] [CrossRef]
  45. Boyd, K.; Eng, K.H.; Page, C.D. Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals. In Proceedings of the Machine Learning and Knowledge Discovery in Databases; Blockeel, H., Kersting, K., Nijssen, S., Železný, F., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 451–466. [Google Scholar]
  46. Lacasa, L.; Luque, B.; Ballesteros, F.; Luque, J.; Nuño, J.C. From time series to complex networks: The visibility graph. Proc. Natl. Acad. Sci. USA 2008, 105, 4972–4975. [Google Scholar] [CrossRef] [PubMed]
  47. Qi, M.; Mei, L.; Li, Z.; Yan, L.; Wang, Z.; Ju, P. Revealing the Complexity of Load Fluctuations for Electricity Consumers Using MLP-HVG. In Proceedings of the 2023 IEEE Power and Energy Society General Meeting (PESGM); IEEE: Piscataway, NJ, USA, 2023; pp. 1–5. [Google Scholar] [CrossRef]
  48. Cheng, L.; Zhu, P.; Sun, W.; Han, Z.; Tang, K.; Cui, X. Time series classification by Euclidean distance-based visibility graph. Phys. A Stat. Mech. Its Appl. 2023, 625, 129010. [Google Scholar] [CrossRef]
  49. Yang, N.; Huang, F.; Zhao, S.; Li, S.; Hu, W. Predicting Sleeping Beauty Coefficients Based on ts2net Model. Data Anal. Knowl. Discov. 2024, 8, 72–82. [Google Scholar] [CrossRef]
  50. Silva, V.F.; Silva, M.E.; Ribeiro, P.; Silva, F. Novel features for time series analysis: A complex networks approach. Data Min. Knowl. Discov. 2022, 36, 1062–1101. [Google Scholar] [CrossRef]
  51. Luque, B.; Lacasa, L.; Ballesteros, F.; Luque, J. Horizontal visibility graphs: Exact results for random time series. Phys. Rev. E—Stat. Nonlinear Soft Matter Phys. 2009, 80, 046103. [Google Scholar] [CrossRef]
  52. Campanharo, A.S.; Sirer, M.I.; Malmgren, R.D.; Ramos, F.M.; Amaral, L.A.N. Duality between time series and networks. PLoS ONE 2011, 6, e23378. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Example of how bad imputation samples result in a bigger loss.
Figure 1. Example of how bad imputation samples result in a bigger loss.
Applsci 16 06837 g001
Figure 2. Illustration of quality difference.
Figure 2. Illustration of quality difference.
Applsci 16 06837 g002
Figure 3. Workflow of proposed method.
Figure 3. Workflow of proposed method.
Applsci 16 06837 g003
Figure 4. The changes in the indicator when k takes different values.
Figure 4. The changes in the indicator when k takes different values.
Applsci 16 06837 g004
Figure 5. Evaluation time.
Figure 5. Evaluation time.
Applsci 16 06837 g005
Figure 6. Sample visualization.
Figure 6. Sample visualization.
Applsci 16 06837 g006
Figure 7. Scatter plot of sample score.
Figure 7. Scatter plot of sample score.
Applsci 16 06837 g007
Figure 8. Correlation between sample quality and complex features in NVG graph.
Figure 8. Correlation between sample quality and complex features in NVG graph.
Applsci 16 06837 g008
Figure 9. Scatter plot of SGD-influence on Italy Air-Quality.
Figure 9. Scatter plot of SGD-influence on Italy Air-Quality.
Applsci 16 06837 g009
Figure 10. Scatter plot between sample quality and complex network features.
Figure 10. Scatter plot between sample quality and complex network features.
Applsci 16 06837 g010
Table 1. Data information used in this work.
Table 1. Data information used in this work.
DatasetETTItaly Air-QualityPhysioNet2012PhysioNet2019
# of Total Samples35877439974927
Features7133533
Sample Sequence Length48124848
Time Interval1 h1 h1 h1 h
Original Missing Rate (%)0079.373.9
Table 2. Italy Air-Quality datasets (part 1: GPVAE, SSGAN, and CSDI).
Table 2. Italy Air-Quality datasets (part 1: GPVAE, SSGAN, and CSDI).
ScenarioGPVAESSGANCSDI
TypeAlgorithmMSEMAEMSEMAEMSEMAE
s (10%)LSTM0.6069 ± 0.02621.7760 ± 0.04460.5466 ± 0.00361.8120 ± 0.01310.5289 ± 0.00870.5379 ± 0.0268
Grand0.5981 ± 0.00851.7737 ± 0.00410.5681 ± 0.00441.7785 ± 0.02120.5339 ± 0.03800.6664 ± 0.0894
VoG0.5842 ± 0.00831.7200 ± 0.00370.5370 ± 0.01731.7656 ± 0.02030.5099 ± 0.02750.6081 ± 0.0658
SGD-influence0.6161 ± 0.08661.5727 ± 0.43860.5520 ± 0.07961.4083 ± 0.13910.4962 ± 0.02760.5606 ± 0.0446
G-Shapley0.5806 ± 0.01601.7057 ± 0.03090.5415 ± 0.01461.7715 ± 0.03520.4850 ± 0.03370.5129 ± 0.0265
p (10%)LSTM0.4685 ± 0.00391.4330 ± 0.00380.4906 ± 0.00641.4647 ± 0.00340.2023 ± 0.00510.4128 ± 0.0112
Grand0.4441 ± 0.00511.4168 ± 0.01270.5697 ± 0.01091.7937 ± 0.02860.1747 ± 0.00470.4447 ± 0.0011
VoG0.4218 ± 0.03591.4441 ± 0.02260.5370 ± 0.01731.7656 ± 0.02030.1466 ± 0.01140.3603 ± 0.0074
SGD-influence0.4442 ± 0.01111.1112 ± 0.02160.5668 ± 0.06461.4321 ± 0.05120.1734 ± 0.00700.3880 ± 0.0415
G-Shapley0.4480 ± 0.04781.3212 ± 0.26260.5346 ± 0.00751.7770 ± 0.01410.1526 ± 0.01110.3552 ± 0.0048
p (50%)LSTM0.3836 ± 0.01460.5231 ± 0.17780.4923 ± 0.00680.7624 ± 0.07510.7001 ± 0.02321.2032 ± 0.0639
Grand0.3614 ± 0.00410.4882 ± 0.00220.4634 ± 0.00550.8356 ± 0.00270.6746 ± 0.01021.1488 ± 0.0589
VoG0.3618 ± 0.00350.4949 ± 0.00170.4662 ± 0.00750.8450 ± 0.01490.6990 ± 0.00121.1684 ± 0.0269
SGD-influence0.3505 ± 0.03310.4088 ± 0.11610.4399 ± 0.02990.6382 ± 0.20550.6968 ± 0.01571.1714 ± 0.0248
G-Shapley0.3674 ± 0.00660.5076 ± 0.01330.4236 ± 0.01220.5484 ± 0.06400.7185 ± 0.03411.1914 ± 0.0858
b (10%)LSTM0.4848 ± 0.00321.2204 ± 0.01040.4834 ± 0.00521.5211 ± 0.01230.4254 ± 0.01811.5433 ± 0.0896
Grand0.5079 ± 0.02191.1346 ± 0.05010.4843 ± 0.00661.5208 ± 0.01900.4666 ± 0.00531.6654 ± 0.0302
VoG0.4893 ± 0.00771.2178 ± 0.02110.4820 ± 0.00201.5191 ± 0.01360.4334 ± 0.01671.5761 ± 0.0753
SGD-influence0.4954 ± 0.00721.2017 ± 0.00610.4687 ± 0.06511.3208 ± 0.35410.4160 ± 0.01401.4412 ± 0.0817
G-Shapley0.4864 ± 0.00671.2113 ± 0.01320.4859 ± 0.00451.5072 ± 0.00620.4117 ± 0.03721.5986 ± 0.1171
Table 3. Italy Air-Quality datasets (part 2: comparison of GRUD, TimesNet, StemGNN, and SAITS).
Table 3. Italy Air-Quality datasets (part 2: comparison of GRUD, TimesNet, StemGNN, and SAITS).
ScenarioGRUDTimesNetStemGNNSAITS
TypeAlgorithmMSEMAEMSEMAEMSEMAEMSEMAE
s (10%)LSTM0.7092 ± 0.00362.0865 ± 0.01610.7064 ± 0.00651.8812 ± 0.02920.6659 ± 0.00292.4489 ± 0.04250.5362 ± 0.00431.8708 ± 0.0199
Grand0.7162 ± 0.05032.1787 ± 0.29910.5684 ± 0.03291.4741 ± 0.03490.6806 ± 0.03472.2659 ± 0.09960.6667 ± 0.00871.8317 ± 0.0312
VoG0.7166 ± 0.01832.0568 ± 0.00830.7133 ± 0.02421.5320 ± 0.30860.6604 ± 0.00512.4551 ± 0.01620.5674 ± 0.03991.9854 ± 0.1905
SGD-influence0.7651 ± 0.01962.0978 ± 0.07230.6779 ± 0.00751.4849 ± 0.07610.6442 ± 0.02341.9921 ± 0.37650.4526 ± 0.01711.2107 ± 0.0201
G-Shapley0.7205 ± 0.00842.0929 ± 0.01600.6947 ± 0.03601.6994 ± 0.27870.6522 ± 0.00472.3964 ± 0.02650.5402 ± 0.00751.8558 ± 0.0199
p (10%)LSTM0.4497 ± 0.00451.4008 ± 0.00210.4686 ± 0.00701.4310 ± 0.00530.4689 ± 0.00371.4796 ± 0.00920.4439 ± 0.03411.4392 ± 0.0173
Grand0.4064 ± 0.00261.4164 ± 0.01190.4596 ± 0.00481.3905 ± 0.00090.5931 ± 0.19701.7824 ± 0.44790.4098 ± 0.05331.4298 ± 0.0196
VoG0.4356 ± 0.03561.3015 ± 0.17250.4314 ± 0.00631.4361 ± 0.02430.4637 ± 0.01301.4886 ± 0.00640.4129 ± 0.01301.4141 ± 0.0435
SGD-influence0.4268 ± 0.04941.1224 ± 0.25770.4257 ± 0.01640.9025 ± 0.05730.4394 ± 0.01551.3646 ± 0.19310.4425 ± 0.07111.2340 ± 0.3155
G-Shapley0.4264 ± 0.00811.4144 ± 0.01220.4439 ± 0.00201.4293 ± 0.01140.4549 ± 0.00471.4933 ± 0.00770.4153 ± 0.01281.4058 ± 0.1008
p (50%)LSTM0.5649 ± 0.00331.2445 ± 0.00930.5287 ± 0.00240.9650 ± 0.01460.4945 ± 0.00871.1204 ± 0.03820.4825 ± 0.00790.9279 ± 0.0106
Grand0.5297 ± 0.00231.2010 ± 0.00370.4931 ± 0.00360.9191 ± 0.00260.4421 ± 0.00161.0928 ± 0.00580.4773 ± 0.02050.9155 ± 0.0034
VoG0.5233 ± 0.01631.1415 ± 0.07970.4884 ± 0.02380.8375 ± 0.12240.4448 ± 0.00411.0924 ± 0.00180.4954 ± 0.02910.9204 ± 0.0102
SGD-influence0.4943 ± 0.04170.7424 ± 0.22770.4195 ± 0.00640.5913 ± 0.01690.4595 ± 0.03740.8583 ± 0.16900.4822 ± 0.00920.8576 ± 0.0158
G-Shapley0.5073 ± 0.03980.9415 ± 0.26940.4622 ± 0.02070.7828 ± 0.11750.4630 ± 0.00261.1397 ± 0.00360.4372 ± 0.00780.9126 ± 0.0094
b (10%)LSTM0.5206 ± 0.00301.4827 ± 0.01280.5357 ± 0.00201.3399 ± 0.00660.4381 ± 0.00321.3491 ± 0.01060.4943 ± 0.01751.9141 ± 0.0206
Grand0.4999 ± 0.00521.2988 ± 0.07140.5476 ± 0.05721.2716 ± 0.05200.4465 ± 0.00261.2628 ± 0.05890.4528 ± 0.00271.7850 ± 0.0129
VoG0.4914 ± 0.00801.3575 ± 0.04010.5291 ± 0.00431.3205 ± 0.01720.4371 ± 0.00161.2731 ± 0.02520.4527 ± 0.00131.7579 ± 0.0215
SGD-influence0.5199 ± 0.00611.4300 ± 0.00340.5416 ± 0.00421.3022 ± 0.01270.4453 ± 0.00491.3535 ± 0.00860.4687 ± 0.01131.8571 ± 0.0122
G-Shapley0.5340 ± 0.00081.4686 ± 0.01570.5310 ± 0.00521.3573 ± 0.02310.4424 ± 0.00621.3584 ± 0.00780.4727 ± 0.00981.8980 ± 0.0083
Table 4. ETT datasets (part 1: GPVAE, SSGAN, and CSDI).
Table 4. ETT datasets (part 1: GPVAE, SSGAN, and CSDI).
TypeAlgorithmGPVAESSGANCSDI
MSEMAEMSEMAEMSEMAE
s (10%)LSTM 0.9052 ± 0.0319 1.1292 ± 0.0601 0.8886 ± 0.0268 1.1957 ± 0.0701 0.9772 ± 0.0259 1.4738 ± 0.1067
Grand 0.8519 ± 0.0266 1.0469 ± 0.0593 0.8743 ± 0.0693 1.1503 ± 0.1576 1.0069 ± 0.0107 1.5818 ± 0.0460
VoG 0.8059 ± 0.0250 0.9748 ± 0.0500 0.8461 ± 0.0321 1.0757 ± 0.0925 0.9354 ± 0.0136 1.3333 ± 0.0576
SGD-influence 0.7855 ± 0.0115 0.9414 ± 0.0270 0.7927 ± 0.0315 1.0324 ± 0.0243 0.9161 ± 0.0091 1.2753 ± 0.0157
G-Shapley 0.8180 ± 0.0173 0.9995 ± 0.0337 0.8125 ± 0.0533 1.0318 ± 0.1187 0.9223 ± 0.0353 1.3194 ± 0.0767
p (10%)LSTM 0.9712 ± 0.0033 1.3399 ± 0.0049 0.9594 ± 0.0094 1.2938 ± 0.0184 0.9957 ± 0.0405 1.4507 ± 0.1616
Grand 0.9447 ± 0.0364 1.2763 ± 0.0823 0.9518 ± 0.0242 1.2955 ± 0.0877 1.0238 ± 0.0235 1.5387 ± 0.0755
VoG 0.9175 ± 0.0334 1.2321 ± 0.0659 0.8824 ± 0.0136 1.1262 ± 0.0206 0.9300 ± 0.0331 1.2498 ± 0.0918
SGD-influence 0.9007 ± 0.0299 1.2294 ± 0.0541 0.8953 ± 0.0404 1.1753 ± 0.0914 0.8923 ± 0.0196 1.2062 ± 0.0392
G-Shapley 0.8833 ± 0.0022 1.1877 ± 0.0198 0.8866 ± 0.0077 1.1404 ± 0.0203 0.8957 ± 0.0136 1.1382 ± 0.0242
p (50%)LSTM 1.0353 ± 0.0170 1.6280 ± 0.0373 1.0418 ± 0.0321 1.5878 ± 0.1017 1.0326 ± 0.0129 1.6232 ± 0.0489
Grand 1.1884 ± 0.0579 2.2628 ± 0.2644 1.0784 ± 0.0133 1.7261 ± 0.0460 0.9912 ± 0.0281 1.5515 ± 0.0754
VoG 1.0557 ± 0.0582 1.6776 ± 0.1497 1.0261 ± 0.0536 1.5190 ± 0.1616 0.9652 ± 0.0222 1.4645 ± 0.1121
SGD-influence 0.9832 ± 0.0230 1.5159 ± 0.0739 0.9841 ± 0.0241 1.4433 ± 0.0393 0.9676 ± 0.0248 1.4478 ± 0.0712
G-Shapley 0.9808 ± 0.0055 1.4910 ± 0.0171 0.9715 ± 0.0174 1.3890 ± 0.0439 0.9462 ± 0.0396 1.3633 ± 0.0884
b (10%)LSTM 1.0074 ± 0.0595 1.4952 ± 0.1561 0.8580 ± 0.0054 1.1546 ± 0.0234 0.9713 ± 0.0211 1.4098 ± 0.0567
Grand 1.0111 ± 0.0341 1.5257 ± 0.0707 0.8582 ± 0.0103 1.2008 ± 0.0850 0.9466 ± 0.0073 1.3350 ± 0.0345
VoG 0.8841 ± 0.0224 1.1923 ± 0.0311 0.8638 ± 0.0079 1.1609 ± 0.0196 0.9223 ± 0.0039 1.2574 ± 0.0197
SGD-influence 0.9117 ± 0.0173 1.2431 ± 0.0428 0.8425 ± 0.0234 1.1365 ± 0.0457 0.9433 ± 0.0375 1.3089 ± 0.0913
G-Shapley 0.8750 ± 0.0480 1.1964 ± 0.0992 0.8673 ± 0.0044 1.1061 ± 0.0273 0.8972 ± 0.0066 1.1827 ± 0.0076
Table 5. ETT dataset (part 2: GRUD, TimesNet, StemGNN, and SAITS).
Table 5. ETT dataset (part 2: GRUD, TimesNet, StemGNN, and SAITS).
TypeAlgorithmGRUDTimesNetStemGNNSAITS
MSEMAEMSEMAEMSEMAEMSEMAE
s (10%)LSTM 0.8904 ± 0.0144 1.1846 ± 0.0245 0.9195 ± 0.0334 1.3104 ± 0.0990 0.9401 ± 0.0323 1.2709 ± 0.0992 0.9289 ± 0.0190 1.3192 ± 0.0604
Grand 0.8832 ± 0.0458 1.2251 ± 0.1121 0.9105 ± 0.0370 1.2514 ± 0.0581 0.9491 ± 0.0235 1.2973 ± 0.0947 0.9608 ± 0.0516 1.3871 ± 0.1407
VoG 0.7993 ± 0.0587 0.9805 ± 0.0961 0.8420 ± 0.0181 1.0462 ± 0.0436 0.9070 ± 0.0266 1.1810 ± 0.0534 0.8745 ± 0.0345 1.1536 ± 0.0991
SGD-influence 0.7771 ± 0.0825 0.9351 ± 0.1344 0.8280 ± 0.0088 1.0741 ± 0.0377 0.8448 ± 0.0479 1.0516 ± 0.1123 0.8362 ± 0.0179 1.0422 ± 0.0390
G-Shapley 0.7851 ± 0.0430 0.9613 ± 0.1044 0.7936 ± 0.0293 0.9622 ± 0.0590 0.8466 ± 0.0197 1.0646 ± 0.0315 0.8274 ± 0.0540 1.0184 ± 0.0893
p (10%)LSTM 0.9560 ± 0.0127 1.2848 ± 0.0319 0.9454 ± 0.0017 1.2457 ± 0.0048 0.9542 ± 0.0100 1.2756 ± 0.0227 0.9545 ± 0.0118 1.2707 ± 0.0226
Grand 0.8915 ± 0.0189 1.1676 ± 0.0686 0.9172 ± 0.0270 1.1976 ± 0.0593 0.9069 ± 0.0246 1.1925 ± 0.0753 0.9665 ± 0.0528 1.3462 ± 0.1776
VoG 0.9082 ± 0.0424 1.2140 ± 0.1355 0.9111 ± 0.0504 1.1934 ± 0.1317 0.8944 ± 0.0256 1.1727 ± 0.1054 0.8912 ± 0.0553 1.1711 ± 0.1383
SGD-influence 0.8626 ± 0.0140 1.1090 ± 0.0456 0.8588 ± 0.0251 1.1250 ± 0.0710 0.8836 ± 0.0512 1.1678 ± 0.0783 0.8831 ± 0.0284 1.1299 ± 0.0368
G-Shapley 0.8688 ± 0.0113 1.1135 ± 0.0129 0.8661 ± 0.0175 1.1345 ± 0.0370 0.8830 ± 0.0110 1.1239 ± 0.0324 0.8752 ± 0.0202 1.1070 ± 0.0502
p (50%)LSTM 0.9752 ± 0.0077 1.3908 ± 0.0239 0.9969 ± 0.0430 1.4610 ± 0.1460 0.9591 ± 0.0065 1.4114 ± 0.0096 0.9863 ± 0.0185 1.3517 ± 0.0598
Grand 1.1297 ± 0.1097 1.9888 ± 0.4859 1.0241 ± 0.0174 1.5823 ± 0.0768 0.9010 ± 0.0473 1.2664 ± 0.1283 0.9205 ± 0.0216 1.2619 ± 0.0635
VoG 0.9184 ± 0.0414 1.2335 ± 0.0951 0.9249 ± 0.0392 1.2667 ± 0.0927 0.8928 ± 0.0063 1.2103 ± 0.0220 0.9439 ± 0.0555 1.2915 ± 0.1433
SGD-influence 0.8525 ± 0.0206 1.1219 ± 0.0497 0.8847 ± 0.0370 1.2029 ± 0.1056 0.8502 ± 0.0480 1.1413 ± 0.1475 0.9132 ± 0.0223 1.2268 ± 0.0631
G-Shapley 0.8558 ± 0.0219 1.1307 ± 0.0310 0.9141 ± 0.0237 1.2401 ± 0.0495 0.8530 ± 0.0338 1.0732 ± 0.0445 0.8959 ± 0.0304 1.1843 ± 0.1051
b (10%)LSTM 0.9298 ± 0.0147 1.3244 ± 0.0245 0.8983 ± 0.0352 1.2782 ± 0.0814 0.9976 ± 0.0239 1.5340 ± 0.0719 0.9201 ± 0.0040 1.2872 ± 0.0048
Grand 0.9714 ± 0.0414 1.4470 ± 0.1024 0.8854 ± 0.0389 1.2764 ± 0.1318 1.0052 ± 0.0363 1.5640 ± 0.1299 0.9582 ± 0.0269 1.3752 ± 0.0839
VoG 0.8473 ± 0.0100 1.1409 ± 0.0199 0.8448 ± 0.0653 1.1592 ± 0.2050 0.9190 ± 0.0133 1.2915 ± 0.0314 0.9029 ± 0.0297 1.2238 ± 0.0751
SGD-influence 0.8169 ± 0.0202 1.0631 ± 0.0738 0.8017 ± 0.0432 1.0481 ± 0.0815 0.8923 ± 0.0337 1.1867 ± 0.0894 0.9204 ± 0.0180 1.2515 ± 0.0449
G-Shapley 0.8091 ± 0.0322 1.0485 ± 0.0772 0.8068 ± 0.0168 1.0481 ± 0.0162 0.8916 ± 0.0332 1.1906 ± 0.0927 0.9354 ± 0.0381 1.2686 ± 0.1045
Table 6. PhysioNet 2012 dataset (part 1: GPVAE, SSGAN, CSDI).
Table 6. PhysioNet 2012 dataset (part 1: GPVAE, SSGAN, CSDI).
AlgorithmGPVAESSGANCSDI
ACF1AUPRCACF1AUPRCACF1AUPRC
LSTM-ATT 0.8588 ± 0.0043 0.5341 ± 0.0100 0.3402 ± 0.0211 0.8638 ± 0.0050 0.5628 ± 0.0307 0.4231 ± 0.0706 0.8667 ± 0.0069 0.6006 ± 0.0107 0.4382 ± 0.0316
Grand 0.8683 ± 0.0026 0.5626 ± 0.0228 0.4385 ± 0.0225 0.8613 ± 0.0078 0.6134 ± 0.0262 0.4142 ± 0.0478 0.8667 ± 0.0019 0.6044 ± 0.0100 0.4295 ± 0.0148
VoG 0.8658 ± 0.0019 0.5545 ± 0.0180 0.4101 ± 0.0224 0.8600 ± 0.0045 0.5777 ± 0.0187 0.3779 ± 0.0365 0.8688 ± 0.0025 0.6199 ± 0.0222 0.4479 ± 0.0226
SGD-influence 0.8675 ± 0.0022 0.6019 ± 0.0081 0.4355 ± 0.0123 0.8675 ± 0.0013 0.5875 ± 0.0507 0.4581 ± 0.0379 0.8667 ± 0.0059 0.6182 ± 0.0159 0.4384 ± 0.0326
G-Shapley 0.8663 ± 0.0033 0.5705 ± 0.0196 0.4180 ± 0.0290 0.8671 ± 0.0040 0.5965 ± 0.0290 0.4390 ± 0.0155 0.8700 ± 0.0022 0.6141 ± 0.0116 0.4535 ± 0.0142
Table 7. PhysioNet 2012 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).
Table 7. PhysioNet 2012 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).
AlgorithmGRUDTimesNetStemGNNSAITS
ACF1AUPRCACF1AUPRCACF1AUPRCACF1AUPRC
LSTM-ATT 0.8554 ± 0.0085 0.5609 ± 0.0115 0.3514 ± 0.0451 0.8633 ± 0.0040 0.5470 ± 0.0291 0.4011 ± 0.0343 0.8613 ± 0.0038 0.5574 ± 0.0484 0.3720 ± 0.0406 0.8583 ± 0.0069 0.5501 ± 0.0111 0.3595 ± 0.0546
Grand 0.8679 ± 0.0062 0.5780 ± 0.0842 0.4988 ± 0.0731 0.8658 ± 0.0007 0.5504 ± 0.0384 0.4421 ± 0.0553 0.8633 ± 0.0058 0.5970 ± 0.0287 0.4269 ± 0.0309 0.8638 ± 0.0043 0.5779 ± 0.0010 0.4019 ± 0.0264
VoG 0.8675 ± 0.0025 0.5676 ± 0.0211 0.4334 ± 0.0232 0.8671 ± 0.0029 0.5865 ± 0.0002 0.4272 ± 0.0202 0.8654 ± 0.0019 0.5701 ± 0.0132 0.4079 ± 0.0184 0.8688 ± 0.0025 0.5934 ± 0.0015 0.4408 ± 0.0191
SGD-influence 0.8600 ± 0.0043 0.5812 ± 0.0187 0.3800 ± 0.0347 0.8688 ± 0.0022 0.5997 ± 0.0174 0.4414 ± 0.0165 0.8642 ± 0.0051 0.5829 ± 0.0217 0.4083 ± 0.0411 0.8579 ± 0.0104 0.6059 ± 0.0444 0.4195 ± 0.0042
G-Shapley 0.8650 ± 0.0013 0.6089 ± 0.0065 0.4239 ± 0.0097 0.8667 ± 0.0026 0.5666 ± 0.0230 0.4293 ± 0.0362 0.8617 ± 0.0040 0.5824 ± 0.0241 0.3887 ± 0.0356 0.8625 ± 0.0045 0.5880 ± 0.0178 0.4041 ± 0.0261
Table 8. PhysioNet 2019 dataset (part 1: GPVAE, SSGAN, CSDI).
Table 8. PhysioNet 2019 dataset (part 1: GPVAE, SSGAN, CSDI).
AlgorithmGPVAESSGANCSDI
ACF1AUPRCACF1AUPRCACF1AUPRC
LSTM-ATT 0.9017 ± 0.0697 0.4862 ± 0.0126 0.0621 ± 0.0487 0.8917 ± 0.0406 0.4852 ± 0.0112 0.0590 ± 0.0153 0.9069 ± 0.0206 0.4908 ± 0.0133 0.0554 ± 0.0213
Grand 0.9215 ± 0.0024 0.5006 ± 0.0198 0.0684 ± 0.0540 0.9316 ± 0.0049 0.5109 ± 0.0150 0.0832 ± 0.0371 0.9361 ± 0.0057 0.5274 ± 0.0406 0.1210 ± 0.0991
VoG 0.9205 ± 0.0158 0.5024 ± 0.0269 0.0703 ± 0.0570 0.9194 ± 0.0229 0.4868 ± 0.0072 0.0326 ± 0.0202 0.9170 ± 0.0120 0.5128 ± 0.0061 0.1130 ± 0.0309
SGD-influence 0.9295 ± 0.0032 0.4956 ± 0.0128 0.0459 ± 0.0360 0.9420 ± 0.0061 0.5126 ± 0.0165 0.0745 ± 0.0427 0.9302 ± 0.0036 0.5145 ± 0.0090 0.0948 ± 0.0214
G-Shapley 0.9333 ± 0.0172 0.5073 ± 0.0265 0.0718 ± 0.0594 0.9375 ± 0.0075 0.4946 ± 0.0095 0.0351 ± 0.0224 0.9208 ± 0.0118 0.5130 ± 0.0138 0.1039 ± 0.0231
Table 9. PhysioNet 2019 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).
Table 9. PhysioNet 2019 dataset (part 2: GRUD, TimesNet, StemGNN, SAITS).
AlgorithmGRUDTimesNetStemGNNSAITS
ACF1AUPRCACF1AUPRCACF1AUPRCACF1AUPRC
LSTM-ATT 0.8948 ± 0.0379 0.4879 ± 0.0173 0.0628 ± 0.0049 0.8620 ± 0.0656 0.4789 ± 0.0317 0.0678 ± 0.0320 0.8794 ± 0.0733 0.4858 ± 0.0243 0.0712 ± 0.0494 0.8670 ± 0.0880 0.4765 ± 0.0268 0.0630 ± 0.0307
Grand 0.9111 ± 0.0069 0.4953 ± 0.0055 0.0665 ± 0.0192 0.9069 ± 0.0112 0.4977 ± 0.0158 0.0777 ± 0.0356 0.9052 ± 0.0018 0.4927 ± 0.0059 0.0657 ± 0.0194 0.9163 ± 0.0091 0.5025 ± 0.0160 0.0795 ± 0.0362
VoG 0.9306 ± 0.0042 0.5097 ± 0.0230 0.0824 ± 0.0621 0.9163 ± 0.0068 0.4978 ± 0.0045 0.0673 ± 0.0191 0.9156 ± 0.0081 0.5020 ± 0.0157 0.0793 ± 0.0362 0.9392 ± 0.0051 0.5260 ± 0.0071 0.1112 ± 0.0200
SGD-influence 0.9313 ± 0.0135 0.5204 ± 0.0141 0.1081 ± 0.0228 0.9135 ± 0.0031 0.5071 ± 0.0103 0.1007 ± 0.0381 0.9337 ± 0.0109 0.5117 ± 0.0120 0.0836 ± 0.0350 0.9212 ± 0.0138 0.5000 ± 0.0205 0.0681 ± 0.0548
G-Shapley 0.9170 ± 0.0187 0.5089 ± 0.0151 0.1017 ± 0.0499 0.9104 ± 0.0090 0.4988 ± 0.0045 0.0779 ± 0.0016 0.9111 ± 0.0081 0.4955 ± 0.0138 0.0666 ± 0.0395 0.9333 ± 0.0048 0.5067 ± 0.0135 0.0710 ± 0.0406
Table 10. Time complexity comparison of data quality methods.
Table 10. Time complexity comparison of data quality methods.
MethodCore MechanismTime Complexity
VoGVariance in gradients across training iterations (Equation (5)) O ( 1 )
GrandGradient norm of the loss at early training (Equation (4)) O ( 1 )
SGD-influenceThe cumulative influence of each sample (Equation (7)) O ( n )
G-ShapleyMarginal contribution v j t v j 1 t O ( 2 n )
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Huang, F.; Li, S.; Peng, J.; Ma, C. Optimizing-Time Series Imputation with Data Quality. Appl. Sci. 2026, 16, 6837. https://doi.org/10.3390/app16146837

AMA Style

Huang F, Li S, Peng J, Ma C. Optimizing-Time Series Imputation with Data Quality. Applied Sciences. 2026; 16(14):6837. https://doi.org/10.3390/app16146837

Chicago/Turabian Style

Huang, Feihu, Shan Li, Jian Peng, and Changyou Ma. 2026. "Optimizing-Time Series Imputation with Data Quality" Applied Sciences 16, no. 14: 6837. https://doi.org/10.3390/app16146837

APA Style

Huang, F., Li, S., Peng, J., & Ma, C. (2026). Optimizing-Time Series Imputation with Data Quality. Applied Sciences, 16(14), 6837. https://doi.org/10.3390/app16146837

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop