1. Introduction
The analysis of functional time series constitutes a primordial topic in functional statistics. Usually, conventional methods are typically developed under the least squares framework, this paper proposes a novel nonparametric smoother based on the Absolute Relative Error (ARE) criterion. Based on its scale-invariant, the proposed approach offers an alternative robust approach to the classical least squares criterion. Such approach limits the impact of outliers and the heteroscedasticity of the data. Thus, the Functional ARE estimator has the potential to improve estimation accuracy, predictive performance, particularly in the complex structures.
The general framework of nonparametric functional data analysis is well developed in the the past few decades. Since the pioneering work of [
1], the field has attracted considerable attention and has grown into a rich and active area of research. For example, Ref. [
2] established the
-norm convergence of the kernel estimator for functional regression. The leading term expansion of the corresponding
error was derived in [
3], whereas [
4] proved the asymptotic normality of the estimator under strong mixing conditions. Beyond the classical kernel approach, important methodological advances have also been achieved through
M-estimation and local linear smoothing; see, for example, [
5,
6,
7] for comprehensive developments in these directions.
Motivated by these developments, this paper focuses on relative error regression (ReR), as alternative regression framework in which prediction accuracy is assessed through relative absolute deviations. Such a criterion is often more appropriate in applications where the response variable exhibits substantial variability or where proportional prediction errors are of primary interest. Relative error regression has found important applications in several fields, including medicine [
8] and finance [
9]. Nevertheless, its nonparametric development remains relatively limited. The first contributions in this direction were made by [
10], who investigated estimation based on the relative squared error criterion within multiplicative regression models. Ref. [
11] proposed a nonparametric local linear estimator under the same framework. More recently, these methodologies have been extended to dependent data settings, including quasi-associated time series [
12].
In the context of functional statistics, nonparametric relative error regression was pioneered by [
13], who established the strong consistency and asymptotic normality of the proposed estimator. This topic was extended to accommodate more complex data settings. In particular, Ref. [
14] generalized the methodology to incomplete functional data. They established the almost complete consistency of the adapted estimator for truncated data. More recent advances and methodological developments can be found in [
15,
16].
It is worth emphasizing that all existing studies in the functional relative have focused on relative squared error criteria, which is sensitive to atypical observations and large prediction errors. To overcome these limitations, we propose a new nonparametric functional regression estimator based on the Absolute Relative Error (ARE) criterion. By replacing squared relative deviations with absolute relative deviations, the proposed approach provides more robust and scale invariant measure of prediction accuracy. This formulation reduces the influence of outliers and offers stable predictor in the presence of heteroscedasticity., while retaining the intuitive relative interpretation of prediction errors. These properties make the proposed estimator particularly attractive for applications where the response variable exhibits high variability. Thus, in functional data analysis, where observations are often noisy, densely sampled, and characterized by the local fluctuations and high variability the gain is very important.
From a theoretical point of view the ARE framework is more challenging than the LSRE model. The LSRE estimator admits an explicit representation via the ratio of conditional inverse moments which facilitates its theoretical analysis. Conversely, the LARE estimator does not possess such a explicit expression. Therefore, the asymptotic behavior of the LARE model cannot be established through direct analytical arguments and instead requires the development of a suitable Bahadur representation. Moreover, this implicit formulation leads to additional computational challenges, as the estimator requires local, data-driven optimization rather than the direct estimation of a fixed operator. However, despite these technical difficulties, we derive the asymptotic distribution of the proposed estimator under standard conditions commonly assumed in nonparametric functional statistics. These assumptions explore both the infinite-dimensional nature of the functional predictor and the dependence structure of the data.
The second important advantage of the proposed methodology is that it applies to a large class of regression models than the existing Least Squares Relative Error (LSRE)-approach. In contrast to the existing LSRE approach, which requires the response variable to be strictly positive, the proposed LARE criterion does not impose such a restriction. Consequently, the new predictor is applicable to a large class of functional regression models. This flexibility is particularly valuable in the analysis of functional time series, where the observations exhibit temporal dependence and often display complex dynamic features that are absent in the independent setting. Therefore, the proposed methodology extends naturally beyond independent functional data and provides a robust framework for modeling the dependent functional processes encountered in practice.
Finally, the practical relevance of the proposed methodology is demonstrated through comprehensive simulation studies and real-world functional time series applications. The simulation experiments examine the finite-sample behavior of the proposed estimator under diverse dependence structures and noise levels, whereas the real-data examples highlight its practical effectiveness. The empirical findings consistently indicate that the proposed LARE estimator provides greater robustness, improved estimation accuracy, and superior predictive performance compared with the existing LSRE-based methodology, especially in challenging settings characterized by temporal dependence, heteroscedasticity, and atypical observations.
The rest of the paper is organized as follows. In
Section 2, we introduce the proposed estimation procedure.
Section 4 establishes the regularity conditions and the asymptotic theory of the estimator.
Section 5 investigates its finite sample performance through simulation experiments and a real-data application is given in
Section 6. Concluding remarks are given in
Section 7, whereas all technical proofs are presented in
Appendix A.
3. Model and Its Estimation
As outlined in the previous section, our objective is to investigate the relationship between the curve C and a future attribute D. For the sake of generality, we consider a random pair taking values in the product space , where is a functional space equipped with a suitable semi-metric . Throughout the paper, we fix an arbitrary point and study the local behavior of the regression operator in a neighborhood of .
In our previous works [
13], the relationship between the functional covariate and the response variable was modeled through the least squares relative error (LSRE) criterion. The main attribute of the LSRE criterion is that it leads to an explicit representation of the regression operator. However, despite its attractive analytical properties, the LSRE criterion has several limitations. Since it relies on a quadratic loss, large relative errors receive disproportionately high penalties, making the estimator particularly sensitive to observations with very small response values or highly dispersed data. Such behavior may substantially affect estimation accuracy in the presence of heavy-tailed distributions or atypical observations.
To address these limitations, we introduce a functional regression operator based on the least absolute relative error (LARE) criterion, which penalizes relative deviations linearly rather than quadratically. The proposed regression operator is defined by
By assigning equal weight to relative deviations, the LARE criterion is inherently more robust to extreme observations and large fluctuations in the response variable. Consequently, it provides a more reliable and stable modelling framework when the data exhibit skewness, heavy tails, or substantial heterogeneity, while preserving the desirable scale-invariant property of relative error methods. This regression model was first introduced by Laksaci et al. [
19], who established its asymptotic properties under the assumption that the observations are independent and identically distributed. In this paper, we extend this framework to the more general setting of functional time series, where successive functional observations may exhibit temporal dependence. Of course this generalization allows to cover more realistic situations. We point out that, many practical areas, including electricity consumption, financial data, environmental monitoring, and other applications involving functional observations, are subject to temporal dependence. In contrast, the independent functional observations are relatively uncommon in practical applications compared to the dependent case. Thus, we can say that the functional time series case provides a more general framework that reflects the structure of many real data cases. On the other hand, from a theoretical point of view, establishing the asymptotic properties of the LARE estimator in the functional time-series case is more challenging than in the independent case. The treatment of the temporal dependence requires different probabilistic tools and additional mathematical arguments. In that sense, the proof cannot be obtained as a straightforward extension of the i.i.d. results. At this stage, the kernel estimator of the regression operator
is defined by
where
is a kernel function and
is a sequence of positive bandwidths satisfying
as
. We point out that, the main advantage of the proposed nonparametric LARE approach arises when the relationship between the input variable
and the out variable
is unknown, which is more common in practice. Thus the nonparametric approach allows to avoid the restrictive parametric assumptions providing greater robustness and flexibility.
The main contribution of this paper is to establish the asymptotic normality of the estimator
in the setting of functional time series. To the best of our knowledge, this is the first work to develop a regression operator based on the least absolute relative error (LARE) criterion for functional time series data analysis. While finite-dimensional regression models arise as a special case, the proposed framework is more general and presents additional theoretical challenges due to the infinite-dimensional nature of the covariates. Further background on relative error regression can be found in [
20,
21,
22].
5. Empirical Analysis
As with all theoretical contributions, this empirical investigation is designed to assess the practical performance of the proposed estimator
under different regression settings. In particular, we examine its robustness and computational reliability in both homoscedastic and heteroscedastic models. Heteroscedasticity is common in real-world applications and can affect the accuracy of conventional regression estimators. Thus, to highlight the robustness of
against this phenomena, we compare its performance with several standard benchmark regression methods. In the first illustration, we compare
with the
-relative regression estimator, defined by
Clearly comparing both estimators under heteroscedastic permits examining the sensitivity of the estimator for changes in the conditional variability of the response.
For this first illustration, we conduct a simulation study based on data generated from the following nonparametric regression model:
where the function
controls the conditional variance of the response. The homoscedastic model is recovered by taking
to be constant, whereas a non-constant choice of
yields a heteroscedastic regression model. This framework allows comparison of the proposed estimator under both variance structures and highlights its practical effectiveness in the presence of varying levels of conditional heterogeneity.
On the other hand, to examine the impact of temporal dependence on the performance of the proposed estimator, the functional regressor was generated from a functional GARCH(1,1) process. Specifically, the functional observations were constructed according to
where
is a sequence of smooth Gaussian innovation functions and the conditional variance function satisfies the recursion
To reduce the effect of the initial value on the simulated process, we generated an additional 100 functional observations as a burn-in period and discarded them before retaining the sample used in the Monte Carlo experiments. The initial conditional variance function was set equal to the baseline variance component.
Three dependence scenarios were considered by varying the persistence parameters
, corresponding to weak
, moderate
, and strong
temporal dependence. The simulated functional covariates under these three situations are presented in
Figure 1.
The endogenous response variable
D was generated according to the nonparametric regression model (
3), where the regression operator is defined by
To investigate the impact of the conditional variance on the performance of the proposed estimator, we considered three representative variance structures corresponding to increasing levels of heteroscedasticity:
The first specification corresponds to a constant conditional variance, whereas the second and third introduce progressively stronger heteroscedastic effects through functional characteristics of the covariate. This simulation design gives a comprehensive assessment of the robustness and stability of the proposed estimator.
For this empirical analysis, we compared two selectors for the smoothing parameter
s that are
and
where
denotes either the
or the
estimator computed after removing the
ith observation from the sample. To ensure a fair comparison, both bandwidth selection procedures were optimized over the same candidate set
.
For each selector, the optimal smoothing parameter
s was chosen from
, which was constructed from the empirical quantiles of the pairwise distances between the Hilbert-valued covariates
. Specifically, the candidate values of
s correspond to the empirical quantiles of orders
Finally, the estimator was implemented using a quadratic kernel with support on
. The similarity between functional covariates was measured through the PCA-based
semi-metric, defined using the first three empirical eigenfunctions of the covariance operator associated with the three largest empirical eigenvalues (see Ferraty and Vieu [
23]).
The predictive performance of the proposed estimation procedure was assessed by comparing the observed response values
with their corresponding predictions
using the relative squared error (RSE), defined as
where
denotes the leave-one-out prediction of
.
The following algorithm summarizes the detailed procedure used in this part of the analysis:
- Step 1.
Choose the level of dependence.
- Step 2.
Choose the level of heteroscedasticity.
- Step 3.
For the specified levels of dependence and heteroscedasticity and a given sample size
n, generate a sequence of observations
according to model (
3).
- Step 4.
Split the sample in two parts: 80% of the observations were used as the training sample, while the remaining 20% were reserved for testing.
- Step 5.
For each and each observation i in the training sample we compute the estimators and using the kernel and metric specified above.
- Step 6.
For each observation
i in the training sample we select the two optimal bandwidths according to the two bandwidth-selection rules defined in (
4) and (
5).
- Step 7.
For each observation (j) in the testing sample, we compute the optimal estimators and using the optimal bandwidths associated with its nearest observation in the training sample.
- Step 8.
Compute the of the optimal estimators and .
The algorithm was repeated over 150 independent Monte Carlo replications, and the average RSE was used to compare the competing estimation procedures. The corresponding prediction results are presented in
Table 1.
The results presented in
Table 1 indicate that the proposed estimator,
outperforms its competitor,
in terms of estimation accuracy. More importantly,
exhibits remarkably low error variability across the various simulated scenarios, whereas the performance of
has more fluctuation. This stable behavior is especially observed under heteroscedastic conditions, which pose a more complex modeling challenge. Given that the robustness of a regression estimator is evaluated by its capacity to deliver stable predictions despite changing data structures, the minimal variance in the error of
offers a good evidence of its superior robustness and practical utility in heterogeneous environments.
Now, in order to assess the consistency and the stability of the proposed estimator, we compare its performance with two standard benchmark approaches: the mean regression and the median regression. Such models are, respectively, estimated by
and
For the sake of brevity, we focus on the most challenging simulation scenario, characterized by strong dependence and strong heteroscedasticity. This choice is motivated by the fact that, if an estimator maintains reliable performance under strong dependence and substantial heteroscedasticity, this provides stronger evidence of its robustness. Under this challenging setting, we compare the three regression approaches across a different of sample sizes
.
The conditional mean and median regressions are computed using the corresponding routines fregre.np.cv and cond.quantile, available in the R package fda.usc. This comparison therefore provides a complementary assessment of the finite-sample behavior and practical reliability of the proposed estimator relative to standard regression methods. We follow the same algorithm described above under the rule 1 to compute
. We report the resulting
values in the following
Table 2.
The results in
Table 2 show that
achieves the lowest
for all sample sizes, indicating better estimation accuracy than mean regression and median regression. Its
decreases from
to
as
n increases. However, the performance remains stable for
n large. The conditional median estimator
also benefits from larger sample sizes, but its error remains systematically higher than that of
. Overall, these results highlight the good accuracy and stable performance of
, namely under the challenging combination of strong dependence and strong heteroscedasticity.
6. A Real Data Application
In this section, we illustrate the practical applicability of the proposed methodology through the analysis of a real world dataset. Specifically, we consider the monthly electricity consumption data for Malaysia, which are publicly available at
https://storage.data.gov.my/energy/electricity_consumption.csv (accessed on 18 July 2026). The use of this type of data is motivated by its naturally heterogeneous structure, which is often associated with substantial seasonal variation and possible structural changes in electricity demand. In particular, electricity consumption may vary considerably across months and seasons due to changes in weather conditions, economic activity, and consumer behavior. Such variations can lead to high variability over time, making electricity demand a relevant and realistic setting for assessing the performance and robustness of regression methods under heteroscedasticity. Furthermore, the considered dataset consists of 80 monthly observations during the period from January 2018 to December 2024. The corresponding electricity consumption curve is presented in
Figure 2.
Our objective is to predict the monthly electricity consumption one month ahead using the observations from the preceding 12 months. A similar analysis of this dataset was conducted by Ferraty and Vieu [
23] in the framework of functional data analysis using the classical nonparametric regression mode after transforming the original time series by applying a logarithmic difference. This transformation is important for ensuring the stationarity of the data.
Although conventional regression methods perform well under standard Gaussian assumptions, electricity consumption data often exhibit complex dynamics driven by structural changes, extreme weather conditions, and unexpected economic events. Such factors typically induce heavy-tailed distributions and produce atypical observations that can substantially affect the predictive performance of least-squares-based methods. So, to overcome these limitations, we propose a functional regression approach based on the Least Absolute Relative Error (LARE) criterion. The LARE model is particularly attractive because of its scale invariance and its robustness to outliers. Indeed, the -type relative loss penalizes large deviations linearly rather than quadratically, reducing the influence of extreme observations on the fitted model.
To demonstrate the advantages of the proposed approach, we compare the LARE estimator with both the Least Squares Relative Error (LSRE) model and the standard Nadaraya–Watson Conditional Expectation (NWCE) estimator,
Specifically, the kernel estimator associated with the traditional LSRE model, denoted by
, is defined as follows:
whereas the classic kernel or Nadraya-Watson-Conditional-Expectation (NWCE)
is defined as:
Now, for this experiment, we keep the notations of the preceding sections we denote by
the monthly electricity consumption time series observed over a horizon of 80 months.
The monthly electricity consumption data are organized into functional units by using each consecutive block of 12 monthly observations to construct a functional curve. This segmentation provides a natural functional representation of the annual consumption, with each curve describing the evolution of electricity demand over a one year period. Using this representation, we aim to predict the consumption during the last 12 months, corresponding to the 68th functional segment, based on the preceding 67 segments used as the training sample. More specifically, for each fixed target month j in the last year, we construct the functional regression sample from the pairs , where is the functional predictor obtained from the 12 monthly electricity consumption observations preceding month j, and is the scalar electricity consumption observed in month. This formulation allows the same functional covariate to be used to predict each of the 12 monthly consumption values separately, while preserving the dependence structure within the annual consumption profiles. Furthermore, to investigate the robustness of the estimators, we perform a comparative study across two distinct data regimes:
- 1.
Contamination-Free Regime (Absence of Outliers): The models are trained on the stationary, log-differenced transformation introduced by Ferraty and Vieu [
23]. This baseline scenario evaluates performance under standard, well-behaved structural conditions.
- 2.
Contaminated Regime (Presence of Outliers): Artificial anomalies are introduced into the dataset by arbitrarily scaling some percentage p of the response variables () by a factor of M. This heavy-tailed contamination explicitly challenges the model sensitivities to extreme leverage points.
In both experimental settings, the functional predictor is endowed with the semi-metric induced by the principal component representation of the functional data. Specifically, the semi-metric is constructed by projecting the curves onto the
m first principal components associated with the largest eigenvalues of the empirical covariance operator. Nonparametric smoothing is performed using the quadratic (Epanechnikov) kernel,
The structural tuning parameters, namely the number of principal components
m defining the semi-metric and the local smoothing bandwidth
s, are selected automatically through a data-driven cross-validation procedure based on the criterion given in (
4). The resulting prediction curves are displayed in
Figure 3 where the observed electricity consumption series is represented by a solid line, while the corresponding predictions obtained from the competing models are shown by dashed lines.
An examination of the forecasting results presented in
Figure 3 confirms the effectiveness of the proposed functional prediction framework. In the absence of anomalous observations, both the classical least-squares relative error (LSRE) regression and the proposed Least Absolute Relative Error (LARE) regression provide highly accurate forecasts. To assess predictive performance, we compute the mean absolute error (MAE), defined by
where
denotes the prediction obtained from the LARE, LSRE, or Nadaraya–Watson conditional expectation (NWCE) model.
The obtained MAE values are for the proposed LARE estimator, compared with for the LSRE estimator and for the NWCE estimator. These results indicate that the proposed LARE approach achieves the highest predictive accuracy, even under regular operating conditions where no prominent outliers are present. This demonstrates that the scale-invariant relative loss underlying the LARE criterion preserves predictive efficiency while avoiding the sensitivity to large deviations that characterizes conventional least-squares-based methods.
In contrast, the superiority of the proposed LARE framework becomes particularly evident under the contaminated data setting. See the MAE reported in
Table 3.
The robustness and stability of the proposed LARE regression are particularly evident under the contaminated data case, as shown in
Table 3 and
Figure 4. Unlike the competing methods, whose prediction errors increase with the the contamination level, the LARE estimator maintains a stable performance. For instance, when
, its MAE changes only slightly, from
at a contamination level of
to
at
. The same stability is observed for
and
, where the MAE varies only within the narrow ranges
and
, respectively. In contrast, the MAE of
and
increases substantially with the contamination level, particularly when
. Thus, the small variation in the LARE error across different contamination levels provides clear evidence of its robustness to anomalous observations. This stability confirms that the relative absolute error successfully limits the influence of extreme observations, allowing the proposed regression to preserve its predictive accuracy even when the data are increasingly contaminated.
To visualize the advantage of the proposed LARE regression over its main competitors, the LSRE and Nadaraya–Watson conditional expectation (NWCE) estimators,
Figure 4 presents their prediction results under the most challenging contamination scenario considered in
Table 3. Specifically, the figure corresponds to the last row of the table, where
and
of the observations are contaminated.
Once again the graphical results provide a clear illustration of the robustness and stability of the LARE estimator. Despite the severe contamination, the LARE predictions remain close to the observed curve and preserve its main features, with only minor deviations. In contrast, the predictions produced by the LSRE and NWCE estimators are visibly more affected by the contaminated observations. This difference is consistent with the numerical results reported in
Table 3, where the MAE of LARE remains stable, while the errors of the competing methods increase substantially. Overall, the figure provides complementary visual evidence that the proposed LARE regression is less sensitive to extreme observations and maintains reliable predictive performance even in the presence of a high level of contamination. Finally, let us point out that the stationarity is a fundamental condition for establishing our theoretical results. In this real data application, stationarity is ensured by considering the differences of the logarithmic series. This transformation is commonly used in financial time-series analysis to remove stochastic trends and stabilize the mean and variance of the series. Moreover, we have confirmed this aspect by the Dickey–Fuller (ADF) test, through the
adf.test routine in R. Since our observations are functional, the test was applied to the leading principal component scores obtained from the functional observations. The results provide empirical evidence supporting the stationarity of the transformed functional time series. However, to assess the impact of this aspect on forecasting performance, we compare the three models using the original data without applying the stationarity transformation. The results show a substantial difference in predictive performance between the transformed and untransformed cases. In particular, the obtained MAE values are 1087 for the proposed LARE estimator, compared with 2695 for the LSRE estimator and 3957 for the NWCE estimator. These considerably larger prediction errors highlight the practical importance of the stationarity assumption for achieving accurate and reliable forecasts and provide empirical support for the use of the proposed methodology under stationary data.
7. Conclusions and Prospects
This paper extends the functional Least Absolute Relative Error (LARE) regression framework to the more challenging setting of dependent functional observations, where the explanatory variables form a functional time series. This extension represents a significant generalization of the existing theory, since temporal dependence introduces additional technical difficulties in both the estimation procedure and the asymptotic analysis. To address these challenges, we develop a new kernel-based LARE estimator for functional time series and establish its main asymptotic properties, including asymptotic normality under suitable weak dependence conditions. As in the independent setting, the functional structure is characterized through the small-ball probability function, which explores the local concentration of the probability measure in infinite-dimensional spaces. The use of the LARE loss further provides a robust estimation framework that is considerably less sensitive to atypical observations and heavy-tailed distributions than classical least-squares approaches.
The theoretical results are established under mild and flexible assumptions allowing to include a large class of stationary functional time series. In particular, the mixing condition provides a general framework for controlling the temporal dependence between functional observations that are sufficiently separated in time, while still allowing for substantial dependence at shorter lags. Consequently, the proposed methodology applies to a wide range of dependent functional data arising in economics, finance, environmental sciences, energy systems, and other applications where serial dependence is an intrinsic feature of the observed curves. From a practical point of view, the assumed dependence structure in finite-dimensional case can be assessed empirically using diagnostic tools available in standard statistical software such as Autocorrelation Function ACF in R-package stats. For functional observations, this problem can be done by applying autocorrelation-type measures to suitable scalar summaries by principal component scores obtained from the curves. However, constructing a practical tool to verify the strong mixing condition remains an open question for future research. Of course the construction of this partiocal tool enhances the feasibility of our model. Overall, the practical value of the proposed methodology is illustrated through the analysis of a real monthly electricity consumption dataset. The empirical study compares the proposed functional LARE predictor with the functional Least Squares Relative Error (LSRE) estimator and the classical functional Nadaraya–Watson conditional expectation predictor. When the data are free from anomalous observations, all competing methods provide satisfactory forecasts, with the proposed LARE estimator achieving the smallest prediction error. Its advantage becomes substantially more pronounced in the presence of contaminated observations, where the predictive performance of the least-squares-based methods deteriorates markedly, whereas the LARE estimator remains stable and accurate. These results clearly demonstrate that the proposed approach successfully combines predictive efficiency with robustness, making it particularly suitable for forecasting functional time series exhibiting outliers or heavy-tailed behaviour.
Several directions deserve further investigation. An important extension is the development of robust functional LARE estimators based on local k-nearest-neighbour smoothing or semiparametric regression models for dependent functional data. Another promising research direction concerns the analysis of partially observed or incomplete functional time series. Extending the proposed methodology to accommodate missing or censored trajectories would further enhance its practical applicability and could be developed by combining the LARE framework with modern techniques for incomplete functional data, including likelihood-based approaches, inverse-probability weighting, and semiparametric estimation methods.