Next Article in Journal
A Novel Meshfree Approach with a Radial Polynomial for Solving Nonhomogeneous Partial Differential Equations
Previous Article in Journal
A New Look at the Single Ladder Problem (SLP) via Integer Parametric Solutions to the Corresponding Quartic Equation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Initialization Methods for Multiple Seasonal Holt–Winters Forecasting Models

by
Oscar Trull
1,*,
Juan Carlos García-Díaz
1 and
Alicia Troncoso
2
1
Department of Applied Statistics and Operational Research and Quality, Universitat Politècnica de València, 46022 Valencia, Spain
2
Department of Computer Science, Pablo de Olavide University, 41013 Sevilla, Spain
*
Author to whom correspondence should be addressed.
Mathematics 2020, 8(2), 268; https://doi.org/10.3390/math8020268
Submission received: 8 January 2020 / Revised: 7 February 2020 / Accepted: 13 February 2020 / Published: 18 February 2020
(This article belongs to the Section Financial Mathematics)

Abstract

:
The Holt–Winters models are one of the most popular forecasting algorithms. As well-known, these models are recursive and thus, an initialization value is needed to feed the model, being that a proper initialization of the Holt–Winters models is crucial for obtaining a good accuracy of the predictions. Moreover, the introduction of multiple seasonal Holt–Winters models requires a new development of methods for seed initialization and obtaining initial values. This work proposes new initialization methods based on the adaptation of the traditional methods developed for a single seasonality in order to include multiple seasonalities. Thus, new methods to initialize the level, trend, and seasonality in multiple seasonal Holt–Winters models are presented. These new methods are tested with an application for electricity demand in Spain and analyzed for their impact on the accuracy of forecasts. As a consequence of the analysis carried out, which initialization method to use for the level, trend, and seasonality in multiple seasonal Holt–Winters models with an additive and multiplicative trend is provided.

1. Introduction

Exponential smoothing methods are widely used worldwide in time series forecasting, especially in financial and energy forecasting [1,2]. These methods smooth the observed values of a time series, using an exponentially downward weighting strategy giving more weight to recent values compared to older values. Weights decrease geometrically over past observations. The most commonly used methods are: Simple exponential smoothing for the series that does not show any trend, or with a locally stable mean, having a single smoothing parameter α; double seasonal exponential smoothing (also known as Holt’s method [3]) for trend-having series with two smoothing parameters: α and γ; finally, triple exponential smoothing (also known as Holt–Winters [4]) for the series with a trend and seasonal component, with α, γ, and δ as smoothing parameters. The smoothing parameters are bounded in the interval [0, 1], where the closer to 0 means the more weight of the old values against the newer ones.
The multiple seasonal Holt–Winters models (nHWT) outperform former Holt–Winters methods by including several seasonalities nested in the model. This development has been driven by the necessity of improving forecasts, especially in energy planning, where system operators need accurate forecasts. Hong [5] determines how a 1% improvement in the forecast accuracy can save up to $600,000 per year in a 1 GW power station.
However, these new forecasting methods are recursive and based on initial values, and the performance of the models highly depend on those initial values. Thus, new initialization methods to include multiple seasonality must be developed. Another question is then raised: Is there any method that outperforms the rest?
This article intends to provide answers to these questions. Hence, new initialization methods are proposed for nHWT models and their performance is analyzed for forecast accuracy by using the Spanish hourly electricity demand.
Holt–Winters models were formerly introduced in the 1960s and have been very commonly used in forecasting techniques and signal processing. The Holt–Winters model (also known as triple exponential smoothing) introduced by Winters [4] consists of three smoothing equations and a forecasting equation as shown in Equations (1)–(4):
Level :   S t = α ( X t I t s ) + ( 1 α ) ( S t 1 + T t 1 )
Trend :   T t = γ ( S t S t 1 ) + ( 1 γ ) T t 1
Seasonality :   I t = δ ( X t S t ) + ( 1 δ ) I t 1
Forecasting :   X ^ t ( k ) = ( S t + k   T t ) I t s + k
where α, γ, and δ are the smoothing parameters, and S t , T t , and I t are the smoothing equations known as level, trend, and seasonality. The information from the observed values ( X t ) is projected through a forecasting Equation (4) k steps ahead to obtain predictions ( X ^ t   ( k ) ).
Taylor [6,7] introduced the double and triple seasonal Holt–Winters models (HWT). These models are characterized by capturing the information contained in the seasonal component, split into several seasonalities of different lengths, as well as including an adjustment of the forecast including the first autocorrelation error. García-Díaz and Trull [8] generalized these models to adapt to an indeterminate number of seasonalities, proposing the multiple seasonal Holt–Winters models (nHWT).
The trend and seasonal equations can be expressed in an additive or multiplicative form. The way the equations are combined allow a total of 30 possible combinations. The nomenclature used to name the models is based on three letters: The first to indicate the trend method, the second to indicate the seasonality method, and a third to indicate if the model has an adjustment using the first order autocorrelation error, as shown in Table 1. Additionally, the seasonalities used are indicated by adding subscripts with period lengths.
The notation used is based on the following criteria: The first letter stands for the trend method (N: None, A: Additive, M: Multiplicative, d: Damped Additive, and D: Damped Multiplicative). The second letter stands for the seasonality method (N: None, A: Additive, and M: Multiplicative). The third letter is used to designate if the model has an AR (1) adjustment (C: Adjusted, L: Not adjusted).
As an example, the AMC24,168 model is a model with an additive trend and multiplicative seasonality; the model is adjusted by using the first-order autocorrelation error, and it has two seasonalities: One daily (subscript 24) and one weekly (subscript 168). The equations defining the AMC24,168 model are described in Equations (5)–(9). The general formulae of all possible models depending on the trend and seasonal type can be found in Appendix A:
S t = α ( X t I t 24 ( 24 ) I t 168 ( 168 ) ) + ( 1 α ) ( S t 1 + T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) T t 1
I t ( 24 ) = δ ( 24 ) ( X t S t I t 168 ( 168 ) ) + ( 1 δ ( 24 ) ) I t 1 ( 24 )
I t ( 168 ) = δ ( 168 ) ( X t S t I t 24 ( 24 ) ) + ( 1 δ ( 168 ) ) I t 1 ( 168 )
X ^ t ( k ) = ( S t + k   T t ) I t 24 + k ( 24 ) I t 168 + k ( 168 ) + φ A R k ε t
where the former seasonal equation I t now splits into I t ( s i ) and δ splits into δ ( s i ) , s i being the seasonal periods considered, s 1 = 24 and s 2 = 168 . Here, the value φ A R is the adjustment factor to include the first-order autocorrelation error ( ε t ).
The rest of the paper is organized as follows: In Section 2, the previous literature is analyzed; in Section 3 the initialization methods are described; in Section 4, an analysis is carried out and the results obtained are described; and in Section 5, these results are discussed. Section 6 lists the conclusions reached.

2. Related Work

The Holt–Winters models are recursive, and thus an initialization value is needed to feed the model. With the development of new models, it is mandatory to define new initialization methods for obtaining the initial values of the smoothing equations, considering that the older methods were defined only for single seasonal models. These initialization methods also depend on the method used for trend and seasonality.
The first methods of obtaining initial values date back to the proposal made by Winters [4] with the definition of triple exponential smoothing models. (Do not confuse triple exponential smoothing, with triple seasonal exponential smoothing, the former being a reference to the use of three equations, while the latter refers to the use of three seasonalities). In [4], the initial value of the trend (T0) is calculated as the slope between the average of the last available full period q and the first, as indicated by Equation (10), where the only seasonality is of length s.
T 0 = D ¯ q   D ¯ 1 ( q 1 ) s
Here, the value of D ¯ 1 indicates the average value for the first period and D ¯ q indicates the average value for the last period considered q. In many cases, using the first two periods (that is, q = 2) is sufficient [9]. Granger and Newbold [10] proposed leaving the trend in values of 0 for additive trend methods and 1 for multiplicative trend methods. In this way, the slope adjusts itself to the trend value.
The previous work of Holt [3,11] and Brown [12] in single and double exponential smoothing did not require calculations of initial values external to the model. Makridakis, Wheelright, and Hyndman [9] proposed a new method of calculating the trend and seasonality. Bowerman, O’Connell and Pack [13], and Bowerman, O’Connell, and Köhler [14] proposed a regression method where they consider that the intercept is the level and the slope is the trend. This method is criticized by Hyndman [15] for the bias it introduces. Rasmussen [16] proposed obtaining initial values through minimization. With the emergence of multiple seasonal models, new initialization methods were introduced [6,7], although some authors prefer not to use them [17]. Taylor introduced a new initialization method of the level and trend applied to double seasonal Holt–Winters in [6]. In particular, the seasonality is initialized as the division of the simple values over the moving average of the period (called the “simple” method), and the level (S0) is obtained once the series trend has been eliminated. It consists in first obtaining the trend of the series and then the level, as seen in Equation (11):
S 0 =   D ¯ 1 s m + 1 2 T 0
where s m is the longest seasonality. This scheme to initialize the level was also adopted by Hyndman et al. [18]. Hyndman introduced new initialization methods incorporated in the exponential smoothing methodology based on state spaces and included them in the “forecast” package of the statistical software R. Trull, García-Díaz, and Troncoso [19] also used a series decomposition using STL methods of various seasonality, in order to obtain initial values in discrete seasonality.
Some papers [20,21,22] analyze the initial values but very succinctly. Segura and Vercher [23] collect the information about the initialization methods and perform an analysis similar to that carried out by Makridakis and Hibon [24]. They conclude that when the parameters are optimized, it is not possible to determine significant differences between the different initialization methods.
After an exhaustive review of these previously published works, it can be concluded that the analysis of the initialization methods is not very extensive in the literature. This fact justifies the need for research in the topic described in this paper.

3. Materials and Methods

The way to obtain the initial values must match the trend and seasonal method, as it would impact later on the accuracy of the model. The addition of more seasonal patterns in the model requires newer methods of obtaining the initial values or seeds. Therefore, several methods depending on the trend and seasonal method have been implemented. This paper proposes new initialization methods for multiple seasonalities based on the previous methods, which were defined for a single seasonal pattern.
The proposed methods for the initialization of the Holt–Winters models are separated into three groups. The first ones calculate the seeds for the level and trend separately. The last one implements each seasonality separately. The latter first obtains a seed, as the trend, and then obtains another one on a recurring basis, such as that of the level.

3.1. Level Methods

The level initialization basically consists in determining the longest period, or the longest seasonality ( s m ) and determining the initial values around that point, by using the moving average (adapted from Holt [3]) or the average (adapted from Winters [4]). Williams and Miller [25] used the first value of the series for the level. This method is included although it remains unchanged for the further comparative analysis in Section 4. Table 2 shows the adapted methods to obtain the initial value of the level ( S 0 ).

3.2. Trend Methods

Based on Winters’ method [4], a new initialization method has been developed to be able to include more than one seasonality in the model, according to the contribution to the trend of smaller seasonality, as indicated [24]. These proposals (methods overall and two periods) are shown in Table 3 along with the methods published in [6,26] for the further comparative analysis in Section 4. T 0 i is an intermediate step where individual contributions are calculated in each period of length s i . The average of all of them will be taken into account, counting the maximum number of periods q for the overall case, and only two periods for that special case ( q = 2 ). The seasonality of greater length is used as the basis of calculation. The value of s m indicates the length of the longest seasonal period considered in the model. The rest is calculated in the form of differences. The value s p indicates the length of the minor of the periods considered. D 12 indicates differences in values for the first two periods, while D i refers to differences in the period considered. Finally, the average of the contributions is calculated to obtain the value of T 0 .

3.3. Seasonality Calculation Methods

The first methods determined for the calculation were developed by Winters [4]. The calculation of seasonality consists in calculating the series averages over the series without a trend. When it comes to more than one seasonality that are modeled annually, as in nHWT, it is necessary to avoid duplication of the effects of seasonality. Thus, based on Winters’ method [4], we propose to obtain the seasonal indices I t s i ( s i ) for each seasonality ( i ) of length s i as described in Equations (12)–(16):
I t s i ( i ) = { I * t s 1 ( i ) ,     i = 1 I t s i * ( i ) j = 1 i 1 I t s j * ( i ) ,   i > 1
with the individual seasonal indices,
I * t s i ( i ) = 1 q i I t s i ( i ) ,   t = 1 , , s i
I t s i ( i ) = 1 s i I t , j ( j ) ,   j = 1 , , q i
I t , j ( i ) = X t D ¯ j i ) ( s i + 1 2 i ) T 0 , j = 1 , , s i , t = j , j + s i , , ( q i 1 ) s i
D ¯ j ( i ) = 1 q i k = 1 q i X t , j = 1 , , s i ;   t = j , j + s i , , j + ( q i 1 ) s i
where q i is the maximum number of complete cycles of length s i that exist in the series. i refers to the seasonality considered, so that i   =   1 , ,   n s .
Brockwell and Davis [27] proposed another method, in which the calculation of seasonality is done by obtaining the weights of the series against the average values of the cyclic pattern. This methodology is adopted by the National Institute of Standards and Technology (NIST) [28]. This method has also been adapted to multiple seasonality, and the proposed method is described in the following steps:
Step 1:
For each seasonality, it is necessary to reorganize the data and obtain the means in each internal position within the seasonality as the average of the values obtained. In this way, the values A m ( i ) are obtained, for each seasonality of length s i and that occurs n q times in the data series, as shown in Equation (17):
A m ( i ) = j = 1 s i X ( m 1 ) * s i + j s i ,   m = 1 , , n q
Step 2:
For each seasonality, the proportion of the series over the average is obtained. There are m i occurrences of seasonal cycles in the range considered of length s i .
12q
1 X 1 / A 1 ( i ) X s i + 1 / A 2 ( i ) X s i + 1 / A 2 ( i )
s i X s i / A 1 ( i ) X 2 s i / A 2 ( i ) X m 1 s i + 1 / A m i ( i )
Step 3:
The provisional seasonal indices of each seasonality on the series are obtained as follows:
I 1 s i * ( i ) = X 1 A 1 ( i ) + X s i + 1 A 2 ( i ) + + X ( m i 1 ) s i + 1 A m i ( i ) m i
I 0 * ( i ) = X s i A 1 ( i ) + X 2 s i A 2 ( i ) + + X m i s i + 1 A m i ( i ) m i
Step 4:
The definitive seasonal indices, shown in Equation (18) are obtained taking into account that they are nested, and therefore the seasonal indices by removing the first one, need to compensate for the effect produced in the indices considered prior to the one calculated.
I t s i ( i ) = { I * t s 1 ( i ) ,     i = 1 ,   t = 1 , s i I t s i * ( i ) j = 1 i 1 I t s j * ( i ) ,   i > 1 ,   t = 1 , s i
Finally, the initialization method proposed by Granger and Newbold [26], named the “normal” method, has been adapted, where the values of the first cycle are divided by their average. This proposal is described by Equations (19) and (20):
I * t s i ( i ) = D t D ¯ s i ,   t = 1 , , s i
I t s i ( i ) = { I * t s 1 ( i ) ,     i = 1 I t s i * ( i ) j = 1 i 1 I t s j * ( j ) ,   i > 1

4. Results

The proposed new methods and older methods published in [6,25,26] were applied to the hourly electricity demand series in Spain in the period 1999 to 2004. Figure 1 shows the time series worked. This period is characterized by strong continued growth and marked seasonality. This will allow working with models with clear seasonality and trend.
The analysis has been raised in the form of an experimental design. The main factors to analyze are the different methods to estimate the initial values of level, trend, and seasonality. It has been used as two seasonal patterns. It is important to note that, when performing this analysis, the influence of the meteorological variables has been considered as a noise factor, so that windows have been created in the four seasons of the year where the analysis was performed. Within the same context, several replicas of the analysis have been included, using the different years.
The response variables used were the MAPE (see Equation (20)), an indicator of forecast accuracy widely used in the time series analysis [29]. To obtain the response variable, the seven-week series have been used randomly extracted from the series, although always taking into account that they belong to a specific season of the year—having at least six series in each seasonal period and each year.
M A P E ( % ) = 100 1 h h | X ^ t X t | | X t |
The process of comparing the initial values needs a specific methodology, since once the parameter optimization is performed, the differences between them are lost [9,24]. This situation can be avoided by performing the analysis based on the forecasts directly from the initial values and without adjusting. It is also necessary that the model does not cushion the results, which implies that the parameters used must be α = 0 ,   γ = 0 , and δ ( i ) = 0 for all seasons. Table 4 shows all methods both proposed and published in the literature that will be used to initialize the level, trend, and seasonality factors of nHWT models.
The names used are consistent with the methods presented in the previous section. In addition, they have been carried out in four different years, which is an additional factor to consider. The models studied have been A M C 24 , 168 , A A C 24 , 168 , M A C 24 , 168 , and M M C 24 , 168 .
The design of experiments includes 4096 tests, three controllable multilevel factors, and a noise factor that is the period of the year replicated for four different years. This study is shown in Table 5.
The first action taken, regardless of the design, was to be clear if there are significant differences between the models and from there determine which options to use. The result is shown in Figure 2, where you can see how the groups with additive trend differ significantly from the groups with multiplicative trend. Thus, the design will be separated in two to address each trend by its side.
Table 5 shows the results of the ANOVA (analysis of variance) obtained during the design. Only those significant factors and interactions are shown. This ANOVA has been carried out using the models with multiplicative trend and in response to the MAPE.
It is appreciated how the use of different seasonal methods is not significant, while the rest of the factors are. This model is also able to minimize the effect of the seasons of the year, becoming a nonsignificant factor, due to the influence of the trend being superior to that of the other parameters.
The same analysis performed on the models with additive trend offers slightly different results. Table 6 shows the ANOVA of this analysis. Only the significant factors and interactions are shown. The behavior is similar, although the additive trend methods are more sensitive to the annual period considered and the seasonality method considered.
The analysis for each factor is shown in the graphs of Figure 3. This figure shows the average graphs of the different factors separated by the trend method. MAPE (%) is displayed before optimizing. You can see how the behaviors are different depending on the trend. For those with multiplicative trend only the method proposed by Taylor is significantly different, both for the level and for the trend, but not for the seasonality. However, for additive trend methods, there are differences in all cases. Seasonal values in additive trend methods show differences between them, with the simple method and NIST being the best results.
Following these results, the values obtained during the experiment were analyzed, and each of the analyzed factors was studied separately.

4.1. Trend Analysis

The trend determines the behavior of the series in the long term. Using the seven-week series, this influence is remarkable. The models that include multiplicative trend obtain results for the trend close to 1. It is difficult to assess this situation. However, with the additive trend models, more information can be obtained. The distribution of the initial values for the additive trend is shown in Figure 4. It should be noted that the initial value of the Newbold method is always 0, and that the overall method has little variability. This is not the case with the two-period method. This tells us that the larger the set of data we take for the calculation of initial values, the more the variability is reduced.
Taylor’s method has a different behavior. Its variability is much greater than the rest. This is in contrast to using only the first two periods, in addition to introducing the contribution of the minor seasonality to obtain the overall trend.

4.2. Level Analysis

The analysis on the level shown in Figure 5 reveals that the level values in the additive trend models are close. However, following what has been verified in the ANOVA, they are clearly significant when determining the accuracy of the model. The fact that Taylor’s method for the level is mixed, and that the trend has been previously calculated, causes this method to decrease variability, transferring it to the trend. For cases of multiplicative trend, the results are very similar to those obtained in this analysis.

4.3. Seasonality Analysis

The ANOVA indicates that there are significant differences only in the additive trend models. Therefore, this analysis focuses on these models. There are two large groups between which you can include the original adapted Winters method: The NIST method and the simple adapted one. The analysis focuses on these two methods—simple and Winters—and the results obtained with the AMC24,168 model have been used. Therefore, the initial values for the 24- and 168-hour length seasonality are shown. Figure 6 shows the distribution of the initial values for these seasonalities using the simple method. Similarly, Figure 7 reflects this same distribution but using the Winters method.
It can be seen how the simple method has a lower variability in obtaining the seasonal indices of 24 hours, which is accompanied by a lower variability in the seasonal index of 168 hours. This indicates that the simple method ensures that the initial values are better suited to the seasonal patterns shown in the series. That is why it shows a smaller MAPE series. Moreover, you can see how the daily seasonal index is the primary index, and the weekly index has to be adapted according to the series. You might think that this situation occurs by the method of obtaining the initial values, where the first seasonality is considered the daily seasonality. However, we have performed tests where the first seasonality considered is the weekly one, and the results are the same.

5. Discussion

As a result of the analyses carried out in the study, it can be seen how the use of one or another method of obtaining initial values can greatly affect the accuracy of the forecasts. Although once the values of the parameters are optimized, these differences can be minimal (as other authors already describe), their influence on accuracy is clear. As a consequence, the parameters may not be optimal starting from unsuitable initial values, which complicates the optimization of the model in the adjustment, and later, in the forecasts.
The first impression is to see how multiplicative trend models start with a much higher MAPE than additive trend models do. In principle, it could be thought that it is due to the trend method used, but if the MAPE values are observed in Figure 3b, it is observed how this is not the case, but the accuracy is worsened by the rest of the equations with the trend. Clearly, the work of the parameters in this case is to mitigate the effect of the initial seasonal and level values. It has also been observed that the result of the MAPE depends a lot on the trend and seasonality methods used. This does not mean that one method is better than another method, but there are differences between them at the initial state that the model must deal with. For each group of methods, we tried to locate differences within the trend, level, and seasonal methods, looking for the MAPE of the model without optimizing. The cases of multiplicative trend, for example, do not show large differences between initialization methods. On the contrary, the methods that use the additive trend do show a great dependence on how to obtain the initial values. Another factor to highlight is the behavior of seasonal indices. Depending on the method, a greater or lesser variability can be observed.
Thus, for the multiple seasonal methods of additive trend it is proposed to use the Taylor method for the level, the overall method for the trend, and the simple method or that of the NIST for seasonality. For models with a multiplicative trend, the use of the average method for the level, the Granger and Newbold method for the trend, and any of the methods proposed for seasonality are proposed.

6. Conclusions

In this article, we have presented new methods of obtaining initial values for multiple seasonal Holt–Winters models. These methods are based on the adaptation of existing methods for models with a single seasonality. In addition, a comparative analysis between our proposals and well-known methods published in the literature has been carried out in order to determine their influence on the accuracy of the models. All these initialization methods have been applied to the prediction of the electricity demand time series in Spain, in a period between 1999 and 2004. The characteristics of the series allow all methods to be analyzed effectively. An experimental design has been performed in which MAPE has been analyzed as a response variable, using the different initialization methods of the smoothing equations as factors to influence the response variable. The results show that the influence of the methods of obtaining initial values is greater on multiple seasonal Holt–Winters models with an additive trend. Finally, and based on the results obtained, a proposal on which method of initialization to use has been made.

Author Contributions

Conceptualization, O.T. and J.C.G.-D.; methodology, O.T.; software, O.T.; supervision, J.C.G.-D.; validation, A. Troncoso; writing—original draft, O.T.; writing—review and editing, J.C.G.-D. and A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors gratefully acknowledge the comments and suggestions made by reviewers, which have greatly enriched this document.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

The multiple seasonal Holt–Winters formulae are shown in Table A1. They are organized according to the trend (rows) and seasonal method (columns), as described in [8].
Table A1. Multiple seasonal methods equations.
Table A1. Multiple seasonal methods equations.
TrendTrend
NoneAdditiveDamped AdditiveMultiplicativeDamped Multiplicative
SeasonalityNone S t =   α X t + ( 1 α ) S t 1
X ^ t ( k ) =   S t + φ A R k ε t
S t =   α X t + ( 1 α ) ( S t 1 + T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) T t 1
X ^ t ( k ) =   S t + k T t + φ A R k ε t
S t =   α X t + ( 1 α ) ( S t 1 + ϕ T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) ϕ T t 1
X ^ t ( k ) =   S t + T t n = 1 k ϕ n + φ A R k ε t
S t =   α X t + ( 1 α ) ( S t 1 R t 1 )
R t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1
X ^ t ( k ) =   S t R t k + φ A R k ε t
S t =   α X t + ( 1 α ) ( S t 1 R t 1 ϕ )
R t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1 ϕ
X ^ t ( k ) =   S t R t j = 1 k ϕ j + φ A R k ε t
Additive S t =   α ( X t i I t s i ( i ) ) + ( 1 α ) S t 1
I t ( i ) = δ ( i ) ( X t S t j i I t s j ( j ) ) + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t + i I t s i + k ( i ) + φ A R k ε t
S t =   α ( X t i I t s i ( i ) ) + ( 1 α ) ( S t 1 + T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) T t 1
I t ( i ) = δ ( i ) ( X t S t j i I t s j ( j ) ) + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t + k T t + i I t s i + k ( i ) + φ A R k ε t
S t =   α ( X t i I t s i ( i ) ) + ( 1 α ) ( S t 1 + ϕ T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) ϕ T t 1
I t ( i ) = δ ( i ) ( X t S t j i I t s j ( j ) ) + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t + T t n = 1 k ϕ n + i I t s i + k ( i ) + φ A R k ε t
S t =   α ( X t i I t s i ( i ) ) + ( 1 α ) ( S t 1 R t 1 )
R t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1
I t ( i ) = δ ( i ) ( X t S t j i I t s j ( j ) ) + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t R t k + i I t s i + k ( i ) + φ A R k ε t
S t =   α ( X t i I t s i ( i ) ) + ( 1 α ) ( S t 1 R t 1 ϕ )
R t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1 ϕ
I t ( i ) = δ ( i ) ( X t S t j i I t s j ( j ) ) + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t R t j = 1 k ϕ j + i I t s i + k ( i ) +
Damped Multiplicative S t = α X t i I t s i ( i ) + ( 1 α ) S t 1
I t ( i ) = δ ( i ) X t S t j i I t s j ( j )   + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   S t i I t s i + k ( i ) + φ A R k ε t
S t = α X t i I t s i ( i ) + ( 1 α ) ( S t 1 + T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) T t 1
I t ( i ) = δ ( i ) X t S t j i I t s j ( j )   + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   ( S t + k T t ) i I t s i + k ( i ) + φ A R k ε t
S t = α X t i I t s i ( i ) + ( 1 α ) ( S t 1 + ϕ T t 1 )
T t = γ ( S t S t 1 ) + ( 1 γ ) ϕ T t 1
I t ( i ) = δ ( i ) X t S t j i I t s j ( j )   + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   ( S t + T t n = 1 k ϕ n ) i I t s i + k ( i ) + φ A R k ε t
S t = α X t i I t s i ( i ) + ( 1 α ) ( S t 1 R t 1 )
T t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1
I t ( i ) = δ ( i ) X t S t j i I t s j ( j )   + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   ( S t R t k ) i I t s i + k ( i ) + φ A R k ε t
S t = α X t i I t s i ( i ) + ( 1 α ) ( S t 1 R t 1 ϕ )
R t = γ ( S t / S t 1 ) + ( 1 γ ) R t 1 ϕ
I t ( i ) = δ ( i ) X t S t j i I t s j ( j )   + ( 1 δ ( i ) ) I t s i ( i )
X ^ t ( k ) =   ( S t R t j = 1 k ϕ j ) i I t s i + k ( i ) + φ A R k ε t
Although they share a common underlaying structure, differences are notable in the equations. S t stands for the level equation. T t stands for an additive trend smoothing equation, whereas R t stands for a multiplicative one. This name has been chosen according to Pegels’ classification. I t ( i ) are the seasonal indices; there are as many indices as seasonalities considered. The superscript ( i ) stands for the seasonality of length s i considered. α , β , and δ ( i ) are the smoothing parameters. X t are the observed values and X ^ t ( k ) are the k-ahead forecasted values. The factor ϕ stands for the damping factor when using a damping trend, regardless of it being additive or multiplicative. φ A R is the factor of the adjustment with the first autocorrelation error. When the factor is null, the model does not include this adjustment. ε t is the one-step-ahead forecasting error.

References

  1. Weron, R. Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach; John Wiley & Sons, Ltd.: Chichester, UK, 2006; ISBN 978-0-470-05753-7. [Google Scholar]
  2. Weron, R. Electricity price forecasting: A review of the state-of-the-art with a look into the future. Int. J. Forecast. 2014, 30, 1030–1081. [Google Scholar] [CrossRef] [Green Version]
  3. Holt, C.C. Forecasting seasonals and trends by exponentially weighted averages. In Proceedings of the O.N.R. Memorandum, Carnegie Institute of Technology, Pittsburgh 1957; Volume 52. [Google Scholar]
  4. Winters, P.R. Forecasting sales by exponentially weighted moving averages. Management 1960, 6, 324–342. [Google Scholar]
  5. Hong, T. Crystal Ball Lessons in Predictive Analytics. Energybiz 2015, 12, 35–37. [Google Scholar]
  6. Taylor, J.W. Short-term electricity demand forecasting using double seasonal exponential smoothing. J. Oper. Res. Soc. 2003, 54, 799–805. [Google Scholar] [CrossRef]
  7. Taylor, J.W. Triple seasonal methods for short-term electricity demand forecasting. Eur. J. Oper. Res. 2010, 204, 139–152. [Google Scholar] [CrossRef] [Green Version]
  8. García-Díaz, J.C.; Trull, O. Competitive Models for the Spanish Short-Term Electricity Demand Forecasting. In Time Series Analysis and Forecasting: Selected Contributions from the ITISE Conference; Rojas, I., Pomares, H., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 217–231. ISBN 978-3-319-28725-6. [Google Scholar]
  9. Makridakis, S.; Wheelwright, S.C.; Hyndman, R.J. Forecasting: Methods and Applications; John Willey and Sons, Inc.: Chichester, UK, 1998. [Google Scholar]
  10. Granger, C.W.J.; Newbold, P. Forecasting Economic Time Series, 1st ed.; Academic Press Inc.: New York, NY, USA, 1977; ISBN 0-12-295150-6. [Google Scholar]
  11. Holt, C.C. Forecasting seasonals and trends by exponentially weighted moving averages. Int. J. Forecast. 2004, 20, 5–10. [Google Scholar] [CrossRef]
  12. Brown, R.G. Statistical Forecasting for Inventory Control; McGraw-Hill: New York, NY, USA, 1959. [Google Scholar]
  13. Bowerman, B.L.; Koehler, A.B.; Pack, D.J. Forecasting time series with increasing seasonal variation. J. Forecast. 1990, 9, 419–436. [Google Scholar] [CrossRef]
  14. Bowerman, B.L.; O’Connell, R.T.; Koehler, A.B. Forecasting, Time Series, and Regression: An Applied Approach; Thomson Brooks/Cole: Belmot, CA, USA, 2005; ISBN 0534409776. [Google Scholar]
  15. Hyndman, R.J. Initializing the Holt–Winters Method. Available online: https://robjhyndman.com/hyndsight/hw-initialization/ (accessed on 10 August 2019).
  16. Rasmussen, R. On time series data and optimal parameters. Omega 2004, 32, 111–120. [Google Scholar] [CrossRef]
  17. Souza, R.C.; Barros, M.; Miranda, C.V.C. Short term load forecasting using double seasonal exponential smoothing and interventions to account for holidays and temperature effects. Tlaio Ii-2 Do Taller Lat. Iberoam. Investig. Oper. Acapulco México 2007, 1–8. [Google Scholar]
  18. Hyndman, R.J.; Koehler, A.B.; Ord, J.K.; Snyder, R.D. Forecasting with Exponential Smoothing: The State Space Approach; Springer, Ed.; Springer: Berlin, Germany, 2008; ISBN 978-3-540-71916-8. [Google Scholar]
  19. Trull, O.; García-Díaz, J.C.; Troncoso, A. Application of Discrete-Interval Moving Seasonalities to Spanish Electricity Demand Forecasting during Easter. Energies 2019, 12, 1083. [Google Scholar] [CrossRef] [Green Version]
  20. Kalekar, P. Time series forecasting using Holt–Winters exponential smoothing. Kanwal Rekhi Sch. Inf. Technol. 2004, 1–13. [Google Scholar]
  21. Montgomery, D.C.; Jennings, C.; Kulahci, M. Introduction to Time Series Analysis and Forecasting; John Wiley & Sons, Inc.: New Jersey, USA, 2008; ISBN 978-0471653974. [Google Scholar]
  22. Suppalakpanya, K.; Nikhom, R.; Booranawong, A.; Booranawong, T. An evaluation of Holt–Winters methods with different initial trend values for forecasting crude palm oil production and prices in Thailand. Suranaree J. Sci. Technol. 2019, 26, 13–22. [Google Scholar]
  23. Segura, J.V.; Vercher, E. A spreadsheet modeling approach to the Holt–Winters optimal forecasting. Eur. J. Oper. Res. 2001, 131, 375–388. [Google Scholar] [CrossRef]
  24. Makridakis, S.; Hibon, M. Exponential smoothing: The effect of initial values and loss functions on post-sample forecasting accuracy. Int. J. Forecast. 1991, 7, 317–330. [Google Scholar] [CrossRef]
  25. Williams, D.W.; Miller, D. Level-adjusted exponential smoothing for modeling planned discontinuities. Int. J. Forecast. 1999, 15, 273–289. [Google Scholar] [CrossRef]
  26. Granger, C.W.J.; Newbold, P. Forecasting Economic Time Series, 2nd ed.; Academic Press, Inc.: New York, NY, USA, 1986; ISBN 9780122951831. [Google Scholar]
  27. Brockwell, P.J.; Davis, R.A. Introduction to Time Series and Forecasting; Springer: New York, NY, USA, 2002. [Google Scholar]
  28. NIST/SEMATECH e-Handbook of Statistical Methods. Available online: http://www.itl.nist.gov/div898/handbook/ (accessed on 1 April 2012).
  29. Torres, J.; Fernández, A.M.; Troncoso, A.; Martínez-Álvarez, F. Deep Learning-Based Approach for Time Series Forecasting with Application to Electricity Load. In Biomedical Applications Based on Natural and Artificial Computing; Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Toledo Moreo, J., Adeli, H., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 203–212. [Google Scholar]
Figure 1. Spanish hourly electricity demand in the period 1998 to 2004.
Figure 1. Spanish hourly electricity demand in the period 1998 to 2004.
Mathematics 08 00268 g001
Figure 2. Means and Fisher’s LSD (least significant differences) diagram of the MAPE obtained against the nHWT models considered.
Figure 2. Means and Fisher’s LSD (least significant differences) diagram of the MAPE obtained against the nHWT models considered.
Mathematics 08 00268 g002
Figure 3. Mean graphs for the MAPE according to the initialization methods analyzed. Left column: Additive trend methods, right column: Multiplicative. From top to bottom: Level, trend, and seasonality. The levels used are those described in Table 4.
Figure 3. Mean graphs for the MAPE according to the initialization methods analyzed. Left column: Additive trend methods, right column: Multiplicative. From top to bottom: Level, trend, and seasonality. The levels used are those described in Table 4.
Mathematics 08 00268 g003
Figure 4. Distribution of initial values obtained for the trend in additive trend models A M C 24 , 168 and A A C 24 , 168 .
Figure 4. Distribution of initial values obtained for the trend in additive trend models A M C 24 , 168 and A A C 24 , 168 .
Mathematics 08 00268 g004
Figure 5. Distribution of the initial values obtained for the level in the additive trend models A M C 24 , 168 y A A C 24 , 168 .
Figure 5. Distribution of the initial values obtained for the level in the additive trend models A M C 24 , 168 y A A C 24 , 168 .
Mathematics 08 00268 g005
Figure 6. Distribution of the initial seasonal indices for the AMC24,168 model using the simple method. In the left part, the seasonality of 24 hours is used, and in the right part the seasonality of 168 hours is used. The central line represents the average of the values, regardless of the time of the year, while the shaded area represents the variability with ± standard deviation.
Figure 6. Distribution of the initial seasonal indices for the AMC24,168 model using the simple method. In the left part, the seasonality of 24 hours is used, and in the right part the seasonality of 168 hours is used. The central line represents the average of the values, regardless of the time of the year, while the shaded area represents the variability with ± standard deviation.
Mathematics 08 00268 g006
Figure 7. Distribution of the initial seasonal indices for the AMC24,168 model using the Winters method. In the left part, the seasonality of 24 hours is used, and in the right part the seasonality of 168 hours is used. The central line represents the average of the values, regardless of the time of the year, while the shaded area represents the variability with ± standard deviation.
Figure 7. Distribution of the initial seasonal indices for the AMC24,168 model using the Winters method. In the left part, the seasonality of 24 hours is used, and in the right part the seasonality of 168 hours is used. The central line represents the average of the values, regardless of the time of the year, while the shaded area represents the variability with ± standard deviation.
Mathematics 08 00268 g007
Table 1. Multiple seasonal Holt–Winters models’ nomenclature according to the trend and seasonal method.
Table 1. Multiple seasonal Holt–Winters models’ nomenclature according to the trend and seasonal method.
TrendSeasonal
AR (1) AdjustedNon-Adjusted
NoneAdditiveMultiplicativeNoneAdditiveMultiplicative
NoneNNCNACNMCNNLNALNML
AdditiveANCAACAMCANLAALAML
Damped AdditivedNCdACdMCdNLdALdML
MultiplicativeMNCMACMMCMNLMALMML
Damped MultiplicativeDNCDACDMCDNLDALDML
Table 2. Proposed methods and the method published in [25] for obtaining the initial value of the level in multiple-seasonal methods.
Table 2. Proposed methods and the method published in [25] for obtaining the initial value of the level in multiple-seasonal methods.
DenominationCalculation
Moving average adapted from Holt [3] S 0 = 1 S m [ X 1 + s m X 1 s m + X 2 + s m X 2 s m + + X 2 s m X s m s m ]
First value [25] S 0 = X 1
First period’s average adapted from Winters [4] S 0 = 1 s m X i s m
Table 3. Proposed methods and methods published in [6,25] for obtaining the initial value of the trend in multiple-seasonal methods.
Table 3. Proposed methods and methods published in [6,25] for obtaining the initial value of the trend in multiple-seasonal methods.
DenominationCalculation
Newbold [26] T 0 = 0 (additive)
T 0 = 1 (multiplicative)
Taylor [6] T 0 = ( D ¯ 1 D ¯ 2 s m + 1 2 s m D 12 2 s p ) 2
Overall and two periods method. Multiplicative. T 0 = i = 1 , , q T 0 i q ,
with T 0 i = { D ¯ q D ¯ 1 q i f s i = s m 1 s i D i s i i f r e s t
Overall and two periods method. Multiplicative. T 0 = 1 n s T 0 i ,
with T 0 i = { D ¯ q D ¯ 1 q i f s i = s m 1 s i D i s i i f r e s t
Table 4. The factors and initialization methods analyzed.
Table 4. The factors and initialization methods analyzed.
FactorTypeInitialization Methods
New MethodsOlder
LevelControllableMoving average, average First value [25], Taylor [6]
TrendControllableOverall, two periods Newbold [26], Taylor [6]
SeasonalityControllableNormal, Winters, NIST Simple [6]
Table 5. Analysis of the variance for the factors studied using the models with multiplicative trend.
Table 5. Analysis of the variance for the factors studied using the models with multiplicative trend.
SourceSum of SquaresdfMean SquareF-Ratiop-Value
Main effects
ALevel283.89394.636.660.0002
BTrend2.96E63984124.69240.760.0000
CSeasonality1099.633366.5225.790.0000
DModel19.36119.361.360.2432
ESeason91.29330.432.140.0931
Interactions
AB876.46997.38436.850.0000
BC300.32933.36912.350.0124
BE296.07932.89682.310.0138
CD189.57363.19034.450.0040
Residuals28483.0200414.2131
Total 2.98E62047
Table 6. Analysis of the variance for the factors studied using the models with additive trend, without adjustment.
Table 6. Analysis of the variance for the factors studied using the models with additive trend, without adjustment.
SourceSum of SquaresdfMean SquareF-ratiop-Value
Main effects
ALevel0.848530.2828495.590.0008
BTrend1.322830.4409388.710.0000
CSeasonality1864.543621.51412276.070.0000
DModel73.2721173.27211447.260.0000
ESeason1.190230.3967257.840.0000
Interactions
AE1.1907490.1323052.610.0053
BD1.167430.3891357.590.0000
CD299.458399.81921971.620.0000
Residuals102.21820190.0506281
Total 2345.212047

Share and Cite

MDPI and ACS Style

Trull, O.; García-Díaz, J.C.; Troncoso, A. Initialization Methods for Multiple Seasonal Holt–Winters Forecasting Models. Mathematics 2020, 8, 268. https://doi.org/10.3390/math8020268

AMA Style

Trull O, García-Díaz JC, Troncoso A. Initialization Methods for Multiple Seasonal Holt–Winters Forecasting Models. Mathematics. 2020; 8(2):268. https://doi.org/10.3390/math8020268

Chicago/Turabian Style

Trull, Oscar, Juan Carlos García-Díaz, and Alicia Troncoso. 2020. "Initialization Methods for Multiple Seasonal Holt–Winters Forecasting Models" Mathematics 8, no. 2: 268. https://doi.org/10.3390/math8020268

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop