Exponential smoothing approaches for prediction in real-time electricity markets

: The optimal design of offering strategies for wind power producers is commonly based on unconditional (and, hence, constant) expectation values for prices in real-time markets, directly deﬁning their loss function in a stochastic optimization framework. This is why it may certainly be advantageous to account for the seasonal and dynamic behavior of such prices, hence translating to time-varying loss functions. With that objective in mind, forecasting approaches relying on simple models that accommodate the seasonal and dynamic nature of real-time prices are derived and analyzed. These are all based on the well-known Holt–Winters model with a daily seasonal cycle, either in its conventional form or conditioned upon exogenous variables, such as: (i) day-ahead price; (ii) system load; and (iii) wind power penetration. The superiority of the proposed approach over a number of common benchmarks is subsequently demonstrated through an empirical investigation for the Nord Pool, mimicking practical forecasting for a three-year period over 2008–2011.


Introduction
In parallel with the rapid growth in electricity generation by renewable energy sources, producers are increasingly urged to sell their generation though the market.This has triggered the interest of both researchers and practitioners in proposing optimal bidding strategies for renewable energy producers as balance responsible parties (BRPs) in deregulated electricity markets.Especially, wind power appears to have a leading role among recently emerging renewable energy sources.The wind power producer's point of view will also be considered here for the sake of an example.Other market participants may be interested in the forecasting of regulation market quantities for optimization of their market participation strategies.Wind power production is a stochastic process with limited predictability on a day-ahead basis.Accordingly, the offering strategies of wind power producers are derived in a stochastic optimization framework.The resulting optimization problems aim at minimizing the expected costs induced by their (involuntary) participation in the real-time imbalance market (also referred to as regulation market), potentially also accounting for risk aversion [1][2][3][4][5][6][7][8].
The unit regulation costs (per MWh of imbalance) in the real-time market are dynamic and asymmetric [9].As shown by [10] in the general case and by [1] for wind power specifically, this makes common bidding procedures solely based on the expected generation for every lead time sub-optimal.Instead, the bid maximizing expected revenues is found to be a particular quantile of predictive production densities.The nominal level of this quantile is a direct function of expected unit regulation costs in the real-time market, also referred to as imbalance penalties.Despite their obvious impact on the performance of trading strategies, these quantities are often assumed deterministic and known [2] or model-based on long-term averages [3,6,7], hence disregarding the short-term dynamics of the real-time market.Under similar assumptions, [11] conclude that gaming in general cannot be profitable.Recently though, [4], [5] and [8] have taken into account short-term variations in the penalties with considerable benefits.The drawback of the approach of [5] and [8] is that their models cannot accommodate negative prices, even though they are a reality of many electricity markets.Furthermore, information that was not available before the market gate closure is used.In contrast, the results of [4] are obtained using the forecasting methodology described in the present paper, hence yielding optimal bids based entirely on predictions from readily available information prior to gate closure.
The objective of this paper is to rigorously model and predict imbalance penalties, at the lead times of interest, when trading wind power in a day-ahead market, in an exponential smoothing framework.The very nature of regulation markets makes that real-time electricity price modeling ought to differ substantially from conventional time series modeling approaches.Excessive volatility and skewness aside, anti-gaming policies have in many cases caused these prices to exhibit unique dynamic features.Firstly, the widely adopted dual pricing scheme for regulating power (which implies different pricing for producers in surplus and deficit) induces a regime-switching behavior in the prices, driven by the net balance of the system.Additionally, some markets have real-time prices that are bounded by the day-ahead price (e.g., the Danish and the Spanish ones) or capped in another manner (e.g., the Pennsylvania-New Jersey-Maryland-PJM, and the New England markets in the USA) to discourage gaming even further.This feature magnifies the state dependency of the prices, since they either share characteristics with the day-ahead prices or have their own unique dynamics.Furthermore, this policy arguably inflates the volatility in the real-time market through reduced supply.
Conditioning models for the real-time prices on the net balance of the whole system is paramount for capturing relevant price dynamics.This, in turn, makes popular time series models, like the seasonal Auto-Regressive Moving Average (ARMA) model used in [5], inadequate, since this type of model does not account for this regime-switching behavior.Olsson and Söder [12] introduced a Markov-switching seasonal ARIMA model with time-inhomogeneous transition probabilities for addressing this issue, though with the following pitfalls.Firstly, the transition probabilities are time-invariant, hence ignoring the short-term variations in state probabilities, while such variations are shown to be substantial in this paper.Secondly, the lack of auto-correlation between day-ahead lags causes the time-inhomogeneous transition probabilities to converge to the homogeneous ones rather quickly, and for lead times shorter than those required for bidding into a day-ahead market.Put differently, the transition probability matrices for lead times required for the day-ahead trading of wind power contain only the empirical steady-state distribution during the period on which the estimation is based.
The idea behind the prediction approach introduced here is to take advantage of the formulation of imbalance costs as the product of two variables: (i) a categorical one representing the sign of the net system balance; and (ii) a penalty part describing the magnitude of imbalance penalties when active.Combining predictions for these two variables by applying the law of total expectation then yields the expected imbalance costs.Both variables are modeled using Holt-Winters models [13] with a daily seasonal cycle, either in its conventional form or conditioned by exogenous variables.The proposed approach is to be evaluated against a climatology benchmark, for each individual variable and for the final expected imbalance penalties.
The remainder of the paper is structured as follows: Section 2 gives an overview of the empirical context of the paper and describes the data used for the analysis.Afterwards, the necessary definitions and data analysis are presented in Section 3. The models and parameter estimation procedures are given in Section 4, followed by the results of our empirical investigation in Section 5. Finally, concluding remarks are gathered in Section 6.

Specific Characteristics and Data for Nord Pool
Day-ahead electricity markets are the result of a general movement around the world towards deregulation in the electricity industry over the past two decades.Although the actual implementation varies between countries and regions, the basic functionalities remain similar among those who have adopted these policies.Even though emphasis is placed here on the Nord Pool electricity market in Scandinavia, the proposed models and forecasting methodologies may certainly be appropriate for other electricity markets (with some variations in forecast performance).After first presenting some of the specifics of the Nord Pool, the dataset available for our modeling and forecasting study is described in detail.

Nord Pool and the Danish Electricity Market
The Danish electricity market is a part of the Nord Pool market, which is the world's first multinational electricity market.It was founded by Statnett SF and Svenska Kraftnät (the Norwegian and Swedish Transmission System Operators (TSOs), respectively) in 1996.Since then, it has been gradually expanded to encompass Denmark, Finland and Estonia, as well.In 2002, physical exchange activities were transferred to a separate company, Nord Pool Spot ASA, which operates the markets.It is jointly owned by Statnett SF, Svenska Kraftnät (30% each), Energinet.dkand Fingrid Oy (20% each).Nord Pool's market share is one of the highest in the world with 72% of the total Nordic consumption traded on its markets in 2009 [14].In 2010 and 2011, the market share rose to 74% and 75%, respectively [15,16].
The market region is divided into 10 price areas, bordered by bottlenecks in the transmission grid and with internal transmission capacity practically infinite.Denmark comprises two of these areas, one on either side of the Storebaelt channel.
Nord Pool runs two different markets for the physical exchange of electricity, Elspot and Elbas.Elspot is a day-ahead market with gate closure at noon on the day before delivery.Here, producers and retailers bid for the sale and purchase of electricity in hourly intervals.Once the bids are collected, a system price is determined as the intersection between the aggregated supply and demand curves.The system price is the price at which the physical exchange is settled during hours where transmission across the grid bottlenecks does not reach capacity.Besides, the system price serves as a reference price for almost all financial derivatives linked to Nord Pool.In case the desired transmission across price area borders reaches its capacity, multiple area prices are defined.An area price is determined by the same procedure as the system price, though only considering the bids from the particular area, and the full usage of the connections to the surrounding areas as price-independent bids.Elbas is opened for trading once Elspot prices have been published and has gate closure one hour prior to delivery.Elbas is a bid-ask market where bids for either the purchase or sale of electricity are placed.The bids are prioritized according to price and submission time.They are settled at the bid price.The acceptance of a bid across price areas is subject to capacity availability.Almost the entire exchange takes place on Elspot, which is responsible for more than 99% of the total exchanged volume each year.A more detailed description of the market environment and price settlement is provided in [17].
In addition, the national TSOs each run a real-time market in their countries for balancing the transmission grid.Markets for supplier imbalances and retailer imbalances are run separately and with different pricing schemes.For the retailers, a single price is defined at which those short of their contracted volume buy the surplus of those having overestimated their consumption at the time.In contrast, two prices are defined on the suppliers' market.The producers short of their contracts buy their deficits at the up-regulation price, while those overproducing sell their surplus at the down-regulation price.The regulation prices are bounded by the Elspot prices, so that the up-regulation price can never deceed it and the down-regulation price can never exceed it.Furthermore, imbalances that negate the total system imbalance are not penalized.This implies that at any given time, either the up-regulation or the down-regulation price is equal to the spot price.

Available Data for the Study
The data for the empirical investigation covers the period from November, 2008, to December, 2011.The dataset includes hourly spot and regulation prices for the Western Danish price area of Elspot (DK-1) along with predicted system load, wind power production and spot prices for the same area.All forecasts are issued before noon on the day before delivery.They also have an hourly temporal resolution.The observed prices and the load forecasts are publicly available on the website of Nord Pool (http://www.nordpoolspot.com).The spot price forecast is obtained by the method described in [18], and the wind power forecasts originate from a commercially available wind power prediction software [19].Due to different currency conversion procedures between Nord Pool and Energinet.dk,prices are rounded off to the first decimal.

Problem Formulation and Data Analysis
The purpose of the data analysis that follows is to establish the desirable features of the models for imbalance costs and to identify relevant exogenous variables.Only results that appeared to deserve further inspection are presented.t denote the down-and up-regulation penalty during hour t, respectively, defined as:

Background and Variable Definition
[4], [3] and [1] all show that the bid W * t maximizing the expected hourly revenue of a price-taker wind power producer is: where is the inverse cumulative density function (cdf) of the wind power generation for the hour t.Furthermore, are the expected imbalance penalties, conditional on the information available before the gate closure of the spot market, χ t−k .In order to ease the notation, ψ t|t−k will be denoted ψ t from here on.For the same reason, The first two conditions are a result of the fact that real-time prices are bounded by the spot price, while the latter two conditions stem from the fact that only producers that contribute to the overall imbalance are penalized.From a producer's point of view, these conditions allow for the relationship between day-ahead and real-time markets to be categorized as potentially taking three discrete states.These are down-regulation hours (production surpluses penalized), non-regulation hours (imbalances not penalized) and up-regulation hours (production deficits penalized).They are mathematically defined as: during up-regulation hours 0 during hours without regulation −1 during down-regulation hours (10) For the system operator, these states are not necessarily the same, since the system operatoris working with a higher temporal resolution with the actual physical balance of the system.Such an actual physical balance can actually change sign within the hour and is seldom precisely zero.The hours without regulation thus comprise both hours of no physical regulation and hours where the balancing power has been inexpensive enough not to prompt a penalty for imbalances.However, since the producer's main objective is to maximize his revenue, regardless of the exact physical balance of the system, it is primarily price differences that are relevant to him.Consequently, the following modeling efforts are all done in terms of price differences and not of physical imbalance.
By applying the law of total expectation, Equations ( 4) and ( 5) can be rewritten as: This allows for partitioning the problem into the estimation of the probabilities of different regulation states, hereafter termed the imbalance sign, and the forecasting of the penalties conditional upon the imbalance sign.
Let us support a bit more of our decision to divide the problem in such a way.Firstly, it was found that the statistical models we designed were better at mimicking the actual behavior of observed penalties, for both down-and up-regulation cases.In parallel, such a division made it easier to incorporate exogenous effects into the models.For instance, the potential effect of predicted wind power generation on penalties is to differ for down-and up-regulation cases, since the characteristics of forecasting errors, which then induce imbalances, are known to be asymmetric [20].Secondly, this approach allows for a more intuitive approach for scenario generation by combining information on imbalance sign and conditional penalties.Note that one could alternatively consider this problem as a whole, though potentially requiring one to implement complex regime-switching approaches, which may not bring a substantial benefit [12].
From a modeling perspective, working with penalties, in contrast to actual prices, yields advantages, as well.Indeed, such penalties have a constant lower boundary at zero, which, to some extent, can mitigate high positive residuals.Most importantly though, the penalty forecasts are applicable at all horizons, both day-ahead and intra-day.Combined with the current available information about spot prices, they form a prediction for the regulation prices.Finally, a model for the penalties is more versatile in terms of applications.When, for instance, the strategy in [4] is extended, first to accommodate the price risk of a price taking producer and, subsequently, to a price maker, the problem is most easily solved by stochastic programming, which, in turn, calls for stochastic scenarios to be generated [21].Due to the hierarchical structure of the market, scenarios that respect the regulatory framework of the market are best found via predictions of the regulation penalties and not of the prices [22].
For estimation and analysis purposes, three additional variables are defined.Following standard estimation procedures for a multinomial regression model, I (ψ) t can be decomposed into a vector of binary variables as: such that: For the penalties, let: and let ψ (↓) t|>0 and ψ (↑) t|>0 be the corresponding observations.These are not defined during up-and down-regulation hours, respectively, and otherwise are equal to ψ (↓) t and ψ (↑) t , respectively.

Non-Stationarity
The penalty series, ψ (↑/↓) t|>0 , include a few spikes of such magnitude that they would induce biases in parameter estimates of our statistical models.These extremes are thus removed from the data set after being identified by the procedure described in [22].The unmodified time series are plotted in the top row of Figure 1, where the removed observations are marked with a cross.In total of 85 and 29 observations was removed from the up-and down-regulation penalty series, respectively.
Cleaned versions of the series are shown in the bottom row of the same figure.They reveal considerable time-variations in the first and second order moments of the penalties.The mean constantly fluctuates, and volatile periods with rather frequent price spikes are followed by periods of relative tranquility.
where 0 < λ < 1 is a smoothing parameter.Should the probabilities of each regulation scenario be constant over the period analyzed, I (↑/↓) t would oscillate around its mean I (↑/↓) with deviations inversely related to λ.However, as illustrated by Figure 2, this is not the case for the imbalance sign probabilities.The bottom two plots show the tracking of a series simulated from a trinomial distribution with probabilities of each instance equal to the empirical probabilities from Table 1.The top two plots, on the other hand, show the tracking of the actual occurrences of regulation in each direction.Forgetting these factors, λ = 0.99 and λ = 0.999 were applied for the two plots on the left and on the right, respectively.The horizontal lines represent the empirical probabilities for the whole period.For both values of λ, the observed series deviate considerably more from the empirical probabilities and seems to drift distinctively away from them over shorter periods.The plots therefore provide a clear indication that greater knowledge about the next day's imbalance sign can be obtained by considering more dynamic approaches to the modeling of such probabilities.

Seasonality
Mainly driven by the daily and weekly cycles of consumption, electricity prices are generally known to have the same seasonal cycles.It therefore seems natural to examine the seasonalities of I for each hour of the day and of the week relative to the corresponding empirical means.For the imbalance sign, there is an apparent diurnal variation for the up-and non-regulation hours.For the down-regulation hours, the diurnal variation is less distinctive, yet there seems to be some evidence of such behavior.Furthermore, the frequency of up-regulation hours seems to exhibit stronger diurnal variation during the weekends than during working days, whereas the opposite is observed for the non-regulation hours.The diurnal variation of the frequency of down-regulation hours seems to be quite consistent throughout the week.Penalties have an obvious diurnal seasonality, where up-regulation penalties are generally above average during the day and below average during the night, while down-regulation penalties exhibit the opposite pattern.Given the high share of hours where ψ (↑/↓) t|>0 is not defined, segmenting the penalties according to the hour of the week dilutes the data quite severely.The excessive fluctuations seen in the bottom-right plot of Figure 3 should therefore be interpreted with caution.Besides magnitude variations, daily seasonal cycles seem to be consistent throughout the entire week.

Exogenous Variables
Figure 4 illustrates the impact of exogenous variables deemed relevant for the imbalance sign and penalties.These plots are constructed by segmenting the data into 10 equally populated bins according to x-axis variable.The sign frequency, or average penalty, for each bin is plotted against the bin median.Along with the mean of each bin, 95% confidence intervals obtained by bootstrapping (see [23]) are shown.The top-left plot in Figure 4 shows the empirical frequencies of each imbalance sign as a function of predicted wind power penetration.Wind power penetration is defined as the ratio between predicted wind power production and predicted load.Our motivation to use such a variable, instead of actual production forecasts, is to account for the varying ability of wind power to affect the market outcome depending upon demand [24].The remaining three plots in Figure 4 illustrate the dependencies of average imbalance penalties upon predicted spot price (top right), load (bottom left) and wind power penetration (bottom right).
The top-left plot indicates a significant impact of predicted wind power penetration and imbalance sign.besides, the top-right plot shows that both penalties are significantly affected by the predicted spot price.Even though some of the middle points are not so different from their neighbors, there are non-negligible differences between points that are located further apart.Similar conclusions can be drawn for the impact of predicted load on up-regulation penalties and for the impact of predicted wind power penetration on down-regulation penalties.The predicted load, however, does not seem to have an influence on down-regulation penalties.Likewise, up-regulation penalties seem to be merely affected by predicted wind power penetration.
The previously demonstrated dynamic and seasonal variations of I (↑/↓) t and ψ (↑/↓) t|>0 are not taken into account here.This hence prevents any final conclusions to be drawn from the plots.The question of whether or not the imbalance sign and penalties are affected by these variables will be answered by examining whether a model including this information has superior forecasting skills compared to a model that does not account for it.

Holt-Winters Model for the Imbalance Sign and Penalties
The Holt-Winters model (HW model) is a pragmatic approach to model seasonal time series.The standard formulation of the HW model, suitable for time series with a single seasonal pattern, was introduced by [13].In [25], the HW model is extended to accommodate multiple seasonal patterns.The model can be formulated either as an additive or as a multiplicative one.The authors of [26] and [27] provide an excellent overview of these different possible formulations.In light of the vast existing literature on the generalities of HW models, the discussion is limited here to the relevant formulations used at various modeling stages.

S
(2) t = α S (2) (y t − (µ t + S (1) where s 1 and s 2 are the periods of seasonal components S (1) and S (2) , respectively, while α µ , α S (1) and α S (2) are smoothing parameters.After the updating step in Equations ( 18)-( 20), the k-step ahead prediction, y t+k|t , is given by: t−s 1 +k + S (2) Similarly, a multiplicative HW model for Y t with two seasonal cycles can be defined as: t−s 1 S (2) for which the definitions of s 1 and s 2 are the same as in the above, while: By defining the one step prediction error as: and following [28], the models can be made robust by defining: where g(•, τ ) is the Huber influence function: and by substituting y t for y t in Equations ( 18)- (20) and Equations ( 22)-( 24).In compliance with the common formulation of the HW model in the literature, Equations ( 18)-( 20) can be written on their more compact error-correction form as:

S
(2) t = S (2) It is readily seen that letting τ = ∞ yields a non-robust HW model.Should a single seasonal pattern be sufficient, Equations ( 20), ( 24) and ( 31) are simply omitted from the models.Correspondingly, the second seasonal term vanishes from the prediction Equations ( 25) and ( 21).

Conditional Holt-Winters Model
In order to account for the effects of external variables, e.g., predicted spot price, wind power penetration and load, the previously described HW models can be conditioned on exogenous variables.Let X t = [x 0 , x 1 , . ..] for t = [0, 1, . ..] be a variable on which Y t arbitrarily depends.Inspired by [29], let x i , i ∈ [1, . . ., M ] be a particular fitting point in a set of M distinct fitting points in X t .At each x i , a HW model like the ones given either by Equations ( 22)- (24) or by ( 29)-( 31) can describe the dynamics of Y t in the close vicinity of x i .A model fully describing Y t can then be found as a series of M different HW models each on the same form, as given previously.Now, however, the smoothing in each model at time t is not only done in time, but also by weighting the observations according to the Euclidean distance between x t and x i .The weights are assigned as: where V (•) is a function taking non-negative arguments, || • || denotes the Euclidean norm and h(x i ) is the bandwidth applied in the fitting point x i .Following [29] and [30], a tri-cube kernel used to determine the weights, i.e., which entails weights between zero and one.A nearest-neighbor bandwidth is employed here.This implies that the actual bandwidth varies with the local density of the data, since h(x i ) is set as the range of the (γ • 100)% closest observation to each x i , where 0 ≤ γ ≤ 1 is the relative bandwidth, common for all fitting points.Eventually, one defines α = [ α µ α S (1) α S (2) ] and subsequently finds the effective smoothing parameters at time t, and for the fitting point x i , as: The robust conditional HW model thus consists of M models, for which the additive version of the updating formulae for the i-th model is: S t,i = S (1) t,i = S (2) Similarly, the updating scheme for the i-th multiplicative HW model becomes: t−s 1 S (2) S t,i = α t,i = α t /(µ t S For a value of x t with x i ≤ x t ≤ x i+1 , y t+k|t is found by linear interpolating between y t+k|t,i and y t+k|t,i+1 .
Although, in principle, the number of variables used to condition upon could be infinity, one should be cautious in doing so, due to the risk of sparse updates in the points located close to the edges of the multidimensional space.

Parameter Estimation
Let β be the model parameters, for the standard HW model Due to the binary nature of the I , only the additive formulation of the HW model is feasible for modeling the imbalance sign.Given N observations of I (↑/↓) , an estimate β can be derived by Maximum Likelihood (ML) estimation, where (β) is the log-likelihood function for a trinomial variable, + (1 − (I where, in turn, p t,i (β) = P I (↑/↓) t,i = 1 β .Since a finite value for τ is not meaningful in the context of binary variables, it is fixed at τ = ∞ for I (↑/↓) t .After the updating and forecasting steps, the inverse logit-transformation is applied for deriving the posterior probabilities for the imbalance sign, For the case of regulation penalties, both the multiplicative and the additive formulations of the HW models are tested.The estimation procedure is the same for both models.An estimate of β is found by minimizing the sum of squared residuals, with forecasts forced to be positive, In the estimation process, the practical situation of day-ahead market participation is mimicked.More specifically, the models are fit in the context of forecasts made at 11:00 on the day before realization.Therefore, estimates for the hour between 00:00 and 01:00 are found using k = 13 while k = 37 for the hour between 23:00 and 00:00.

Empirical Investigation Results
Various versions of the model described in the previous section are fit to the data in order to conclude on the their most appropriate structure.The first 14 months of the data set (i.e., before 1 January 2010) are used for parameter estimation, and the subsequent two years are seen as an independent test period.In terms of seasonal cycles, the following model structures are tried: I Exponential smoothing, i.e., no seasonalities included; II Single seasonal HW-model with a daily period, i.e., S (1) = 24; III Single seasonal HW-model with a weekly period, i.e., S (1) = 168; IV Double seasonal HW-model with daily and weekly periods, i.e., S (1) = 24 and S (2) = 168.
Unconditional models are fitted for all three series, as well as conditional ones.For the imbalance penalties, all possible combinations of exogenous variables, i.e., predicted spot price, wind power penetration and load, are evaluated.When it comes to the imbalance sign, however, the model is only conditioned on predicted wind power penetration.For all conditional models, fitting points are chosen as the deciles of the explanatory variables in the training set.Since there are in total 56 different versions of the penalty models tried, results are only presented for a few of the best performing ones.
For all models, only one set of parameters is estimated across all lead times and fitting points.Although this along with the somewhat arbitrarily chosen fitting points might lead to sub-optimal results for individual lead times and fitting points, the obtained results are decisive enough to serve the objective of this paper.Should the model be implemented in practice, however, the extra effort of estimating more locally optimal parameters would most certainly be worthwhile.

Imbalance Sign Probabilities
For a more intuitive comparison of the models, also for different periods, the discrete ranked probability skill score (RPSS D ) [31] is employed.The RPSS D is given by: where RPS I (↑/↓) t ,t and RPS I (↑/↓) ,t are the ranked probability scores [32][33][34] for estimated posterior probabilities, and for climatology forecasts, respectively.Furthermore, D is a bias correction term, i.e., The estimated parameters along with the corresponding RPSS D are collated in Table 2.  2 reveal that all models have a forecast skill significantly superior to the constant probability model, since all RP SSs are considerably higher than zero.The difference in forecast skill between the conditional models and the unconditional ones seems to be insignificant.Considering results over both training and evaluation sets, it appears that the models with daily seasonality are slightly better than the others.The performance of all models with seasonal terms is rather similar, though.For illustration, a visualization of a single set of forecasts is given in Figure 5.In Figure 6, reliability diagrams for both unconditional and conditional versions of Model II are depicted, along with 95% consistency bars (following the terminology of [35]).The diagrams are based on segmenting predicted probabilities into five equally populated bins centered on their respective averages.The consistency bars are constructed by bootstrapping 10,000 samples with replacement for each bin [23,35,36], accounting for the autocorrelation of the probability transformation integral (PIT), following the proposal of [37].
For both models and periods, the predictions cannot be deemed probabilistically unreliable at the 5% significance level.Both unconditional and conditional models appear to perform similarly overall.Hence, it must be concluded that the forecast wind power penetration has no significant impact on the imbalance sign; at least, not when defined in terms of price differences and under such a family of models.
The reason for the lack of improved forecasting skill most likely lies in the time variation of imbalance sign probabilities; both periodical variations and drift.Since they are not taken into account in Figure 4, the increased probability of down-regulation could be the result of generally higher wind power penetration during the night, while periods of high down-regulation frequency coincide with periods of high wind power production.
As a final remark, it should be noted that the segmentation of predicted probabilities implies that their position in the horizontal dimension is subject to uncertainty just as their vertical position.Especially this uncertainty could be large for the bins, including the highest and the lowest probabilities, as the distribution of elements in these bins is likely to be skewed, positively and negatively, respectively.This Tables 4 and 5 list the estimated model parameters, as well as the corresponding performance measures for these up-and down-regulation penalty models.The best performing models are the conditional ones, more precisely those involving conditioning upon predicted spot price.Moreover, the models include either a mean term only or both mean and daily seasonal terms.However, none of these models performs particularly well: their residual RMSE is only slightly less than the series standard deviation.In light of the optimal smoothing parameters, which yield long model memory, this is not surprising.
The long memory, combined with the high value of τ and the residual RMSE values, indicates that the model is only capable of tracking the relatively long-term average penalty and its variations.Spiking Our results were derived in a framework tailored for the day-ahead offering of wind power, with its specific lead times (between 13 and 37 hours ahead).Even though conditioning models upon predicted wind power penetration did not result in significant improvements, the conditional Holt-Winters framework is likely to be more relevant for other variables and for shorter lead times.For instance, one interesting aspect to investigate in the context of short-term prediction would be to include updated wind power and load forecasts when they become available.
Although the forecasting skill of the proposed models might seem low to some readers, one has to bare in mind that the process it describes is mainly driven by errors from well-tuned forecasting models and unforeseeable events, like plant malfunctions.Consequently, the observed forecasting quality is, in our opinion, quite satisfactory.From the market operator's point of view, however, the results of this paper might be worrying, since they hint that profitable gaming on the electricity market is possible.Thus, it is clear that anti-gaming policies have to be revised if the desire is to maintain a gaming-free market.Given the current carbon emission curbing targets in various parts of the world, however, the potential benefits of gaming for producers of and systems highly penetrated with electricity by renewable sources have to be considered while structuring such reforms.
The models presented in this paper are adapted to the purpose of facilitating the bidding strategy in the spirit of those presented in [4].Thus, expectations for imbalance penalties are modeled conditional on the information available before gate closure only.The proposal of similar models for scenario generation purposes does not necessarily call for such availability restrictions.In that case, models can be constructed based on realizations of the variables affecting the penalties, e.g., spot price, regulation needs and interconnection capacity to neighboring areas.In that case, accounting for the interdependence between simulated variables becomes paramount, for instance using the method presented in [38].
t be the day-ahead area price at hour t, and let π (↓) t and π (↑) t be the down-and up-regulation prices for the same hour, respectively.In addition, let ψ

Figure 1 .
Figure 1.Time series plot of the down-and up-regulation penalties (left and right, respectively) with the excluded observations marked.

Figure 3 .
Figure3.The intra-day and intra-week variations (left and right columns, respectively) of the imbalance sign (top row) and imbalance penalties (bottom row), with respect to their empirical average.

Figure 4 .
Figure 4.The empirical frequency of each imbalance sign as a function of predicted wind power penetration (top left) and average imbalance penalties as a function of predicted spot price (top right), predicted load (bottom left) and predicted wind power penetration (bottom right).0.0 0.2 0.4 0.6 0.8 1.0 0.2 0.3 0.4 0.5 0.6 0.7 Wind Power Penetration [−]

Figure 5 .
Figure 5. Stacked bar plot showing the posterior imbalance sign probabilities estimated at 10:00 on 12 November 2010, for November 13.The most likely imbalance sign and the observed one are marked.

Table 1
summarizes the empirical probabilities, I It reveals the dominance of down-regulation in long-term expectation, while the other two states' probabilities are quite similar.

Table 1 .
The empirical probabilities of I (↑/↓) over the period analyzed.

Table 2 .
Estimated parameters and RPSS D for the different model setups investigated.
First and foremost, the score values in Table

Table 3 .
Standard deviation of the down-and up-regulation penalties.

Table 4 .
The estimated model parameters along with performance measures for the best performing up-regulation penalty models.In-sample measures are for the training set, and out-of-sample ones relate to the test set.& L 0.5223 701 0.0030 0.0533 92.87 0.0938 114.47 0.0705 Multiplicative π (S) & L 0.4252 695 0.0050 0.0202 93.570.0801 117.13 0.0268

Table 5 .
The estimated model parameters along with performance measures for the best performing down-regulation penalty models.In-sample measures are for the training set, out-of-sample ones relate to the test set.